-- Logs begin at Thu 2022-09-01 04:02:15 UTC, end at Thu 2022-09-01 06:42:21 UTC. -- Sep 01 04:35:33.382100 n-d-820368-37 systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 04:35:33.391364 n-d-820368-37 devstack@n-api.service[112987]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 04:35:33 2022] *** Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: nodename: n-d-820368-37 Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: machine: x86_64 Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: clock source: unix Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: pcre jit disabled Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: detected number of CPU cores: 4 Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: current working directory: / Sep 01 04:35:33.393889 n-d-820368-37 devstack@n-api.service[112987]: detected binary path: /usr/bin/uwsgi-core Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: your processes number limit is 47680 Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: your memory page size is 4096 bytes Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: detected max file descriptor number: 2048 Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: lock engine: pthread robust mutexes Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: thunder lock: enabled Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 04:35:33.394506 n-d-820368-37 devstack@n-api.service[112987]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 04:35:33.433498 n-d-820368-37 devstack@n-api.service[112987]: Python main interpreter initialized at 0x55739cc099c0 Sep 01 04:35:33.433498 n-d-820368-37 devstack@n-api.service[112987]: python threads support enabled Sep 01 04:35:33.433498 n-d-820368-37 devstack@n-api.service[112987]: your server socket listen backlog is limited to 100 connections Sep 01 04:35:33.433498 n-d-820368-37 devstack@n-api.service[112987]: your mercy for graceful operations on workers is 90 seconds Sep 01 04:35:33.433855 n-d-820368-37 devstack@n-api.service[112987]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 04:35:33.433855 n-d-820368-37 devstack@n-api.service[112987]: *** Operational MODE: preforking *** Sep 01 04:35:33.434162 n-d-820368-37 devstack@n-api.service[112987]: *** uWSGI is running in multiple interpreter mode *** Sep 01 04:35:33.434162 n-d-820368-37 devstack@n-api.service[112987]: spawned uWSGI master process (pid: 112987) Sep 01 04:35:33.434359 n-d-820368-37 systemd[1]: Started Devstack devstack@n-api.service. Sep 01 04:35:33.435822 n-d-820368-37 devstack@n-api.service[112987]: spawned uWSGI worker 1 (pid: 112988, cores: 1) Sep 01 04:35:33.435822 n-d-820368-37 devstack@n-api.service[112987]: spawned uWSGI worker 2 (pid: 112989, cores: 1) Sep 01 04:35:33.435822 n-d-820368-37 devstack@n-api.service[112987]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 04:35:34.101064 n-d-820368-37 devstack@n-api.service[112989]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 04:35:34.109835 n-d-820368-37 devstack@n-api.service[112988]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 04:35:35.163450 n-d-820368-37 devstack@n-api.service[112988]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:35:35.163450 n-d-820368-37 devstack@n-api.service[112988]: from cryptography.utils import int_from_bytes Sep 01 04:35:35.164195 n-d-820368-37 devstack@n-api.service[112988]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:35:35.164195 n-d-820368-37 devstack@n-api.service[112988]: from cryptography.utils import int_from_bytes Sep 01 04:35:35.165960 n-d-820368-37 devstack@n-api.service[112989]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:35:35.165960 n-d-820368-37 devstack@n-api.service[112989]: from cryptography.utils import int_from_bytes Sep 01 04:35:35.166417 n-d-820368-37 devstack@n-api.service[112989]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:35:35.166417 n-d-820368-37 devstack@n-api.service[112989]: from cryptography.utils import int_from_bytes Sep 01 04:35:37.647824 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 04:35:37.648452 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 04:35:37.648554 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 04:35:37.648554 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 04:35:37.648973 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 04:35:37.648973 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 04:35:37.649143 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 04:35:37.649217 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 04:35:37.649295 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 04:35:37.649537 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.649668 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 04:35:37.649827 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.649935 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.650168 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.650300 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.650448 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.650550 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.650802 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.650957 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.651133 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.651264 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.651448 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.651599 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.651760 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.651891 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652079 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652223 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652319 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652413 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652626 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652758 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.652948 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-37 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.653079 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.653227 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.653319 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-37 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.653546 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.653678 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.653859 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654002 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654137 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654237 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654443 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654537 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654754 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.654852 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.655074 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.655165 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.655392 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.655562 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.655964 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656121 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656231 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656335 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656487 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656602 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656797 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.656925 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.657125 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.657218 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.657451 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.657921 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.658076 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.658261 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.658397 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.658487 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.658708 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.658805 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.659030 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.659134 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.659359 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.659501 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-37 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.659721 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.659818 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-37 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.660028 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.660124 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.660340 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.660519 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.660761 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.660850 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.661152 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.661352 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.661452 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.661666 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.661762 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.661980 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.662078 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.662304 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.662393 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.662627 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.662727 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.662960 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663053 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663290 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663380 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663601 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663691 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663898 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.663988 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.664205 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.664301 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.664496 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.664583 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.664806 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.664891 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665103 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665190 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665402 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665500 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665648 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665734 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.665953 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666046 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666240 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666342 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666550 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666643 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666870 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.666972 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.667144 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.667319 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.667456 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.667547 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.667693 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.667790 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668008 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668151 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668311 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668408 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668615 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668714 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.668916 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669009 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669218 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669312 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669522 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669615 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669821 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.669905 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.670122 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.670208 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.670427 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.670525 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.670734 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.670827 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.671068 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.671156 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.671384 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.671484 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.671686 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.671780 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672000 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672085 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672308 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672407 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672621 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672706 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.672921 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673015 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673252 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673340 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673561 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673650 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673861 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.673953 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.674177 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.674263 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.674492 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.674578 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.674793 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.674879 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.675118 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.675207 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.675421 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.675507 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.675733 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.675833 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676079 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676225 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676370 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676456 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676615 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676776 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.676904 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677083 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677196 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677338 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677508 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677640 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677806 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.677947 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.678106 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.678264 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.678405 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.678572 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.678698 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.678906 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679023 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679211 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679324 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679514 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679628 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679821 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.679927 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.680128 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.680222 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.680436 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.680570 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.680742 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.680837 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681048 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681148 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681353 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681439 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681650 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681736 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.681954 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.682048 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.682260 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.682360 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.682558 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.682642 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.682855 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683007 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683174 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683262 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683473 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683558 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683787 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.683886 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.684090 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.684185 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.684389 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.684475 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.684705 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.684801 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685002 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685088 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685299 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685384 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685609 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685703 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685910 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.685997 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.686208 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.686293 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.686518 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.686613 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.686809 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.686916 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.687134 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.687223 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.687441 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.687537 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.687740 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.687824 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688035 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688119 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688330 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688429 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688626 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688720 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.688919 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689005 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689215 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689302 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689507 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689592 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689799 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.689892 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.690090 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.690186 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.690392 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.690476 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.690694 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.690789 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691017 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691107 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691316 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691400 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691625 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691797 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.691969 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.692065 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.692282 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.692367 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.692591 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.692687 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.692911 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:35:37.692997 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.693235 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.693320 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.693562 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.693727 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.693886 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.693973 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.694206 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.694301 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.694515 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.694609 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.694826 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.694946 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.695180 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.695266 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.695490 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.695577 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.695796 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.695881 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.696102 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.696196 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.696415 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.696501 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.696725 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.696809 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697041 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697143 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697344 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697439 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697655 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697750 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.697966 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.698060 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.698269 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.698368 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.698584 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.698720 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.698929 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699020 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699230 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699325 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699538 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699627 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699862 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.699955 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.700185 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.700271 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.700490 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.700576 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.700809 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.700904 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.701125 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.701212 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.701431 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.701518 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.701737 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.701832 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.702042 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.702128 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.702373 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.702467 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.702680 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.702780 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703014 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703102 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703326 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703412 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703635 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703730 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.703951 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704044 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704261 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704348 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704565 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704651 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704870 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.704964 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.705175 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.705261 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.705480 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.705567 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.705790 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.705875 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.706103 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.706188 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.706414 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.706500 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.706720 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.706805 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.707048 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.707191 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.707405 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.707481 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.707719 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.707953 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708062 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708196 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708312 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708399 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708612 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708702 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.708911 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709010 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709209 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709295 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709512 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709597 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709811 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.709968 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.710113 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.710199 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.710422 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.710507 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.710723 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.710817 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711070 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711157 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711367 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711452 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711676 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711763 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.711982 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712080 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712286 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712379 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712585 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712672 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712890 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.712975 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.713196 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.713281 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.713494 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.713580 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.713810 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.713903 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.714121 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.714215 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.714416 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.714502 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.714731 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.714825 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715056 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715156 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715358 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715444 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715667 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715753 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.715974 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716139 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716276 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716361 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716583 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716669 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716889 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.716982 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.717205 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.717353 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.717500 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.717585 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.717808 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.717902 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.718124 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.718211 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.718436 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.718538 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.718738 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.718858 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.719083 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.719180 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.719403 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.719491 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.719709 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.719795 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720007 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720091 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720312 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720399 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720614 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720703 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.720919 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721067 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721202 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721348 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721491 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721624 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721796 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.721931 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.722094 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.722232 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.722395 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.722539 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.722678 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.722819 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723117 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723233 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723392 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723486 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723696 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723781 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.723995 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724097 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724296 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724391 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724597 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724684 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724899 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.724992 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.725204 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.725290 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.725726 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.725856 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.725977 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726066 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726145 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726232 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726455 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726541 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726762 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.726850 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.727097 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.727197 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.727404 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.727508 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.727708 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.727813 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728013 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728109 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728316 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728402 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728624 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728710 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.728929 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729021 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729239 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729343 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729537 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729630 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729849 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.729943 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.730150 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.730244 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.730461 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.730554 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.730759 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.730844 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.731096 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.731210 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.731421 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.731506 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.731726 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.731811 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732041 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732139 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732354 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732440 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732661 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732753 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.732969 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733056 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733274 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733360 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733580 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733674 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733884 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.733970 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.734193 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.734278 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.734500 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.734583 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.734800 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.734911 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.735136 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.735222 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.735438 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.735526 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.735752 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.735837 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736054 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736139 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736362 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736453 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736660 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736758 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.736967 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737053 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737282 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737380 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737588 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737673 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737900 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.737993 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.738207 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.738302 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.738582 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.738681 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739010 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739100 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739335 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739446 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739671 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739772 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.739940 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740030 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740241 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740337 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740545 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740632 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740856 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.740949 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.741165 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.741261 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.741466 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.741552 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.741766 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.741861 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.742075 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.742161 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.742377 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.742469 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.742677 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.742763 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743003 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743103 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743311 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743397 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743622 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743708 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.743927 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744029 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744233 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744326 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744549 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744720 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744848 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.744934 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.745148 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.745241 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.745462 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.745556 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.745764 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.745849 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746060 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746145 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746359 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746453 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746660 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746746 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.746997 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747086 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747307 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747405 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747604 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747734 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747913 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.747998 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.748227 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.748321 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.748531 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.748615 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.748834 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.748917 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.749140 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.749287 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.749427 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.749510 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.749743 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.749839 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750050 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750138 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750353 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750438 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750660 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750749 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.750988 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.751077 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.751297 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.751394 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.751600 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.751683 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.751913 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752000 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752211 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752302 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752516 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752645 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752822 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.752915 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.753119 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.753204 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.753421 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.753515 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.753725 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.753809 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.754028 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.754388 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.754483 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.754707 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.754803 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.755044 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.755304 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.755403 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.755638 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.755725 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.755957 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.756058 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.756278 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.756364 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.756623 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.756708 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.756936 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757035 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757242 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757327 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757549 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757634 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757853 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.757959 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.758154 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.758241 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.758460 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.758554 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.758759 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.758854 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759083 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759169 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759384 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759478 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759687 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759776 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.759984 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760068 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760285 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760370 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760583 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760669 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760884 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.760968 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.761185 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.761269 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.761482 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.761570 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.761784 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.761869 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.762080 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.762164 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.762387 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.762473 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.762687 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.762771 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763008 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763115 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763307 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763393 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763605 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763692 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.763923 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764016 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764230 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764316 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764534 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764621 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764865 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.764959 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.765174 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.765258 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.765492 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.765577 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.765793 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.765879 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.766113 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.766198 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.766413 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.766498 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.766715 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.766801 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767038 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767139 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767344 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767429 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767647 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767732 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.767942 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768026 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768248 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768341 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768554 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768642 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768855 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.768947 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.769156 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.769249 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.769454 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.769539 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.769803 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.769983 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.770087 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.770177 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.770395 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.770487 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.770697 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.770783 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771019 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771121 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771320 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771413 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771626 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771726 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.771924 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772018 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772222 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772307 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772529 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772613 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772825 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.772911 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.773130 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.773221 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.773426 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.773513 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.773726 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.773821 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774023 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774109 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774327 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774420 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774629 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774714 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.774949 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775038 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775260 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775344 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775563 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775648 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775860 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.775947 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.776156 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.776250 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.776459 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.776546 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.776761 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.776846 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777058 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777151 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777360 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777443 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777662 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777755 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.777965 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.778063 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.778260 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.778344 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.778563 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.778647 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.778858 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779027 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779178 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779263 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779473 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779566 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779774 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.779859 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780070 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780153 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780367 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780453 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780666 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780754 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.780964 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781048 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781262 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781346 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781563 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781662 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781862 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.781946 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.782159 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.782243 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.782456 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.782871 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.783113 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.783231 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.783418 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.783520 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.783721 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.783812 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784023 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784105 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784365 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784470 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784668 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784763 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.784979 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.785064 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.785286 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.785553 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.785646 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.785726 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.785986 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.786082 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.786302 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.786399 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.786617 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.786703 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.786953 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787044 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787263 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787369 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787569 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787655 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787868 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.787958 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.788182 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.788279 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.788481 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.788567 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.788784 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.788868 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.789098 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.789199 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.789408 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.789493 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.789719 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.789820 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790018 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790113 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790316 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790402 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790624 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790719 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.790943 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791033 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791249 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791335 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791549 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791667 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791857 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.791954 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.792160 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.792245 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.792464 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.792563 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.792769 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.792857 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793073 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793176 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793373 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793482 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793673 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793761 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.793974 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.794060 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.794277 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.794371 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.794585 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.794669 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.794971 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795074 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795205 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795292 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795506 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795591 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795802 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.795888 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.796104 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.796191 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.796398 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.796490 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.796699 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.796814 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.797001 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.797155 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.797300 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.797427 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.797721 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.797860 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798024 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798119 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798329 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798427 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798630 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798728 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.798962 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.799053 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.799276 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.799374 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.799593 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.799721 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.799905 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.800092 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.800201 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.800330 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.800611 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.800707 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.800922 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.801046 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.801297 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.801391 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.801601 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.801699 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.801921 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802033 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802220 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802329 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802518 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802613 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802814 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.802933 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.803152 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.803259 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.803452 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.803561 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.803764 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.803878 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.804084 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.804169 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.804388 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.804484 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.804707 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.804805 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.805121 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.805206 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.805431 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.805519 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.805731 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.805815 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806046 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806145 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806357 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806455 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806672 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806759 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.806994 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.807084 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.807302 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.807471 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.807605 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.807691 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.807922 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808017 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808236 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808420 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808537 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808623 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808843 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.808928 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.809140 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.809235 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.809454 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.809541 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.809768 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.809861 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.810072 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.810249 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.810385 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.810472 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.810702 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.810787 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.811040 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.811131 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.811362 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.811449 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.811710 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.811796 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812035 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812141 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812335 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812439 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812630 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812725 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.812933 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813029 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813230 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813324 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813527 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813626 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813840 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.813927 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.814135 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.814221 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.814441 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.814540 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.814742 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.814828 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815066 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815166 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815361 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815456 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815660 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815753 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.815971 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.816056 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.816267 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.816363 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.816571 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.816683 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.816899 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817038 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817212 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817356 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817526 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817671 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817824 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.817995 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.818142 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.818320 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.818493 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.818645 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.818731 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.818977 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.819082 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.819306 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.819394 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.819619 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.819713 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.819924 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820018 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820244 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820385 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820534 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820621 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820856 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.820951 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.821162 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.821249 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.821483 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.821577 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.821804 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.821890 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.822126 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.822237 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.822435 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.822537 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.822754 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.822847 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823078 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823173 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823380 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823474 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823685 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823779 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.823984 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824086 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824289 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824384 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824587 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824687 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824891 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.824986 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.825191 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.825294 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.825490 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.825583 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.825790 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.825882 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.826102 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.826214 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.826402 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.826494 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.826703 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.826795 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827030 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827139 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827329 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827430 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827628 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827721 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.827924 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828026 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828239 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828338 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828542 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828635 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828845 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.828983 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.829144 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.829279 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.829459 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.829592 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.829768 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.829915 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.830077 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.830210 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.830384 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.830514 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.830694 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.830833 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831028 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831117 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831337 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831430 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831646 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831791 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.831948 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.832033 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.832316 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.832409 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.832635 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.832777 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.833047 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.833132 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.833404 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.833565 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.833723 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.833890 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.834039 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.834201 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.834356 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.834512 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.834820 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.834926 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.835155 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.835241 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.835465 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.835567 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.835770 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.835865 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.836079 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.836164 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.836384 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.836472 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.836686 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.836772 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837010 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837096 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837321 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837407 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837633 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837718 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.837945 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838031 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838260 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838345 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838568 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838791 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838878 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.838989 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.839199 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.839286 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.839545 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.839638 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.839852 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.839938 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.840152 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.840245 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.840460 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.840598 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.840768 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.840855 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841077 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841175 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841386 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841480 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841690 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841777 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.841996 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.842082 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.842302 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.842438 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.842605 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.842698 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.842940 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843056 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843242 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843355 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843552 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843649 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843861 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.843973 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.844175 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.844280 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.844487 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.844582 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.844792 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.844877 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.845100 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.845187 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.845410 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.845494 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.845744 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.845924 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.846059 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.846237 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.846373 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.846566 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.846689 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.846905 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.847236 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.847329 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.847550 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.847634 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848024 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848124 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848239 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848333 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848542 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848627 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848843 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.848942 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.849150 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.849243 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.849455 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.849540 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.849756 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.849858 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.850072 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.850165 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.850379 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.850465 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.850681 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.850786 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851006 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851094 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851324 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851410 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851632 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851850 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.851937 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.852193 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.852280 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.852506 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.852601 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.852828 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.853061 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.853146 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.853406 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.853490 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.853723 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.853809 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854041 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854124 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854348 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854432 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854652 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854739 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.854982 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855068 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855292 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855392 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855594 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855681 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855893 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.855985 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.856200 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.856294 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.856505 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.856598 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.856804 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.856889 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.857107 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.857201 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.857403 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.857487 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.857713 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.857806 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858011 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858104 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858309 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858401 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858605 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858692 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.858933 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859033 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859234 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859319 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859531 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859615 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859830 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.859924 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.860126 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.860218 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.860432 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.860536 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.860731 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.860845 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861032 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861129 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861329 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861424 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861633 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861729 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.861929 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862033 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862233 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862326 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862537 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862635 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862853 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.862957 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.863176 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.863279 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.863477 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.863622 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.863828 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864035 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864133 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864223 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864442 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864529 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864746 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.864832 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865051 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865218 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865359 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865453 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865684 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865770 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.865996 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.866211 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.866299 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.866541 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.866627 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.866858 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.866987 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.867211 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.867489 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.867583 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.867824 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.867910 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.868124 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.868216 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.868424 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.868510 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.868744 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.868829 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869052 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869146 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869357 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869444 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869667 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869760 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.869967 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.870051 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.870271 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.870356 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.870575 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.870668 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.870901 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871010 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871200 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871286 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871505 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871599 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871808 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.871893 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.872112 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.872197 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.872418 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.872504 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.872719 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.872811 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873023 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873109 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873328 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873427 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873638 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873722 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.873947 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.874032 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.874255 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.874341 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.874563 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.874647 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.874872 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875012 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875201 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875288 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875504 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875601 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875803 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.875897 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.876103 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.876189 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.876410 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.876496 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.876719 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.876830 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877027 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877113 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877326 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877410 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877637 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877731 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.877967 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.878054 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.878280 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.878372 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.878585 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.878672 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.878941 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879041 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879425 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879518 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879610 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879692 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879877 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.879964 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.880192 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.880350 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.880497 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.880583 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.880818 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.880927 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.881152 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.881259 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.881470 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.881555 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.881777 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.881861 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.882076 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.882169 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.882375 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.882461 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.882674 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.882757 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883002 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883104 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883315 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883401 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883619 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883705 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.883919 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884053 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884223 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884361 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884526 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884611 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884824 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.884911 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.885120 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.885206 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.885418 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.885503 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.885715 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.885801 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886017 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886102 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886313 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886397 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886613 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886746 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.886931 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887019 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887233 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887330 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887530 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887623 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887829 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.887913 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.888132 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.888226 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.888425 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.888509 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.888723 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889409 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889511 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889602 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889682 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889761 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889761 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889904 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.889990 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.890185 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.890301 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.890611 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.890703 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.890949 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.891260 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.891358 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.891574 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.891807 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.891894 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.892181 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.892404 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.892492 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.892789 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.893020 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.893109 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.893404 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.893615 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.893702 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.894009 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.894206 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.894318 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.894624 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.894847 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.895090 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.895402 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.895501 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.895728 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.896026 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.896113 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.896340 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.896626 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.896712 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.896962 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.897239 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.897327 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.897577 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.897876 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.897969 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.898197 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.898419 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.898506 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.898797 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.899090 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.899179 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.899430 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.899637 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.899724 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.900030 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.900125 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.900336 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.900436 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.900642 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.900927 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901012 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901252 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901362 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901571 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901671 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901889 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.901989 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.902195 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.902322 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.902516 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.902643 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.902835 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903011 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903204 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903340 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903514 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903689 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903854 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.903994 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.904181 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.904313 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.904492 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.904649 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.904801 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.904966 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.905101 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.905282 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.905370 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 04:35:37.905597 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.905911 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.906225 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.906544 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.906862 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.907201 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.907860 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.908209 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.908520 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.908850 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.909167 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.909499 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.909827 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.910176 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.910533 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.910945 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.911222 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.911543 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.911856 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.912163 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:35:37.912408 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112989) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 04:35:38.061331 n-d-820368-37 devstack@n-api.service[112988]: INFO dbcounter [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Registered counter for database nova_api Sep 01 04:35:38.067204 n-d-820368-37 devstack@n-api.service[112989]: INFO dbcounter [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Registered counter for database nova_api Sep 01 04:35:38.081557 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_db.sqlalchemy.engines [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.087350 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_db.sqlalchemy.engines [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.088472 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writer thread running {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.094404 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writer thread running {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.145378 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.context [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=112988) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 04:35:38.149424 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:35:38.149833 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:35:38.151302 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.context [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=112989) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 04:35:38.151437 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:35:38.152136 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:35:38.152574 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:35:38.154557 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:35:38.155146 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_concurrency.lockutils [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:35:38.155623 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_concurrency.lockutils [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:35:38.156593 n-d-820368-37 devstack@n-api.service[112988]: INFO dbcounter [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Registered counter for database nova_cell0 Sep 01 04:35:38.157201 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_concurrency.lockutils [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:35:38.158283 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_concurrency.lockutils [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:35:38.158731 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_concurrency.lockutils [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:35:38.160836 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_concurrency.lockutils [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112989) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:35:38.161170 n-d-820368-37 devstack@n-api.service[112988]: INFO dbcounter [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Registered counter for database nova_cell1 Sep 01 04:35:38.162849 n-d-820368-37 devstack@n-api.service[112989]: INFO dbcounter [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Registered counter for database nova_cell0 Sep 01 04:35:38.167097 n-d-820368-37 devstack@n-api.service[112989]: INFO dbcounter [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Registered counter for database nova_cell1 Sep 01 04:35:38.168445 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_db.sqlalchemy.engines [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.171299 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_db.sqlalchemy.engines [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.174067 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_db.sqlalchemy.engines [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.175817 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writer thread running {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.178588 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_db.sqlalchemy.engines [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.180610 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writer thread running {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.310832 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writer thread running {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.319403 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writer thread running {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.321021 n-d-820368-37 devstack@n-api.service[112988]: INFO dbcounter [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Registered counter for database nova_cell0 Sep 01 04:35:38.328233 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_db.sqlalchemy.engines [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.328560 n-d-820368-37 devstack@n-api.service[112989]: INFO dbcounter [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Registered counter for database nova_cell0 Sep 01 04:35:38.334481 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writer thread running {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.337445 n-d-820368-37 devstack@n-api.service[112989]: DEBUG oslo_db.sqlalchemy.engines [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112989) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:35:38.342050 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writer thread running {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:35:38.668047 n-d-820368-37 devstack@n-api.service[112989]: WARNING keystonemiddleware.auth_token [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:35:38.677068 n-d-820368-37 devstack@n-api.service[112988]: WARNING keystonemiddleware.auth_token [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:35:38.677807 n-d-820368-37 devstack@n-api.service[112989]: WARNING keystonemiddleware.auth_token [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:35:38.684344 n-d-820368-37 devstack@n-api.service[112988]: WARNING keystonemiddleware.auth_token [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:35:39.029939 n-d-820368-37 devstack@n-api.service[112988]: WARNING keystonemiddleware.auth_token [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:35:39.036467 n-d-820368-37 devstack@n-api.service[112988]: WARNING keystonemiddleware.auth_token [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:35:39.041768 n-d-820368-37 devstack@n-api.service[112988]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55739cc099c0 pid: 112988 (default app) Sep 01 04:35:39.043894 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:35:39.045094 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001785 Sep 01 04:35:39.045791 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Thu Sep 1 04:35:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:35:39.055083 n-d-820368-37 devstack@n-api.service[112989]: WARNING keystonemiddleware.auth_token [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:35:39.064086 n-d-820368-37 devstack@n-api.service[112989]: WARNING keystonemiddleware.auth_token [None req-df3c46c4-a19d-4585-9c65-81c133df840d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:35:39.069564 n-d-820368-37 devstack@n-api.service[112989]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55739cc099c0 pid: 112989 (default app) Sep 01 04:37:00.409193 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:00.411430 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003141 Sep 01 04:37:00.412002 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:00.424715 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_api:SELECT=3 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:00.426070 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_cell0:SELECT=3 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:00.427178 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_cell1:SELECT=3 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:00.428295 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:01.290716 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-480d1b43-b435-4413-8284-69b2e0f38ec4 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:01.323341 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-480d1b43-b435-4413-8284-69b2e0f38ec4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903899 Sep 01 04:37:01.324293 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 04:37:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:03.703364 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:03.704711 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-59b95192-ceac-4768-85bb-981adeb7f327 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Sep 01 04:37:03.705344 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:04.144841 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-7045d9f8-de68-4837-8eb9-ab566edfcbce admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:04.194585 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-7045d9f8-de68-4837-8eb9-ab566edfcbce admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482962 Sep 01 04:37:04.199907 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 04:37:04.418164 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-dea24e05-4b65-4783-81d4-0c9c33b0a66f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:04.424635 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_api:SELECT=3 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:04.425495 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_cell1:SELECT=3 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:04.426676 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_cell0:SELECT=3 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:04.427396 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:04.488893 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-dea24e05-4b65-4783-81d4-0c9c33b0a66f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285295 Sep 01 04:37:04.489489 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 1 04:37:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:06.867578 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-7045d9f8-de68-4837-8eb9-ab566edfcbce admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:06.869176 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-7045d9f8-de68-4837-8eb9-ab566edfcbce admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Sep 01 04:37:06.869176 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:07.588402 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-5cf14172-c86c-49b6-961c-1a57c0d557fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512, "name": "ds512M"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:07.632558 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-5cf14172-c86c-49b6-961c-1a57c0d557fd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.756635 Sep 01 04:37:07.633802 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:07.646166 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-e056cbd7-6f5d-4512-8007-a2cb7938256e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:07.693012 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-e056cbd7-6f5d-4512-8007-a2cb7938256e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050874 Sep 01 04:37:07.694970 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 1 04:37:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:10.240111 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-5cf14172-c86c-49b6-961c-1a57c0d557fd admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:10.241135 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-5cf14172-c86c-49b6-961c-1a57c0d557fd admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 01 04:37:10.241823 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:10.705242 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-5e6303f8-1670-4406-b144-d830d2af0e92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:10.735408 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-5e6303f8-1670-4406-b144-d830d2af0e92 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487063 Sep 01 04:37:10.736608 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:10.753913 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-b4cd439e-d553-41d3-8c54-c12140c369b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:10.792466 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-b4cd439e-d553-41d3-8c54-c12140c369b9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042899 Sep 01 04:37:10.804048 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 1 04:37:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:13.525572 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-5e6303f8-1670-4406-b144-d830d2af0e92 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:13.526611 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-5e6303f8-1670-4406-b144-d830d2af0e92 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 01 04:37:13.527009 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:14.009296 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-8b6d1fcb-819a-4dfa-bc91-5ca4aed61cc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:14.030249 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-8b6d1fcb-819a-4dfa-bc91-5ca4aed61cc9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496473 Sep 01 04:37:14.031229 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:14.043951 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-9eabe3e7-190f-430b-b38e-925f1edb77c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:14.070145 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-9eabe3e7-190f-430b-b38e-925f1edb77c3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029995 Sep 01 04:37:14.070798 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 1 04:37:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:16.463430 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-8b6d1fcb-819a-4dfa-bc91-5ca4aed61cc9 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:16.465014 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-8b6d1fcb-819a-4dfa-bc91-5ca4aed61cc9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Sep 01 04:37:16.465590 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:16.946291 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-558541d0-b87d-4a47-8ab3-915ffa5f6ac8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:16.972992 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-558541d0-b87d-4a47-8ab3-915ffa5f6ac8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500997 Sep 01 04:37:16.973632 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:16.986679 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-d748475f-0ce0-4c51-9c63-ca4efddc5100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:17.018937 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-d748475f-0ce0-4c51-9c63-ca4efddc5100 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035743 Sep 01 04:37:17.020076 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 1 04:37:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:19.427685 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-558541d0-b87d-4a47-8ab3-915ffa5f6ac8 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:19.429290 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-558541d0-b87d-4a47-8ab3-915ffa5f6ac8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Sep 01 04:37:19.440524 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:19.861815 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-3f75a467-c348-44e5-a2a5-c9bdf4936c65 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:19.890414 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-3f75a467-c348-44e5-a2a5-c9bdf4936c65 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453624 Sep 01 04:37:19.891187 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 04:37:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:37:22.582383 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-558541d0-b87d-4a47-8ab3-915ffa5f6ac8 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:22.583665 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-558541d0-b87d-4a47-8ab3-915ffa5f6ac8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Sep 01 04:37:22.584094 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:23.076028 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-714854df-2065-4ee2-84ad-07687d7e9091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "swap": 0, "name": "m1.tiny", "vcpus": 1}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:23.100855 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-714854df-2065-4ee2-84ad-07687d7e9091 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.509875 Sep 01 04:37:23.101425 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:23.119873 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-8fa4b7e1-12b5-4a91-9763-b0a97bde4cd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:23.165467 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-8fa4b7e1-12b5-4a91-9763-b0a97bde4cd7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054499 Sep 01 04:37:23.166300 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 1 04:37:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:25.847948 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-714854df-2065-4ee2-84ad-07687d7e9091 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:25.849322 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-714854df-2065-4ee2-84ad-07687d7e9091 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Sep 01 04:37:25.849887 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:26.427825 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-83c77d20-1b96-42b1-9fbb-f20fcd4b6e50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "name": "m1.small", "ram": 2048}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:26.451427 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-83c77d20-1b96-42b1-9fbb-f20fcd4b6e50 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.594917 Sep 01 04:37:26.452161 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:26.466730 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-cbb59c55-bb41-49e2-87f1-7154dcaad753 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:26.494642 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-cbb59c55-bb41-49e2-87f1-7154dcaad753 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031731 Sep 01 04:37:26.495275 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 1 04:37:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:28.883430 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-83c77d20-1b96-42b1-9fbb-f20fcd4b6e50 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:28.884340 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-83c77d20-1b96-42b1-9fbb-f20fcd4b6e50 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 01 04:37:28.884740 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:29.255987 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-ec13d752-6a98-4903-b6bf-02aa94461e67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:29.276172 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-ec13d752-6a98-4903-b6bf-02aa94461e67 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.385163 Sep 01 04:37:29.276966 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:29.289576 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-d7470442-8c50-41e5-b6e5-054caabccfe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:29.315081 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-d7470442-8c50-41e5-b6e5-054caabccfe9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028981 Sep 01 04:37:29.315506 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 1 04:37:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:31.705715 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-ec13d752-6a98-4903-b6bf-02aa94461e67 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:31.706756 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-ec13d752-6a98-4903-b6bf-02aa94461e67 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Sep 01 04:37:31.707443 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:32.222726 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-253ad6e8-869f-4415-a0a6-92f578150663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "id": "4"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:32.229437 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:32.248777 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-253ad6e8-869f-4415-a0a6-92f578150663 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.535159 Sep 01 04:37:32.249475 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 04:37:32.261687 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-2c2b7d74-d91f-4fb6-b1ef-862971a8871a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:32.287624 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-2c2b7d74-d91f-4fb6-b1ef-862971a8871a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029350 Sep 01 04:37:32.295499 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 1 04:37:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:37:34.636096 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-253ad6e8-869f-4415-a0a6-92f578150663 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:34.637722 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-253ad6e8-869f-4415-a0a6-92f578150663 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Sep 01 04:37:34.638115 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:35.097440 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-a89f52ef-fdab-47b6-9865-2cd700682701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:35.103563 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:35.119623 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-a89f52ef-fdab-47b6-9865-2cd700682701 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475240 Sep 01 04:37:35.120628 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 1 04:37:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:37:35.132492 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-272fab17-904a-4cf1-9f6b-7ed608c16811 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:37:35.159924 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-272fab17-904a-4cf1-9f6b-7ed608c16811 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031019 Sep 01 04:37:35.160745 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 1 04:37:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:37:57.364691 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-a89f52ef-fdab-47b6-9865-2cd700682701 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:57.366050 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-a89f52ef-fdab-47b6-9865-2cd700682701 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Sep 01 04:37:57.366545 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:37:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:57.384269 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:37:57.807215 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-404224c6-df7d-4536-93ab-a994c47da067 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:57.827316 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-404224c6-df7d-4536-93ab-a994c47da067 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.450542 Sep 01 04:37:57.827857 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 04:37:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:37:58.903111 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-a89f52ef-fdab-47b6-9865-2cd700682701 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:58.904408 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-a89f52ef-fdab-47b6-9865-2cd700682701 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Sep 01 04:37:58.904948 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:37:59.492191 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-5ccd15c4-a928-4d1d-aeb3-20adf995ec03 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:59.498010 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.wsgi [None req-5ccd15c4-a928-4d1d-aeb3-20adf995ec03 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-5ccd15c4-a928-4d1d-aeb3-20adf995ec03 admin admin] Request method failure captured: Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Accept: application/json Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Accept-Encoding: gzip, deflate Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Connection: keep-alive Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Content-Length: 0 Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Host: 10.222.0.26 Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Openstack-Api-Version: compute 2.90 Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: Openstack-System-Scope: None Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: User-Agent: python-novaclient Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Auth-Token: gAAAAABjEDcmyniCoTYNU-BmkJkLUUkBgDlH2UzbPkKEdP7b9k5dIRfqJJHs4HwNL9Wl1lW-O51OBwsfANXB-1EykfnZqQ6m0gW_oJ4fuCPpjONpNrKP9XBUns0WAuLWEmsF7VioM0YBtrD1AXk3TXHjnzu6mKOJouoXMrzveOJLYM_ADiEVVUc Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Domain-Id: None Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Domain-Name: None Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Identity-Status: Confirmed Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Is-Admin-Project: True Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Domain-Id: default Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Domain-Name: Default Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Name: admin Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Role: reader,admin,member Sep 01 04:37:59.501366 n-d-820368-37 devstack@n-api.service[112989]: X-Roles: reader,admin,member Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant: admin Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant-Name: admin Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-User: admin Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-User-Domain-Id: default Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-User-Domain-Name: Default Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-User-Id: 23ccd8c72524416b8ab3004ac4d52144 Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: X-User-Name: admin Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: method: > Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: exception: Flavor 42 could not be found. Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: action_args: {'id': '42'} Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:37:59.503079 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:37:59.504098 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.505561 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-5ccd15c4-a928-4d1d-aeb3-20adf995ec03 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112989) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:37:59.506873 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-5ccd15c4-a928-4d1d-aeb3-20adf995ec03 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.444050 Sep 01 04:37:59.507050 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:37:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:37:59.512730 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-02c6b0b0-4fa1-4c00-9518-20fbaa62ca17 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:59.536276 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-02c6b0b0-4fa1-4c00-9518-20fbaa62ca17 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027182 Sep 01 04:37:59.536820 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 1 04:37:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:37:59.549900 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-938d897f-0b6f-4fab-800d-2e3cad4763a4 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:59.572743 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-938d897f-0b6f-4fab-800d-2e3cad4763a4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028942 Sep 01 04:37:59.573283 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 1 04:37:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:37:59.588297 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-adc823d2-7b4f-4cfe-82bf-e1775eb74bc9 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:37:59.597426 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.wsgi [None req-adc823d2-7b4f-4cfe-82bf-e1775eb74bc9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-adc823d2-7b4f-4cfe-82bf-e1775eb74bc9 admin admin] Request method failure captured: Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Accept: application/json Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Accept-Encoding: gzip, deflate Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Connection: keep-alive Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Content-Length: 0 Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Host: 10.222.0.26 Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Openstack-Api-Version: compute 2.90 Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: Openstack-System-Scope: None Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: User-Agent: python-novaclient Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Auth-Token: gAAAAABjEDcmyniCoTYNU-BmkJkLUUkBgDlH2UzbPkKEdP7b9k5dIRfqJJHs4HwNL9Wl1lW-O51OBwsfANXB-1EykfnZqQ6m0gW_oJ4fuCPpjONpNrKP9XBUns0WAuLWEmsF7VioM0YBtrD1AXk3TXHjnzu6mKOJouoXMrzveOJLYM_ADiEVVUc Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Domain-Id: None Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Domain-Name: None Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Identity-Status: Confirmed Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Is-Admin-Project: True Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Domain-Id: default Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Domain-Name: Default Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Name: admin Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Role: reader,admin,member Sep 01 04:37:59.602759 n-d-820368-37 devstack@n-api.service[112988]: X-Roles: reader,admin,member Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant: admin Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant-Name: admin Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-User: admin Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-User-Domain-Id: default Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-User-Domain-Name: Default Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-User-Id: 23ccd8c72524416b8ab3004ac4d52144 Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: X-User-Name: admin Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: method: > Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: exception: Flavor 42 could not be found. Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: action_args: {'id': '42'} Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:37:59.604491 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:37:59.605591 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:37:59.606868 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-adc823d2-7b4f-4cfe-82bf-e1775eb74bc9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:37:59.608143 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-adc823d2-7b4f-4cfe-82bf-e1775eb74bc9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021827 Sep 01 04:37:59.608143 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:37:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 04:38:00.573992 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-938d897f-0b6f-4fab-800d-2e3cad4763a4 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:00.575053 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-938d897f-0b6f-4fab-800d-2e3cad4763a4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 01 04:38:00.575491 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:38:01.137789 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-211dda1d-8bf2-4b9c-94c5-9c96387e733d admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:01.143714 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.wsgi [None req-211dda1d-8bf2-4b9c-94c5-9c96387e733d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-211dda1d-8bf2-4b9c-94c5-9c96387e733d admin admin] Request method failure captured: Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Accept: application/json Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Accept-Encoding: gzip, deflate Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Connection: keep-alive Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Content-Length: 0 Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Host: 10.222.0.26 Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Openstack-Api-Version: compute 2.90 Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: Openstack-System-Scope: None Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: User-Agent: python-novaclient Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Auth-Token: gAAAAABjEDcoeqdrKGcIstL4npcHeHUy9vPij6VarCmb7ZC6uCUm8usGSZPLkX_o2T-PlGCQFnXjzsL7sRGvmMgkIFKYDYcxTrA31d1EU3L8JUJl7qkUL0DCdbenJwHuDB_ZPEcxX6JlRioNGsPPhAaEHYi9_O5aZjeeLvUcHAkHCWNkk0E6few Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Domain-Id: None Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Domain-Name: None Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Identity-Status: Confirmed Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Is-Admin-Project: True Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Domain-Id: default Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Domain-Name: Default Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Name: admin Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Role: reader,admin,member Sep 01 04:38:01.145162 n-d-820368-37 devstack@n-api.service[112988]: X-Roles: reader,admin,member Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant: admin Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant-Name: admin Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-User: admin Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-User-Domain-Id: default Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-User-Domain-Name: Default Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-User-Id: 23ccd8c72524416b8ab3004ac4d52144 Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: X-User-Name: admin Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: method: > Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: exception: Flavor 84 could not be found. Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: action_args: {'id': '84'} Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:38:01.146578 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:01.147640 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.148948 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-211dda1d-8bf2-4b9c-94c5-9c96387e733d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:38:01.150321 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-211dda1d-8bf2-4b9c-94c5-9c96387e733d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.432558 Sep 01 04:38:01.150321 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:38:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:38:01.156655 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-eb412d24-761a-49df-93ae-0380e7b98c36 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:01.172212 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-eb412d24-761a-49df-93ae-0380e7b98c36 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019318 Sep 01 04:38:01.172757 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 1 04:38:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:38:01.182730 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-819993a0-ca33-4bd2-83af-53b940af055e admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:01.198159 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-819993a0-ca33-4bd2-83af-53b940af055e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019080 Sep 01 04:38:01.198678 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 1 04:38:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:38:01.208391 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-8e89475d-14ef-4bcb-84f6-784d1d0c3e97 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:01.214242 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.wsgi [None req-8e89475d-14ef-4bcb-84f6-784d1d0c3e97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-8e89475d-14ef-4bcb-84f6-784d1d0c3e97 admin admin] Request method failure captured: Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Accept: application/json Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Accept-Encoding: gzip, deflate Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Connection: keep-alive Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Content-Length: 0 Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Host: 10.222.0.26 Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Openstack-Api-Version: compute 2.90 Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: Openstack-System-Scope: None Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: User-Agent: python-novaclient Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Auth-Token: gAAAAABjEDcoeqdrKGcIstL4npcHeHUy9vPij6VarCmb7ZC6uCUm8usGSZPLkX_o2T-PlGCQFnXjzsL7sRGvmMgkIFKYDYcxTrA31d1EU3L8JUJl7qkUL0DCdbenJwHuDB_ZPEcxX6JlRioNGsPPhAaEHYi9_O5aZjeeLvUcHAkHCWNkk0E6few Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Domain-Id: None Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Domain-Name: None Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Identity-Status: Confirmed Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Is-Admin-Project: True Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Domain-Id: default Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Domain-Name: Default Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Name: admin Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Role: reader,admin,member Sep 01 04:38:01.215783 n-d-820368-37 devstack@n-api.service[112989]: X-Roles: reader,admin,member Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant: admin Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant-Name: admin Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-User: admin Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-User-Domain-Id: default Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-User-Domain-Name: Default Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-User-Id: 23ccd8c72524416b8ab3004ac4d52144 Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: X-User-Name: admin Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: method: > Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: exception: Flavor 84 could not be found. Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: action_args: {'id': '84'} Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:38:01.217465 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:01.218747 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:01.220370 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-8e89475d-14ef-4bcb-84f6-784d1d0c3e97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112989) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:38:01.222908 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-8e89475d-14ef-4bcb-84f6-784d1d0c3e97 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012759 Sep 01 04:38:01.222908 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:38:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:38:02.194755 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-819993a0-ca33-4bd2-83af-53b940af055e admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:02.195791 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-819993a0-ca33-4bd2-83af-53b940af055e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 04:38:02.196176 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:38:02.742052 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-84a2773d-03fa-4f24-9785-e0359415d3f3 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:02.748217 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.wsgi [None req-84a2773d-03fa-4f24-9785-e0359415d3f3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-84a2773d-03fa-4f24-9785-e0359415d3f3 admin admin] Request method failure captured: Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Accept: application/json Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Accept-Encoding: gzip, deflate Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Connection: keep-alive Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Content-Length: 0 Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Host: 10.222.0.26 Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Openstack-Api-Version: compute 2.90 Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: Openstack-System-Scope: None Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: User-Agent: python-novaclient Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Auth-Token: gAAAAABjEDcqlLozNlQq_QLXWncVIgcJbNPw5NCDLj49vldCsX32uI_e_BqqgJ3Z-fHUicSXQQkLHuExe-lndDKIOIPWdG80CW-3sjBDa7PkVTqjhrRr1eWG4wDLX4NqIp4UklSa2VGooOcesScTVadgbaEUE-jCXNPKd-8y8wKXRbxQJJijb3A Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Domain-Id: None Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Domain-Name: None Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Identity-Status: Confirmed Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Is-Admin-Project: True Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Domain-Id: default Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Domain-Name: Default Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Project-Name: admin Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Role: reader,admin,member Sep 01 04:38:02.749721 n-d-820368-37 devstack@n-api.service[112989]: X-Roles: reader,admin,member Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant: admin Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-Tenant-Name: admin Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-User: admin Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-User-Domain-Id: default Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-User-Domain-Name: Default Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-User-Id: 23ccd8c72524416b8ab3004ac4d52144 Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: X-User-Name: admin Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: method: > Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: exception: Flavor 451 could not be found. Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: action_args: {'id': '451'} Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:38:02.751183 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:02.752024 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.753074 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-84a2773d-03fa-4f24-9785-e0359415d3f3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112989) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:38:02.754107 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-84a2773d-03fa-4f24-9785-e0359415d3f3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.419354 Sep 01 04:38:02.754107 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 04:38:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:38:02.761179 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-95c5b7e8-0758-460d-986a-96e23fe0e1a4 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:02.776773 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-95c5b7e8-0758-460d-986a-96e23fe0e1a4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019228 Sep 01 04:38:02.777315 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 1 04:38:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:38:02.787607 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:02.803097 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019248 Sep 01 04:38:02.803631 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 1 04:38:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:38:02.812984 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-a5eea67a-a368-42dd-af05-57f6e6f87321 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:02.818512 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.wsgi [None req-a5eea67a-a368-42dd-af05-57f6e6f87321 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-a5eea67a-a368-42dd-af05-57f6e6f87321 admin admin] Request method failure captured: Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Accept: application/json Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Accept-Encoding: gzip, deflate Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Connection: keep-alive Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Content-Length: 0 Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Host: 10.222.0.26 Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Openstack-Api-Version: compute 2.90 Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: Openstack-System-Scope: None Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: User-Agent: python-novaclient Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Auth-Token: gAAAAABjEDcqlLozNlQq_QLXWncVIgcJbNPw5NCDLj49vldCsX32uI_e_BqqgJ3Z-fHUicSXQQkLHuExe-lndDKIOIPWdG80CW-3sjBDa7PkVTqjhrRr1eWG4wDLX4NqIp4UklSa2VGooOcesScTVadgbaEUE-jCXNPKd-8y8wKXRbxQJJijb3A Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Domain-Id: None Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Domain-Name: None Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Identity-Status: Confirmed Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Is-Admin-Project: True Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Domain-Id: default Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Domain-Name: Default Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Project-Name: admin Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Role: reader,admin,member Sep 01 04:38:02.820082 n-d-820368-37 devstack@n-api.service[112988]: X-Roles: reader,admin,member Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/291edaa2c0d84f13bbf39fdd05708455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant: admin Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant-Id: 291edaa2c0d84f13bbf39fdd05708455 Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-Tenant-Name: admin Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-User: admin Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-User-Domain-Id: default Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-User-Domain-Name: Default Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-User-Id: 23ccd8c72524416b8ab3004ac4d52144 Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: X-User-Name: admin Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: method: > Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: exception: Flavor 451 could not be found. Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: action_args: {'id': '451'} Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:38:02.821625 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:02.822693 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: ERROR nova.api.openstack.wsgi Sep 01 04:38:02.824077 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-a5eea67a-a368-42dd-af05-57f6e6f87321 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:38:02.825322 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-a5eea67a-a368-42dd-af05-57f6e6f87321 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012049 Sep 01 04:38:02.825653 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 04:38:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:38:03.797799 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:03.798813 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 01 04:38:03.799246 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:38:04.352445 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-45896db9-9719-4bfb-8652-52c9411c6993 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:38:04.379802 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-45896db9-9719-4bfb-8652-52c9411c6993 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.442747 Sep 01 04:38:04.380349 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 1 04:38:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:38:05.367049 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:05.368066 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 01 04:38:05.368459 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:38:05.968240 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-185dd254-cc57-407f-bcf0-8ef823e2a62c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:38:05.990725 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-185dd254-cc57-407f-bcf0-8ef823e2a62c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.484021 Sep 01 04:38:05.991292 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 1 04:38:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:38:07.018827 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:07.019872 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Sep 01 04:38:07.020237 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:38:07.572633 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-c86d67ab-c538-4cef-9931-b6e9086185f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:38:07.595887 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-c86d67ab-c538-4cef-9931-b6e9086185f7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.440794 Sep 01 04:38:07.596546 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 1 04:38:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:38:08.578642 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:08.579722 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 01 04:38:08.580113 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:38:09.152596 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-3a36ed64-7144-4c93-98bf-373526d6b9af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:38:09.175900 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-3a36ed64-7144-4c93-98bf-373526d6b9af admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.446296 Sep 01 04:38:09.176366 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 1 04:38:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:38:10.166042 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:10.167087 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 01 04:38:10.167502 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:38:10.722193 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-43d20a41-b7d9-41aa-a218-67853b21b76e admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:38:10.748639 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-43d20a41-b7d9-41aa-a218-67853b21b76e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.444808 Sep 01 04:38:10.749151 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Sep 1 04:38:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:39:04.849885 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:39:04.851665 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-09099062-56b7-4dd9-bcb4-6cf66e32f0d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002304 Sep 01 04:39:04.852289 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 1 04:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:39:04.866656 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:39:05.437891 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-28e00ff4-4362-4dee-b57d-287124602e85 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:39:05.458515 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-28e00ff4-4362-4dee-b57d-287124602e85 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.596487 Sep 01 04:39:05.459077 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 04:39:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:39:05.480206 n-d-820368-37 devstack@n-api.service[112989]: DEBUG dbcounter [-] [112989] Writing DB stats nova_api:SELECT=14 {{(pid=112989) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:39:05.484609 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-5722b6c4-1700-4ede-a6b9-3b261f520a9e admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:39:05.492771 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-5722b6c4-1700-4ede-a6b9-3b261f520a9e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013990 Sep 01 04:39:05.493278 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Thu Sep 1 04:39:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:39:05.507277 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-625d47c6-502a-4785-82d4-44f7087af446 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:39:05.518499 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-625d47c6-502a-4785-82d4-44f7087af446 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016806 Sep 01 04:39:05.519062 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Thu Sep 1 04:39:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:39:05.530630 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-a33d2d7e-b232-4cec-a96d-7bbcba061271 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:39:05.539068 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-a33d2d7e-b232-4cec-a96d-7bbcba061271 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011988 Sep 01 04:39:05.539581 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Thu Sep 1 04:39:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:39:05.551434 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-ae2f71d8-abf5-4833-92d2-3532279c5785 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:39:05.559347 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-ae2f71d8-abf5-4833-92d2-3532279c5785 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011681 Sep 01 04:39:05.559867 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Thu Sep 1 04:39:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:44:44.212502 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-a33d2d7e-b232-4cec-a96d-7bbcba061271 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:44:44.213540 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-a33d2d7e-b232-4cec-a96d-7bbcba061271 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Sep 01 04:44:44.213948 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:44:44.353176 n-d-820368-37 devstack@n-api.service[112988]: DEBUG dbcounter [-] [112988] Writing DB stats nova_api:SELECT=6 {{(pid=112988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:44:44.528095 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:44:44.531946 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:44:44.532424 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:44:44.532847 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:44:44.533606 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:44:44.534585 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:44:44.535015 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:44:44.579759 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-f0fe938c-7ee5-4e57-80d8-3e8923d1039d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.228043 Sep 01 04:44:44.580323 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 04:44:44 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:44:45.403543 n-d-820368-37 devstack@n-api.service[112989]: DEBUG nova.api.openstack.wsgi [None req-a33d2d7e-b232-4cec-a96d-7bbcba061271 admin admin] Calling method '>' {{(pid=112989) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:44:45.404560 n-d-820368-37 devstack@n-api.service[112989]: INFO nova.api.openstack.requestlog [None req-a33d2d7e-b232-4cec-a96d-7bbcba061271 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 04:44:45.404951 n-d-820368-37 devstack@n-api.service[112989]: [pid: 112989|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 1 04:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:44:45.601680 n-d-820368-37 devstack@n-api.service[112988]: DEBUG nova.api.openstack.wsgi [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Calling method '>' {{(pid=112988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:44:45.605098 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:44:45.605572 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:44:45.605998 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:44:45.606707 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:44:45.607183 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:44:45.607660 n-d-820368-37 devstack@n-api.service[112988]: DEBUG oslo_concurrency.lockutils [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:44:45.630109 n-d-820368-37 devstack@n-api.service[112988]: INFO nova.api.openstack.requestlog [None req-71bcc5aa-a3e8-41b0-91c6-170e4e434ce4 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.084784 Sep 01 04:44:45.631033 n-d-820368-37 devstack@n-api.service[112988]: [pid: 112988|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 04:44:45 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:45:31.165235 n-d-820368-37 devstack@n-api.service[112987]: Thu Sep 1 04:45:31 2022 - graceful shutdown triggered... Sep 01 04:45:31.165366 n-d-820368-37 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 04:45:31.166347 n-d-820368-37 devstack@n-api.service[112988]: Gracefully killing worker 1 (pid: 112988)... Sep 01 04:45:31.166769 n-d-820368-37 devstack@n-api.service[112989]: Gracefully killing worker 2 (pid: 112989)... Sep 01 04:45:32.167163 n-d-820368-37 devstack@n-api.service[112987]: worker 1 buried after 1 seconds Sep 01 04:45:32.167163 n-d-820368-37 devstack@n-api.service[112987]: worker 2 buried after 1 seconds Sep 01 04:45:32.167163 n-d-820368-37 devstack@n-api.service[112987]: goodbye to uWSGI. Sep 01 04:45:32.169613 n-d-820368-37 systemd[1]: devstack@n-api.service: Succeeded. Sep 01 04:45:32.170668 n-d-820368-37 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 04:45:32.175588 n-d-820368-37 systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 04:45:32.198114 n-d-820368-37 devstack@n-api.service[128848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 04:45:32 2022] *** Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: nodename: n-d-820368-37 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: machine: x86_64 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: clock source: unix Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: pcre jit disabled Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: detected number of CPU cores: 4 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: current working directory: / Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: detected binary path: /usr/bin/uwsgi-core Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: your processes number limit is 47680 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: your memory page size is 4096 bytes Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: detected max file descriptor number: 2048 Sep 01 04:45:32.216926 n-d-820368-37 devstack@n-api.service[128848]: lock engine: pthread robust mutexes Sep 01 04:45:32.217976 n-d-820368-37 devstack@n-api.service[128848]: thunder lock: enabled Sep 01 04:45:32.217976 n-d-820368-37 devstack@n-api.service[128848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 04:45:32.217976 n-d-820368-37 devstack@n-api.service[128848]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 04:45:32.256374 n-d-820368-37 devstack@n-api.service[128848]: Python main interpreter initialized at 0x564039aa29c0 Sep 01 04:45:32.256374 n-d-820368-37 devstack@n-api.service[128848]: python threads support enabled Sep 01 04:45:32.256374 n-d-820368-37 devstack@n-api.service[128848]: your server socket listen backlog is limited to 100 connections Sep 01 04:45:32.256374 n-d-820368-37 devstack@n-api.service[128848]: your mercy for graceful operations on workers is 90 seconds Sep 01 04:45:32.256806 n-d-820368-37 devstack@n-api.service[128848]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 04:45:32.256806 n-d-820368-37 devstack@n-api.service[128848]: *** Operational MODE: preforking *** Sep 01 04:45:32.257048 n-d-820368-37 devstack@n-api.service[128848]: *** uWSGI is running in multiple interpreter mode *** Sep 01 04:45:32.257048 n-d-820368-37 devstack@n-api.service[128848]: spawned uWSGI master process (pid: 128848) Sep 01 04:45:32.257244 n-d-820368-37 systemd[1]: Started Devstack devstack@n-api.service. Sep 01 04:45:32.258592 n-d-820368-37 devstack@n-api.service[128848]: spawned uWSGI worker 1 (pid: 128862, cores: 1) Sep 01 04:45:32.259153 n-d-820368-37 devstack@n-api.service[128848]: spawned uWSGI worker 2 (pid: 128863, cores: 1) Sep 01 04:45:32.259350 n-d-820368-37 devstack@n-api.service[128848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 04:45:32.914906 n-d-820368-37 devstack@n-api.service[128862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 04:45:32.918679 n-d-820368-37 devstack@n-api.service[128863]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 04:45:34.057092 n-d-820368-37 devstack@n-api.service[128862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:45:34.057092 n-d-820368-37 devstack@n-api.service[128862]: from cryptography.utils import int_from_bytes Sep 01 04:45:34.057720 n-d-820368-37 devstack@n-api.service[128862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:45:34.057720 n-d-820368-37 devstack@n-api.service[128862]: from cryptography.utils import int_from_bytes Sep 01 04:45:34.065480 n-d-820368-37 devstack@n-api.service[128863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:45:34.065480 n-d-820368-37 devstack@n-api.service[128863]: from cryptography.utils import int_from_bytes Sep 01 04:45:34.066045 n-d-820368-37 devstack@n-api.service[128863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:45:34.066045 n-d-820368-37 devstack@n-api.service[128863]: from cryptography.utils import int_from_bytes Sep 01 04:45:36.535436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 04:45:36.536181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 04:45:36.536299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 04:45:36.536606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 04:45:36.536856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 04:45:36.537246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.537578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.537859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.538178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.538505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.538812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.539172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.539491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.539816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.540075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.540390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.540708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-37 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.541190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.541501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.541813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.542134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.542439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.542766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.543103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.543609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.544069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.544363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.544828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.545012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.545324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.545632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.545955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.546262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.546584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.546913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.547328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-37 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.547658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.547970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.548294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.548693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.549217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.549536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.549847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.550305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.550628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.550970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.551290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.551609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.551928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.552077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 04:45:36.552491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.552586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 04:45:36.554015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.554015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 04:45:36.555203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 04:45:36.555400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 04:45:36.555583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.555977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.556806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.557077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-820368-37 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.557314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.557533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.557648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.557839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.557943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.558146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.558242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.558461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.558565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.558767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.558983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.559112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.559231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.559416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.559530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.559745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.559925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.560987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.561173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.561311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.561484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.561631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.561790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.561958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.562105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.562270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.562407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.562592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.562723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-820368-37 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.563930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.564056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.564252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.564345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.564570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.564737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.564888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.565495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.565595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.565690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.566956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.567977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.568192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.568300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.568541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.568657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.568798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.568899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.569985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.570997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.571142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.571247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.571390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.571593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.571694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.571781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.572914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.573941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.574129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.574231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.574430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.574522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.574745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.574858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.575078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.575189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.575394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.575493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.575695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.575794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.576920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.577939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.578148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.578248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.578449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.578551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.578754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.578846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.579993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.580927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.581134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.581242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.581503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.581607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.581824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.581987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.582172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.582285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.582413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.582507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.582705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.582805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.583029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.583140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.583329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.583424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.583632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.583747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.583933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.584050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.584233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.584357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.584530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.584692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.584820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.585015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.585120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.585324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.585428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.585644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.585751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.585970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.586073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.586284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.586386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.586582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.586676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.586899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.586996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.587204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.587308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.587507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.587599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.587822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.587924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.588125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.588229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.588425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.588530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.588740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.588843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.589039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.589131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.589340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.589441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.589653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.589759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.589952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.590052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.590253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.590345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.590564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.590671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.590858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.590988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.591177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.591280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.591490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.591591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.591790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.591887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.592088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.592181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.592385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.592487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.592684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.592777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.592981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.593086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.593278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.593372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.593575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.593695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.593877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.594006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.594173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.594290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.594478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.594584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.594782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.594877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.595116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.595232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.595420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.595527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.595718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.595822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.596038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:45:36.596142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.596368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.596470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.596694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.596788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.597052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.597157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.597370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.597479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.597695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.597796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.598973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.599993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.600208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.600309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.600520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.600627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.600818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.600920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.601139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.601272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.601447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.601550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.601760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.601855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.602073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.602177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.602378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.602486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.602686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.602781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.603970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.604096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.604277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.604374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.604602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.604696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.604913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.605928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.606142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.606235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.606455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.606547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.606765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.606869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.607096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.607198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.607412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.607515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.607718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.607820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.608958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.609995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.610204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.610305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.610519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.610620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.610821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.610988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.611155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.611300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.611470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.611566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.611775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.611867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.612084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.612175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.612391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.612492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.612770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.612940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.613911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.614976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.615955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.616061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.616262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.616355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.616597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.616689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.616900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.617925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.618141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.618240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.618446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.618538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.618747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.618849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.619999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.620098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.620304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.620397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.620612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.620707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.620921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.621941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.622157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.622286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.622488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.622607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.622817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.622992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.623144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.623251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.623464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.623561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.623774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.623911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.624986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.625091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.625285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.625379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.625588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.625746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.625897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.626916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.627106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.627213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.627405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.627507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.627719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.627814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.628023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.628124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.628358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.628464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.628696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.628801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.629959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.630054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.630289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.630397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.630601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.630701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.630936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.631982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.632160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.632267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.632464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.632566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.632766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.632860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.633995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.634087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.634303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.634396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.634606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.634700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.634940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.635982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.636167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.636260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.636488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.636590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.636796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.636897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.637100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.637196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.637402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.637503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.637705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.637796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.638955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.639968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.640187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.640288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.640489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.640581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.640804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.640904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.641105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.641208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.641414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.641514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.641725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.641825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.642994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.643141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.643307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.643405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.643620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.643711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.643976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.644981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.645202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.645472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.645573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.645804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.645914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.646105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.646209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.646410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.646504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.646715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.646809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.647950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.648995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.649187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.649279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.649487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.649586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.649789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.649890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.650096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.650198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.650394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.650494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.650692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.650798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.651930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.652953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.653153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.653288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.653460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.653563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.653768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.653861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.654071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.654217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.654376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.654471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.654678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.654779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.655936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.656042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.656257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.656370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.656561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.657924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.658132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.658225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.658437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.658540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.658746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.659033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.659149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.659370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.659469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.659709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.659857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.660006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.660157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.660317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.660497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.660794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.660900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.661099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.661193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.661411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.661504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.661716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.661820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.662965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.663986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.664184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.664361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.664491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.664584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.664790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.664882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.665092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.665195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.665391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.665493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.665695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.665816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.666920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.667938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.668162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.668263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.668439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.668534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.668740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.668830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.669987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.670081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.670294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.670387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.670593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.670693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.670924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.671929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.672996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.673098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.673298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.673399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.673603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.673698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.673908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.674961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.675139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.675318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.675709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.676011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.676121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.676452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.676694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.676797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.677003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.677099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.677337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.677432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.677706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.677806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.678024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.678276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.678380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.678639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.678763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.678992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.679261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.679456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.679616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.679715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.679925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.680176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.680270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.680543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.680644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.680855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.681136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.681230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.681470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.681635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.681792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.682116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.682208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.682421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.682555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.682731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.683063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.683185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.683373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.683535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.683684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.683993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.684094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.684304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.684455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.684620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.684914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.685044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.685225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.685384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.685536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.685845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.685948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.686159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.686343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.686468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.686770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.686875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.687125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.687296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.687435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.687739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.687841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.688049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.688204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.688355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.688666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.688759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.688969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.689134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.689404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.689596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.689699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.690010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.690114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.690315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.690496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.690622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.691012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.691118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.691396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.691505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.691716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.691948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.692050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.692424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.692527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.692737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.692888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.693047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.693359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.693451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.693665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.693893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.693988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.694265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.694497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.694588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.694926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.695070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.695212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.695518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.695702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.695839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.696142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.696236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.696462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.696774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.696868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.697177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.697354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.697482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.697898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.697992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.698210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.698521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.698622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.698845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.698984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.699196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.699298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.699524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.699628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.699830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.699942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.700150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.700251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.700460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.700563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.700768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.700869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.701095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.701188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.701407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.701509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.701714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.701815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.702983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.703100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.703293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.703430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.703638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.703819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.704040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.704167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.704352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.704665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.704866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.705023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.705329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.705475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.705645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.705913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.706016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.706343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.706516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.706704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.706977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.707112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.707301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.707528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.707634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.707841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.707945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.708155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.708257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.708470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.708574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.708784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.708877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.709992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.710097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.710302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.710404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.710608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.710710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.710951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.711084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.711276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.711401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.711585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.711697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.711908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.712932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.713140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.713236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.713481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.713575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.713788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.713890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.714112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.714216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.714440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.714577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.714851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.714998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.715089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.715175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.715390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.715495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.715699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.715793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.716934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.717935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.718152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.718248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.718456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.718538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.718765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.718855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.719227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.719332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.719416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.719552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.719687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.719859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.720934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.721125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.721219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.721439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.721541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.721745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.721849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.722103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.722256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.722417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.722552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.722806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.722973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.723147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.723243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.723452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.723555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.723774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.723873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.724096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.724189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.724410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.724511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.724730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.724832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.725974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.726077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.726292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.726398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.726608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.726711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.726945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.727044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.727258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.727524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.727622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.727857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.727952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.728173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.728274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.728478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.728581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.728790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.728897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.729098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.729200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.729406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.729509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.729709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.729810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.730952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.731064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.731269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.731398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.731588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.731709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.731925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.732999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.733124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.733227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.733425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.733520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.733725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.733829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.734065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.734160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.734368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.734550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.734687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.734788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.735955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.736055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.736269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.736375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.736581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.736684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.758024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.758372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.758528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.758981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.758981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.759810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.760898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.761343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.761749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.761749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.762240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.762550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.763009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.763009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.764089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.764751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.764945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.765203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.765381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.765381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.765769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.765979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.766206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.766772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.767164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.767372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.767372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.769310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.770869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.771947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.772999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.773967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.774991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.775984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.776990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.777968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.778996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.779898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.780924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.781995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.782859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.783974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.784981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.785985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.786926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.787956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.788981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.789933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.790983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.791938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.792948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.793906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.794005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.794196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.794335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.794468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.794672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.794796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.795959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.796090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.796263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.796423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.796575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.796731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.796888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.797044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.797197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.797375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.797498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.797691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.797798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.798967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.799965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.800210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.800350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.800559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.800641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.800859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.800985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.801160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.801241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.801459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.801539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.801763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.801852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.802988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.803100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.803286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.803431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.803612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.803748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.803946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.804059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.804262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.804367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.804582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.804672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 04:45:36.804892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.805208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.805592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.805838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.806149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.806462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.806766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.807121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.807428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.807735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.808043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.808351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.808658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.808962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.809287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.809605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.809905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.810225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.810537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.810853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.811185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.811497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.811823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.812134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.812439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.812746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.813057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.813364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.813675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.813980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.814286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.814599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.814930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.815256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.815577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.815962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.816293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.816610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.816961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.817266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.817611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.817934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.818240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.818548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.818845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:45:36.819109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 04:45:36.865639 n-d-820368-37 devstack@n-api.service[128863]: INFO dbcounter [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Registered counter for database nova_api Sep 01 04:45:36.879697 n-d-820368-37 devstack@n-api.service[128862]: INFO dbcounter [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Registered counter for database nova_api Sep 01 04:45:36.886099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:36.892662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:36.899773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:36.906272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:36.949295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.context [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=128863) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 04:45:36.953349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:45:36.953831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:45:36.955467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:45:36.956164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:45:36.956640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:45:36.958643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:45:36.960666 n-d-820368-37 devstack@n-api.service[128863]: INFO dbcounter [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Registered counter for database nova_cell0 Sep 01 04:45:36.962057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.context [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=128862) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 04:45:36.964722 n-d-820368-37 devstack@n-api.service[128863]: INFO dbcounter [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Registered counter for database nova_cell1 Sep 01 04:45:36.966123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:45:36.966610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:45:36.968204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:45:36.968951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:45:36.969361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:45:36.971431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:45:36.972632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:36.973589 n-d-820368-37 devstack@n-api.service[128862]: INFO dbcounter [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Registered counter for database nova_cell0 Sep 01 04:45:36.977665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:36.978103 n-d-820368-37 devstack@n-api.service[128862]: INFO dbcounter [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Registered counter for database nova_cell1 Sep 01 04:45:36.980706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:36.984588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:36.985250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:36.987623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:37.000042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:37.001504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:37.133857 n-d-820368-37 devstack@n-api.service[128863]: INFO dbcounter [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Registered counter for database nova_cell0 Sep 01 04:45:37.141095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:37.146163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:37.152856 n-d-820368-37 devstack@n-api.service[128862]: INFO dbcounter [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Registered counter for database nova_cell0 Sep 01 04:45:37.160377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_db.sqlalchemy.engines [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:45:37.165834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writer thread running {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:45:37.464474 n-d-820368-37 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:45:37.471847 n-d-820368-37 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:45:37.491910 n-d-820368-37 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:45:37.499378 n-d-820368-37 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:45:37.817065 n-d-820368-37 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:45:37.823149 n-d-820368-37 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-4960e74c-c7d1-4d48-a87c-6c39462a1238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:45:37.828460 n-d-820368-37 devstack@n-api.service[128863]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564039aa29c0 pid: 128863 (default app) Sep 01 04:45:37.862582 n-d-820368-37 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 04:45:37.868781 n-d-820368-37 devstack@n-api.service[128862]: WARNING keystonemiddleware.auth_token [None req-060deeb0-1b6a-4294-8734-0fcffab67dda None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 04:45:37.874045 n-d-820368-37 devstack@n-api.service[128862]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564039aa29c0 pid: 128862 (default app) Sep 01 04:46:18.566330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:18.567118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:18.567923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:18.568965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:19.478288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:19.479955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:19.481579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:19.482740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:19.775854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:19.780656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:19.781127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:19.781556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:19.782842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:19.783308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:19.783757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:19.827830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c2427c0-a052-475e-a040-962a137addcc tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.278417 Sep 01 04:46:19.828420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1/1] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:46:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:20.301819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Calling method '.version_select at 0x7fa7616ffca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:20.310776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=128863) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 01 04:46:20.311760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.312230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.312660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.341336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.341830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.342464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.357924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.358628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.359116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.365979 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-677e4202-87ef-48a8-a951-b07f00cd7727 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.536264 Sep 01 04:46:20.366515 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1208 bytes} [Thu Sep 1 04:46:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:46:20.371195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5175d77-a6bb-4fb3-a4bb-083200715afa tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2051191769"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:20.390641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-f5175d77-a6bb-4fb3-a4bb-083200715afa tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 8fdcd3c6-181b-419e-b6f6-cf23436d1564 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:20.460605 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5175d77-a6bb-4fb3-a4bb-083200715afa tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092638 Sep 01 04:46:20.467043 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:20.468914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5175d77-a6bb-4fb3-a4bb-083200715afa tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:20.470058 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5175d77-a6bb-4fb3-a4bb-083200715afa tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001692 Sep 01 04:46:20.470935 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 4/4] 10.222.0.26 () {56 vars in 886 bytes} [Thu Sep 1 04:46:20 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 01 04:46:20.745169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:20.747788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.748689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.749868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.750959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.751724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.752477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.768366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '.version_select at 0x7fa76184d1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:20.777583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=128862) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 01 04:46:20.778512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.779272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.780124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.781561 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c95b95a1-2191-4993-9f4b-121fb6773c02 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.309237 Sep 01 04:46:20.783705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Sep 1 04:46:20 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:20.812175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.812712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.813090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.827105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.827381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.827809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.834673 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b363ee76-d318-4b01-abdf-887238b8b7bb tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.373185 Sep 01 04:46:20.846910 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1/6] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 1 04:46:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:20.846910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ade39fa-be17-438a-952d-8450ed2cd5a2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:20.871771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ade39fa-be17-438a-952d-8450ed2cd5a2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:20.872244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ade39fa-be17-438a-952d-8450ed2cd5a2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:20.872671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ade39fa-be17-438a-952d-8450ed2cd5a2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:20.930105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-605775306", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:21.511026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ade39fa-be17-438a-952d-8450ed2cd5a2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 0.672931 Sep 01 04:46:21.513304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2/7] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:46:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:21.575605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:46:21.679935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4453615-2250-4a42-bc24-6313e2515cdd tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] Calling method '.version_select at 0x7fa760e3b430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:21.700275 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4453615-2250-4a42-bc24-6313e2515cdd tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.184849 Sep 01 04:46:21.701203 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3/8] 10.222.0.26 () {60 vars in 1226 bytes} [Thu Sep 1 04:46:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:21.706962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:21.709561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:21.710067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:21.710560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:21.711408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:21.711924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:21.712422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:21.756715 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-963f4117-d4bd-40d4-9fde-e946e6083330 tempest-AZAdminV2TestJSON-1200218917 tempest-AZAdminV2TestJSON-1200218917-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.054014 Sep 01 04:46:21.759061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 4/9] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 04:46:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:21.890270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9a14042-3dee-47de-be37-3afa4419447b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-784362238", "id": 422729139, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:21.914479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:46:21.914926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:46:21.915205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:46:21.915611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:46:21.916016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:46:21.932169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:21.933136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:21.933728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:21.934457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:21.934931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:21.935501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:21.973863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Getting quotas for project 0133c74c727c4767ab66201ffaab8fda. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:21.979246 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9a14042-3dee-47de-be37-3afa4419447b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.219977 Sep 01 04:46:21.980145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 5/10] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:21 2022] POST /compute/v2.1/flavors => generated 435 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:21.981585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Getting quotas for user 53833f12609b47fa917e5144f70fef4c and project 0133c74c727c4767ab66201ffaab8fda. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:21.985500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:21.995559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:46:22.002094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:22.002853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:22.003915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:22.005073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:46:22.044480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-820368-37. Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 40 Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:22.064264 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: {"add_host": {"host": "n-h1-820368-37"}} Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:22.065788 n-d-820368-37 devstack@n-api.service[128862]: exception: Aggregate 1 already has host n-h1-820368-37. Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-820368-37'}}} Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:46:22.066699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-820368-37-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi session.flush() Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 04:46:22.071895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 04:46:22.073036 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:46:22.074027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-820368-37-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 1, 4, 46, 22, 28217), 'updated_at': None, 'host': 'n-h1-820368-37', 'aggregate_id': 1}] Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:22.074979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-820368-37. Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.075880 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-820368-37. Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:22.076904 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:22.079102 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-820368-37. Sep 01 04:46:22.079102 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:22.079102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-820368-37. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:22.079102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46f7f2cb-33af-43dd-9c3d-96d70f4a8759 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.084830 Sep 01 04:46:22.079102 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 6/11] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:46:21 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 01 04:46:22.079102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33576faa-a378-46ea-b8c3-c322f9b67925 tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] Action: 'update', calling method: .version_select at 0x7fa760b5e4c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:22.123790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df07f450-2f18-4c1a-a00a-33fae2bc60c1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338666 Sep 01 04:46:22.134393 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 6/12] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:46:22.140703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ac66e50-8ad7-48de-b9d1-abb8e8597a17 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:22.316076 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33576faa-a378-46ea-b8c3-c322f9b67925 tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.247622 Sep 01 04:46:22.317195 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 7/13] 10.222.0.26 () {62 vars in 1247 bytes} [Thu Sep 1 04:46:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:22.322399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3256bf0-da9e-4eaa-9e81-c70e8a4ddc92 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:22.335205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3256bf0-da9e-4eaa-9e81-c70e8a4ddc92 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:22.335677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3256bf0-da9e-4eaa-9e81-c70e8a4ddc92 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:22.336234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3256bf0-da9e-4eaa-9e81-c70e8a4ddc92 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:22.497281 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3256bf0-da9e-4eaa-9e81-c70e8a4ddc92 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.178543 Sep 01 04:46:22.498760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 8/14] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:46:22 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:22.505998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8110556-1fb1-4570-ad0f-2b6381d0188c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:22.507500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8110556-1fb1-4570-ad0f-2b6381d0188c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:22.540229 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ac66e50-8ad7-48de-b9d1-abb8e8597a17 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/422729139/action" status: 200 len: 96 microversion: 2.1 time: 0.404140 Sep 01 04:46:22.547981 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 7/15] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Sep 1 04:46:22 2022] POST /compute/v2.1/flavors/422729139/action => generated 96 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:22.553149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e256dfb-1d9e-4ac5-b72c-038ddd793fd6 tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] Calling method '.version_select at 0x7fa760e4ae50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:22.574319 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e256dfb-1d9e-4ac5-b72c-038ddd793fd6 tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.024595 Sep 01 04:46:22.575314 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 8/16] 10.222.0.26 () {60 vars in 1226 bytes} [Thu Sep 1 04:46:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:22.585643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd0005b9-d57b-455c-ba41-a785d9749ec5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:22.629110 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd0005b9-d57b-455c-ba41-a785d9749ec5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.052581 Sep 01 04:46:22.630046 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:22 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:22.642384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab3a9f90-cf34-4454-91ae-96d16e108a10 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:22.998490 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ab3a9f90-cf34-4454-91ae-96d16e108a10 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 1efa44c33f344a5ea18f792013e5076b combination. Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab3a9f90-cf34-4454-91ae-96d16e108a10 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Request method failure captured: Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/flavors/422729139/action HTTP/1.1 Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 67 Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkcZ1cdbl3pN-mZEP-jG6DxdVGXL_igzMGEkZF9ye5rcHeaqTtkclBeU_0NjQbKYlt-eMug8GzNQdPFMwILL09x2xWK29pNXgc9M75dEF1lWyDy831rQmHTPMyyPxvJos6nUI2XpidJs9mx_R-OM68uWDO7v05FRDmuKregSqJ3HFM Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 13f3690d7b4042f7bfa63ac2b83a392a Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:46:23.018927 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 13f3690d7b4042f7bfa63ac2b83a392a Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: cc6735b4849a42199e9df01c2eb6a970 Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: {"addTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} Sep 01 04:46:23.020406 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: exception: Flavor access already exists for flavor 15 and project 1efa44c33f344a5ea18f792013e5076b combination. Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '422729139', 'body': {'addTenantAccess': {'tenant': '1efa44c33f344a5ea18f792013e5076b'}}} Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result.read() Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:46:23.021175 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-1efa44c33f344a5ea18f792013e5076b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi session.flush() Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 04:46:23.022248 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 04:46:23.023385 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:46:23.024425 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result.read() Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-1efa44c33f344a5ea18f792013e5076b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 1, 4, 46, 22, 990254), 'updated_at': None, 'flavor_id': 15, 'project_id': '1efa44c33f344a5ea18f792013e5076b'}] Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:23.025544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 1efa44c33f344a5ea18f792013e5076b combination. Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:23.026535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 1efa44c33f344a5ea18f792013e5076b combination. Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:23.027954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:23.029523 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 1efa44c33f344a5ea18f792013e5076b combination. Sep 01 04:46:23.029523 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.029849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab3a9f90-cf34-4454-91ae-96d16e108a10 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 1efa44c33f344a5ea18f792013e5076b combination. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:23.031087 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab3a9f90-cf34-4454-91ae-96d16e108a10 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/422729139/action" status: 409 len: 152 microversion: 2.1 time: 0.399416 Sep 01 04:46:23.036475 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 10/18] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Sep 1 04:46:22 2022] POST /compute/v2.1/flavors/422729139/action => generated 152 bytes in 406 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:46:23.044959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21c56eda-af10-4ca3-bc29-c30ec23a383f tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] Action: 'update', calling method: .version_select at 0x7fa760bb5b80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:23.189333 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21c56eda-af10-4ca3-bc29-c30ec23a383f tempest-QuotaClassesAdmin257Test-1067208854 tempest-QuotaClassesAdmin257Test-1067208854-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.150873 Sep 01 04:46:23.189912 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 11/19] 10.222.0.26 () {62 vars in 1247 bytes} [Thu Sep 1 04:46:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:23.195325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a69c172-cffd-4535-90ab-7f03ee52a4ec tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1645730270"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:23.199972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-7a69c172-cffd-4535-90ab-7f03ee52a4ec tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Generated uuid 7c31789a-de55-4f96-bccd-e2d28a290d70 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:23.233319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8110556-1fb1-4570-ad0f-2b6381d0188c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:23.234463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a69c172-cffd-4535-90ab-7f03ee52a4ec tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.043165 Sep 01 04:46:23.236594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 12/20] 10.222.0.26 () {62 vars in 1205 bytes} [Thu Sep 1 04:46:23 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:23.244013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2874f83-ae9d-4089-a7e0-60a2163216da tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1001687275"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:23.249628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-e2874f83-ae9d-4089-a7e0-60a2163216da tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 4e5e2f6b-dd39-4ebf-bdc1-4ca4d38eea95 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:23.281157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2874f83-ae9d-4089-a7e0-60a2163216da tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043026 Sep 01 04:46:23.281761 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8110556-1fb1-4570-ad0f-2b6381d0188c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1219 microversion: 2.1 time: 0.775531 Sep 01 04:46:23.283426 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 13/21] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:23.284444 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 9/22] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:22 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1219 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:23.289913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92282faa-4dce-4f96-a776-6b98e9e01bbb tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:23.291912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05d8ab96-5ec8-4981-9815-70250eddb9f2 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1574037"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:23.416939 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05d8ab96-5ec8-4981-9815-70250eddb9f2 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 296 microversion: 2.41 time: 0.129216 Sep 01 04:46:23.418743 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 10/23] 10.222.0.26 () {62 vars in 1210 bytes} [Thu Sep 1 04:46:23 2022] PUT /compute/v2.1/os-aggregates/2 => generated 296 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:23.883912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9f3059-a464-4dad-a780-99cae353fc04 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:23.888402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe9f3059-a464-4dad-a780-99cae353fc04 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5349ae268be44f1ba7762eda25816148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d394885a2343438400d36c85f38385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9f3059-a464-4dad-a780-99cae353fc04 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Request method failure captured: Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 40 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkYmVyytTIlfbFhY3A02omcyu_IdM72gWZnt1yFVAtcUAMzHezmRMRh_9kIW793rQc4bnI6eEhuCH_msZNG4VFmkc3bxTHTPh3k5FK0zZBNBVtxqnxgyy95--fsAL7LnpWyKV9fXZZMo13z5FyXxZ77WCKbZIJCNjAOIZmDkz5s1K0 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:23.892121 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5d394885a2343438400d36c85f38385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5d394885a2343438400d36c85f38385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5349ae268be44f1ba7762eda25816148 Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: {"add_host": {"host": "n-h1-820368-37"}} Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:23.893361 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-820368-37'}}} Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:23.894227 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 01 04:46:23.895711 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:23.896976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe9f3059-a464-4dad-a780-99cae353fc04 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:23.897220 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe9f3059-a464-4dad-a780-99cae353fc04 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.476619 Sep 01 04:46:23.902079 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 11/24] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:46:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 482 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:23.908562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f74e87f-7150-4baf-b70e-c4716e68da52 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:23.919125 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f74e87f-7150-4baf-b70e-c4716e68da52 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 296 microversion: 2.41 time: 0.015651 Sep 01 04:46:23.927011 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 12/25] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:46:23 2022] GET /compute/v2.1/os-aggregates/2 => generated 296 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:23.932713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00135166-2f75-499a-82e5-2b682f09ec46 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:23.968459 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00135166-2f75-499a-82e5-2b682f09ec46 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.040181 Sep 01 04:46:23.970244 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:23 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:23.985120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8274300-920b-4274-9d15-8f762173446f tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.023765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8274300-920b-4274-9d15-8f762173446f tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:24.024425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8274300-920b-4274-9d15-8f762173446f tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:24.025369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8274300-920b-4274-9d15-8f762173446f tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:24.039657 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92282faa-4dce-4f96-a776-6b98e9e01bbb tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/422729139/action" status: 200 len: 21 microversion: 2.1 time: 0.754842 Sep 01 04:46:24.040238 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 14/27] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Sep 1 04:46:23 2022] POST /compute/v2.1/flavors/422729139/action => generated 21 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:24.050361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a4b2518-b6d7-412f-87d0-b5e3e7291756 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-765242825"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.054610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-8a4b2518-b6d7-412f-87d0-b5e3e7291756 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 9114925f-0860-4b7e-b703-2fcccb984c68 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:24.102475 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a4b2518-b6d7-412f-87d0-b5e3e7291756 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.061078 Sep 01 04:46:24.103654 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 15/28] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:24.130093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4d75c7c-9a8b-4079-b66f-0b922a7d8a1e tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.174198 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4d75c7c-9a8b-4079-b66f-0b922a7d8a1e tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/422729139" status: 202 len: 0 microversion: 2.1 time: 0.066274 Sep 01 04:46:24.175246 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 16/29] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:46:24 2022] DELETE /compute/v2.1/flavors/422729139 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:24.199192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1099898398"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.234984 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8274300-920b-4274-9d15-8f762173446f tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 312 microversion: 2.41 time: 0.254619 Sep 01 04:46:24.235751 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 14/30] 10.222.0.26 () {62 vars in 1232 bytes} [Thu Sep 1 04:46:23 2022] POST /compute/v2.1/os-aggregates/2/action => generated 312 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:24.237139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:24.238492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:24.240023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:24.252799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06a47de3-f0f7-4df8-876a-511e0af9a698 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.257964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:24.258703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:24.259484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:24.274475 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1099898398 could not be found. Sep 01 04:46:24.298451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=11,nova_api:UPDATE=8,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 58 Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:46:24.303758 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: {"add_host": {"host": "tempest-nonexist_host-1099898398"}} Sep 01 04:46:24.305099 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: exception: Compute host tempest-nonexist_host-1099898398 could not be found. Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1099898398'}}} Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1099898398' is not mapped to any cell Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.305814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Sep 01 04:46:24.310036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1099898398 could not be found. Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1099898398 could not be found. Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.311105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1099898398 could not be found. Sep 01 04:46:24.312343 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.318132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1099898398 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:24.323096 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c264b0a4-d370-4709-9d22-05e98c26e045 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.138668 Sep 01 04:46:24.324387 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 17/31] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:24.329392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06a47de3-f0f7-4df8-876a-511e0af9a698 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092319 Sep 01 04:46:24.334725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a0842d0-bfb1-4fb2-81eb-fedb633201bd tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.336503 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 15/32] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:24.341914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.342914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:24.352828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:24.353678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:24.354296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:24.356002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:24.356842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:24.357985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:24.358104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:DELETE=6,nova_api:UPDATE=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:24.365187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a0842d0-bfb1-4fb2-81eb-fedb633201bd tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:24.365728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a0842d0-bfb1-4fb2-81eb-fedb633201bd tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:24.366169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a0842d0-bfb1-4fb2-81eb-fedb633201bd tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:24.531706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:24.558495 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e71b50f-2b1e-4a51-9a75-ed7bcf61c6dc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1271 microversion: 2.1 time: 0.220527 Sep 01 04:46:24.560448 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 16/33] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:24 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:24.571554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6557a0e-f7ad-4e7e-a07b-6d6b63e2c7d0 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.604648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6557a0e-f7ad-4e7e-a07b-6d6b63e2c7d0 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.043004 Sep 01 04:46:24.605304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:24 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:24.611945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e63fb5c6-163e-4c23-8c4e-96874c0f2aae tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-85820278", "id": 1392408721, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.640596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e63fb5c6-163e-4c23-8c4e-96874c0f2aae tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.034125 Sep 01 04:46:24.641190 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 18/35] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/flavors => generated 436 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:24.655659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dba8822-e8be-48ac-a92b-39bfb7f249c1 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dba8822-e8be-48ac-a92b-39bfb7f249c1 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 283 Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:24.677943 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:24.679381 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:46:24.679885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:24.680429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.681436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.682385 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:46:24.682385 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:46:24.682385 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 04:46:24.682385 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.689226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dba8822-e8be-48ac-a92b-39bfb7f249c1 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:24.690606 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dba8822-e8be-48ac-a92b-39bfb7f249c1 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.048251 Sep 01 04:46:24.691525 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 19/36] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:46:24.713071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-858b57cc-8d86-4e26-bf02-03a475063dec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.753513 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-858b57cc-8d86-4e26-bf02-03a475063dec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-858b57cc-8d86-4e26-bf02-03a475063dec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Request method failure captured: Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/flavors/1392408721/os-flavor-access HTTP/1.1 Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkcZ1cdbl3pN-mZEP-jG6DxdVGXL_igzMGEkZF9ye5rcHeaqTtkclBeU_0NjQbKYlt-eMug8GzNQdPFMwILL09x2xWK29pNXgc9M75dEF1lWyDy831rQmHTPMyyPxvJos6nUI2XpidJs9mx_R-OM68uWDO7v05FRDmuKregSqJ3HFM Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 13f3690d7b4042f7bfa63ac2b83a392a Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:24.756655 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 13f3690d7b4042f7bfa63ac2b83a392a Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cc6735b4849a42199e9df01c2eb6a970 Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: exception: Access list not available for public flavors. Sep 01 04:46:24.758623 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'flavor_id': '1392408721'} Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 01 04:46:24.759719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.762594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-858b57cc-8d86-4e26-bf02-03a475063dec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:24.764122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-858b57cc-8d86-4e26-bf02-03a475063dec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1392408721/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.065400 Sep 01 04:46:24.769847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 20/37] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Sep 1 04:46:24 2022] GET /compute/v2.1/flavors/1392408721/os-flavor-access => generated 91 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:46:24.780551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7edcfe38-4f65-4855-a090-1abf0e3a084f tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7edcfe38-4f65-4855-a090-1abf0e3a084f tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 27 Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:24.804929 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: {"aggregate": {"name": ""}} Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:24.806990 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:24.808143 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 01 04:46:24.809942 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.813428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7edcfe38-4f65-4855-a090-1abf0e3a084f tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:24.815193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7edcfe38-4f65-4855-a090-1abf0e3a084f tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.043048 Sep 01 04:46:24.816133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 21/38] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:46:24.826913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-757dea37-f05d-4f28-a0b6-5863f5010a83 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.864637 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-757dea37-f05d-4f28-a0b6-5863f5010a83 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1392408721" status: 202 len: 0 microversion: 2.1 time: 0.041464 Sep 01 04:46:24.865300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:46:24 2022] DELETE /compute/v2.1/flavors/1392408721 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:24.880226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-778db853-102f-4882-b7fe-609d4537c0bf tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-644882013"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.886988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-778db853-102f-4882-b7fe-609d4537c0bf tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5349ae268be44f1ba7762eda25816148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d394885a2343438400d36c85f38385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-778db853-102f-4882-b7fe-609d4537c0bf tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Request method failure captured: Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 59 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkYmVyytTIlfbFhY3A02omcyu_IdM72gWZnt1yFVAtcUAMzHezmRMRh_9kIW793rQc4bnI6eEhuCH_msZNG4VFmkc3bxTHTPh3k5FK0zZBNBVtxqnxgyy95--fsAL7LnpWyKV9fXZZMo13z5FyXxZ77WCKbZIJCNjAOIZmDkz5s1K0 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:24.889051 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5d394885a2343438400d36c85f38385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5d394885a2343438400d36c85f38385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5349ae268be44f1ba7762eda25816148 Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: {"aggregate": {"name": "tempest-test_aggregate-644882013"}} Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:24.890372 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-644882013'}}} Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:24.891202 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:24.892330 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 01 04:46:24.893410 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:24.894873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-778db853-102f-4882-b7fe-609d4537c0bf tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:24.897234 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-778db853-102f-4882-b7fe-609d4537c0bf tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029773 Sep 01 04:46:24.899288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 23/40] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:24.907313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04fb9406-6528-466a-a89c-a928a551f0fd tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:24.937572 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04fb9406-6528-466a-a89c-a928a551f0fd tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036371 Sep 01 04:46:24.938879 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 24/41] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:24.948678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82b46105-62d3-49e9-87fe-23b70a4e2cff tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-865117693"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:24.954747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-82b46105-62d3-49e9-87fe-23b70a4e2cff tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 439bc8b6-ff1c-498b-a4e3-4d240ad7be75 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:24.989654 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82b46105-62d3-49e9-87fe-23b70a4e2cff tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.049042 Sep 01 04:46:24.991222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 25/42] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.008988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d633137-fbe4-43e9-8f5a-020288155675 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-96724863", "id": 2034307251, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.049693 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d633137-fbe4-43e9-8f5a-020288155675 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.056700 Sep 01 04:46:25.051492 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 26/43] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/flavors => generated 437 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.056860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cafdef66-b52b-4202-a2d0-8137e7e4c6d6 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-865117693"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.071168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-cafdef66-b52b-4202-a2d0-8137e7e4c6d6 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid db8ddab7-d54f-432f-9b3d-e797983ce78e for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:25.092411 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cafdef66-b52b-4202-a2d0-8137e7e4c6d6 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-865117693 already exists. Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cafdef66-b52b-4202-a2d0-8137e7e4c6d6 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 59 Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:25.096841 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: {"aggregate": {"name": "tempest-test_aggregate-865117693"}} Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:25.098775 n-d-820368-37 devstack@n-api.service[128862]: exception: Aggregate tempest-test_aggregate-865117693 already exists. Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-865117693'}}} Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 01 04:46:25.099609 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-865117693 already exists. Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:25.100756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-865117693 already exists. Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-865117693 already exists. Sep 01 04:46:25.102027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.107537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cafdef66-b52b-4202-a2d0-8137e7e4c6d6 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-865117693 already exists. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.109082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cafdef66-b52b-4202-a2d0-8137e7e4c6d6 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.056397 Sep 01 04:46:25.111801 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 27/44] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:46:25.127756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a0842d0-bfb1-4fb2-81eb-fedb633201bd tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 296 microversion: 2.41 time: 0.800017 Sep 01 04:46:25.133921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 18/45] 10.222.0.26 () {62 vars in 1232 bytes} [Thu Sep 1 04:46:24 2022] POST /compute/v2.1/os-aggregates/2/action => generated 296 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:25.140404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa84209b-6690-4f55-a030-31906ebe8d17 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.170334 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa84209b-6690-4f55-a030-31906ebe8d17 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.032968 Sep 01 04:46:25.171363 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 19/46] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:25.176744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-469a3ff1-4e29-4933-b7dd-13d02a0761c6 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.204550 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-469a3ff1-4e29-4933-b7dd-13d02a0761c6 tempest-AggregatesAdminTestV241-1109340516 tempest-AggregatesAdminTestV241-1109340516-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.031958 Sep 01 04:46:25.205869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 20/47] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.212480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c35b6b1-a686-4ac0-b24a-dc2b76f6da93 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1824619869"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.226801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-4c35b6b1-a686-4ac0-b24a-dc2b76f6da93 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 3f700e8e-5d77-4672-a892-ba3ff65d1ee3 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:25.250717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c35b6b1-a686-4ac0-b24a-dc2b76f6da93 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043186 Sep 01 04:46:25.252113 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 21/48] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.260980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cd12aa8-b21a-4c63-8920-c234dd15b087 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-488308519", "name": "tempest-test_aggregate-220179832"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.310361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-4cd12aa8-b21a-4c63-8920-c234dd15b087 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 5a8dbf07-56b7-442b-b9c3-f59141b74253 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:25.364390 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cd12aa8-b21a-4c63-8920-c234dd15b087 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.110265 Sep 01 04:46:25.366051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 22/49] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.372338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e951dfce-ee2e-4d43-a18d-f8756b47f182 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.375701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e951dfce-ee2e-4d43-a18d-f8756b47f182 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5349ae268be44f1ba7762eda25816148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d394885a2343438400d36c85f38385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e951dfce-ee2e-4d43-a18d-f8756b47f182 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Request method failure captured: Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkYmVyytTIlfbFhY3A02omcyu_IdM72gWZnt1yFVAtcUAMzHezmRMRh_9kIW793rQc4bnI6eEhuCH_msZNG4VFmkc3bxTHTPh3k5FK0zZBNBVtxqnxgyy95--fsAL7LnpWyKV9fXZZMo13z5FyXxZ77WCKbZIJCNjAOIZmDkz5s1K0 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:46:25.381780 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5d394885a2343438400d36c85f38385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5d394885a2343438400d36c85f38385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 5349ae268be44f1ba7762eda25816148 Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 01 04:46:25.384209 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '6'} Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:25.385393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 01 04:46:25.386668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.388736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e951dfce-ee2e-4d43-a18d-f8756b47f182 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.389065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e951dfce-ee2e-4d43-a18d-f8756b47f182 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.021410 Sep 01 04:46:25.390070 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 23/50] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:25.400558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1618b9d7-e4d6-4ddf-8fcf-4e4c138a5926 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.416022 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1618b9d7-e4d6-4ddf-8fcf-4e4c138a5926 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.024551 Sep 01 04:46:25.416618 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 24/51] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:46:25 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.421641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32e8c24f-879d-4b0c-9fba-7f92fb848260 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.457051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32e8c24f-879d-4b0c-9fba-7f92fb848260 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.039103 Sep 01 04:46:25.463158 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 25/52] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:25.473653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b313fb3-9628-44a0-8600-b8599defe8d9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.487255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b313fb3-9628-44a0-8600-b8599defe8d9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:25.488060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b313fb3-9628-44a0-8600-b8599defe8d9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:25.489360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b313fb3-9628-44a0-8600-b8599defe8d9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:25.527295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e25c8f1b-eb42-4b83-be29-6392a0ddb51d tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.535757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e25c8f1b-eb42-4b83-be29-6392a0ddb51d tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '371c56908063433a82e20d7b80e84372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efa44c33f344a5ea18f792013e5076b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e25c8f1b-eb42-4b83-be29-6392a0ddb51d tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Request method failure captured: Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/flavors/2034307251/action HTTP/1.1 Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 67 Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkZVpniSe6lfxiXvHb9GzOWSM9BjqpE0xKDcKnYXDkPt7DbaHNmQ0MMLMHDpxOffeuUYO9YmuD_yT-F83FY_ZSm2uJb-_oVBlEv_TsmksztWqeHlI8jX2EWYfelXu1cya9E7vnWg7XNKrUNgH_BxlPMk6_VUF-vaBv94cMl-QW_oUs Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1efa44c33f344a5ea18f792013e5076b Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1566698300 Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:25.542904 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1566698300 Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1efa44c33f344a5ea18f792013e5076b Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1566698300 Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsAccessNegativeTestJSON-1566698300-project Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 371c56908063433a82e20d7b80e84372 Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1566698300-project Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: {"addTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} Sep 01 04:46:25.544028 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2034307251', 'body': {'addTenantAccess': {'tenant': '1efa44c33f344a5ea18f792013e5076b'}}} Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:25.544748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 01 04:46:25.545708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.547945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e25c8f1b-eb42-4b83-be29-6392a0ddb51d tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.550783 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e25c8f1b-eb42-4b83-be29-6392a0ddb51d tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] 10.222.0.26 "POST /compute/v2.1/flavors/2034307251/action" status: 403 len: 130 microversion: 2.1 time: 0.435096 Sep 01 04:46:25.551633 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 28/53] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/flavors/2034307251/action => generated 130 bytes in 437 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:25.562865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12ac2d6b-0a7a-410e-9a61-7cac2dfb588a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.591466 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-12ac2d6b-0a7a-410e-9a61-7cac2dfb588a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12ac2d6b-0a7a-410e-9a61-7cac2dfb588a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:25.593181 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: exception: Aggregate -1 could not be found. Sep 01 04:46:25.594450 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '-1'} Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 01 04:46:25.595144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.596201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12ac2d6b-0a7a-410e-9a61-7cac2dfb588a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12ac2d6b-0a7a-410e-9a61-7cac2dfb588a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039449 Sep 01 04:46:25.597390 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 29/54] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:46:25.611059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fc695f1-ae00-4757-b061-0efc6d6a2c18 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.646831 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fc695f1-ae00-4757-b061-0efc6d6a2c18 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2034307251" status: 202 len: 0 microversion: 2.1 time: 0.050556 Sep 01 04:46:25.653043 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/flavors/2034307251 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:25.658329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.659039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:25.666833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:25.667406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:25.667946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:25.668795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:25.669615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:25.669821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:25.709506 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b313fb3-9628-44a0-8600-b8599defe8d9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 313 microversion: 2.1 time: 0.244918 Sep 01 04:46:25.710300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 26/56] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/os-aggregates/7/action => generated 313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.715400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aab86b7d-4966-4c3e-9f29-19bf4aef158d tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1813773697"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.720053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-aab86b7d-4966-4c3e-9f29-19bf4aef158d tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 88c1345c-0a35-4f30-a2c1-0dfca5f47896 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:46:25.752480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aab86b7d-4966-4c3e-9f29-19bf4aef158d tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040611 Sep 01 04:46:25.761269 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 27/57] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.768591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e30f4d7b-ff79-4fe5-a7fc-c1e7b62cd459 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.800004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:25.802455 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e30f4d7b-ff79-4fe5-a7fc-c1e7b62cd459 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039539 Sep 01 04:46:25.803304 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 28/58] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:25.808427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30db3f04-662b-4590-9f72-0058fb6c8d01 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.810107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30db3f04-662b-4590-9f72-0058fb6c8d01 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5349ae268be44f1ba7762eda25816148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d394885a2343438400d36c85f38385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30db3f04-662b-4590-9f72-0058fb6c8d01 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Request method failure captured: Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkYmVyytTIlfbFhY3A02omcyu_IdM72gWZnt1yFVAtcUAMzHezmRMRh_9kIW793rQc4bnI6eEhuCH_msZNG4VFmkc3bxTHTPh3k5FK0zZBNBVtxqnxgyy95--fsAL7LnpWyKV9fXZZMo13z5FyXxZ77WCKbZIJCNjAOIZmDkz5s1K0 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:46:25.812210 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5d394885a2343438400d36c85f38385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5d394885a2343438400d36c85f38385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 5349ae268be44f1ba7762eda25816148 Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 01 04:46:25.813499 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '8'} Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:25.827242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 01 04:46:25.828954 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.830128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffcd40ca-70c1-4a3d-a7b6-65aca8abaaba tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1277 microversion: 2.1 time: 0.160194 Sep 01 04:46:25.830128 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:25 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:25.830128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b2269a3-7c60-4055-8739-6bb2eaf45bd8 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-888844867", "id": 2060227544, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.831844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30db3f04-662b-4590-9f72-0058fb6c8d01 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.832966 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30db3f04-662b-4590-9f72-0058fb6c8d01 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.028562 Sep 01 04:46:25.837498 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 29/60] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 04:46:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:25.842971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77585687-7b67-4ea2-ac37-0cebd05af23d tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.874563 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b2269a3-7c60-4055-8739-6bb2eaf45bd8 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.048732 Sep 01 04:46:25.875067 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77585687-7b67-4ea2-ac37-0cebd05af23d tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.035826 Sep 01 04:46:25.876199 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/flavors => generated 438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:25.881242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 30/62] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:25.895823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8219ac47-8e98-4c92-8252-d54bff91fe73 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.899252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1516597c-1da6-4981-9bd4-a8c46cf41862 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:25.914250 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8219ac47-8e98-4c92-8252-d54bff91fe73 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8219ac47-8e98-4c92-8252-d54bff91fe73 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:46:25.919074 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: exception: Aggregate -1 could not be found. Sep 01 04:46:25.920310 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '-1'} Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.921557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 01 04:46:25.922757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.926862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8219ac47-8e98-4c92-8252-d54bff91fe73 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.928159 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8219ac47-8e98-4c92-8252-d54bff91fe73 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036354 Sep 01 04:46:25.929444 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 31/63] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:46:25 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:46:25.941974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b6335ea-86ff-4827-a3b8-bd22b58d78a5 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:25.944400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b6335ea-86ff-4827-a3b8-bd22b58d78a5 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5349ae268be44f1ba7762eda25816148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d394885a2343438400d36c85f38385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b6335ea-86ff-4827-a3b8-bd22b58d78a5 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Request method failure captured: Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkYmVyytTIlfbFhY3A02omcyu_IdM72gWZnt1yFVAtcUAMzHezmRMRh_9kIW793rQc4bnI6eEhuCH_msZNG4VFmkc3bxTHTPh3k5FK0zZBNBVtxqnxgyy95--fsAL7LnpWyKV9fXZZMo13z5FyXxZ77WCKbZIJCNjAOIZmDkz5s1K0 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:46:25.946181 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5d394885a2343438400d36c85f38385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5d394885a2343438400d36c85f38385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 5349ae268be44f1ba7762eda25816148 Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 01 04:46:25.947828 n-d-820368-37 devstack@n-api.service[128863]: action_args: {} Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:25.948611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 01 04:46:25.949799 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:25.951684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b6335ea-86ff-4827-a3b8-bd22b58d78a5 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:25.952757 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b6335ea-86ff-4827-a3b8-bd22b58d78a5 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018366 Sep 01 04:46:25.953460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:46:25 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:46:26.472067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-483632159", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "availability_zone": "tempest-test_az-488308519"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:26.489396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:26.490439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:26.491077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:26.492240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:26.492959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:26.493672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:26.582777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:46:26.633293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1516597c-1da6-4981-9bd4-a8c46cf41862 tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2060227544/action" status: 200 len: 97 microversion: 2.1 time: 0.742093 Sep 01 04:46:26.633937 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Sep 1 04:46:25 2022] POST /compute/v2.1/flavors/2060227544/action => generated 97 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:26.657690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-975573a6-fcf3-4c71-b50d-d6613fa56151 tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:26.664001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-975573a6-fcf3-4c71-b50d-d6613fa56151 tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '371c56908063433a82e20d7b80e84372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efa44c33f344a5ea18f792013e5076b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-975573a6-fcf3-4c71-b50d-d6613fa56151 tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Request method failure captured: Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/flavors/2060227544/action HTTP/1.1 Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 70 Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkZVpniSe6lfxiXvHb9GzOWSM9BjqpE0xKDcKnYXDkPt7DbaHNmQ0MMLMHDpxOffeuUYO9YmuD_yT-F83FY_ZSm2uJb-_oVBlEv_TsmksztWqeHlI8jX2EWYfelXu1cya9E7vnWg7XNKrUNgH_BxlPMk6_VUF-vaBv94cMl-QW_oUs Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1efa44c33f344a5ea18f792013e5076b Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1566698300 Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:26.678224 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1efa44c33f344a5ea18f792013e5076b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1566698300 Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1efa44c33f344a5ea18f792013e5076b Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1566698300 Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsAccessNegativeTestJSON-1566698300-project Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 371c56908063433a82e20d7b80e84372 Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1566698300-project Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: {"removeTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} Sep 01 04:46:26.679960 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2060227544', 'body': {'removeTenantAccess': {'tenant': '1efa44c33f344a5ea18f792013e5076b'}}} Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can( Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:26.680810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 01 04:46:26.683752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:26.686034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-975573a6-fcf3-4c71-b50d-d6613fa56151 tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:26.686034 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-975573a6-fcf3-4c71-b50d-d6613fa56151 tempest-FlavorsAccessNegativeTestJSON-1566698300 tempest-FlavorsAccessNegativeTestJSON-1566698300-project] 10.222.0.26 "POST /compute/v2.1/flavors/2060227544/action" status: 403 len: 133 microversion: 2.1 time: 0.031346 Sep 01 04:46:26.686034 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Sep 1 04:46:26 2022] POST /compute/v2.1/flavors/2060227544/action => generated 133 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:26.708821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e264460e-c830-486e-b8f7-105029b9cc3b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1efa44c33f344a5ea18f792013e5076b"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:27.108479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:46:27.109310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:46:27.110010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:46:27.110635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:46:27.111296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:46:27.134481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:27.140481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:27.141936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:27.144231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:27.147172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:27.152878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:27.243627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Getting quotas for project 8b9254bc3b5a475aa46ad6cff7f4b431. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:27.250879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Getting quotas for user c455ebe8e8b34ba483438f2d2f7c4755 and project 8b9254bc3b5a475aa46ad6cff7f4b431. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:27.284439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:46:27.293049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:46:27.411662 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0abb7126-6fa4-4047-be8e-82005eecfbf6 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179291 Sep 01 04:46:27.413326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:46:27.427995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:27.428909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:27.444791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:27.445587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:27.446494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:27.447793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:27.448473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:27.449258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:27.990294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e264460e-c830-486e-b8f7-105029b9cc3b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2060227544/action" status: 200 len: 21 microversion: 2.1 time: 1.293101 Sep 01 04:46:27.992209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Sep 1 04:46:26 2022] POST /compute/v2.1/flavors/2060227544/action => generated 21 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:28.006717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84a9ad56-d955-40b7-a541-3d96a9253fdc tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:28.009717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-84a9ad56-d955-40b7-a541-3d96a9253fdc tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:28.121804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:28.177210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84a9ad56-d955-40b7-a541-3d96a9253fdc tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:28.177713 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6d92159-3fcb-4e76-b4fd-1b4111779ade tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.761768 Sep 01 04:46:28.188012 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:27 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:28.192120 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84a9ad56-d955-40b7-a541-3d96a9253fdc tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1241 microversion: 2.1 time: 0.196198 Sep 01 04:46:28.208679 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 36/70] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:27 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:28.235463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-721441af-d778-4599-8d5c-c1fd6ea6ebec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:28.290696 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-721441af-d778-4599-8d5c-c1fd6ea6ebec tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2060227544" status: 202 len: 0 microversion: 2.1 time: 0.079432 Sep 01 04:46:28.294306 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 37/71] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:46:28 2022] DELETE /compute/v2.1/flavors/2060227544 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:28.308922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da369033-fbbd-4a66-b794-1e11dce7a3ef tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:28.367569 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da369033-fbbd-4a66-b794-1e11dce7a3ef tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071700 Sep 01 04:46:28.383241 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 38/72] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:28.393294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc87ac9a-44a0-4fe1-99e3-1db718a82e8e tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1987365215", "id": 351884255, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:28.442756 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc87ac9a-44a0-4fe1-99e3-1db718a82e8e tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.048649 Sep 01 04:46:28.453493 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 39/73] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:28 2022] POST /compute/v2.1/flavors => generated 436 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:28.469963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a36aa4f-b9eb-44ae-a535-4fc883f5ca8b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b35bd5de300148e989596491ce30c6dc"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:29.117822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d298580-8fbb-4884-89d5-72e8e95c1bb6 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '.version_select at 0x7fa760a7aee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:29.965411 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5a36aa4f-b9eb-44ae-a535-4fc883f5ca8b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] HTTP exception thrown: Flavor access not found for 19 / b35bd5de300148e989596491ce30c6dc combination. Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a36aa4f-b9eb-44ae-a535-4fc883f5ca8b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Request method failure captured: Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/flavors/351884255/action HTTP/1.1 Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 70 Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkcZ1cdbl3pN-mZEP-jG6DxdVGXL_igzMGEkZF9ye5rcHeaqTtkclBeU_0NjQbKYlt-eMug8GzNQdPFMwILL09x2xWK29pNXgc9M75dEF1lWyDy831rQmHTPMyyPxvJos6nUI2XpidJs9mx_R-OM68uWDO7v05FRDmuKregSqJ3HFM Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 13f3690d7b4042f7bfa63ac2b83a392a Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:29.968192 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13f3690d7b4042f7bfa63ac2b83a392a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 13f3690d7b4042f7bfa63ac2b83a392a Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-494378175 Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cc6735b4849a42199e9df01c2eb6a970 Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: {"removeTenantAccess": {"tenant": "b35bd5de300148e989596491ce30c6dc"}} Sep 01 04:46:29.969567 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: exception: Flavor access not found for 19 / b35bd5de300148e989596491ce30c6dc combination. Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '351884255', 'body': {'removeTenantAccess': {'tenant': 'b35bd5de300148e989596491ce30c6dc'}}} Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 01 04:46:29.970376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 19 / b35bd5de300148e989596491ce30c6dc combination. Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 19 / b35bd5de300148e989596491ce30c6dc combination. Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:29.971735 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:29.973031 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:29.973031 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:29.973031 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:29.973031 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:29.973031 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 19 / b35bd5de300148e989596491ce30c6dc combination. Sep 01 04:46:29.973031 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:29.974292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a36aa4f-b9eb-44ae-a535-4fc883f5ca8b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Returning 404 to user: Flavor access not found for 19 / b35bd5de300148e989596491ce30c6dc combination. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:29.975321 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a36aa4f-b9eb-44ae-a535-4fc883f5ca8b tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/351884255/action" status: 404 len: 124 microversion: 2.1 time: 1.520770 Sep 01 04:46:29.976051 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 40/74] 10.222.0.26 () {60 vars in 1197 bytes} [Thu Sep 1 04:46:28 2022] POST /compute/v2.1/flavors/351884255/action => generated 124 bytes in 1522 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:29.983990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:29.984880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:29.993267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:29.994018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:29.994609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:29.995525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:29.996132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:29.996753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:30.006512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d298580-8fbb-4884-89d5-72e8e95c1bb6 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a" status: 200 len: 371 microversion: 2.1 time: 1.809865 Sep 01 04:46:30.008892 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 35/75] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 04:46:28 2022] GET /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a => generated 371 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:30.018612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:30.045723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:30.076364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:30.077129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:30.079232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:30.081953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:30.083570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:30.084431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:30.469154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:30.483356 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-825526c7-7dcc-41db-ac1a-32d2d0ae6722 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1289 microversion: 2.1 time: 0.469866 Sep 01 04:46:30.495232 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 36/76] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:30 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1289 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:30.499092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c4c2689-8396-4b5b-957e-1f9a417ed30d tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:30.546071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c4c2689-8396-4b5b-957e-1f9a417ed30d tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/351884255" status: 202 len: 0 microversion: 2.1 time: 0.058370 Sep 01 04:46:30.547895 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 37/77] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:46:30 2022] DELETE /compute/v2.1/flavors/351884255 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:30.557486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Action: 'update', calling method: .version_select at 0x7fa760913dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:30.645530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:30.662838 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1b91c6d-c970-4c4d-841a-8fddda295a46 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.685570 Sep 01 04:46:30.683870 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 41/78] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:29 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:30.694005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5416cfce-077b-44db-a5e7-684e8c2858cc tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:30.729560 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5416cfce-077b-44db-a5e7-684e8c2858cc tempest-FlavorsAccessNegativeTestJSON-494378175 tempest-FlavorsAccessNegativeTestJSON-494378175-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044007 Sep 01 04:46:30.757361 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 42/79] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:31.467585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.468818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.469687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.472553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.476245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.478822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.558318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=12,nova_api:INSERT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:31.655586 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e8dcab6-6e5d-4b2f-9cde-bca07f6835fd tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a" status: 200 len: 328 microversion: 2.1 time: 1.106858 Sep 01 04:46:31.658975 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 38/80] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:46:30 2022] PUT /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a => generated 328 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:31.671916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:31.678373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:31.701578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.703269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.705549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.708655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.709556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.710144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.723634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:31.768764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e8561b-07d9-4397-b561-24974c2640a3", "tag": "946fa3b6-24ff-4ca9-9596-0c2a3d8f5756"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:31.819586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.821288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.824122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.908948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Creating event network-changed:946fa3b6-24ff-4ca9-9596-0c2a3d8f5756 for instance 88e8561b-07d9-4397-b561-24974c2640a3 on n-h2-820368-37 Sep 01 04:46:31.910011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:46:31.910553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c248dc8-5197-4c6d-b1d5-1bdfb3867cc1 req-79f80a3e-63fb-479c-b996-94ee52536cc9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:46:31.911855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.913336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.914602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.916591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:31.918824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:31.919472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:31.937101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.rpcapi [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 04:46:31.940058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:46:31.947864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:31.956653 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04d5e35d-455c-4ed7-9b3a-ac7d2b906a4f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1295 microversion: 2.1 time: 0.295069 Sep 01 04:46:31.965755 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 39/81] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:31 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1295 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:31.973526 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab96d70d-8afd-4154-8aa0-4b835d7129a3 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.214675 Sep 01 04:46:31.974823 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 43/82] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:31.986126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9f5651b-fccc-4537-bce8-89c2a47583e2 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:31.986916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:31.989134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:32.008260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:32.008260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:32.008584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:32.009385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:32.013635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:32.019270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:32.021624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9f5651b-fccc-4537-bce8-89c2a47583e2 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a" status: 202 len: 0 microversion: 2.1 time: 0.049390 Sep 01 04:46:32.026746 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 40/83] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 04:46:31 2022] DELETE /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:32.045930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce2d8c9a-4f41-463f-902b-e2a24122dd53 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '.version_select at 0x7fa760897790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:32.633585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:32.653969 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5dd8580f-9628-4a0f-ae6c-865100ae6591 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.675653 Sep 01 04:46:32.654602 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 44/84] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:31 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:33.170595 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce2d8c9a-4f41-463f-902b-e2a24122dd53 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a" status: 200 len: 371 microversion: 2.1 time: 1.137637 Sep 01 04:46:33.176013 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 41/85] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 04:46:32 2022] GET /compute/v2.1/os-quota-sets/8d352fa6df474ee3b4ca869e77016c5a => generated 371 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:33.191163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:33.192880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:33.202046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:33.204463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:33.205173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:33.206240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:33.207222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:33.208680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:33.447296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6319844e-75bf-42ce-a49a-a826e82cf1f6 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-609053133", "id": 2083307182, "os-flavor-access:is_public": "False"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:33.487374 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6319844e-75bf-42ce-a49a-a826e82cf1f6 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.828633 Sep 01 04:46:33.500814 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 45/86] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:32 2022] POST /compute/v2.1/flavors => generated 430 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:33.505330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:33.512531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ac52cc6-4b16-44b6-9da8-0b2f6d5ae254 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d2e5f30340804e4da2cefee35e120fab"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:33.531528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00addf94-88a5-4bdc-890f-b15f40552137 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.353679 Sep 01 04:46:33.543731 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 42/87] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:33 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:33.680079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:33.680704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:33.691867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:33.693458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:33.694144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:33.695145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:33.695810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:33.696606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:33.888310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:33.901200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3712a8d4-2bea-4aaa-b95d-8e7c6e19659e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.225250 Sep 01 04:46:33.903395 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 43/88] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:33 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:33.911287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-220489dc-abba-4db4-9de2-40c4910a8f83 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '.version_select at 0x7fa760897310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:34.484519 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ac52cc6-4b16-44b6-9da8-0b2f6d5ae254 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2083307182/action" status: 200 len: 97 microversion: 2.1 time: 0.982197 Sep 01 04:46:34.495532 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 46/89] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Sep 1 04:46:33 2022] POST /compute/v2.1/flavors/2083307182/action => generated 97 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:35.229053 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-220489dc-abba-4db4-9de2-40c4910a8f83 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714/defaults" status: 200 len: 371 microversion: 2.1 time: 1.324086 Sep 01 04:46:35.232421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 44/90] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:46:33 2022] GET /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714/defaults => generated 371 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:35.254188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:35.256089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:35.283881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:35.285659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:35.288616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:35.290467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:35.294496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:35.297477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:35.450862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9628a2f4-ffc2-47c1-bdd7-4b1036ffda42 tempest-FlavorsAccessTestJSON-704067735 tempest-FlavorsAccessTestJSON-704067735-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:35.534251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=13,nova_api:INSERT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:35.609644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:35.620816 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a2ad32d-54ac-4867-ac5f-441a2b47d476 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.386086 Sep 01 04:46:35.621008 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9628a2f4-ffc2-47c1-bdd7-4b1036ffda42 tempest-FlavorsAccessTestJSON-704067735 tempest-FlavorsAccessTestJSON-704067735-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 1.123676 Sep 01 04:46:35.621746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 47/91] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:34 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:35.622576 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 45/92] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:35 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:35.628161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:35.629950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:35.637530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:35.638701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:35.639535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:35.640526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:35.641203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:35.642095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:35.665973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f22f0131-8f32-4cd5-925b-9ad829485fcd tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d2e5f30340804e4da2cefee35e120fab"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:36.081015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:36.098156 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad0b96f5-7a43-4e4e-8131-3bcdfc20ad9d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.472738 Sep 01 04:46:36.116420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 46/93] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:35 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:36.658336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:36.659200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:36.692732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:36.696259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:36.697208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:36.701616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:36.702409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:36.706810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:37.149143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:37.159403 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f5ecb4a-e261-4b2a-8a90-2ccc5c4df62f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.508489 Sep 01 04:46:37.187364 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 47/94] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:36 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:37.192717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:37.193337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:37.249886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:37.259971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:37.260962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:37.262178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:37.262843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:37.265532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:37.370313 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f22f0131-8f32-4cd5-925b-9ad829485fcd tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2083307182/action" status: 200 len: 21 microversion: 2.1 time: 1.720686 Sep 01 04:46:37.374000 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 48/95] 10.222.0.26 () {60 vars in 1200 bytes} [Thu Sep 1 04:46:35 2022] POST /compute/v2.1/flavors/2083307182/action => generated 21 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:37.394431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43d243b4-553f-4a66-b045-7b9c1dd95d0b tempest-FlavorsAccessTestJSON-704067735 tempest-FlavorsAccessTestJSON-704067735-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:37.473402 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43d243b4-553f-4a66-b045-7b9c1dd95d0b tempest-FlavorsAccessTestJSON-704067735 tempest-FlavorsAccessTestJSON-704067735-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091748 Sep 01 04:46:37.480611 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 49/96] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:37.501900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5988a91-38d7-4aec-b2d6-40445b5c7e2f tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:37.574061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5988a91-38d7-4aec-b2d6-40445b5c7e2f tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2083307182" status: 202 len: 0 microversion: 2.1 time: 0.079499 Sep 01 04:46:37.583489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 50/97] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:46:37 2022] DELETE /compute/v2.1/flavors/2083307182 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:37.590118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74a2bcab-bec0-4224-ba0e-fac28a3c0802 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:37.631047 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74a2bcab-bec0-4224-ba0e-fac28a3c0802 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045609 Sep 01 04:46:37.649034 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 51/98] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:37.667601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Action: 'update', calling method: .version_select at 0x7fa7608c83a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:37.770599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:37.784707 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b74c54c-c57f-4ecd-93fc-167e61aa5a0d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.595896 Sep 01 04:46:37.809437 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 48/99] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:37 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:37.818028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3f5654f-91c6-4a17-a80f-7ca82bf68bdc tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1697716287", "id": 627707258, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:37.864617 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3f5654f-91c6-4a17-a80f-7ca82bf68bdc tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.053558 Sep 01 04:46:37.873139 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 49/100] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:37.883366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78bba95d-f06b-4aaf-bfaf-694bb6cbd461 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:37.916463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78bba95d-f06b-4aaf-bfaf-694bb6cbd461 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/627707258/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.042033 Sep 01 04:46:37.923220 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1206 bytes} [Thu Sep 1 04:46:37 2022] GET /compute/v2.1/flavors/627707258/os-flavor-access => generated 21 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:37.929834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0382184-be8c-4e62-97c0-87b86eca68ac tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:37.976199 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0382184-be8c-4e62-97c0-87b86eca68ac tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/627707258" status: 202 len: 0 microversion: 2.1 time: 0.051551 Sep 01 04:46:37.977178 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 51/102] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:46:37 2022] DELETE /compute/v2.1/flavors/627707258 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:37.996904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5948bebd-7729-47df-baa6-520ba9029050 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:38.037062 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5948bebd-7729-47df-baa6-520ba9029050 tempest-FlavorsAccessTestJSON-126126030 tempest-FlavorsAccessTestJSON-126126030-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043832 Sep 01 04:46:38.061818 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 52/103] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:38.183873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:38.185182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:38.223407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:38.225730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:38.228878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:38.230020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:38.231108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:38.234925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:38.235785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:38.236318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:38.237098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:38.244273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:38.246721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:38.247939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:38.462129 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-537a7d8f-66cd-4ffd-a7b9-b1f4bd1a7e92 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f" status: 200 len: 328 microversion: 2.1 time: 0.811767 Sep 01 04:46:38.478856 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 52/104] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:46:37 2022] PUT /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f => generated 328 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:38.492332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '.version_select at 0x7fa7608801f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:38.761802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:38.785709 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31f9e1b4-a495-4239-8932-cf41dbc8f445 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.606103 Sep 01 04:46:38.787686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 53/105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:38 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:39.598735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:39.600442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:39.601352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:39.602772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:39.603844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:39.604817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:39.634810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9939c526-2c2e-465f-a4a9-5763a7301e9a tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1745024553", "ram": 512, "vcpus": 1, "disk": 10, "id": 739634513, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:39.637787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f223992e-9dfa-4d59-86db-6ac1b4b72888 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f/detail" status: 200 len: 916 microversion: 2.1 time: 1.156523 Sep 01 04:46:39.639040 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 53/106] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:46:38 2022] GET /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f/detail => generated 916 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:39.644150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:39.645267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:39.658918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:39.660526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:39.661163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:39.662245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:39.663109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:39.663881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:39.696246 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9939c526-2c2e-465f-a4a9-5763a7301e9a tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.906888 Sep 01 04:46:39.698319 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 54/107] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:38 2022] POST /compute/v2.1/flavors => generated 413 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:40.015241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a7b786-bbb6-4e29-89fb-b90fc5b22085", "tag": "25eec357-45b7-472f-812a-fa86d731a178"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:40.020291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:40.042254 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aab640ab-d0d0-49f4-a732-eb474d88de27 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.401765 Sep 01 04:46:40.044103 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 54/108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:39 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:40.046757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:40.047556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:40.048338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:40.071001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a66f306-72cf-4e11-bd32-406f7efe8047 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:40.082207 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Creating event network-changed:25eec357-45b7-472f-812a-fa86d731a178 for instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 on n-h1-820368-37 Sep 01 04:46:40.082730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:46:40.083342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39446873-f363-41d1-89ec-e66e3881e19f req-9d9ce480-03ae-4220-a062-00ad572803cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:46:40.084613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:40.086294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:40.086940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:40.087954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:40.089342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:40.090564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:40.110315 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.compute.rpcapi [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 04:46:40.111563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] Releasing lock "compute-rpcapi-router" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:46:40.137534 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55bf5135-c15c-4065-9383-778e7f54dee3 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436234 Sep 01 04:46:40.139171 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 55/109] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:40.149017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:40.149865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:40.160721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:40.162664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:40.163802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:40.165400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:40.166351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:40.167006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:40.192792 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a66f306-72cf-4e11-bd32-406f7efe8047 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.131418 Sep 01 04:46:40.200023 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 55/110] 10.222.0.26 () {60 vars in 1221 bytes} [Thu Sep 1 04:46:40 2022] POST /compute/v2.1/flavors/739634513/os-extra_specs => generated 66 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:40.551562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:40.561389 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68092ce1-001a-4cd8-962d-8a888ec53b00 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.420801 Sep 01 04:46:40.562823 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 56/111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:40 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:40.667276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Action: 'update', calling method: .version_select at 0x7fa760913f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:40.863836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-680ed3bc-4f8c-4139-bb85-3c29f182067e tempest-FlavorsExtraSpecsTestJSON-1316302784 tempest-FlavorsExtraSpecsTestJSON-1316302784-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:40.911343 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-680ed3bc-4f8c-4139-bb85-3c29f182067e tempest-FlavorsExtraSpecsTestJSON-1316302784 tempest-FlavorsExtraSpecsTestJSON-1316302784-project] 10.222.0.26 "GET /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.708755 Sep 01 04:46:40.912295 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 56/112] 10.222.0.26 () {58 vars in 1200 bytes} [Thu Sep 1 04:46:40 2022] GET /compute/v2.1/flavors/739634513/os-extra_specs => generated 66 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:40.925300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20093750-9f30-4778-8b57-5c64adc1c627 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:40.966274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20093750-9f30-4778-8b57-5c64adc1c627 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046404 Sep 01 04:46:40.967720 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 57/113] 10.222.0.26 () {60 vars in 1221 bytes} [Thu Sep 1 04:46:40 2022] POST /compute/v2.1/flavors/739634513/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 04:46:40.981141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb70bbe4-e8e3-4d0f-9517-a0cc9b9f4e1e tempest-FlavorsExtraSpecsTestJSON-1316302784 tempest-FlavorsExtraSpecsTestJSON-1316302784-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:41.016565 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb70bbe4-e8e3-4d0f-9517-a0cc9b9f4e1e tempest-FlavorsExtraSpecsTestJSON-1316302784 tempest-FlavorsExtraSpecsTestJSON-1316302784-project] 10.222.0.26 "GET /compute/v2.1/flavors/739634513/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.042017 Sep 01 04:46:41.018637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 58/114] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 04:46:40 2022] GET /compute/v2.1/flavors/739634513/os-extra_specs/hw:numa_nodes => generated 22 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 04:46:41.039368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d44001a9-776c-4641-9d2f-e7bea863288a tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:41.112409 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d44001a9-776c-4641-9d2f-e7bea863288a tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083299 Sep 01 04:46:41.114275 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 59/115] 10.222.0.26 () {60 vars in 1221 bytes} [Thu Sep 1 04:46:41 2022] POST /compute/v2.1/flavors/739634513/os-extra_specs => generated 66 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:41.119946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:41.121022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:41.134548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.134760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.135234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.136263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.137116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.137470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.353118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:41.369748 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46cbd8f2-3476-418b-be1c-3c95ab80439c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.252571 Sep 01 04:46:41.370355 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 60/116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:41 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:41.385466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4997120a-a964-4dc2-9396-1dee26d3006c tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:41.417503 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4997120a-a964-4dc2-9396-1dee26d3006c tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036764 Sep 01 04:46:41.420523 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 61/117] 10.222.0.26 () {58 vars in 1200 bytes} [Thu Sep 1 04:46:41 2022] GET /compute/v2.1/flavors/739634513/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:41.440609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f3023d9-1de4-446c-9b99-754180718cec tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:41.513430 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f3023d9-1de4-446c-9b99-754180718cec tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/739634513/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.085553 Sep 01 04:46:41.513994 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 62/118] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:46:41 2022] PUT /compute/v2.1/flavors/739634513/os-extra_specs/hw:numa_nodes => generated 22 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:41.532577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00060c58-4d19-4e63-bb27-dc678d144e6b tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:41.568645 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00060c58-4d19-4e63-bb27-dc678d144e6b tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047672 Sep 01 04:46:41.573715 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 63/119] 10.222.0.26 () {58 vars in 1200 bytes} [Thu Sep 1 04:46:41 2022] GET /compute/v2.1/flavors/739634513/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:41.581281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f78700b0-a86a-48d4-9411-9cd0934c9b4b tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:41.638179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:41.678190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f78700b0-a86a-48d4-9411-9cd0934c9b4b tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/739634513/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.102676 Sep 01 04:46:41.685348 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 64/120] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 04:46:41 2022] DELETE /compute/v2.1/flavors/739634513/os-extra_specs/hw:numa_nodes => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 01 04:46:41.705285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:41.706018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:41.730279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.732104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.732660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.736794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.737294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.737865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.806122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.808521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.808987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.812847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.816576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.819849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.884593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:41.991615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.993935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:41.995392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:41.999079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:41.999886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:42.001988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:42.188270 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a79022e7-914b-40ab-b279-1c91f683a088 tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f?user_id=f7134c0ae52c46d6b2d6e4b49dba7fa8" status: 200 len: 328 microversion: 2.1 time: 1.525332 Sep 01 04:46:42.198576 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 57/121] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:46:40 2022] PUT /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f?user_id=f7134c0ae52c46d6b2d6e4b49dba7fa8 => generated 328 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:42.205347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6d71c62-231f-406b-b8db-37e8b78f52f0 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:42.255488 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6d71c62-231f-406b-b8db-37e8b78f52f0 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/739634513/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.055265 Sep 01 04:46:42.260546 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 58/122] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 04:46:42 2022] DELETE /compute/v2.1/flavors/739634513/os-extra_specs/hw:cpu_policy => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:46:42.274870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-384f14dd-0f94-428a-bf26-80a46c6cdfaf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '.version_select at 0x7fa760856700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:42.401567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:42.415289 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3058cdf8-529e-4dfc-9e1f-f9336d6c0e7c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.728766 Sep 01 04:46:42.416154 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 65/123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:41 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:42.426868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76eb38fd-f530-471a-8695-b0aedc148672 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:42.455615 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76eb38fd-f530-471a-8695-b0aedc148672 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/739634513/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033491 Sep 01 04:46:42.459059 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 66/124] 10.222.0.26 () {58 vars in 1200 bytes} [Thu Sep 1 04:46:42 2022] GET /compute/v2.1/flavors/739634513/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:42.470803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:42.474177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:42.485974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:42.490512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:42.491405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:42.492395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:42.493031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:42.495390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:42.883736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:42.900275 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-315dd4be-c142-4db1-980e-b4903c2cd7a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.439863 Sep 01 04:46:42.901516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 67/125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:42 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:42.907764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61ce973e-9465-45cd-96f1-66fa0765cc56 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:42.941346 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61ce973e-9465-45cd-96f1-66fa0765cc56 tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/739634513" status: 202 len: 0 microversion: 2.1 time: 0.038298 Sep 01 04:46:42.945740 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 68/126] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:46:42 2022] DELETE /compute/v2.1/flavors/739634513 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:42.951213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8833b0f0-e5f2-4273-9022-c0d9513f969e tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:42.979919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8833b0f0-e5f2-4273-9022-c0d9513f969e tempest-FlavorsExtraSpecsTestJSON-1601264338 tempest-FlavorsExtraSpecsTestJSON-1601264338-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032870 Sep 01 04:46:42.980760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 69/127] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:43.052298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-384f14dd-0f94-428a-bf26-80a46c6cdfaf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f?user_id=f7134c0ae52c46d6b2d6e4b49dba7fa8" status: 200 len: 370 microversion: 2.1 time: 0.789081 Sep 01 04:46:43.054937 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 59/128] 10.222.0.26 () {58 vars in 1323 bytes} [Thu Sep 1 04:46:42 2022] GET /compute/v2.1/os-quota-sets/8aa84989956c43548539a8721731653f?user_id=f7134c0ae52c46d6b2d6e4b49dba7fa8 => generated 370 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:43.438334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:43.438993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:43.449004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:43.449911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:43.450601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:43.451990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:43.452579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:43.453271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:43.623126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:43.631440 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81b75e11-787f-4f53-8f72-e25246903d03 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.197006 Sep 01 04:46:43.645425 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 70/129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:43 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:43.812842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a649c42-5048-42e8-b417-a0e43e8df2eb tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Calling method '.version_select at 0x7fa760897550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:43.923289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:43.924225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:43.931360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:43.932744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:43.933739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:43.934806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:43.935461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:43.936151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:44.107479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:44.117361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-684b4d4e-496f-43e5-aebc-55a6d924e244 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.198700 Sep 01 04:46:44.118545 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 71/130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:43 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:44.402112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a649c42-5048-42e8-b417-a0e43e8df2eb tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714/defaults" status: 200 len: 371 microversion: 2.1 time: 0.592975 Sep 01 04:46:44.410255 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 60/131] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:46:43 2022] GET /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714/defaults => generated 371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:44.415697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Action: 'update', calling method: .version_select at 0x7fa7608488b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:44.736592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bc6c01d-1b04-4281-817e-c13aad10a807 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1922313525", "ram": 512, "vcpus": 1, "disk": 10, "id": 1285491547, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:44.757625 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1bc6c01d-1b04-4281-817e-c13aad10a807 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.458519 Sep 01 04:46:44.758326 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 72/132] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:46:44 2022] POST /compute/v2.1/flavors => generated 416 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:44.762824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:44.763666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:44.769691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:44.770613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:44.771333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:44.772012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:44.772450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:44.772870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:44.971337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:44.984374 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2575dd2-4d3f-46e9-9d1f-cd4d01b6e4d1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.224815 Sep 01 04:46:44.997964 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 73/133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:44 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:45.044499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:45.045004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:45.045455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:45.049178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:45.050583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:45.053006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:45.080102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:45.293297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1811dfec-ada2-4206-ad64-2a64b632fc3b tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:45.307193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1811dfec-ada2-4206-ad64-2a64b632fc3b tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] HTTP exception thrown: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1811dfec-ada2-4206-ad64-2a64b632fc3b tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Request method failure captured: Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/flavors/1285491547/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkx8EbrjguZ89kBjyiAOO-ob29EeQxW7JdVFdir7NtNVy5SuWe9cEaPWOHsq8jx3PI1xXjhHSvctc8Nh_1QcOcRyxsnBhwwOalvior7wBrrGnOmpyZ0j4Pp-SHS4iHt8bXG9fMZ-al1IDdKb55T13-RRtV3iHae_xEWsVCI4Zf7DUA Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:45.309166 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a3292c617754f64a3826b402ae971d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2d0be1b0c0f946ed9a752e6858fa4880 Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:45.310905 n-d-820368-37 devstack@n-api.service[128862]: exception: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'flavor_id': '1285491547', 'id': 'hw:cpu_thread_policy'} Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:45.311722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:45.313163 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.315917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1811dfec-ada2-4206-ad64-2a64b632fc3b tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Returning 404 to user: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:45.318193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1811dfec-ada2-4206-ad64-2a64b632fc3b tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] 10.222.0.26 "GET /compute/v2.1/flavors/1285491547/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.331535 Sep 01 04:46:45.319562 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 74/134] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 04:46:44 2022] GET /compute/v2.1/flavors/1285491547/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 333 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:45.326599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:45.327760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:45.335362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:45.336935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:45.336935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:45.337642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:45.338087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:45.338718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:45.358546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:45.364408 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ac6feb1-899a-4b48-99be-038f83cada0c tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714" status: 200 len: 329 microversion: 2.1 time: 0.953015 Sep 01 04:46:45.365785 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 61/135] 10.222.0.26 () {60 vars in 1263 bytes} [Thu Sep 1 04:46:44 2022] PUT /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714 => generated 329 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:45.373967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad7c9aed-031d-4852-bd66-9d8518d2206e tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:45.377762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad7c9aed-031d-4852-bd66-9d8518d2206e tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '2d0be1b0c0f946ed9a752e6858fa4880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3292c617754f64a3826b402ae971d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad7c9aed-031d-4852-bd66-9d8518d2206e tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Request method failure captured: Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/flavors/1285491547/os-extra_specs HTTP/1.1 Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 66 Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkx8EbrjguZ89kBjyiAOO-ob29EeQxW7JdVFdir7NtNVy5SuWe9cEaPWOHsq8jx3PI1xXjhHSvctc8Nh_1QcOcRyxsnBhwwOalvior7wBrrGnOmpyZ0j4Pp-SHS4iHt8bXG9fMZ-al1IDdKb55T13-RRtV3iHae_xEWsVCI4Zf7DUA Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:46:45.379818 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a3292c617754f64a3826b402ae971d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2d0be1b0c0f946ed9a752e6858fa4880 Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 01 04:46:45.381012 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'flavor_id': '1285491547', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:45.381647 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 01 04:46:45.382832 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.384776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad7c9aed-031d-4852-bd66-9d8518d2206e tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:45.384776 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad7c9aed-031d-4852-bd66-9d8518d2206e tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] 10.222.0.26 "POST /compute/v2.1/flavors/1285491547/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014481 Sep 01 04:46:45.387262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 62/136] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Sep 1 04:46:45 2022] POST /compute/v2.1/flavors/1285491547/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:45.393152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Action: 'update', calling method: .version_select at 0x7fa760848ca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:45.504694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:45.514187 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e30a8919-b818-4d54-90fb-c37a0bd8d1d1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.193066 Sep 01 04:46:45.514778 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 75/137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:45 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:45.520777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6c513a5-af9f-4dd8-af7f-6d80f533adf5 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:45.562024 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6c513a5-af9f-4dd8-af7f-6d80f533adf5 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1285491547/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046097 Sep 01 04:46:45.562634 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 76/138] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Sep 1 04:46:45 2022] POST /compute/v2.1/flavors/1285491547/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:45.575801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8c10893-85ef-4064-9c95-bce644c5efae tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:45.578573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8c10893-85ef-4064-9c95-bce644c5efae tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '2d0be1b0c0f946ed9a752e6858fa4880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3292c617754f64a3826b402ae971d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8c10893-85ef-4064-9c95-bce644c5efae tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Request method failure captured: Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkx8EbrjguZ89kBjyiAOO-ob29EeQxW7JdVFdir7NtNVy5SuWe9cEaPWOHsq8jx3PI1xXjhHSvctc8Nh_1QcOcRyxsnBhwwOalvior7wBrrGnOmpyZ0j4Pp-SHS4iHt8bXG9fMZ-al1IDdKb55T13-RRtV3iHae_xEWsVCI4Zf7DUA Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:45.583839 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a3292c617754f64a3826b402ae971d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2d0be1b0c0f946ed9a752e6858fa4880 Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:45.585300 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'flavor_id': '1285491547', 'id': 'hw:numa_nodes'} Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:45.585915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.587028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8c10893-85ef-4064-9c95-bce644c5efae tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:45.588287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8c10893-85ef-4064-9c95-bce644c5efae tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] 10.222.0.26 "DELETE /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011750 Sep 01 04:46:45.588287 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 77/139] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 04:46:45 2022] DELETE /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:46:45.596265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-524b9b6e-9c5f-449a-b5e7-d365bb995b80 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:45.630134 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-524b9b6e-9c5f-449a-b5e7-d365bb995b80 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1285491547/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038750 Sep 01 04:46:45.633685 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 78/140] 10.222.0.26 () {60 vars in 1224 bytes} [Thu Sep 1 04:46:45 2022] POST /compute/v2.1/flavors/1285491547/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:45.640396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5beeaa8e-3160-4336-b114-cb8cd7c495b3 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa7608af3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:45.705555 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5beeaa8e-3160-4336-b114-cb8cd7c495b3 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c" status: 200 len: 636 microversion: 2.1 time: 0.070429 Sep 01 04:46:45.706258 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 79/141] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:46:45 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c => generated 636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:45.722719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e3a6a7a-e2b9-4500-b457-ccdf0b0bbb68 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:45.726352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e3a6a7a-e2b9-4500-b457-ccdf0b0bbb68 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '2d0be1b0c0f946ed9a752e6858fa4880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3292c617754f64a3826b402ae971d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e3a6a7a-e2b9-4500-b457-ccdf0b0bbb68 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Request method failure captured: Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 22 Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkx8EbrjguZ89kBjyiAOO-ob29EeQxW7JdVFdir7NtNVy5SuWe9cEaPWOHsq8jx3PI1xXjhHSvctc8Nh_1QcOcRyxsnBhwwOalvior7wBrrGnOmpyZ0j4Pp-SHS4iHt8bXG9fMZ-al1IDdKb55T13-RRtV3iHae_xEWsVCI4Zf7DUA Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:46:45.728007 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a3292c617754f64a3826b402ae971d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a3292c617754f64a3826b402ae971d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9a3292c617754f64a3826b402ae971d5 Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2d0be1b0c0f946ed9a752e6858fa4880 Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: {"hw:numa_nodes": "1"} Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:45.729156 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'flavor_id': '1285491547', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:46:45.729989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 01 04:46:45.731027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:45.732480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e3a6a7a-e2b9-4500-b457-ccdf0b0bbb68 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:45.732480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e3a6a7a-e2b9-4500-b457-ccdf0b0bbb68 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233 tempest-FlavorsExtraSpecsNegativeTestJSON-59656233-project] 10.222.0.26 "PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012422 Sep 01 04:46:45.732480 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 80/142] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Sep 1 04:46:45 2022] PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:45.735839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc605c59-cf9b-449c-8399-0dee88441e36 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa7609d0160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:45.752164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:45.752628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:45.753064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:45.754644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:45.755124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:45.755719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:45.813365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fc605c59-cf9b-449c-8399-0dee88441e36 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:45.819586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fc605c59-cf9b-449c-8399-0dee88441e36 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:46.002303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:46.151497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=28,nova_api:UPDATE=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:46.168684 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc605c59-cf9b-449c-8399-0dee88441e36 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.436612 Sep 01 04:46:46.169087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 81/143] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:45 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:46.176660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feed8344-9e80-43b2-b43e-f51cff5513af tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:46.187755 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-feed8344-9e80-43b2-b43e-f51cff5513af tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] HTTP exception thrown: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feed8344-9e80-43b2-b43e-f51cff5513af tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Request method failure captured: Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/flavors/1285491547/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDk0dkOtoaSgXOA8mvtShU2D2FZIhOErbW22xvt5_s2XOZeuTbT70a9cAJUY3KzsRxpWgDxsMqAcMWdt1W52x0LoR1qhvgltVinlYvYVIue-ZPxF2nBxJuBGPImwdVDZQ_V_TbcE1pOfn3sDmthswNolAEkjkE4VtZem7eKP5tIeqmc Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 7c0fe5c8103a4b1399522067abd96f87 Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:46:46.189451 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 7c0fe5c8103a4b1399522067abd96f87 Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: c4d99082eda54de9b0237593cbf614c0 Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:46:46.191460 n-d-820368-37 devstack@n-api.service[128862]: exception: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'flavor_id': '1285491547', 'id': 'hw:cpu_thread_policy'} Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:46.197231 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feed8344-9e80-43b2-b43e-f51cff5513af tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Returning 404 to user: Flavor 1285491547 has no extra specs with key hw:cpu_thread_policy. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-feed8344-9e80-43b2-b43e-f51cff5513af tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1285491547/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.020461 Sep 01 04:46:46.198682 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 82/144] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:46:46 2022] DELETE /compute/v2.1/flavors/1285491547/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:46:46.199426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:46.199426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:46.212477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:46.212961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:46.213430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:46.213816 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-570c9038-ac05-416b-aa1d-2f6e7c0387cf tempest-QuotasAdminTestJSON-791925411 tempest-QuotasAdminTestJSON-791925411-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714" status: 200 len: 329 microversion: 2.1 time: 0.824861 Sep 01 04:46:46.214135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:46.214682 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 63/145] 10.222.0.26 () {60 vars in 1263 bytes} [Thu Sep 1 04:46:45 2022] PUT /compute/v2.1/os-quota-sets/6dbcabe08caa4d7e962a5e3753ca0714 => generated 329 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:46.215247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:46.216075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:46.225350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-802bd979-9542-42b3-98e0-601a28b3fb69 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa7609275e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:46.569875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:46.577231 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-802bd979-9542-42b3-98e0-601a28b3fb69 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "DELETE /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.360799 Sep 01 04:46:46.577800 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 64/146] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Sep 1 04:46:46 2022] DELETE /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata/os_version => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:46:46.578419 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0beb9da-86be-4b19-86af-dce1685b71f1 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.385858 Sep 01 04:46:46.578977 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 83/147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:46 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:46.584187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23707467-8152-49de-a267-4f3d0f124352 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:46.590306 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-23707467-8152-49de-a267-4f3d0f124352 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23707467-8152-49de-a267-4f3d0f124352 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Request method failure captured: Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 27 Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDk0dkOtoaSgXOA8mvtShU2D2FZIhOErbW22xvt5_s2XOZeuTbT70a9cAJUY3KzsRxpWgDxsMqAcMWdt1W52x0LoR1qhvgltVinlYvYVIue-ZPxF2nBxJuBGPImwdVDZQ_V_TbcE1pOfn3sDmthswNolAEkjkE4VtZem7eKP5tIeqmc Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 7c0fe5c8103a4b1399522067abd96f87 Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:46:46.592098 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 7c0fe5c8103a4b1399522067abd96f87 Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c4d99082eda54de9b0237593cbf614c0 Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: {"hw:cpu_policy": "shared"} Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:46.593501 n-d-820368-37 devstack@n-api.service[128863]: exception: Request body and URI mismatch Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'flavor_id': '1285491547', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:46.594330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:46.595749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:46:46.595749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:46:46.595749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 01 04:46:46.595749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.595749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23707467-8152-49de-a267-4f3d0f124352 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:46.595749 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23707467-8152-49de-a267-4f3d0f124352 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.014721 Sep 01 04:46:46.596143 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 65/148] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Sep 1 04:46:46 2022] PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes => generated 73 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:46:46.603757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:46.604558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:46.611954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:46.612439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:46.613027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:46.613729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:46.614174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:46.614588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:46.760665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:46.771570 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cfa40a5-32b6-428d-bcb3-4aed5ee2d26e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.171786 Sep 01 04:46:46.772318 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 66/149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:46 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:46.790340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d650ca1-6264-4067-8040-eabceff582f0 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa7607f9940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:46.837944 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d650ca1-6264-4067-8040-eabceff582f0 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.060259 Sep 01 04:46:46.838575 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 67/150] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:46:46 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 37 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:46.840149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa4a7fb9-0c8e-4179-89ef-f0b9260280ae tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-594238506", "id": 1292603727, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:46.843449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c268ba8-0acd-42cb-a50b-34cbdeef5848 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c268ba8-0acd-42cb-a50b-34cbdeef5848 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Request method failure captured: Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 49 Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDk0dkOtoaSgXOA8mvtShU2D2FZIhOErbW22xvt5_s2XOZeuTbT70a9cAJUY3KzsRxpWgDxsMqAcMWdt1W52x0LoR1qhvgltVinlYvYVIue-ZPxF2nBxJuBGPImwdVDZQ_V_TbcE1pOfn3sDmthswNolAEkjkE4VtZem7eKP5tIeqmc Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 7c0fe5c8103a4b1399522067abd96f87 Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:46:46.856682 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7c0fe5c8103a4b1399522067abd96f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 7c0fe5c8103a4b1399522067abd96f87 Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c4d99082eda54de9b0237593cbf614c0 Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 01 04:46:46.857917 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'flavor_id': '1285491547', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance: Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 01 04:46:46.858556 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.859819 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c268ba8-0acd-42cb-a50b-34cbdeef5848 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c268ba8-0acd-42cb-a50b-34cbdeef5848 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.018296 Sep 01 04:46:46.861191 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 68/151] 10.222.0.26 () {60 vars in 1265 bytes} [Thu Sep 1 04:46:46 2022] PUT /compute/v2.1/flavors/1285491547/os-extra_specs/hw:numa_nodes => generated 117 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:46:46.865028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5a7b9d2-450b-4ee0-84fe-5eaf103c2214 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa76080f700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:46.868325 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa4a7fb9-0c8e-4179-89ef-f0b9260280ae tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.288145 Sep 01 04:46:46.869105 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 84/152] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:46:46 2022] POST /compute/v2.1/flavors => generated 467 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:46.873532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f3eced4-9409-4dae-9e63-edc90574bb95 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:46.892757 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f3eced4-9409-4dae-9e63-edc90574bb95 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1285491547" status: 202 len: 0 microversion: 2.1 time: 0.022401 Sep 01 04:46:46.893331 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 85/153] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:46:46 2022] DELETE /compute/v2.1/flavors/1285491547 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:46:46.932690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e5a7b9d2-450b-4ee0-84fe-5eaf103c2214 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:46.937237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e5a7b9d2-450b-4ee0-84fe-5eaf103c2214 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:47.033697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fc7ca26-634f-4d08-ac54-3599e95601ef tempest-FlavorsV261TestJSON-732739053 tempest-FlavorsV261TestJSON-732739053-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.056973 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fc7ca26-634f-4d08-ac54-3599e95601ef tempest-FlavorsV261TestJSON-732739053 tempest-FlavorsV261TestJSON-732739053-project] 10.222.0.26 "GET /compute/v2.1/flavors/1292603727" status: 200 len: 467 microversion: 2.61 time: 0.162096 Sep 01 04:46:47.057916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 86/154] 10.222.0.26 () {60 vars in 1199 bytes} [Thu Sep 1 04:46:46 2022] GET /compute/v2.1/flavors/1292603727 => generated 467 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:47.069664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bede1670-0424-41fe-890b-2bfcd8761384 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.094165 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bede1670-0424-41fe-890b-2bfcd8761384 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612 tempest-FlavorsExtraSpecsNegativeTestJSON-535325612-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.034940 Sep 01 04:46:47.111433 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 87/155] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:47.119761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e943eb44-5a88-4781-ae69-970be09789ba tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] Action: 'update', calling method: .version_select at 0x7fa761c09dc0>, body: {"flavor": {"description": "new"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:47.210291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e943eb44-5a88-4781-ae69-970be09789ba tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1292603727" status: 200 len: 468 microversion: 2.61 time: 0.096487 Sep 01 04:46:47.211376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 88/156] 10.222.0.26 () {62 vars in 1219 bytes} [Thu Sep 1 04:46:47 2022] PUT /compute/v2.1/flavors/1292603727 => generated 468 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:47.230369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fba0a754-fb90-4aea-acc1-3945de2633ab tempest-FlavorsV261TestJSON-732739053 tempest-FlavorsV261TestJSON-732739053-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.266187 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fba0a754-fb90-4aea-acc1-3945de2633ab tempest-FlavorsV261TestJSON-732739053 tempest-FlavorsV261TestJSON-732739053-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.045653 Sep 01 04:46:47.268127 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 89/157] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:46:47.293754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cb6e66f-3d85-4042-a361-6bf900daad18 tempest-FlavorsV261TestJSON-732739053 tempest-FlavorsV261TestJSON-732739053-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.321078 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cb6e66f-3d85-4042-a361-6bf900daad18 tempest-FlavorsV261TestJSON-732739053 tempest-FlavorsV261TestJSON-732739053-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.036657 Sep 01 04:46:47.321874 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 90/158] 10.222.0.26 () {60 vars in 1166 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:46:47.346507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c8f4d54-ce95-42e9-a1c2-c34d5d8ed8d5 tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.398112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c8f4d54-ce95-42e9-a1c2-c34d5d8ed8d5 tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1292603727" status: 202 len: 0 microversion: 2.61 time: 0.063247 Sep 01 04:46:47.399452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 91/159] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Sep 1 04:46:47 2022] DELETE /compute/v2.1/flavors/1292603727 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:46:47.411082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1663b049-6059-465e-b12f-f4e25e69d17e tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.412047 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5a7b9d2-450b-4ee0-84fe-5eaf103c2214 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.551152 Sep 01 04:46:47.412895 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 69/160] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:46 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:47.423341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-103f01d4-ff11-4c69-87f6-1d1bb5c27af6 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa76080f430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.433226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=77,nova_api:INSERT=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:47.458060 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1663b049-6059-465e-b12f-f4e25e69d17e tempest-FlavorsV261TestJSON-520543593 tempest-FlavorsV261TestJSON-520543593-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.054294 Sep 01 04:46:47.458966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 92/161] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:46:47.496669 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-103f01d4-ff11-4c69-87f6-1d1bb5c27af6 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.077687 Sep 01 04:46:47.497537 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 70/162] 10.222.0.26 () {58 vars in 1290 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata/os_distro => generated 33 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 04:46:47.509924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9568b3f-b19f-4618-91ef-edb41f1d1ebd tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa76084f160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:47.599499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f9568b3f-b19f-4618-91ef-edb41f1d1ebd tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:47.600938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.602049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:47.605023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f9568b3f-b19f-4618-91ef-edb41f1d1ebd tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:47.625684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:47.626682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:47.628440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:47.629589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:47.632032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:47.632496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:47.826317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9568b3f-b19f-4618-91ef-edb41f1d1ebd tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.321605 Sep 01 04:46:47.827229 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 93/163] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:47 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:47.833062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:47.834463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:47.842193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:47.845516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:47.848230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:47.849045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:47.849564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:47.852029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:48.064573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:48.072574 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33f7a131-beab-43fd-80b2-c3a0d6d7bc20 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.477129 Sep 01 04:46:48.077512 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 71/164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:48.082212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62a3fad2-48c4-491a-98bc-dfe954b0e75c tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa760848790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:48.146271 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62a3fad2-48c4-491a-98bc-dfe954b0e75c tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.067662 Sep 01 04:46:48.146928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 72/165] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:46:48 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:48.156867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a1e5539-5ce9-4cfd-baf9-2d03e686d471 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa7607f9dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:48.214858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2a1e5539-5ce9-4cfd-baf9-2d03e686d471 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:48.221507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2a1e5539-5ce9-4cfd-baf9-2d03e686d471 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:48.349791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:48.367593 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0974b085-ebc6-4d58-ae40-1f93dd6d8f32 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.538532 Sep 01 04:46:48.368219 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 94/166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:47 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:48.513595 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a1e5539-5ce9-4cfd-baf9-2d03e686d471 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.360383 Sep 01 04:46:48.519260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 73/167] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:48 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 04:46:48.527083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc18c270-9594-4166-aa68-19ecb4ed25bf tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa7608011f0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:48.633576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-dc18c270-9594-4166-aa68-19ecb4ed25bf tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:48.649288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-dc18c270-9594-4166-aa68-19ecb4ed25bf tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:49.082470 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc18c270-9594-4166-aa68-19ecb4ed25bf tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.561756 Sep 01 04:46:49.084691 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 95/168] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:48 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 64 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:49.094523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca75a602-e504-45fa-80d3-753b7daef8ff tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa7607f9160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:49.098770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:49.099412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:49.112964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:49.113701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:49.114399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:49.115489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:49.116079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:49.116637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:49.158018 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca75a602-e504-45fa-80d3-753b7daef8ff tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.067268 Sep 01 04:46:49.159255 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 74/169] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:46:49 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 64 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:49.178856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48c5a7c7-f7af-4ada-b3d5-69621d644613 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa76080f940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:49.260054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-48c5a7c7-f7af-4ada-b3d5-69621d644613 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:49.270762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-48c5a7c7-f7af-4ada-b3d5-69621d644613 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:49.372006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:49.383619 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80146b6d-2dcf-4188-9042-96b2f7e23dfd tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.288090 Sep 01 04:46:49.396736 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 96/170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:49 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:49.402202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:49.403137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:49.410932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:49.411722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:49.412284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:49.413187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:49.413771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:49.414323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:49.626988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:49.758962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48c5a7c7-f7af-4ada-b3d5-69621d644613 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.589412 Sep 01 04:46:49.759807 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 75/171] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:49 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:49.770547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e0d11b2-fd16-429b-a0df-92d6969fc8ab tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update', calling method: .version_select at 0x7fa76080faf0>, body: {"meta": {"os_version": "alt"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:49.858142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6e0d11b2-fd16-429b-a0df-92d6969fc8ab tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:49.869146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6e0d11b2-fd16-429b-a0df-92d6969fc8ab tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:49.908159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:49.923764 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6e0fa71-c829-44cb-9275-c8d07e7d40f4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.525820 Sep 01 04:46:49.937481 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 97/172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:49 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:50.405137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:50.406169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:50.412997 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e0d11b2-fd16-429b-a0df-92d6969fc8ab tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.647182 Sep 01 04:46:50.414435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 76/173] 10.222.0.26 () {60 vars in 1313 bytes} [Thu Sep 1 04:46:49 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata/os_version => generated 31 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:50.433358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51225e02-3a0c-49be-bc8c-563bb34c66e1 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa760848040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:50.435872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:50.436615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:50.442268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:50.443595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:50.445449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:50.446101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:50.506111 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51225e02-3a0c-49be-bc8c-563bb34c66e1 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.084949 Sep 01 04:46:50.506812 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 77/174] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:46:50 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 58 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:50.520632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8a68a90-5479-49eb-ac13-342e05801da2 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'update_all', calling method: .version_select at 0x7fa7607fbee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:50.595658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c8a68a90-5479-49eb-ac13-342e05801da2 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:50.609284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c8a68a90-5479-49eb-ac13-342e05801da2 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:50.993515 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8a68a90-5479-49eb-ac13-342e05801da2 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.477376 Sep 01 04:46:50.994554 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 78/175] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:46:50 2022] PUT /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 61 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:51.001148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:51.002924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:51.003051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:51.011158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34d9c888-6042-4fca-933e-386a1b9ee6b2 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.610712 Sep 01 04:46:51.013926 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 98/176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:50 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:51.018041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:51.021041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:51.021693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:51.022107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eeb56079-4338-4633-8808-673613d78472 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Action: 'create', calling method: .version_select at 0x7fa76084f3a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:51.023408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:51.026011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:51.026684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:51.133441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:51.136489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-eeb56079-4338-4633-8808-673613d78472 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:46:51.154168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-eeb56079-4338-4633-8808-673613d78472 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Getting quotas for user 5ae629790c794786931b8677a28a0e81 and project ffbb67a29af44445b35cabfc657815ee. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:46:51.423057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:51.443837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d65e4d4-53e2-47e8-8620-e43e62195239 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.447799 Sep 01 04:46:51.447517 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 79/177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:50 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:51.766930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-36a9637e-dd50-46bc-bc9e-aab3acbee546 req-97190d2c-37be-45dc-88ea-e43a63044346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a7b786-bbb6-4e29-89fb-b90fc5b22085", "name": "network-vif-plugged", "status": "completed", "tag": "25eec357-45b7-472f-812a-fa86d731a178"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:51.804732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-36a9637e-dd50-46bc-bc9e-aab3acbee546 req-97190d2c-37be-45dc-88ea-e43a63044346 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:51.805339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-36a9637e-dd50-46bc-bc9e-aab3acbee546 req-97190d2c-37be-45dc-88ea-e43a63044346 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:51.805776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-36a9637e-dd50-46bc-bc9e-aab3acbee546 req-97190d2c-37be-45dc-88ea-e43a63044346 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:51.815256 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eeb56079-4338-4633-8808-673613d78472 tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "POST /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.800185 Sep 01 04:46:51.815907 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 99/178] 10.222.0.26 () {60 vars in 1281 bytes} [Thu Sep 1 04:46:51 2022] POST /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 85 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:51.826489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5909f85a-e9ac-4154-a684-90ccfb89d9fe tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] Calling method '.version_select at 0x7fa7607be160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:51.883415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-36a9637e-dd50-46bc-bc9e-aab3acbee546 req-97190d2c-37be-45dc-88ea-e43a63044346 service nova] Creating event network-vif-plugged:25eec357-45b7-472f-812a-fa86d731a178 for instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 on n-h1-820368-37 Sep 01 04:46:51.897075 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5909f85a-e9ac-4154-a684-90ccfb89d9fe tempest-ImagesMetadataTestJSON-754393838 tempest-ImagesMetadataTestJSON-754393838-project] 10.222.0.26 "GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.073126 Sep 01 04:46:51.897321 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-36a9637e-dd50-46bc-bc9e-aab3acbee546 req-97190d2c-37be-45dc-88ea-e43a63044346 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446954 Sep 01 04:46:51.897934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 80/179] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:51.899528 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 100/180] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:46:51 2022] GET /compute/v2.1/images/077bf320-ffbe-4c3e-a291-b26f7914a82c/metadata => generated 85 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:46:52.038800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:52.039642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:52.056760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:52.062490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:52.063399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:52.064348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:52.065017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:52.067167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:52.419581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:52.433317 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09973bf4-b0a7-4a07-9acd-51ae67f085f5 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.396167 Sep 01 04:46:52.435234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 81/181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:52 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:52.470501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:52.471144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:52.491274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:52.491990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:52.492578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:52.495206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:52.495902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:52.496480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:52.803332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:52.812793 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9936a71f-413e-49a8-8f87-2887ab9665f6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.346983 Sep 01 04:46:52.814903 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 101/182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:52 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:53.458191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:53.460515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:53.475792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:53.477140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:53.478560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:53.482055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:53.482772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:53.485008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:53.835018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:53.836312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:53.850631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:53.852981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:53.857090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:53.858312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:53.860311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:53.861944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:54.007235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:54.023383 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f4b24e3-1b8b-40d8-afc4-e0c7c6acfb13 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 0.567533 Sep 01 04:46:54.024358 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 82/183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:53 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:54.670063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Calling method '.version_select at 0x7fa7608975e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:54.674103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:54.676125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:54.676623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:54.698817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:54.699331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:54.700044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:54.756073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:54.756889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:54.757846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:54.793125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:54.793887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:54.794949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:54.818755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:54.819778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:54.820551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:54.829610 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-faf445ae-d277-4461-8dfa-1b03ad2e3fe3 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.720048 Sep 01 04:46:54.844552 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 83/184] 10.222.0.26 () {60 vars in 1243 bytes} [Thu Sep 1 04:46:54 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:46:54.945260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-911dc2d1-3825-4d0c-bf00-474f258fd60d tempest-InstanceUsageAuditLogTestJSON-1180417250 tempest-InstanceUsageAuditLogTestJSON-1180417250-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:55.025745 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-911dc2d1-3825-4d0c-bf00-474f258fd60d tempest-InstanceUsageAuditLogTestJSON-1180417250 tempest-InstanceUsageAuditLogTestJSON-1180417250-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-01 04:46:54" status: 200 len: 318 microversion: 2.1 time: 0.176926 Sep 01 04:46:55.026387 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 84/185] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 04:46:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-01%2004%3A46%3A54 => generated 318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:55.046959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7b78b518-e60c-42d4-991a-379b3312c200 req-a4d6bc04-89a8-4260-97c5-f5324ea30827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e8561b-07d9-4397-b561-24974c2640a3", "name": "network-vif-plugged", "status": "completed", "tag": "946fa3b6-24ff-4ca9-9596-0c2a3d8f5756"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:46:55.066466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7b78b518-e60c-42d4-991a-379b3312c200 req-a4d6bc04-89a8-4260-97c5-f5324ea30827 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.067834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7b78b518-e60c-42d4-991a-379b3312c200 req-a4d6bc04-89a8-4260-97c5-f5324ea30827 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.068859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7b78b518-e60c-42d4-991a-379b3312c200 req-a4d6bc04-89a8-4260-97c5-f5324ea30827 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.086252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7b78b518-e60c-42d4-991a-379b3312c200 req-a4d6bc04-89a8-4260-97c5-f5324ea30827 service nova] Creating event network-vif-plugged:946fa3b6-24ff-4ca9-9596-0c2a3d8f5756 for instance 88e8561b-07d9-4397-b561-24974c2640a3 on n-h2-820368-37 Sep 01 04:46:55.092660 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7b78b518-e60c-42d4-991a-379b3312c200 req-a4d6bc04-89a8-4260-97c5-f5324ea30827 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060653 Sep 01 04:46:55.095023 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 85/186] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:55.101684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Calling method '.version_select at 0x7fa7607f93a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:55.106869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.108193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.109827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.141579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.142649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.144570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.165310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:55.179129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.180067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.180883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.181877 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb92885f-1cfb-4d4e-b79c-670ba5afb67f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 1.351451 Sep 01 04:46:55.184957 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 102/187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:53 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:55.190170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a0a6e79-09a0-489e-a05b-cd8d379caf97 tempest-InstanceUsageAuditLogTestJSON-1180417250 tempest-InstanceUsageAuditLogTestJSON-1180417250-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:55.198871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.200139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.200823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.240643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.242242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.243047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.254837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-899dca5d-978c-4c55-84d5-7192a3cb513c tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.158147 Sep 01 04:46:55.267036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 86/188] 10.222.0.26 () {60 vars in 1222 bytes} [Thu Sep 1 04:46:55 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:55.269390 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a0a6e79-09a0-489e-a05b-cd8d379caf97 tempest-InstanceUsageAuditLogTestJSON-1180417250 tempest-InstanceUsageAuditLogTestJSON-1180417250-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.082262 Sep 01 04:46:55.269998 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 103/189] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 04:46:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:46:55.274910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:55.277487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:55.284382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Calling method '.version_select at 0x7fa7608801f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:55.286723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.287682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.288341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.288452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.289565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.290220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.290905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.295231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.296102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.348662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:55.349145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:55.349735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:55.364418 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-497467d4-3ed1-4476-871b-b485a7d03671 tempest-HypervisorAdminV253TestBase-2001431304 tempest-HypervisorAdminV253TestBase-2001431304-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/d035b4da-2197-4490-9f29-d777522324a2" status: 200 len: 794 microversion: 2.53 time: 0.093344 Sep 01 04:46:55.374010 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 104/190] 10.222.0.26 () {60 vars in 1298 bytes} [Thu Sep 1 04:46:55 2022] GET /compute/v2.1/os-hypervisors/d035b4da-2197-4490-9f29-d777522324a2 => generated 794 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:46:55.764982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=25 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:46:56.208660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:56.209422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:56.226415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:56.227722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:56.229191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:56.230149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:56.232652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:56.233998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:56.259778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:56.271037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44eb8869-9daf-4cba-bb57-b836485df6e9 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1337 microversion: 2.1 time: 1.002274 Sep 01 04:46:56.273147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 87/191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:55 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1337 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:56.832259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:56.852841 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-797996d7-6db1-4900-bc42-e31defc89efa tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.648974 Sep 01 04:46:56.859245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 105/192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:56 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:57.300126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:57.305517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:57.337958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:57.345376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:57.345376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:57.346341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:57.350442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:57.352303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:57.884783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:57.885489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:57.899026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:57.899587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:57.901795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:57.902862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:57.903389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:57.904022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:58.197875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:58.220872 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b158e5a6-485d-4d0c-9adc-d99d43bff4c7 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1487 microversion: 2.1 time: 0.930503 Sep 01 04:46:58.221468 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 88/193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:57 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1487 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:46:58.245863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:58.246739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:58.260565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:58.261052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:58.261476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:58.262177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:58.262619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:58.263063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:58.609603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:46:58.618753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54fca424-6c8c-4bdc-b953-56a97d1cde66 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1319 microversion: 2.1 time: 0.741668 Sep 01 04:46:58.622689 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 106/194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:57 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1319 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:59.177441 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d457ca48-08a3-4467-8188-a39ad4c3ae2c tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1640 microversion: 2.1 time: 0.935093 Sep 01 04:46:59.179510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 89/195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:58 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1640 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:46:59.207651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:59.208820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:59.215369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:59.216102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:59.216688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:59.217553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:59.218144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:59.218704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:59.250051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:46:59.492439 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af42a982-186d-4033-b888-603801bd69da tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 204 len: 0 microversion: 2.1 time: 0.288942 Sep 01 04:46:59.492439 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 107/196] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:46:59 2022] DELETE /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:46:59.500140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:59.500767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:59.512733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:59.513088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:59.513574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:59.514240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:59.514698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:59.515054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:59.644572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:46:59.645723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:46:59.944213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:59.944905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:59.945471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:46:59.946393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:46:59.947157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:46:59.948508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:00.163600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:00.191312 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31726d2d-7f8b-49de-a3d3-dabd2d7b1246 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1493 microversion: 2.1 time: 0.688398 Sep 01 04:47:00.194414 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 90/197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:59 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1493 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:00.879222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:00.894142 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af5eb232-492b-4c4e-a3ea-3064008ba91c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1469 microversion: 2.1 time: 1.254052 Sep 01 04:47:00.898255 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 108/198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:46:59 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1469 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:47:01.214800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:01.215552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:01.224764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:01.226545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:01.228110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:01.235080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:01.237017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:01.239259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:01.582326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:01.582868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:01.597153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:01.597641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:01.598072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:01.598780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:01.614048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:01.614590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:01.713617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:47:01.809107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:01.844143 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24cf5226-199e-4156-a521-dc8cf2bc4418 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1493 microversion: 2.1 time: 0.633179 Sep 01 04:47:01.845038 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 109/199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:01 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1493 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:01.869961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:02.686867 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f15b350d-3a42-4d5f-9d71-9bfbac4ed7c8 tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 204 len: 0 microversion: 2.1 time: 1.766875 Sep 01 04:47:02.687940 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 91/200] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:00 2022] DELETE /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 0 bytes in 1769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:47:02.693970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d136d3d1-1305-4ef1-89a0-93818d7f593a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7607fb3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:02.773286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d136d3d1-1305-4ef1-89a0-93818d7f593a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/e910b7ab-e24a-41a3-aca8-77e6a2a3365a" status: 200 len: 660 microversion: 2.1 time: 0.083893 Sep 01 04:47:02.773921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 92/201] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:02 2022] GET /compute/v2.1/images/e910b7ab-e24a-41a3-aca8-77e6a2a3365a => generated 660 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:02.787936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:02.789168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:02.805212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:02.805623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:02.807214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:02.809546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:02.810025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:02.810982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3513880-6a32-40e5-a4a5-a335eef64279 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:02.817644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:02.817952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c3513880-6a32-40e5-a4a5-a335eef64279 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3513880-6a32-40e5-a4a5-a335eef64279 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin] Request method failure captured: Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlF5dJSl7uZlGy3gQtzmiR1MLycGiDbWDdYnPLBmZQ6NYAcFwBVDTM3YN_4egiFo-LEfxCFPWQ3uLQ5szorf3HIirnTmjZ8p28dzLLuKKVMbF2TysjOLZrMW8IdS7BUPrF4QFGJiDjHyk2l3PHX8Cc4iGDpj5jZ0JHmHY4p3NbuaTg Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f00eea4946cf4abcbca50d934e986bb3 Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:47:02.839380 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f00eea4946cf4abcbca50d934e986bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f00eea4946cf4abcbca50d934e986bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f00eea4946cf4abcbca50d934e986bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f00eea4946cf4abcbca50d934e986bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f00eea4946cf4abcbca50d934e986bb3 Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ddea220da78246f394fc816af71817c9 Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:02.840741 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid timestamp for date invalid_time Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'invalid_time'} Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:02.841382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3513880-6a32-40e5-a4a5-a335eef64279 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:02.842843 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3513880-6a32-40e5-a4a5-a335eef64279 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940 tempest-InstanceUsageAuditLogNegativeTestJSON-1259820940-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.858664 Sep 01 04:47:02.843702 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 110/202] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Sep 1 04:47:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 861 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:47:02.846375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0776f342-a9e3-4857-9365-02e47f2264e0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76095d040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:02.929259 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0776f342-a9e3-4857-9365-02e47f2264e0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/e910b7ab-e24a-41a3-aca8-77e6a2a3365a" status: 200 len: 660 microversion: 2.1 time: 0.086361 Sep 01 04:47:02.936676 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 111/203] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:02 2022] GET /compute/v2.1/images/e910b7ab-e24a-41a3-aca8-77e6a2a3365a => generated 660 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:03.233709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:03.245123 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c63757fc-c866-4afc-88c7-c0b249334689 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1475 microversion: 2.1 time: 0.470054 Sep 01 04:47:03.247081 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 93/204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:02 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:03.258627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:03.259289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:03.277441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:03.277949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:03.278424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:03.279221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:03.279774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:03.280198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:03.408553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c0bc0e3-fb9f-424a-98c7-97c906d3c3fd tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:03.413406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c0bc0e3-fb9f-424a-98c7-97c906d3c3fd tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '574579caac6d44cfab784365d308e121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c191aaff6b664b1fa82d1aa07523c6a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c0bc0e3-fb9f-424a-98c7-97c906d3c3fd tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Request method failure captured: Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlEbHE9OE1Pw4k6E-UyzcFK_eeXJ9JF1UdGIy2eOTYkGjAbAq1hALqH-VAfMcdkUwkeYz2jzFPtkQD9E_MgTqp4DOYZy39EW0cIxrTJWhN1TXKzqMICJYtZfbnFkrsYjfN1nmMBqPpitK_OgzClAYIqWMbfY22TK0HiTASTaapxY9k Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c191aaff6b664b1fa82d1aa07523c6a5 Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:03.417914 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c191aaff6b664b1fa82d1aa07523c6a5 Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 574579caac6d44cfab784365d308e121 Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project Sep 01 04:47:03.419345 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:03.420039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 01 04:47:03.421399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:03.424283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c0bc0e3-fb9f-424a-98c7-97c906d3c3fd tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:03.426695 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c0bc0e3-fb9f-424a-98c7-97c906d3c3fd tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.488550 Sep 01 04:47:03.429972 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 112/205] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 04:47:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:03.436941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c455ebe8e8b34ba483438f2d2f7c4755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9254bc3b5a475aa46ad6cff7f4b431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:03.454206 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4958a3a8-3142-4a80-ad8e-cf46c00ecca3 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 200 len: 1451 microversion: 2.1 time: 0.205968 Sep 01 04:47:03.458839 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 94/206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:03 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:03.459468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b54cd3cf-b2b0-426f-abdc-e1f5794567cc tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:03.467206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b54cd3cf-b2b0-426f-abdc-e1f5794567cc tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '574579caac6d44cfab784365d308e121', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c191aaff6b664b1fa82d1aa07523c6a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b54cd3cf-b2b0-426f-abdc-e1f5794567cc tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Request method failure captured: Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-01%2004:47:03 HTTP/1.1 Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlEbHE9OE1Pw4k6E-UyzcFK_eeXJ9JF1UdGIy2eOTYkGjAbAq1hALqH-VAfMcdkUwkeYz2jzFPtkQD9E_MgTqp4DOYZy39EW0cIxrTJWhN1TXKzqMICJYtZfbnFkrsYjfN1nmMBqPpitK_OgzClAYIqWMbfY22TK0HiTASTaapxY9k Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c191aaff6b664b1fa82d1aa07523c6a5 Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:03.471922 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c191aaff6b664b1fa82d1aa07523c6a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c191aaff6b664b1fa82d1aa07523c6a5 Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 574579caac6d44cfab784365d308e121 Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project Sep 01 04:47:03.473077 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2022-09-01 04:47:03'} Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:03.473647 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 01 04:47:03.474865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:03.475804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b54cd3cf-b2b0-426f-abdc-e1f5794567cc tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:03.475804 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b54cd3cf-b2b0-426f-abdc-e1f5794567cc tempest-InstanceUsageAuditLogNegativeTestJSON-404123934 tempest-InstanceUsageAuditLogNegativeTestJSON-404123934-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-01 04:47:03" status: 403 len: 128 microversion: 2.1 time: 0.036655 Sep 01 04:47:03.475804 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 113/207] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 04:47:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-01%2004%3A47%3A03 => generated 128 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:03.702812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bccec319-6bcf-4649-8d4f-af596b69914b req-b94dcd29-b15c-48d5-b144-f6985cc516c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a7b786-bbb6-4e29-89fb-b90fc5b22085", "name": "network-vif-deleted", "tag": "25eec357-45b7-472f-812a-fa86d731a178"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:03.724032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bccec319-6bcf-4649-8d4f-af596b69914b req-b94dcd29-b15c-48d5-b144-f6985cc516c4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:03.726258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bccec319-6bcf-4649-8d4f-af596b69914b req-b94dcd29-b15c-48d5-b144-f6985cc516c4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:03.726710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bccec319-6bcf-4649-8d4f-af596b69914b req-b94dcd29-b15c-48d5-b144-f6985cc516c4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:03.777908 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bccec319-6bcf-4649-8d4f-af596b69914b req-b94dcd29-b15c-48d5-b144-f6985cc516c4 service nova] Creating event network-vif-deleted:25eec357-45b7-472f-812a-fa86d731a178 for instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 on n-h1-820368-37 Sep 01 04:47:03.789601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bccec319-6bcf-4649-8d4f-af596b69914b req-b94dcd29-b15c-48d5-b144-f6985cc516c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091650 Sep 01 04:47:03.794952 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 95/208] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:04.272076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:04.273169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:04.285211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:04.287173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:04.289425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:04.292227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:04.293723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:04.294182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:04.648416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-441416030", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "7b76ca05-01a3-4b76-afa8-f7e1d1970480"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:04.753657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] validate_networks() for [('7b76ca05-01a3-4b76-afa8-f7e1d1970480', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:05.021697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:05.266563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:05.720465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:05.730157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-441bf1df-df47-4069-8947-9d1725a59bfc tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 200 len: 1475 microversion: 2.1 time: 1.465502 Sep 01 04:47:05.738791 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 96/209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:04 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 1475 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:05.744026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:05.744630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:05.766691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:05.768218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:05.768868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:05.769475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:05.770238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:05.770700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:05.773520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:05.794472 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] HTTP exception thrown: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Request method failure captured: Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 HTTP/1.1 Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkYHkedEuKyAGL6LBWlZ4UREK7cx1y2_PkvstFQLPlNJC84eoOLBETvO9GFHAO28lxrbXxug11sRxfyFLPyHWt9JkpzoxkL5FNnuILLOrBcAXojdPjeq5FylmTZkVfQYfUxTiUcgKpwCHMhPhqQYSkRrXZgyrKyMWO-1XuCr5xZq6g Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8b9254bc3b5a475aa46ad6cff7f4b431 Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:05.811193 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8b9254bc3b5a475aa46ad6cff7f4b431 Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-705221199-project Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c455ebe8e8b34ba483438f2d2f7c4755 Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-705221199-project Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:05.812610 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '47a7b786-bbb6-4e29-89fb-b90fc5b22085'} Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:05.816988 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:05.818349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:05.820505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Returning 404 to user: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:05.820505 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afd0c21d-0625-4635-99cf-a633b022240c tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 404 len: 111 microversion: 2.1 time: 0.072492 Sep 01 04:47:05.820505 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 97/210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:05 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:06.474711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Action: 'update', calling method: .version_select at 0x7fa76076f160>, body: {"quota_set": {"ram": "5120"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:06.848924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:06.849415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:06.849901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:06.850617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:06.851454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:06.852104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:06.917440 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc5064eb-2d04-47f9-8b7e-23acdb5b36f0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7" status: 200 len: 240 microversion: 2.36 time: 1.096876 Sep 01 04:47:06.918506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 98/211] 10.222.0.26 () {62 vars in 1303 bytes} [Thu Sep 1 04:47:05 2022] PUT /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7 => generated 240 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:06.923345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ac16e92-f20c-4eb7-b0b4-1364e2632e2c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76068e3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:06.975684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ac16e92-f20c-4eb7-b0b4-1364e2632e2c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/2022b7d9-e147-4191-a8a3-134d620c587f" status: 200 len: 662 microversion: 2.1 time: 0.055908 Sep 01 04:47:06.984205 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 99/212] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:06 2022] GET /compute/v2.1/images/2022b7d9-e147-4191-a8a3-134d620c587f => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:06.984205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c204052-bcdd-498a-a5fa-5912907e2511 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:07.008811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c204052-bcdd-498a-a5fa-5912907e2511 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.009802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c204052-bcdd-498a-a5fa-5912907e2511 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.010468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c204052-bcdd-498a-a5fa-5912907e2511 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.029336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:07.029831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:07.030220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:07.030781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:07.031217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:07.053929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.054804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.056110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.058253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.059896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.060736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.083043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Getting quotas for project 3380af7dd06d4c72855de9f45d9cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:07.094894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Getting quotas for user 09c8e8a3f51b486b930a4d445813e3a0 and project 3380af7dd06d4c72855de9f45d9cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:07.109775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:07.114575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:07.195054 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0be53250-3193-4b50-998a-12fda386000b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.138071 Sep 01 04:47:07.196093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 114/213] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:47:07.202835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e31cabf0-655c-439a-a31d-22425984fd3c req-b4f72d75-de91-4a65-ae5b-be4a62c14ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e8561b-07d9-4397-b561-24974c2640a3", "name": "network-vif-deleted", "tag": "946fa3b6-24ff-4ca9-9596-0c2a3d8f5756"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:07.215982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e31cabf0-655c-439a-a31d-22425984fd3c req-b4f72d75-de91-4a65-ae5b-be4a62c14ba1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.216758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e31cabf0-655c-439a-a31d-22425984fd3c req-b4f72d75-de91-4a65-ae5b-be4a62c14ba1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.217395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e31cabf0-655c-439a-a31d-22425984fd3c req-b4f72d75-de91-4a65-ae5b-be4a62c14ba1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.233478 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e31cabf0-655c-439a-a31d-22425984fd3c req-b4f72d75-de91-4a65-ae5b-be4a62c14ba1 service nova] Creating event network-vif-deleted:946fa3b6-24ff-4ca9-9596-0c2a3d8f5756 for instance 88e8561b-07d9-4397-b561-24974c2640a3 on n-h2-820368-37 Sep 01 04:47:07.240162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e31cabf0-655c-439a-a31d-22425984fd3c req-b4f72d75-de91-4a65-ae5b-be4a62c14ba1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042436 Sep 01 04:47:07.241434 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 115/214] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:07.244073 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c204052-bcdd-498a-a5fa-5912907e2511 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 297 microversion: 2.1 time: 0.266232 Sep 01 04:47:07.246160 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 100/215] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:47:06 2022] POST /compute/v2.1/os-aggregates/7/action => generated 297 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:07.250325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:07.251281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:07.259426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.260320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.261000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.261955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.262705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.263615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.264561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Calling method '.version_select at 0x7fa7607ac040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:07.283698 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] HTTP exception thrown: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Request method failure captured: Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 HTTP/1.1 Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkZyjWZvlJM6w6b8ERV5E7xl0WPt0QQmKRRxNtXo6qXXYSISHO-Tp40UdWo6eqq3ruwV4f4Ob-00rxCH6-K_Fk03xnBBKdwOzZtIdAdjM64rI9rBJ8LS6wkR_T9mJeku_OxOAXPGga-EPr84S6MPVqf28FKQRaJuWPFj-yAt7l5B0w Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:07.293161 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 53833f12609b47fa917e5144f70fef4c Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:07.294379 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '88e8561b-07d9-4397-b561-24974c2640a3'} Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:07.295092 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:07.296139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:07.303875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Returning 404 to user: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:07.306103 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b98c8b08-bd2e-44b1-920f-77ff2724370c tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 404 len: 111 microversion: 2.1 time: 0.061819 Sep 01 04:47:07.308449 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 116/216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:07 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:07.330503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf9037e5-c016-4342-b4cf-be235121acf3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76085cc10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:07.391430 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf9037e5-c016-4342-b4cf-be235121acf3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/2022b7d9-e147-4191-a8a3-134d620c587f" status: 200 len: 662 microversion: 2.1 time: 0.066922 Sep 01 04:47:07.409968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 117/217] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:07 2022] GET /compute/v2.1/images/2022b7d9-e147-4191-a8a3-134d620c587f => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:07.423325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b588a64-18cb-4603-a0af-fedc2d18118b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:07.424145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b588a64-18cb-4603-a0af-fedc2d18118b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:07.526257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.529543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.530348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.532963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.537901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.540514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.612467 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8953c961-f8be-43a4-9d03-9901f9d4d6ac tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7/detail" status: 200 len: 672 microversion: 2.36 time: 0.361232 Sep 01 04:47:07.613157 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 101/218] 10.222.0.26 () {60 vars in 1304 bytes} [Thu Sep 1 04:47:07 2022] GET /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7/detail => generated 672 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:07.621502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b588a64-18cb-4603-a0af-fedc2d18118b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:07.634361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b588a64-18cb-4603-a0af-fedc2d18118b tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1223 microversion: 2.1 time: 0.222919 Sep 01 04:47:07.639936 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 118/219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:07 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1223 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:07.658609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-323461e4-0fb5-4d33-9958-f2ef18997e99 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:07.712833 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-323461e4-0fb5-4d33-9958-f2ef18997e99 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.096141 Sep 01 04:47:07.714547 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 102/220] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:47:07 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:07.728107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e428329-74bf-45f0-97ce-ad5c4710cfc6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-825050454"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:07.733005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-4e428329-74bf-45f0-97ce-ad5c4710cfc6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 8da3ee7c-c63a-436f-b831-38f50a420c24 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:07.782620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e428329-74bf-45f0-97ce-ad5c4710cfc6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058919 Sep 01 04:47:07.783707 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 119/221] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:07.802795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdd732c6-251b-4152-aca5-1b4a4d52d2a4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:07.835450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1169578533", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:07.843498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdd732c6-251b-4152-aca5-1b4a4d52d2a4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:07.844220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdd732c6-251b-4152-aca5-1b4a4d52d2a4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:07.845635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdd732c6-251b-4152-aca5-1b4a4d52d2a4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:07.973489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:08.158257 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdd732c6-251b-4152-aca5-1b4a4d52d2a4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.367351 Sep 01 04:47:08.158949 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 103/222] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:47:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:08.171636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Action: 'update', calling method: .version_select at 0x7fa76080f160>, body: {"quota_set": {"ram": "2048"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:08.497244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:08.497868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:08.498198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:08.498593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:08.499185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:08.519568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.520229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.520669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.521421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.524531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.526141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.537974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.538478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.538930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.558750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.561429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.565857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.627025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Getting quotas for project 0133c74c727c4767ab66201ffaab8fda. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:08.640264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Getting quotas for user 53833f12609b47fa917e5144f70fef4c and project 0133c74c727c4767ab66201ffaab8fda. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:08.672642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:08.675045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.675863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.676341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.677072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.683649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:08.685904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.687800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.780866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:08.834720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47192d98-68f0-4e67-84e6-383483c404f8 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000377 Sep 01 04:47:08.836919 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 120/223] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:47:08.883044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5fef4e2-e4bc-4cb1-892c-06778462abfe tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:08.900072 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5fef4e2-e4bc-4cb1-892c-06778462abfe tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.060699 Sep 01 04:47:08.900953 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 121/224] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 04:47:08 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:08.907011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:08.908304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:08.917277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.918071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.918754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.920161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:08.920829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:08.922051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:08.944187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:08.944396 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d4e20ae-9d37-4403-a9f3-8e8eb83bdcbf tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7?user_id=7669bf92627345128d2ad68a42e9987e" status: 200 len: 240 microversion: 2.36 time: 0.778880 Sep 01 04:47:08.946002 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 104/225] 10.222.0.26 () {62 vars in 1384 bytes} [Thu Sep 1 04:47:08 2022] PUT /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7?user_id=7669bf92627345128d2ad68a42e9987e => generated 240 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:08.967645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db43e066-4556-4060-b3e0-469b57512551 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:08.976932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db43e066-4556-4060-b3e0-469b57512551 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:09.096021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:09.137933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b54e120-8e60-40ab-b9ae-eff55628f7df tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1219 microversion: 2.1 time: 0.214443 Sep 01 04:47:09.142075 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 122/226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:08 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:09.171084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce67f3a1-66a3-49d1-bf88-59e5596b168b tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:09.226090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce67f3a1-66a3-49d1-bf88-59e5596b168b tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:09.230999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce67f3a1-66a3-49d1-bf88-59e5596b168b tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:09.231662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce67f3a1-66a3-49d1-bf88-59e5596b168b tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:09.280389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db43e066-4556-4060-b3e0-469b57512551 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:09.308671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db43e066-4556-4060-b3e0-469b57512551 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1220 microversion: 2.1 time: 0.358949 Sep 01 04:47:09.309636 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 105/227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:08 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1220 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:09.328316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9036a2c-ccb7-4e0b-9fd3-e1fc6df72ee0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] Calling method '.version_select at 0x7fa760856310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:09.535745 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce67f3a1-66a3-49d1-bf88-59e5596b168b tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.391258 Sep 01 04:47:09.536414 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 123/228] 10.222.0.26 () {60 vars in 1191 bytes} [Thu Sep 1 04:47:09 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:09.559515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0374b405-e88f-4258-a43b-d1dd2a2f87fd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:09.676533 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0374b405-e88f-4258-a43b-d1dd2a2f87fd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.130915 Sep 01 04:47:09.687802 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 124/229] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:47:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:09.705480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe8484b6-9665-4019-b1dd-926f17a2a5db tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1894505323"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:09.714020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-fe8484b6-9665-4019-b1dd-926f17a2a5db tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 2196d91e-e257-4153-b528-79a512fa9bca for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:09.764797 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe8484b6-9665-4019-b1dd-926f17a2a5db tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064966 Sep 01 04:47:09.765734 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 125/230] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:09.781205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9aff992f-8806-41dc-a418-96d8213e2ed4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:09.809320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9aff992f-8806-41dc-a418-96d8213e2ed4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:09.809928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9aff992f-8806-41dc-a418-96d8213e2ed4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:09.810551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9aff992f-8806-41dc-a418-96d8213e2ed4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:10.104396 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9aff992f-8806-41dc-a418-96d8213e2ed4 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.329791 Sep 01 04:47:10.106424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 126/231] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:09 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:10.113145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-973c6606-d52d-422f-b5f5-8163f615b77a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76095d040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:10.187279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-973c6606-d52d-422f-b5f5-8163f615b77a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b40b1317-f6fc-45e3-80dc-222caaa9faed" status: 200 len: 661 microversion: 2.1 time: 0.079086 Sep 01 04:47:10.188991 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 127/232] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:10 2022] GET /compute/v2.1/images/b40b1317-f6fc-45e3-80dc-222caaa9faed => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:10.208575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0013a74-55b2-4380-b364-181e6289ae97 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:10.237742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0013a74-55b2-4380-b364-181e6289ae97 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.1 time: 0.045075 Sep 01 04:47:10.239087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 128/233] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:47:10 2022] GET /compute/v2.1/os-aggregates => generated 247 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:10.269272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:10.271308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:10.308157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9036a2c-ccb7-4e0b-9fd3-e1fc6df72ee0 tempest-QuotasAdminTestV236-1902847268 tempest-QuotasAdminTestV236-1902847268-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7?user_id=7669bf92627345128d2ad68a42e9987e" status: 200 len: 282 microversion: 2.36 time: 0.996415 Sep 01 04:47:10.310670 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 106/234] 10.222.0.26 () {60 vars in 1364 bytes} [Thu Sep 1 04:47:09 2022] GET /compute/v2.1/os-quota-sets/7434a8f043a3425181298bd619c0eeb7?user_id=7669bf92627345128d2ad68a42e9987e => generated 282 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:10.320135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:10.320640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:10.322575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:10.323352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:10.324627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:10.325321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:10.328777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2817e8b1-e96a-42b8-abeb-4e45fabc4137 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760848c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:10.405903 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2817e8b1-e96a-42b8-abeb-4e45fabc4137 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b40b1317-f6fc-45e3-80dc-222caaa9faed" status: 200 len: 661 microversion: 2.1 time: 0.093982 Sep 01 04:47:10.419647 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 107/235] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:10 2022] GET /compute/v2.1/images/b40b1317-f6fc-45e3-80dc-222caaa9faed => generated 661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:10.438965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc4d9edb-50c8-4e48-adf6-483663ddbbd6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:10.478959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc4d9edb-50c8-4e48-adf6-483663ddbbd6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:10.479639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc4d9edb-50c8-4e48-adf6-483663ddbbd6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:10.480224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc4d9edb-50c8-4e48-adf6-483663ddbbd6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:10.723902 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc4d9edb-50c8-4e48-adf6-483663ddbbd6 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.307485 Sep 01 04:47:10.739336 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 108/236] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:10 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:10.744143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:10.744756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:10.752391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:10.758255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:10.758858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:10.759768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:10.760581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:10.761160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:10.876005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:10.902301 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3a47ae4-b943-438e-a0e9-5f94a108abd6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1281 microversion: 2.1 time: 0.647906 Sep 01 04:47:10.907975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 129/237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:10 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1281 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:10.921436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e4fd78e-4a6d-46eb-80a1-bd1e08343284 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:10.974519 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e4fd78e-4a6d-46eb-80a1-bd1e08343284 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.065354 Sep 01 04:47:10.975501 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 130/238] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:10 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:10.983464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1878729663", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:11.065676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:11.084379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1cc304d-8629-49c6-98dc-a5d27eb8f1a3 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1272 microversion: 2.1 time: 0.342832 Sep 01 04:47:11.086813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 109/239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:10 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:11.104008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d4b4686-feb1-4bc9-a1f9-53de424d7395 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2094487386"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:11.107962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-0d4b4686-feb1-4bc9-a1f9-53de424d7395 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid a9a7054d-ef13-4888-8aa6-b4464580c005 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:11.144020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:11.176184 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d4b4686-feb1-4bc9-a1f9-53de424d7395 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087617 Sep 01 04:47:11.177875 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 110/240] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:11.614094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-585b1ed0-040c-437a-b4d5-e0b0a8eceb21 tempest-NetworksTest-1326036952 tempest-NetworksTest-1326036952-project-admin] Calling method '.version_select at 0x7fa7616baf70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:11.887172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:11.887653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:11.888054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:11.888458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:11.888865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:11.911105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:11.911597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:11.912031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:11.912828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:11.913226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:11.913643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:11.944999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Getting quotas for project c882395ab5974b498cb5d90f4caaad30. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:11.965938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Getting quotas for user ccd6c72e968c494dac827579cb5af129 and project c882395ab5974b498cb5d90f4caaad30. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:11.991213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:11.995819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:12.099186 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-585b1ed0-040c-437a-b4d5-e0b0a8eceb21 tempest-NetworksTest-1326036952 tempest-NetworksTest-1326036952-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 4012 microversion: 2.1 time: 0.919774 Sep 01 04:47:12.100413 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 111/241] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:47:11 2022] GET /compute/v2.1/os-networks => generated 4012 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:12.105634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d2afbfe-230f-440d-ae72-501ef91ff90d tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:12.130396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2afbfe-230f-440d-ae72-501ef91ff90d tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:12.132695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2afbfe-230f-440d-ae72-501ef91ff90d tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:12.133402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2afbfe-230f-440d-ae72-501ef91ff90d tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:12.160183 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ec9a80b-82a1-41d2-a6de-bd0851c72069 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183267 Sep 01 04:47:12.161117 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 131/242] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:47:12.172541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:12.173489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:12.182333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:12.183175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:12.183823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:12.184753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:12.185413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:12.186039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:12.299680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:12.313820 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2eede7e-6bc5-4120-912c-a94c09491d45 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1281 microversion: 2.1 time: 0.147812 Sep 01 04:47:12.314805 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 132/243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:12 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:12.328414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:12.329436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:12.342255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:12.348200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:12.351310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:12.352191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:12.352790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:12.353816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:12.493671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d2afbfe-230f-440d-ae72-501ef91ff90d tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.391750 Sep 01 04:47:12.494304 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 112/244] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:12.512594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed5c0bdd-bd88-4366-9075-0dab72c6dd67 tempest-NetworksTest-1326036952 tempest-NetworksTest-1326036952-project-admin] Calling method '.version_select at 0x7fa76068e3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:12.532561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:12.550296 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a80b543f-9477-4cd1-9a7a-698a9b4246b6 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1278 microversion: 2.1 time: 0.232210 Sep 01 04:47:12.551148 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 133/245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:12 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:12.566047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-246286895", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:12.672690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:12.746096 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed5c0bdd-bd88-4366-9075-0dab72c6dd67 tempest-NetworksTest-1326036952 tempest-NetworksTest-1326036952-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks/de99b901-9137-483d-84f6-8a5416d6d696" status: 200 len: 652 microversion: 2.1 time: 0.243289 Sep 01 04:47:12.752525 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 113/246] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 04:47:12 2022] GET /compute/v2.1/os-networks/de99b901-9137-483d-84f6-8a5416d6d696 => generated 652 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:12.756972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c10d2f4e-478f-47b9-aaa8-6da59a408fb8 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:12.781651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c10d2f4e-478f-47b9-aaa8-6da59a408fb8 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:12.782606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c10d2f4e-478f-47b9-aaa8-6da59a408fb8 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:12.783086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c10d2f4e-478f-47b9-aaa8-6da59a408fb8 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:12.922193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:12.953075 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c10d2f4e-478f-47b9-aaa8-6da59a408fb8 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.200555 Sep 01 04:47:12.955725 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 114/247] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:13.031247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:13.031742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:13.032128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:13.032858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:13.033264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:13.058755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:13.059662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:13.060040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:13.060960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:13.061604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:13.063382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:13.110251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Getting quotas for project c882395ab5974b498cb5d90f4caaad30. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:13.128176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Getting quotas for user ccd6c72e968c494dac827579cb5af129 and project c882395ab5974b498cb5d90f4caaad30. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:13.166784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:13.169573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:13.312352 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68f62589-d453-4d65-8e0b-2d9a90505c07 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758586 Sep 01 04:47:13.314250 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 134/248] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:47:13.329233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef884f72-22e8-40f8-b546-f652a3d8584d tempest-NetworksTest-1326036952 tempest-NetworksTest-1326036952-project-admin] Calling method '.version_select at 0x7fa760919a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:13.374086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-814037238", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "541b0280-9b86-4b41-9f61-cdb1f531e297"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:13.515707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] validate_networks() for [('541b0280-9b86-4b41-9f61-cdb1f531e297', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:13.639252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef884f72-22e8-40f8-b546-f652a3d8584d tempest-NetworksTest-1326036952 tempest-NetworksTest-1326036952-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 4012 microversion: 2.1 time: 0.321942 Sep 01 04:47:13.639873 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 135/249] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:47:13 2022] GET /compute/v2.1/os-networks => generated 4012 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:13.651846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04d23a41-fb0c-4ed5-b93f-85b777ec0067 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:13.717627 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04d23a41-fb0c-4ed5-b93f-85b777ec0067 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.076620 Sep 01 04:47:13.718130 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 136/250] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:13.727197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1e75afa-2c7c-4ac5-833e-39778e793c3e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:13.727749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1e75afa-2c7c-4ac5-833e-39778e793c3e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:14.067838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1e75afa-2c7c-4ac5-833e-39778e793c3e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:14.077933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1e75afa-2c7c-4ac5-833e-39778e793c3e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1217 microversion: 2.1 time: 0.358510 Sep 01 04:47:14.083688 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 137/251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:13 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1217 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:14.088777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:14.099519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:14.115930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:14.116422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:14.116854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:14.117567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:14.118021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:14.118441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:14.828636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:14.837963 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78aa0e2a-35fb-443e-ac6e-271f3ab0b32f tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1323 microversion: 2.1 time: 0.752814 Sep 01 04:47:14.861401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 138/252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:14 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1323 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:14.870824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:14.871482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:14.887890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:14.888386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:14.888820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:14.889529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:14.889983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:14.890407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:15.351244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:15.368044 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c0c7d71-ab51-45c6-a3f2-a9089ab3bf0a tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1320 microversion: 2.1 time: 0.505335 Sep 01 04:47:15.368876 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 139/253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:14 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:15.373795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da34742e-08d6-434e-84b1-81e3485e8186 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-990560843"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:15.377430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-da34742e-08d6-434e-84b1-81e3485e8186 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 4ea82ecc-02f2-4c56-bf4c-c3bfc4ae79c9 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:15.430093 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da34742e-08d6-434e-84b1-81e3485e8186 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059506 Sep 01 04:47:15.437925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 140/254] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:15.446944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef605cf0-bbc0-4115-977f-eaf43cde66d3 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1941525497"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:15.461291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-ef605cf0-bbc0-4115-977f-eaf43cde66d3 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 20a67b6a-c5dc-4697-9150-c9e485eb642f for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:15.511797 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef605cf0-bbc0-4115-977f-eaf43cde66d3 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072600 Sep 01 04:47:15.512488 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 141/255] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:15.521395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-09828a08-7447-402b-8a98-a1975463b595 req-e171d6b6-9e75-4474-8d3d-e45b7e8fa58f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06e1bef-428e-4421-bba8-f95785a2fa38", "tag": "28ce6f40-1dd1-4d67-a310-c64c0362bc5a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:15.532936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-09828a08-7447-402b-8a98-a1975463b595 req-e171d6b6-9e75-4474-8d3d-e45b7e8fa58f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:15.533672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-09828a08-7447-402b-8a98-a1975463b595 req-e171d6b6-9e75-4474-8d3d-e45b7e8fa58f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:15.534611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-09828a08-7447-402b-8a98-a1975463b595 req-e171d6b6-9e75-4474-8d3d-e45b7e8fa58f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:15.553908 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-09828a08-7447-402b-8a98-a1975463b595 req-e171d6b6-9e75-4474-8d3d-e45b7e8fa58f service nova] Creating event network-changed:28ce6f40-1dd1-4d67-a310-c64c0362bc5a for instance b06e1bef-428e-4421-bba8-f95785a2fa38 on n-h1-820368-37 Sep 01 04:47:15.561981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-09828a08-7447-402b-8a98-a1975463b595 req-e171d6b6-9e75-4474-8d3d-e45b7e8fa58f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048277 Sep 01 04:47:15.562824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 142/256] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:15.587017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:15.587760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:15.599150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=7,nova_api:INSERT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:15.602133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:15.602638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:15.603099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:15.603818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:15.604430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:15.604856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:15.816378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:15.816931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:15.817328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:15.817798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:15.818273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:15.839202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:15.850136 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0c87274-4a06-4133-b507-d78c95401172 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1269 microversion: 2.1 time: 0.285299 Sep 01 04:47:15.852389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:15.866085 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 143/257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:15 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1269 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:15.866186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:15.866186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:15.866186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:15.866186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:15.866538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:15.869887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bfdfd6aa-0fb7-41e3-8ec3-cf7ec863e753 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:15.945275 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bfdfd6aa-0fb7-41e3-8ec3-cf7ec863e753 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.088951 Sep 01 04:47:15.950641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:15.952426 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 144/258] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:15.957482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9667b2f4-f068-44f7-a039-5b9982e177f4 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:15.974039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for user ce4ece60266c4a9692b03d795cea8462 and project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:16.010066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667b2f4-f068-44f7-a039-5b9982e177f4 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:16.012075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667b2f4-f068-44f7-a039-5b9982e177f4 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:16.013775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9667b2f4-f068-44f7-a039-5b9982e177f4 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:16.030132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:16.033084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:16.153924 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-420e4ae9-20d0-48dc-bd94-174c5f3fbe96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.196792 Sep 01 04:47:16.161865 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 115/259] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3205 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:47:16.180109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:16.180774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:16.196799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:16.197141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:16.197576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:16.210701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:16.213572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:16.214323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:16.357848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9667b2f4-f068-44f7-a039-5b9982e177f4 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 244 microversion: 2.1 time: 0.404178 Sep 01 04:47:16.358468 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 145/260] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:15 2022] POST /compute/v2.1/os-aggregates/13/action => generated 244 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:16.369372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49181018-d20f-43b4-ba49-37bb4d1f1c13 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:16.401348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-49181018-d20f-43b4-ba49-37bb4d1f1c13 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49181018-d20f-43b4-ba49-37bb4d1f1c13 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Request method failure captured: Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkbBxpeftC6X2RTI1Clp1nFQwI6_j_ahIFe641JV8Ua0HojTlMxBFaEYcEHcsmUG8rUxOydwe8j_wLwyF-RqS_zecwhD1WGRnFjRGZta66kOasD3uIYwd0zyjKpd5-SW8MCkWWmjkI-MTh_YNZOCeT8NNU4VddFnZ_IyFieE_bbnkU Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:47:16.403112 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 151b81390a1c4bf7937b20ebd0b66942 Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: exception: Aggregate 12 could not be found. Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '12'} Sep 01 04:47:16.404374 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:16.405189 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 01 04:47:16.406300 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.410607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49181018-d20f-43b4-ba49-37bb4d1f1c13 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:16.417651 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49181018-d20f-43b4-ba49-37bb4d1f1c13 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.055062 Sep 01 04:47:16.418818 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 146/261] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:47:16 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:47:16.431324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2d11520-140b-46ef-8dec-ae7e1e10a890 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:16.432920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2d11520-140b-46ef-8dec-ae7e1e10a890 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:16.664954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2d11520-140b-46ef-8dec-ae7e1e10a890 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:16.684518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2d11520-140b-46ef-8dec-ae7e1e10a890 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:16.691859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2d11520-140b-46ef-8dec-ae7e1e10a890 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:16.693104 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2d11520-140b-46ef-8dec-ae7e1e10a890 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1261 microversion: 2.25 time: 0.273103 Sep 01 04:47:16.693845 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 147/262] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:16 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1261 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:16.719768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ce8317dd-d257-4a51-bf73-c555846d4be7 req-dec474ee-d51e-4906-8910-ed994191d769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:16.736002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce8317dd-d257-4a51-bf73-c555846d4be7 req-dec474ee-d51e-4906-8910-ed994191d769 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:16.736722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce8317dd-d257-4a51-bf73-c555846d4be7 req-dec474ee-d51e-4906-8910-ed994191d769 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:16.737418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ce8317dd-d257-4a51-bf73-c555846d4be7 req-dec474ee-d51e-4906-8910-ed994191d769 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:16.779901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ce8317dd-d257-4a51-bf73-c555846d4be7 req-dec474ee-d51e-4906-8910-ed994191d769 service nova] Creating event network-changed:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:47:16.796463 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ce8317dd-d257-4a51-bf73-c555846d4be7 req-dec474ee-d51e-4906-8910-ed994191d769 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098964 Sep 01 04:47:16.796986 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 148/263] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:16.821990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bfafd94-9d26-4137-b2e5-dd08aafe09c8 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:16.842688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bfafd94-9d26-4137-b2e5-dd08aafe09c8 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5349ae268be44f1ba7762eda25816148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d394885a2343438400d36c85f38385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bfafd94-9d26-4137-b2e5-dd08aafe09c8 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Request method failure captured: Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 43 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkYmVyytTIlfbFhY3A02omcyu_IdM72gWZnt1yFVAtcUAMzHezmRMRh_9kIW793rQc4bnI6eEhuCH_msZNG4VFmkc3bxTHTPh3k5FK0zZBNBVtxqnxgyy95--fsAL7LnpWyKV9fXZZMo13z5FyXxZ77WCKbZIJCNjAOIZmDkz5s1K0 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:16.852408 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5d394885a2343438400d36c85f38385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5d394885a2343438400d36c85f38385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5d394885a2343438400d36c85f38385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f5d394885a2343438400d36c85f38385 Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-954233764 Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5349ae268be44f1ba7762eda25816148 Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-954233764-project Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: {"remove_host": {"host": "n-h1-820368-37"}} Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:16.853665 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-820368-37'}}} Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:16.854432 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 01 04:47:16.855566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:16.856845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bfafd94-9d26-4137-b2e5-dd08aafe09c8 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:16.856845 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bfafd94-9d26-4137-b2e5-dd08aafe09c8 tempest-AggregatesAdminNegativeTestJSON-954233764 tempest-AggregatesAdminNegativeTestJSON-954233764-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.057742 Sep 01 04:47:16.865244 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 149/264] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:16.883825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:16.889864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:16.917051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:16.917566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:16.918004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:16.921293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:16.921810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:16.922401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:17.088089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:17.103528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-663fba7b-81cb-401c-90b0-17feced99292 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1323 microversion: 2.1 time: 0.940279 Sep 01 04:47:17.104716 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 116/265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:16 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1323 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:17.112564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b5cc631-fdc8-4421-aae3-0671252feb56 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:17.148597 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1b5cc631-fdc8-4421-aae3-0671252feb56 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b5cc631-fdc8-4421-aae3-0671252feb56 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Request method failure captured: Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkbBxpeftC6X2RTI1Clp1nFQwI6_j_ahIFe641JV8Ua0HojTlMxBFaEYcEHcsmUG8rUxOydwe8j_wLwyF-RqS_zecwhD1WGRnFjRGZta66kOasD3uIYwd0zyjKpd5-SW8MCkWWmjkI-MTh_YNZOCeT8NNU4VddFnZ_IyFieE_bbnkU Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:47:17.157680 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 151b81390a1c4bf7937b20ebd0b66942 Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: exception: Aggregate 12 could not be found. Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '12'} Sep 01 04:47:17.159157 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:47:17.160100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:17.161143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:17.162487 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:17.162487 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:17.162487 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:17.162487 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Sep 01 04:47:17.162487 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:17.165355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b5cc631-fdc8-4421-aae3-0671252feb56 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:17.166538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b5cc631-fdc8-4421-aae3-0671252feb56 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.060886 Sep 01 04:47:17.172185 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 117/266] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:17 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:47:17.181666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3f27e1c-9bfa-4872-a5c0-1b0d396df328 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:17.218546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3f27e1c-9bfa-4872-a5c0-1b0d396df328 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:17.219096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3f27e1c-9bfa-4872-a5c0-1b0d396df328 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:17.219540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3f27e1c-9bfa-4872-a5c0-1b0d396df328 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:17.498828 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3f27e1c-9bfa-4872-a5c0-1b0d396df328 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.325239 Sep 01 04:47:17.510720 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 118/267] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:17 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:17.519387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:17.520045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:17.554194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:17.569164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:17.569823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:17.570601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:17.571110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:17.571540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:17.603998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:17.629862 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b36c0cc-c72d-4103-8606-f0e7b5c2231e tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1320 microversion: 2.1 time: 0.759534 Sep 01 04:47:17.631201 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 150/268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:16 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1320 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:17.653991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a543250-08af-4623-a98b-f67e02aea1bf tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1026322536", "name": "tempest-test_aggregate-978549955"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:17.725172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-9a543250-08af-4623-a98b-f67e02aea1bf tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 5adbd89d-5e52-4955-be0b-adb5889dcafe for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:17.787597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:17.815609 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f224110-77c8-450e-9dcd-87d00e23c2e7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1275 microversion: 2.1 time: 0.297839 Sep 01 04:47:17.816445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 119/269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:17 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:17.820170 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a543250-08af-4623-a98b-f67e02aea1bf tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.185036 Sep 01 04:47:17.825687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5503e51-e978-437d-a146-dd6fcc271c4a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:17.835713 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 151/270] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Sep 1 04:47:17 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:17.841960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:17.842997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:17.864470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:17.865105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:17.866831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:17.868200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:17.870380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:17.870854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:17.888406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5503e51-e978-437d-a146-dd6fcc271c4a tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.066252 Sep 01 04:47:17.888994 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 120/271] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:17 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:17.908297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf8a4cd7-5ecf-4b9e-b8d4-6d2a14ec0342 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:17.985566 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf8a4cd7-5ecf-4b9e-b8d4-6d2a14ec0342 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.094456 Sep 01 04:47:17.989907 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 121/272] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:17 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:17.992908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15c13449-a1f5-49d7-a6bf-3150cdc0925e tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1635007769"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:17.996745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-15c13449-a1f5-49d7-a6bf-3150cdc0925e tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Generated uuid 392f0a5b-ed05-4be0-969d-852cecaedd33 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:18.070296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15c13449-a1f5-49d7-a6bf-3150cdc0925e tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.081276 Sep 01 04:47:18.077532 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 122/273] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:18.089253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a6b52df-7890-4781-a40b-7d8189e24a95 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:18.128059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9a6b52df-7890-4781-a40b-7d8189e24a95 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a6b52df-7890-4781-a40b-7d8189e24a95 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Request method failure captured: Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkbBxpeftC6X2RTI1Clp1nFQwI6_j_ahIFe641JV8Ua0HojTlMxBFaEYcEHcsmUG8rUxOydwe8j_wLwyF-RqS_zecwhD1WGRnFjRGZta66kOasD3uIYwd0zyjKpd5-SW8MCkWWmjkI-MTh_YNZOCeT8NNU4VddFnZ_IyFieE_bbnkU Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:47:18.145672 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 151b81390a1c4bf7937b20ebd0b66942 Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: exception: Aggregate 14 could not be found. Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '14'} Sep 01 04:47:18.147113 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.148304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 01 04:47:18.150147 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.154968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a6b52df-7890-4781-a40b-7d8189e24a95 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:18.156331 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a6b52df-7890-4781-a40b-7d8189e24a95 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.077470 Sep 01 04:47:18.161332 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 123/274] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:47:18 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:47:18.169175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:18.192332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:18.193176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:18.193822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:18.216395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:18.217355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:18.219002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:18.245790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.compute.aggregates [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 01 04:47:18.252673 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Request method failure captured: Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 42 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkaVGsVt94sRsEjswhHUolQbOGQLT0m896ARuQRXFIXvUxBUUDut12Y74n_KBwXvEUdBu6An1A0QRM1Yigo--0qwaCcm-ZkAEvl44NhUX7Z1mYfhvCbv9Z5bkW0x-KL4EAISm1euovQoVeU2MO2F6tKdgdGzyM9L5A8hoAzSdF4W7w Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:47:18.255600 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e356817b4aa4d68932caf67312ae6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5e356817b4aa4d68932caf67312ae6a2 Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400 Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 09c4be3b9e8d45f29f08c08d019bfbbb Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: {"remove_host": {"host": "nonexist_host"}} Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:18.256985 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot remove host nonexist_host in aggregate 15 Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Sep 01 04:47:18.257757 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 01 04:47:18.259104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.260439 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:18.261894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbca1fa1-bfc1-4556-a667-a42e83b5aaa5 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.093916 Sep 01 04:47:18.272354 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 124/275] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:18 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:47:18.285109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:18.295109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:18.295918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:18.308427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:18.311487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:18.313067 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a77a8777-b4e6-4f92-ad90-7da904073a3f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1313 microversion: 2.25 time: 0.476038 Sep 01 04:47:18.314840 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 152/276] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:17 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:18.321881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f31a0153-738b-4113-b89f-cf0b0f0b3479 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:18.323534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:18.325828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:18.326790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:18.340825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:18.340825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:18.341016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:18.343919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f31a0153-738b-4113-b89f-cf0b0f0b3479 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f31a0153-738b-4113-b89f-cf0b0f0b3479 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Request method failure captured: Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkbBxpeftC6X2RTI1Clp1nFQwI6_j_ahIFe641JV8Ua0HojTlMxBFaEYcEHcsmUG8rUxOydwe8j_wLwyF-RqS_zecwhD1WGRnFjRGZta66kOasD3uIYwd0zyjKpd5-SW8MCkWWmjkI-MTh_YNZOCeT8NNU4VddFnZ_IyFieE_bbnkU Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:47:18.346087 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/920e6ff048204d2bb1030b8022599bf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 920e6ff048204d2bb1030b8022599bf7 Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021622484 Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 151b81390a1c4bf7937b20ebd0b66942 Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AggregatesAdminTestJSON-1021622484-project-admin Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: exception: Aggregate 14 could not be found. Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '14'} Sep 01 04:47:18.347982 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:47:18.348840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:18.349997 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:18.351301 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:18.351301 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:18.351301 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:18.351301 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Sep 01 04:47:18.351301 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:18.352167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f31a0153-738b-4113-b89f-cf0b0f0b3479 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:18.375110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f31a0153-738b-4113-b89f-cf0b0f0b3479 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.058115 Sep 01 04:47:18.376033 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 153/277] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:18 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:47:18.381076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11c44d7f-291e-494a-a8c2-df5336d54bd2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:18.443408 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11c44d7f-291e-494a-a8c2-df5336d54bd2 tempest-AggregatesAdminNegativeTestJSON-1557769400 tempest-AggregatesAdminNegativeTestJSON-1557769400-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.065996 Sep 01 04:47:18.444383 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 154/278] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:18.456033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3182a7d6-eee1-4bcf-8464-53797fa88028 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-484851665"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:18.467485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.aggregate [None req-3182a7d6-eee1-4bcf-8464-53797fa88028 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid c1de59b0-9380-42ed-bcbc-c1ae7a269b13 for aggregate {{(pid=128862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:18.528902 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3182a7d6-eee1-4bcf-8464-53797fa88028 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080944 Sep 01 04:47:18.531058 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 155/279] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:18.544776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b76b401-6653-433c-9209-cdbe7bba64e9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:18.576240 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b76b401-6653-433c-9209-cdbe7bba64e9 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.035605 Sep 01 04:47:18.582929 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 156/280] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:47:18 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:18.597405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e20d6dcd-3ed7-4ff8-b77a-818d2168c973 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:18.672918 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e20d6dcd-3ed7-4ff8-b77a-818d2168c973 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.082659 Sep 01 04:47:18.679264 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 157/281] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 04:47:18 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:18.691968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:18.692932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:18.703083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:18.705322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:18.706519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:18.711675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:18.712625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:18.714197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:19.404787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:19.417812 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ada0ad37-fc2c-44ea-8aad-866ca73fa0c4 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1320 microversion: 2.1 time: 0.734836 Sep 01 04:47:19.418725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 158/282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:18 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:19.419706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:19.427556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-654c0c01-9b2a-446a-bf34-a3b7e472670a tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:19.438626 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-654c0c01-9b2a-446a-bf34-a3b7e472670a tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.018670 Sep 01 04:47:19.439563 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 159/283] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:47:19 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:19.443326 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6611769a-adfe-44f9-ac67-cb786cb361ac tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1323 microversion: 2.1 time: 1.165917 Sep 01 04:47:19.444245 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 125/284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:18 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1323 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:19.452863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:19.480170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:19.505173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:19.507776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:19.508954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:19.509788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:19.510329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:19.513979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:19.648595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:19.658509 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cfbfcf9-b263-403c-a537-e7b309e5d378 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1275 microversion: 2.1 time: 0.209353 Sep 01 04:47:19.659374 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 126/285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:19 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:19.677104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:19.679534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:19.687086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:19.689096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:19.689967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:19.690907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:19.691702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:19.692310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:19.700471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:19.788198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a009fcce-f820-4b2b-bdcd-6279e0b61808 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] Action: 'create', calling method: .version_select at 0x7fa760b28f70>, body: {"security_group": {"name": "tempest-securitygroup-1927094079", "description": "tempest-description-1041656751"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:19.800893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:19.815751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:19.820805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:19.822081 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e67f77b8-5b39-49b2-8ef4-2aa32ed9d28c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1319 microversion: 2.25 time: 0.161756 Sep 01 04:47:19.827352 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 127/286] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:19 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:19.850323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-850e4239-c20a-4949-b108-31b89a2fad66 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:19.902445 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-850e4239-c20a-4949-b108-31b89a2fad66 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.072066 Sep 01 04:47:19.905873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 128/287] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:19 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:19.922407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9588e892-de6a-4bc6-86d2-3d524626016e tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-26480466", "availability_zone": "tempest-test_az-808325376"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:19.933734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-9588e892-de6a-4bc6-86d2-3d524626016e tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 2b1dcc3d-e6e4-4062-bf39-618fb856c7d7 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:20.009368 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9588e892-de6a-4bc6-86d2-3d524626016e tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.096097 Sep 01 04:47:20.018051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 129/288] 10.222.0.26 () {60 vars in 1165 bytes} [Thu Sep 1 04:47:19 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:20.055631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7a4c118-8377-4e3c-a470-ffa59270c3bd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-26480466_new", "availability_zone": "tempest-test_az-808325376_new"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:20.236456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a4c118-8377-4e3c-a470-ffa59270c3bd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:20.237385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a4c118-8377-4e3c-a470-ffa59270c3bd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:20.239037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a4c118-8377-4e3c-a470-ffa59270c3bd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:20.311122 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7a4c118-8377-4e3c-a470-ffa59270c3bd tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 333 microversion: 2.1 time: 0.287624 Sep 01 04:47:20.318752 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 130/289] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Sep 1 04:47:20 2022] PUT /compute/v2.1/os-aggregates/17 => generated 333 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:20.328867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90481a65-7bdc-42e6-bba5-f6d94a777f8f tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:20.361840 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90481a65-7bdc-42e6-bba5-f6d94a777f8f tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.037316 Sep 01 04:47:20.371951 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 131/290] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:47:20 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:20.378485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-75913ca2-158e-48b4-9610-7f7e2d7e648a req-4441121f-86e8-462e-9501-ea0038d404a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06e1bef-428e-4421-bba8-f95785a2fa38", "name": "network-vif-plugged", "status": "completed", "tag": "28ce6f40-1dd1-4d67-a310-c64c0362bc5a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:20.392528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-75913ca2-158e-48b4-9610-7f7e2d7e648a req-4441121f-86e8-462e-9501-ea0038d404a2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:20.393137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-75913ca2-158e-48b4-9610-7f7e2d7e648a req-4441121f-86e8-462e-9501-ea0038d404a2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:20.395120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-75913ca2-158e-48b4-9610-7f7e2d7e648a req-4441121f-86e8-462e-9501-ea0038d404a2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:20.410529 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-75913ca2-158e-48b4-9610-7f7e2d7e648a req-4441121f-86e8-462e-9501-ea0038d404a2 service nova] Creating event network-vif-plugged:28ce6f40-1dd1-4d67-a310-c64c0362bc5a for instance b06e1bef-428e-4421-bba8-f95785a2fa38 on n-h1-820368-37 Sep 01 04:47:20.418056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-75913ca2-158e-48b4-9610-7f7e2d7e648a req-4441121f-86e8-462e-9501-ea0038d404a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044344 Sep 01 04:47:20.419062 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 132/291] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:20.447076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88fc3b7a-1ea5-4e46-8fec-50460f6f9874 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:20.524616 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88fc3b7a-1ea5-4e46-8fec-50460f6f9874 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.104267 Sep 01 04:47:20.527795 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 133/292] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:20.539970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:20.542415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:20.556104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:20.556657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:20.557096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:20.558606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:20.559110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:20.559539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:20.878694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a009fcce-f820-4b2b-bdcd-6279e0b61808 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.437479 Sep 01 04:47:20.879692 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 160/293] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:47:19 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:20.892688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:20.894038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:20.906836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:20.907974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:20.908648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:20.909694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:20.910551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:20.911343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:21.042261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:21.054875 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54e3c1e2-aacc-4cb3-92f3-b236753c2a8d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1320 microversion: 2.1 time: 0.521276 Sep 01 04:47:21.056046 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 134/294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:20 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1320 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:21.061239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f19a8901-536c-4d4a-96a3-7446681ffe9a tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-28373340"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:21.067150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-f19a8901-536c-4d4a-96a3-7446681ffe9a tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Generated uuid 07f3214f-1609-4350-94e2-35e23332b3b7 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 04:47:21.093833 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f19a8901-536c-4d4a-96a3-7446681ffe9a tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.036384 Sep 01 04:47:21.095066 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 135/295] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 04:47:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:21.110372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:21.113826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:21.134592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:21.135258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:21.135695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:21.137713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:21.138172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:21.138633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:21.665160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:21.675567 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97fd6d6a-4040-4752-9da1-d5e5aab002a6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1323 microversion: 2.1 time: 0.794725 Sep 01 04:47:21.677714 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 161/296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:20 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1323 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:21.715357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:21.719257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:21.742438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:21.743995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:21.747620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:21.749066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:21.749943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:21.753129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:21.753859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:21.760508 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ae5e6e2-1f95-415f-9d1c-679a9e96e898 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.664239 Sep 01 04:47:21.766990 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 136/297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:21 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:21.778867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b529b8d0-003a-46e8-ae7d-eff04c90fa5c tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] Action: 'create', calling method: .version_select at 0x7fa760669f70>, body: {"security_group": {"name": "tempest-securitygroup-1626873251", "description": "tempest-description-940956842"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:22.580609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:22.597867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:22.599369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:22.600499 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa490c78-cd3e-4c99-a6a3-168a318e5224 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1361 microversion: 2.25 time: 0.921699 Sep 01 04:47:22.603845 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 162/298] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:21 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1361 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:22.615384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff5d5fe0-6790-4a3b-98f9-fcfe01c636de tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:22.629153 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff5d5fe0-6790-4a3b-98f9-fcfe01c636de tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.020537 Sep 01 04:47:22.630195 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 163/299] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:47:22 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:22.634972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-107e835d-b400-4e58-a7eb-61c3f6183e02 req-2ed1acbd-48c0-4fa3-a276-d9d711275a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:22.646055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-107e835d-b400-4e58-a7eb-61c3f6183e02 req-2ed1acbd-48c0-4fa3-a276-d9d711275a71 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:22.646790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-107e835d-b400-4e58-a7eb-61c3f6183e02 req-2ed1acbd-48c0-4fa3-a276-d9d711275a71 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:22.649312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-107e835d-b400-4e58-a7eb-61c3f6183e02 req-2ed1acbd-48c0-4fa3-a276-d9d711275a71 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:22.671451 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-107e835d-b400-4e58-a7eb-61c3f6183e02 req-2ed1acbd-48c0-4fa3-a276-d9d711275a71 service nova] Creating event network-changed:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:47:22.678694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-107e835d-b400-4e58-a7eb-61c3f6183e02 req-2ed1acbd-48c0-4fa3-a276-d9d711275a71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046641 Sep 01 04:47:22.683960 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 164/300] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:22.690521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:22.691323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:22.699347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:22.699834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:22.700404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:22.701188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:22.710381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:22.711187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:22.786834 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b529b8d0-003a-46e8-ae7d-eff04c90fa5c tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.013418 Sep 01 04:47:22.786834 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 137/301] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:47:21 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:23.047054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:23.066619 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-870e2762-4127-4f08-a8f3-ac82536b1a79 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1470 microversion: 2.1 time: 0.380638 Sep 01 04:47:23.068403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 165/302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:22 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:23.077833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-119adba3-278d-4be5-ade2-b6265a750c26 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:23.083133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:23.109258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a66944-9df5-4f8d-8f43-7136696b435a tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Calling method '.version_select at 0x7fa760848700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:23.124988 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-119adba3-278d-4be5-ade2-b6265a750c26 tempest-AggregatesAdminTestJSON-1021622484 tempest-AggregatesAdminTestJSON-1021622484-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.052060 Sep 01 04:47:23.125911 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 166/303] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:23 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 04:47:23.137781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:23.141896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:23.156186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.159318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.159810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.162601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.163132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.163568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.205509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:23.347419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=10,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:23.361419 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85a66944-9df5-4f8d-8f43-7136696b435a tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 371 microversion: 2.1 time: 0.573529 Sep 01 04:47:23.362377 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 138/304] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 04:47:22 2022] GET /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 371 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:23.374275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:23.375176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:23.383365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.383962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.384437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.385336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.385845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.386497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.447392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:23.455094 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea51f618-b0d4-4a10-aaff-84d7cfac5ea2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1323 microversion: 2.1 time: 0.327551 Sep 01 04:47:23.460653 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 167/305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:23 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:23.576079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2a6bea5-8535-46da-bd16-eb86d9459446 tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Action: 'create', calling method: .version_select at 0x7fa760685dc0>, body: {"security_group": {"name": "tempest-securitygroup-333968872", "description": "tempest-description-498436172"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:23.636012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:23.644775 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca796b16-b7af-4703-9330-afc63c03e613 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.273672 Sep 01 04:47:23.645343 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 139/306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:23 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:23.649941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:23.652445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:23.661474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.662136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.662554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.663411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.663941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.664474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.762927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba91e708-7773-4191-8414-c9d8f200680a tempest-DeleteServersAdminTestJSON-1566324000 tempest-DeleteServersAdminTestJSON-1566324000-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38/action" status: 202 len: 0 microversion: 2.1 time: 0.116472 Sep 01 04:47:23.763572 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 140/307] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:47:23 2022] POST /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:23.769758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:23.770246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:23.776685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.777361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.777962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.778697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.779170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.779938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.795911 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] HTTP exception thrown: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Request method failure captured: Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 HTTP/1.1 Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkYHkedEuKyAGL6LBWlZ4UREK7cx1y2_PkvstFQLPlNJC84eoOLBETvO9GFHAO28lxrbXxug11sRxfyFLPyHWt9JkpzoxkL5FNnuILLOrBcAXojdPjeq5FylmTZkVfQYfUxTiUcgKpwCHMhPhqQYSkRrXZgyrKyMWO-1XuCr5xZq6g Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8b9254bc3b5a475aa46ad6cff7f4b431 Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:23.798577 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8b9254bc3b5a475aa46ad6cff7f4b431 Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-705221199-project Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c455ebe8e8b34ba483438f2d2f7c4755 Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-705221199-project Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:23.800851 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '47a7b786-bbb6-4e29-89fb-b90fc5b22085'} Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:23.805130 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:23.806513 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.807931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Returning 404 to user: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:23.807931 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9aba6d31-bc1c-4f55-ab44-889759c8715f tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "DELETE /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 404 len: 111 microversion: 2.1 time: 0.036191 Sep 01 04:47:23.807931 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 141/308] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:23 2022] DELETE /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:23.807931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c6b803f8-0875-4515-9948-0eb053497658 req-9d9b08ee-5f6c-424b-b94f-c12aaaef80d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56be13bc-1e86-44b3-8e54-a2f677bb469e", "tag": "6f4d8c12-ccb6-427f-8a09-3816eba070bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:23.817216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6b803f8-0875-4515-9948-0eb053497658 req-9d9b08ee-5f6c-424b-b94f-c12aaaef80d4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.817838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6b803f8-0875-4515-9948-0eb053497658 req-9d9b08ee-5f6c-424b-b94f-c12aaaef80d4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.818299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6b803f8-0875-4515-9948-0eb053497658 req-9d9b08ee-5f6c-424b-b94f-c12aaaef80d4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.829638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c6b803f8-0875-4515-9948-0eb053497658 req-9d9b08ee-5f6c-424b-b94f-c12aaaef80d4 service nova] Creating event network-changed:6f4d8c12-ccb6-427f-8a09-3816eba070bb for instance 56be13bc-1e86-44b3-8e54-a2f677bb469e on n-h2-820368-37 Sep 01 04:47:23.835983 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c6b803f8-0875-4515-9948-0eb053497658 req-9d9b08ee-5f6c-424b-b94f-c12aaaef80d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Sep 01 04:47:23.836601 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 142/309] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:23.952222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-770726d5-db2c-4d4e-86e9-8cd668738286 tempest-AZAdminNegativeTestJSON-584687937 tempest-AZAdminNegativeTestJSON-584687937-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:23.953697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-770726d5-db2c-4d4e-86e9-8cd668738286 tempest-AZAdminNegativeTestJSON-584687937 tempest-AZAdminNegativeTestJSON-584687937-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '5f9b4b4af8eb400b94d5e1d4b590a7cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e701fca666d4d03a373dc7a00ae3c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-770726d5-db2c-4d4e-86e9-8cd668738286 tempest-AZAdminNegativeTestJSON-584687937 tempest-AZAdminNegativeTestJSON-584687937-project] Request method failure captured: Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlatTps1BMLyyzODB50Hq0B8wHRSU2zbIkHaVUit4Q0FASkoDmuhZ9vWcL_9WDvjzHOwVcVg79W-LgMDx0GCimNvBAsZ-XtSHHiApGOm721utVMR_Xu1P-Igw15umwMgqA9HNyq8DX9mUIDMJ6R15asnMl3ZJQ19N1r84-DRkVlXEc Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9e701fca666d4d03a373dc7a00ae3c7b Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AZAdminNegativeTestJSON-584687937 Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:23.955519 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e701fca666d4d03a373dc7a00ae3c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e701fca666d4d03a373dc7a00ae3c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e701fca666d4d03a373dc7a00ae3c7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e701fca666d4d03a373dc7a00ae3c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AZAdminNegativeTestJSON-584687937 Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9e701fca666d4d03a373dc7a00ae3c7b Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-584687937 Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AZAdminNegativeTestJSON-584687937-project Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 5f9b4b4af8eb400b94d5e1d4b590a7cd Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AZAdminNegativeTestJSON-584687937-project Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 01 04:47:23.957377 n-d-820368-37 devstack@n-api.service[128863]: action_args: {} Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:23.958096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:23.959174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-770726d5-db2c-4d4e-86e9-8cd668738286 tempest-AZAdminNegativeTestJSON-584687937 tempest-AZAdminNegativeTestJSON-584687937-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:23.962581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-770726d5-db2c-4d4e-86e9-8cd668738286 tempest-AZAdminNegativeTestJSON-584687937 tempest-AZAdminNegativeTestJSON-584687937-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.119839 Sep 01 04:47:23.962581 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 143/310] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 04:47:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 121 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:23.963962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0cc4f012-bc88-4c3f-9872-d199a6d0c0cb req-f2046086-43a7-4cbf-a227-0d05085346b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "name": "network-vif-plugged", "status": "completed", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:23.975410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0cc4f012-bc88-4c3f-9872-d199a6d0c0cb req-f2046086-43a7-4cbf-a227-0d05085346b3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:23.975855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0cc4f012-bc88-4c3f-9872-d199a6d0c0cb req-f2046086-43a7-4cbf-a227-0d05085346b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:23.976297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0cc4f012-bc88-4c3f-9872-d199a6d0c0cb req-f2046086-43a7-4cbf-a227-0d05085346b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:23.987987 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2a6bea5-8535-46da-bd16-eb86d9459446 tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.530707 Sep 01 04:47:23.988516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0cc4f012-bc88-4c3f-9872-d199a6d0c0cb req-f2046086-43a7-4cbf-a227-0d05085346b3 service nova] Creating event network-vif-plugged:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:47:23.989075 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 168/311] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:47:23 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:23.993866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Action: 'update', calling method: .version_select at 0x7fa760685ca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:24.003664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0cc4f012-bc88-4c3f-9872-d199a6d0c0cb req-f2046086-43a7-4cbf-a227-0d05085346b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044252 Sep 01 04:47:24.004724 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 144/312] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:24.009892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:24.010653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:24.026099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.026610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.027173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.027984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.028320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.028737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.079898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.080378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.080957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.082356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.083065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.083691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.138009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62d0dfc2-36d2-40c6-8fd7-fcf648c77430 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 328 microversion: 2.1 time: 0.147680 Sep 01 04:47:24.138723 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 169/313] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:23 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:24.144375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:24.145009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:24.151405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.151885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.152438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.153150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.153585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.153996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.179598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:24.192399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.192884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.193109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:24.193331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.193774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lazy-loading 'fault' on Instance uuid b06e1bef-428e-4421-bba8-f95785a2fa38 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:47:24.195904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:24.197063 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a5ae039-369b-4900-b32f-99251bb1e138 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1361 microversion: 2.25 time: 0.191564 Sep 01 04:47:24.197941 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 145/314] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:24 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:24.202784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:24.203486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] [instance: 47a7b786-bbb6-4e29-89fb-b90fc5b22085] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:24.209930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.210706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.211374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.212431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.213056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.213641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.232866 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] HTTP exception thrown: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Request method failure captured: Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 HTTP/1.1 Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkYHkedEuKyAGL6LBWlZ4UREK7cx1y2_PkvstFQLPlNJC84eoOLBETvO9GFHAO28lxrbXxug11sRxfyFLPyHWt9JkpzoxkL5FNnuILLOrBcAXojdPjeq5FylmTZkVfQYfUxTiUcgKpwCHMhPhqQYSkRrXZgyrKyMWO-1XuCr5xZq6g Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8b9254bc3b5a475aa46ad6cff7f4b431 Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:24.235034 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8b9254bc3b5a475aa46ad6cff7f4b431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8b9254bc3b5a475aa46ad6cff7f4b431 Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-705221199 Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-705221199-project Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c455ebe8e8b34ba483438f2d2f7c4755 Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-705221199-project Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:24.236333 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '47a7b786-bbb6-4e29-89fb-b90fc5b22085'} Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:24.237136 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. Sep 01 04:47:24.238208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:24.239228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] Returning 404 to user: Instance 47a7b786-bbb6-4e29-89fb-b90fc5b22085 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:24.239228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-703a50ea-0b13-47a2-88ce-e414bc824e18 tempest-AggregatesAdminTestJSON-705221199 tempest-AggregatesAdminTestJSON-705221199-project] 10.222.0.26 "GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085" status: 404 len: 111 microversion: 2.1 time: 0.037360 Sep 01 04:47:24.239228 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 146/315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:24 2022] GET /compute/v2.1/servers/47a7b786-bbb6-4e29-89fb-b90fc5b22085 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:24.242631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d096e732-5d68-4f2b-b030-abdcec5e1392 tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Action: 'create', calling method: .version_select at 0x7fa7605f3160>, body: {"security_group": {"name": "tempest-securitygroup-8617065", "description": "tempest-description-1603015456"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:24.389913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:24.404642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96f4c93a-13e2-4ac9-9a83-a1f667f3cf18 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1453 microversion: 2.1 time: 0.263388 Sep 01 04:47:24.406189 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 170/316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:24 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1453 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:24.585355 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d096e732-5d68-4f2b-b030-abdcec5e1392 tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.346856 Sep 01 04:47:24.585955 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 147/317] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:47:24 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:24.598468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:24.599362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:24.615571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.617766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.618186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.619905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.621685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.622183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.685019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:47:24.872502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1252009976", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:24.904547 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8b9e3bf-b00e-4186-b65f-06d6d268c175 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 204 len: 0 microversion: 2.1 time: 0.309931 Sep 01 04:47:24.908753 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 148/318] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:24 2022] DELETE /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:47:24.917212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:24.918369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:24.929405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.932425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.933217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.935390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:24.936010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:24.937693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:24.942913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:25.216748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:25.245767 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5251850f-ab61-42c1-a1eb-b7c9a314dfed tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1323 microversion: 2.1 time: 0.335046 Sep 01 04:47:25.246909 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 149/319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:24 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:25.251792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Calling method '.version_select at 0x7fa76068edc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:25.309169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:25.310144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:25.310833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:25.311404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:25.312089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:25.336653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.337312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.338343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.339654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.342852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.344546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.395984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Getting quotas for project b897104d2d484ff7ab252e746edb2734. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:25.402097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Getting quotas for user 61d870d984fd4b08b128feec8353e564 and project b897104d2d484ff7ab252e746edb2734. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:25.405089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:25.420060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.utils [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] cores quota exceeded for b897104d2d484ff7ab252e746edb2734, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128862) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 01 04:47:25.421214 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Request method failure captured: Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 145 Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlZ7c1_YAq5JcaL5oT0Nei2hh2mDptFHhqn25lNEJh3mT1F_exffLFUsbaV-yCHbEcgWvSYonmxZCEUiqTFTGSZoZqZyWvqzZ3i-XcSEsgITzXZ0edN0EV9y24o1H-DVwXV3iO9oOJCCX8KohfnFhRZm0sU1IrrbImj_J8iQ_WUFgw Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:25.428902 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b897104d2d484ff7ab252e746edb2734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 61d870d984fd4b08b128feec8353e564 Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1252009976", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} Sep 01 04:47:25.430484 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1252009976', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452'}}} Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 01 04:47:25.431488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:25.434083 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.435469 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:25.437747 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:25.437747 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:25.437747 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:25.437747 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:25.437747 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 01 04:47:25.437747 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:25.449878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:25.452767 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-135f011f-3e0c-4ef1-84b0-23f7eca6762d tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.044489 Sep 01 04:47:25.454582 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 171/320] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:24 2022] POST /compute/v2.1/servers => generated 111 bytes in 1047 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:25.467476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:25.469932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:25.487269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.489147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.490701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.491551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.493713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.498506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.726122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:25.741745 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-362fa010-8c27-4b31-9bf5-17ccdb40c2c1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.285863 Sep 01 04:47:25.742944 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 172/321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:25 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:25.749225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:25.750131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:25.758483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.759303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.760492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.761405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.762029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.763328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.805707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:25.807029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:25.808034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:25.809764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lazy-loading 'fault' on Instance uuid b06e1bef-428e-4421-bba8-f95785a2fa38 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:47:25.991017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:26.007941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81712042-e773-4448-9f2a-4c6384ac5f10 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1459 microversion: 2.1 time: 0.263680 Sep 01 04:47:26.009079 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 173/322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:25 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1459 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:26.013900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:26.015430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:26.022439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:26.023292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:26.023939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:26.024889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:26.025587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:26.026066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:26.725338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:26.735142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:26.737838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:26.740033 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ccc287b-232b-4428-b898-9946505c786e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1361 microversion: 2.25 time: 0.729650 Sep 01 04:47:26.740959 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 174/323] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:26 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1361 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:26.751272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Action: 'update', calling method: .version_select at 0x7fa7606a0700>, body: {"quota_set": {"cores": 20}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:27.083935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.085553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.085553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:27.087590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.088881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.091308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:27.122868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6adbf4f0-25ca-4617-9b95-9f9ae30a76c6 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:47:27.123502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Neutron security group 6adbf4f0-25ca-4617-9b95-9f9ae30a76c6 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:47:27.124110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.security_groups [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Security Group ID 6adbf4f0-25ca-4617-9b95-9f9ae30a76c6 does not exist {{(pid=128863) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 01 04:47:27.157887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6adbf4f0-25ca-4617-9b95-9f9ae30a76c6 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:47:27.158668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Neutron security group 6adbf4f0-25ca-4617-9b95-9f9ae30a76c6 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:47:27.159367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.security_groups [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Security Group ID 6adbf4f0-25ca-4617-9b95-9f9ae30a76c6 does not exist {{(pid=128863) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 01 04:47:27.208735 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ea15877-6dd2-490e-b1ca-33414ff477bb tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 329 microversion: 2.1 time: 0.457467 Sep 01 04:47:27.208735 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 175/324] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:26 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:27.219521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f336fa00-b233-4094-a05e-2b2596ad1a82 req-2bebf4e7-7229-4003-8aaa-526b302b2498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6", "tag": "769d5c39-23ff-4ba9-a1b2-dd29b194edd1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:27.245429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f336fa00-b233-4094-a05e-2b2596ad1a82 req-2bebf4e7-7229-4003-8aaa-526b302b2498 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.245907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f336fa00-b233-4094-a05e-2b2596ad1a82 req-2bebf4e7-7229-4003-8aaa-526b302b2498 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.246926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f336fa00-b233-4094-a05e-2b2596ad1a82 req-2bebf4e7-7229-4003-8aaa-526b302b2498 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:27.284458 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f336fa00-b233-4094-a05e-2b2596ad1a82 req-2bebf4e7-7229-4003-8aaa-526b302b2498 service nova] Creating event network-changed:769d5c39-23ff-4ba9-a1b2-dd29b194edd1 for instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 on n-h1-820368-37 Sep 01 04:47:27.289789 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f336fa00-b233-4094-a05e-2b2596ad1a82 req-2bebf4e7-7229-4003-8aaa-526b302b2498 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087202 Sep 01 04:47:27.290691 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 176/325] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:27.295759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:27.296449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:27.303598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.304228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.304692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:27.305349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.305853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.306198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:27.732575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:27.741510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1575a8be-a36d-4c80-80c3-8e2e6a48e21d tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1518 microversion: 2.1 time: 0.449589 Sep 01 04:47:27.747157 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 177/326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:27 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1518 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:27.760307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:27.760943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:27.767430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.767919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.768382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:27.770865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:27.771396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:27.771826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.216867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=13 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:28.227810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:28.248360 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-282ac61a-ecba-49a1-9111-6cba2b098a04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.498711 Sep 01 04:47:28.251482 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 178/327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:27 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:28.278877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:28.290945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:28.309489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:28.310185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:28.310792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.311699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:28.312578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:28.313062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.356409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:28.356910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:28.357353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.357820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lazy-loading 'fault' on Instance uuid b06e1bef-428e-4421-bba8-f95785a2fa38 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:47:28.427455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53833f12609b47fa917e5144f70fef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0133c74c727c4767ab66201ffaab8fda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:28.443940 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d9afc9d-25c1-4fea-a732-8f411ac554b1 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 200 len: 1310 microversion: 2.1 time: 0.190478 Sep 01 04:47:28.444532 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 179/328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:28 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 1310 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:28.449189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d04cd5eb-f6ab-4794-821a-11358b9dedd7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Calling method '.version_select at 0x7fa7609e8a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:28.742351 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c0e133f-07c2-47fc-abcb-dc57033b4cbf tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7857 microversion: 2.1 time: 3.494142 Sep 01 04:47:28.751290 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 150/329] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Sep 1 04:47:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7857 bytes in 3496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:28.751290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d4a50cba-beee-4931-a7cb-d46ede491e08 req-c99d4182-9f25-47d5-9c49-0abd531109df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "name": "network-vif-plugged", "status": "completed", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:28.770324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4a50cba-beee-4931-a7cb-d46ede491e08 req-c99d4182-9f25-47d5-9c49-0abd531109df service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:28.771093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4a50cba-beee-4931-a7cb-d46ede491e08 req-c99d4182-9f25-47d5-9c49-0abd531109df service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:28.771707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4a50cba-beee-4931-a7cb-d46ede491e08 req-c99d4182-9f25-47d5-9c49-0abd531109df service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.793267 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d4a50cba-beee-4931-a7cb-d46ede491e08 req-c99d4182-9f25-47d5-9c49-0abd531109df service nova] Creating event network-vif-plugged:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:47:28.798481 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d4a50cba-beee-4931-a7cb-d46ede491e08 req-c99d4182-9f25-47d5-9c49-0abd531109df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053900 Sep 01 04:47:28.799239 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 151/330] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:28.806536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:28.807477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:28.816657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:28.817146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:28.817832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.818829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:28.819952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:28.820524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:28.846188 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d04cd5eb-f6ab-4794-821a-11358b9dedd7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 371 microversion: 2.1 time: 0.400398 Sep 01 04:47:28.848807 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 180/331] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 04:47:28 2022] GET /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:28.856056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d3f3918-18b7-4899-8a71-310f5d292572 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'create', calling method: .version_select at 0x7fa7606afd30>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:29.235045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:29.245529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:29.247386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:29.248758 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8819d60c-099b-4a73-99d3-55e042c03096 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1361 microversion: 2.25 time: 0.447846 Sep 01 04:47:29.249735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 152/332] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:28 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1361 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:29.261577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba0a15b4-b941-4ac4-9cfd-b4afd2860bf0 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] Calling method '.version_select at 0x7fa7605f3ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:30.123815 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba0a15b4-b941-4ac4-9cfd-b4afd2860bf0 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.872768 Sep 01 04:47:30.125019 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 153/333] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Sep 1 04:47:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:30.130253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Action: 'update', calling method: .version_select at 0x7fa7608818b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:30.575678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:30.577041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:30.577745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:30.578773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:30.579958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:30.580771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:30.667261 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06b75bca-a4aa-484b-afae-c1dc1652b27e tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 328 microversion: 2.1 time: 0.541150 Sep 01 04:47:30.669123 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 154/334] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:30 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 328 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:30.674657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:30.676054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:30.684420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:30.686237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:30.686994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:30.687965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:30.689715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:30.690696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:30.934029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:30.948810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7033cfe4-7247-4cd8-af8d-04b1babdf0de tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.278322 Sep 01 04:47:30.949407 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 155/335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:30 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:30.968605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9b910cc2-7843-45b4-a7b0-224d6b7adeeb req-8bbd0a63-ad57-4fed-b428-b39adecd7006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06e1bef-428e-4421-bba8-f95785a2fa38", "name": "network-vif-deleted", "tag": "28ce6f40-1dd1-4d67-a310-c64c0362bc5a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:30.979690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b910cc2-7843-45b4-a7b0-224d6b7adeeb req-8bbd0a63-ad57-4fed-b428-b39adecd7006 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:30.980785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b910cc2-7843-45b4-a7b0-224d6b7adeeb req-8bbd0a63-ad57-4fed-b428-b39adecd7006 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:30.981361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b910cc2-7843-45b4-a7b0-224d6b7adeeb req-8bbd0a63-ad57-4fed-b428-b39adecd7006 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:30.994401 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9b910cc2-7843-45b4-a7b0-224d6b7adeeb req-8bbd0a63-ad57-4fed-b428-b39adecd7006 service nova] Creating event network-vif-deleted:28ce6f40-1dd1-4d67-a310-c64c0362bc5a for instance b06e1bef-428e-4421-bba8-f95785a2fa38 on n-h1-820368-37 Sep 01 04:47:31.003812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9b910cc2-7843-45b4-a7b0-224d6b7adeeb req-8bbd0a63-ad57-4fed-b428-b39adecd7006 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042583 Sep 01 04:47:31.004356 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 156/336] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:31.022827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:31.024480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:31.039071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.039563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.040401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.040690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.041166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.041574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.061504 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] HTTP exception thrown: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Request method failure captured: Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 HTTP/1.1 Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkZyjWZvlJM6w6b8ERV5E7xl0WPt0QQmKRRxNtXo6qXXYSISHO-Tp40UdWo6eqq3ruwV4f4Ob-00rxCH6-K_Fk03xnBBKdwOzZtIdAdjM64rI9rBJ8LS6wkR_T9mJeku_OxOAXPGga-EPr84S6MPVqf28FKQRaJuWPFj-yAt7l5B0w Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:31.064147 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 53833f12609b47fa917e5144f70fef4c Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.065664 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'b06e1bef-428e-4421-bba8-f95785a2fa38'} Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:31.066591 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.067893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.069982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Returning 404 to user: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:31.070876 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-279a8d1a-4375-4c87-9071-01ae6d92d02d tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 404 len: 111 microversion: 2.1 time: 0.065372 Sep 01 04:47:31.075910 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 157/337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:31 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:31.088016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a98db94-16e0-4704-a9dd-6658ff3640da tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Calling method '.version_select at 0x7fa7605804c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:31.388963 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d3f3918-18b7-4899-8a71-310f5d292572 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.538930 Sep 01 04:47:31.389926 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 181/338] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 04:47:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:31.394928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:31.395825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:31.406310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.406791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.407264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.408319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.409355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.409799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.597219 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a98db94-16e0-4704-a9dd-6658ff3640da tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2e1dff0d-5414-4c77-95d0-c05d3b93a3b4" status: 202 len: 0 microversion: 2.1 time: 0.519465 Sep 01 04:47:31.605451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 158/339] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:47:31 2022] DELETE /compute/v2.1/os-security-groups/2e1dff0d-5414-4c77-95d0-c05d3b93a3b4 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:31.611560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1069050496", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:31.644179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:31.655486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:31.660471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:31.662232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b576adab-5911-4da5-ba27-10e26999782b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1361 microversion: 2.25 time: 0.271278 Sep 01 04:47:31.663942 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 182/340] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:31 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:31.669356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a2111a3f-1b87-4eb4-a032-d106cd636ed0 req-acc0c7bc-11dd-425b-8d6f-23bd7ee500ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6", "name": "network-vif-plugged", "status": "completed", "tag": "769d5c39-23ff-4ba9-a1b2-dd29b194edd1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:31.679571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2111a3f-1b87-4eb4-a032-d106cd636ed0 req-acc0c7bc-11dd-425b-8d6f-23bd7ee500ec service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.680054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2111a3f-1b87-4eb4-a032-d106cd636ed0 req-acc0c7bc-11dd-425b-8d6f-23bd7ee500ec service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.680542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a2111a3f-1b87-4eb4-a032-d106cd636ed0 req-acc0c7bc-11dd-425b-8d6f-23bd7ee500ec service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.697037 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a2111a3f-1b87-4eb4-a032-d106cd636ed0 req-acc0c7bc-11dd-425b-8d6f-23bd7ee500ec service nova] Creating event network-vif-plugged:769d5c39-23ff-4ba9-a1b2-dd29b194edd1 for instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 on n-h1-820368-37 Sep 01 04:47:31.705000 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a2111a3f-1b87-4eb4-a032-d106cd636ed0 req-acc0c7bc-11dd-425b-8d6f-23bd7ee500ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038661 Sep 01 04:47:31.706128 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 183/341] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:31.710442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:31.714220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:31.715063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:31.722635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.723233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.723829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.724686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:31.725303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:31.725771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:31.743571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] HTTP exception thrown: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Request method failure captured: Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 HTTP/1.1 Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkZyjWZvlJM6w6b8ERV5E7xl0WPt0QQmKRRxNtXo6qXXYSISHO-Tp40UdWo6eqq3ruwV4f4Ob-00rxCH6-K_Fk03xnBBKdwOzZtIdAdjM64rI9rBJ8LS6wkR_T9mJeku_OxOAXPGga-EPr84S6MPVqf28FKQRaJuWPFj-yAt7l5B0w Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:31.745301 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 53833f12609b47fa917e5144f70fef4c Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.746483 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b06e1bef-428e-4421-bba8-f95785a2fa38'} Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:31.747590 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:31.748660 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:31.749732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Returning 404 to user: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:31.749732 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4c6120c-fe81-408f-bde5-35dd23ec283b tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 404 len: 111 microversion: 2.1 time: 0.038734 Sep 01 04:47:31.753981 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 184/342] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:31 2022] DELETE /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:31.769715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c058858-7f9a-4839-98d2-af8397b7750a tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] Calling method '.version_select at 0x7fa7606a0700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:32.088771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:32.089396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:32.090043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:32.090619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:32.091203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:32.101114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.101599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.102255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.104510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.104510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.104510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.124687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Getting quotas for project b897104d2d484ff7ab252e746edb2734. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:32.135006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Getting quotas for user 61d870d984fd4b08b128feec8353e564 and project b897104d2d484ff7ab252e746edb2734. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:32.144956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c058858-7f9a-4839-98d2-af8397b7750a tempest-SecurityGroupsTestAdminJSON-1685447851 tempest-SecurityGroupsTestAdminJSON-1685447851-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f4065e47-da20-49b9-bb41-4a795b8e0fcd" status: 202 len: 0 microversion: 2.1 time: 0.391192 Sep 01 04:47:32.150139 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 185/343] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:47:31 2022] DELETE /compute/v2.1/os-security-groups/f4065e47-da20-49b9-bb41-4a795b8e0fcd => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:32.151481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.utils [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] instances quota exceeded for b897104d2d484ff7ab252e746edb2734, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128863) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 01 04:47:32.153339 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Request method failure captured: Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 145 Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlZ7c1_YAq5JcaL5oT0Nei2hh2mDptFHhqn25lNEJh3mT1F_exffLFUsbaV-yCHbEcgWvSYonmxZCEUiqTFTGSZoZqZyWvqzZ3i-XcSEsgITzXZ0edN0EV9y24o1H-DVwXV3iO9oOJCCX8KohfnFhRZm0sU1IrrbImj_J8iQ_WUFgw Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:32.159199 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b897104d2d484ff7ab252e746edb2734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 61d870d984fd4b08b128feec8353e564 Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1069050496", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} Sep 01 04:47:32.160445 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1069050496', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452'}}} Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 01 04:47:32.161114 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:32.162180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.163998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.165395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:32.165395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:32.165395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:32.165395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:32.165395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 01 04:47:32.165395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.165828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1187254879", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "7b76ca05-01a3-4b76-afa8-f7e1d1970480"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:32.166742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:32.171835 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11fba82a-65cf-42b4-8004-b6dd30c0352f tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.564895 Sep 01 04:47:32.172678 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 159/344] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:31 2022] POST /compute/v2.1/servers => generated 119 bytes in 566 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:32.229008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] validate_networks() for [('7b76ca05-01a3-4b76-afa8-f7e1d1970480', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:32.314630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59872fff-a181-448b-9650-f6d16d3c63ee tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1134824314", "id": 324736816, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:32.348352 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59872fff-a181-448b-9650-f6d16d3c63ee tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.172081 Sep 01 04:47:32.356813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 160/345] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:47:32 2022] POST /compute/v2.1/flavors => generated 468 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:32.356813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:32.356813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: b06e1bef-428e-4421-bba8-f95785a2fa38] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:32.363171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.363717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.364153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.364859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.365304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.365719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.370426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:32.385804 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] HTTP exception thrown: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Request method failure captured: Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 HTTP/1.1 Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkZyjWZvlJM6w6b8ERV5E7xl0WPt0QQmKRRxNtXo6qXXYSISHO-Tp40UdWo6eqq3ruwV4f4Ob-00rxCH6-K_Fk03xnBBKdwOzZtIdAdjM64rI9rBJ8LS6wkR_T9mJeku_OxOAXPGga-EPr84S6MPVqf28FKQRaJuWPFj-yAt7l5B0w Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:32.387845 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 53833f12609b47fa917e5144f70fef4c Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:32.389011 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'b06e1bef-428e-4421-bba8-f95785a2fa38'} Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:32.389664 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. Sep 01 04:47:32.390710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:32.391770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Returning 404 to user: Instance b06e1bef-428e-4421-bba8-f95785a2fa38 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:32.391770 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-197d2192-2a0d-4d0c-b6fb-77ca3176281f tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38" status: 404 len: 111 microversion: 2.1 time: 0.041125 Sep 01 04:47:32.392362 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 161/346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:32 2022] GET /compute/v2.1/servers/b06e1bef-428e-4421-bba8-f95785a2fa38 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:32.402261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:32.402878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:32.412681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.413573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.415412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.416162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.416634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.417515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.649987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:32.662678 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2847347f-6625-4723-b665-d3847712aff6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.268786 Sep 01 04:47:32.667713 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 162/347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:32 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:32.686431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f541e0b-6ae2-4b25-a235-f84fa7e88343 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] Calling method '.version_select at 0x7fa7605571f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:32.851256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:32.851774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:32.853204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:32.853730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:32.854255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:32.868951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.869754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.870463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.871474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:32.872133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:32.872901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:32.905677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Getting quotas for project 3380af7dd06d4c72855de9f45d9cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:32.942769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Getting quotas for user 09c8e8a3f51b486b930a4d445813e3a0 and project 3380af7dd06d4c72855de9f45d9cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:32.961042 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f541e0b-6ae2-4b25-a235-f84fa7e88343 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5885abb0-3734-43b4-8d6f-228e156207eb" status: 202 len: 0 microversion: 2.1 time: 0.278789 Sep 01 04:47:32.961644 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 163/348] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:47:32 2022] DELETE /compute/v2.1/os-security-groups/5885abb0-3734-43b4-8d6f-228e156207eb => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:32.970139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Action: 'update', calling method: .version_select at 0x7fa760557e50>, body: {"quota_set": {"instances": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:32.981304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:32.990267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:33.115124 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b601bed1-a322-4331-81e9-336e5cd3ee92 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962522 Sep 01 04:47:33.128041 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 186/349] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:47:33.134924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e5fc975-debb-49ad-8276-41266f33be41 tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:33.263637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:33.265073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:33.266112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:33.285212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:33.285916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:33.286515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:33.430316 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df667c05-8c89-4a41-b329-d3920dfc9eb7 tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 329 microversion: 2.1 time: 0.464675 Sep 01 04:47:33.434550 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 164/350] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:32 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 329 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:33.450522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:33.453595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:33.476606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:33.477384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:33.478110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:33.479040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:33.480058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:33.481441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:33.517129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] HTTP exception thrown: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Request method failure captured: Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 HTTP/1.1 Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDkZyjWZvlJM6w6b8ERV5E7xl0WPt0QQmKRRxNtXo6qXXYSISHO-Tp40UdWo6eqq3ruwV4f4Ob-00rxCH6-K_Fk03xnBBKdwOzZtIdAdjM64rI9rBJ8LS6wkR_T9mJeku_OxOAXPGga-EPr84S6MPVqf28FKQRaJuWPFj-yAt7l5B0w Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:33.519833 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 53833f12609b47fa917e5144f70fef4c Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:33.521201 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '88e8561b-07d9-4397-b561-24974c2640a3'} Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:33.521889 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:33.523100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:33.527073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Returning 404 to user: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:33.528525 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb382231-90c2-4235-80ab-57b3f399a369 tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 404 len: 111 microversion: 2.1 time: 0.093919 Sep 01 04:47:33.533223 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 165/351] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:33 2022] DELETE /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:33.541980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:33.543111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:33.553623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:33.554410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:33.556282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:33.564437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:33.565965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:33.566730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:33.592274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e5fc975-debb-49ad-8276-41266f33be41 tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/324736816/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.461092 Sep 01 04:47:33.600945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 187/352] 10.222.0.26 () {62 vars in 1262 bytes} [Thu Sep 1 04:47:33 2022] POST /compute/v2.1/flavors/324736816/os-extra_specs => generated 62 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:33.621756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0762144d-38ca-4378-84cb-6e3f2175c947 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] Calling method '.version_select at 0x7fa76084ff70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:33.822259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:33.834806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:33.839553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:33.841004 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-662ff38b-79cf-4c1d-83fa-069a5453c03f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1557 microversion: 2.25 time: 0.304762 Sep 01 04:47:33.843457 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 166/353] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:33 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1557 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:33.849822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b8962ed-07a3-4b5b-b1c4-e4a3888131c2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:33.850527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b8962ed-07a3-4b5b-b1c4-e4a3888131c2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:33.966294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b8962ed-07a3-4b5b-b1c4-e4a3888131c2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:33.977297 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b8962ed-07a3-4b5b-b1c4-e4a3888131c2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1224 microversion: 2.1 time: 0.131559 Sep 01 04:47:33.990980 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 167/354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:33 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:33.996052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02e31275-2324-42e8-b119-56806ed89ccd tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Calling method '.version_select at 0x7fa76063e3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:34.039289 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0762144d-38ca-4378-84cb-6e3f2175c947 tempest-SecurityGroupsTestAdminJSON-529011028 tempest-SecurityGroupsTestAdminJSON-529011028-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6d6e51b4-c700-4197-b326-71d176a4ab14" status: 202 len: 0 microversion: 2.1 time: 0.435927 Sep 01 04:47:34.040235 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 188/355] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:47:33 2022] DELETE /compute/v2.1/os-security-groups/6d6e51b4-c700-4197-b326-71d176a4ab14 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:34.051739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:34.052429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] [instance: 88e8561b-07d9-4397-b561-24974c2640a3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:34.081382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:34.081928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:34.084215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:34.088311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:34.088801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:34.089245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:34.126530 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] HTTP exception thrown: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Request method failure captured: Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 HTTP/1.1 Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDkZyjWZvlJM6w6b8ERV5E7xl0WPt0QQmKRRxNtXo6qXXYSISHO-Tp40UdWo6eqq3ruwV4f4Ob-00rxCH6-K_Fk03xnBBKdwOzZtIdAdjM64rI9rBJ8LS6wkR_T9mJeku_OxOAXPGga-EPr84S6MPVqf28FKQRaJuWPFj-yAt7l5B0w Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:34.129751 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0133c74c727c4767ab66201ffaab8fda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0133c74c727c4767ab66201ffaab8fda Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1519299886 Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 53833f12609b47fa917e5144f70fef4c Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersAdminTestJSON-1519299886-project Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:34.131454 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '88e8561b-07d9-4397-b561-24974c2640a3'} Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:34.132149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. Sep 01 04:47:34.133792 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:34.136207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] Returning 404 to user: Instance 88e8561b-07d9-4397-b561-24974c2640a3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:34.137319 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7d9187f-26f8-480f-b042-a156256819ec tempest-DeleteServersAdminTestJSON-1519299886 tempest-DeleteServersAdminTestJSON-1519299886-project] 10.222.0.26 "GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3" status: 404 len: 111 microversion: 2.1 time: 0.095932 Sep 01 04:47:34.148673 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 189/356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:34 2022] GET /compute/v2.1/servers/88e8561b-07d9-4397-b561-24974c2640a3 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:34.151011 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02e31275-2324-42e8-b119-56806ed89ccd tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 371 microversion: 2.1 time: 0.158524 Sep 01 04:47:34.151604 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 168/357] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 04:47:33 2022] GET /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:34.164581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9f69daf-5c66-48c6-bb62-752105c34dc7 tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:34.171912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:34.173152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:34.176815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:34.183574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:34.184059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:34.184542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:34.185306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:34.185842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:34.186240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:34.211708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9f69daf-5c66-48c6-bb62-752105c34dc7 tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/324736816" status: 202 len: 0 microversion: 2.86 time: 0.059698 Sep 01 04:47:34.215939 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 190/358] 10.222.0.26 () {60 vars in 1199 bytes} [Thu Sep 1 04:47:34 2022] DELETE /compute/v2.1/flavors/324736816 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:47:34.470767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:34.482996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26891dc9-9762-442d-a0c7-ab3cc334344b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.327352 Sep 01 04:47:34.496553 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 169/359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:34 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:34.496553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Action: 'update', calling method: .version_select at 0x7fa7608489d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:34.990058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:34.990856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:35.020922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.022580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.024362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.027494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.028235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.029929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.160412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=63 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:35.168890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.171141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.171659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.174049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.180180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.181071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.296145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1050a72a-a9c3-4e57-ba68-c7f8285f1f4d tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 325 microversion: 2.1 time: 0.810563 Sep 01 04:47:35.297507 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 170/360] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:34 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 325 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:35.310237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ad35f73-f711-42fe-9abc-e075da452807 tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:35.343288 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ad35f73-f711-42fe-9abc-e075da452807 tempest-FlavorMetadataValidation-788649782 tempest-FlavorMetadataValidation-788649782-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.044324 Sep 01 04:47:35.344372 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 171/361] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 04:47:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:35.350980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:35.351899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:35.362008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.362957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.363747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.365234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.365700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.366235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.573137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:35.592245 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1880a17-3e17-4ce1-b65c-58f9d3e35205 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1282 microversion: 2.1 time: 0.246477 Sep 01 04:47:35.611703 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 172/362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:35 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:35.617311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:35.637423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:35.641330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:47:35.651052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.651663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.652299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.653139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:35.653672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:35.654220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:35.822306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7f1887f-5e51-40c9-8149-a0d462e67b74 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 2051 microversion: 2.25 time: 1.604648 Sep 01 04:47:35.823929 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 191/363] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:34 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 2051 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:35.833329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1298588260", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:35.969108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:35.999016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:36.023332 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9cbe1c01-3c82-4719-999f-52410102aef7 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.409675 Sep 01 04:47:36.027039 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 173/364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:35 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:36.033449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:36.041601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:36.058288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.065416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.065913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.066926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.067493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.067883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.570847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:36.571630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:36.572360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:36.572992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:36.573671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:36.589405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=61 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:36.591696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.593508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.594224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.597883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.601784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.602318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.648132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:47:36.711199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Getting quotas for project b897104d2d484ff7ab252e746edb2734. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:36.732888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Getting quotas for user 61d870d984fd4b08b128feec8353e564 and project b897104d2d484ff7ab252e746edb2734. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:36.775923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.utils [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] ram quota exceeded for b897104d2d484ff7ab252e746edb2734, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128862) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 01 04:47:36.780539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Request method failure captured: Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 145 Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlZ7c1_YAq5JcaL5oT0Nei2hh2mDptFHhqn25lNEJh3mT1F_exffLFUsbaV-yCHbEcgWvSYonmxZCEUiqTFTGSZoZqZyWvqzZ3i-XcSEsgITzXZ0edN0EV9y24o1H-DVwXV3iO9oOJCCX8KohfnFhRZm0sU1IrrbImj_J8iQ_WUFgw Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:47:36.787057 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b897104d2d484ff7ab252e746edb2734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 61d870d984fd4b08b128feec8353e564 Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1298588260", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} Sep 01 04:47:36.788918 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1298588260', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452'}}} Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 01 04:47:36.789829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:36.791115 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.792690 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:36.794112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:36.794112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:36.794112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:36.794112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:36.794112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 01 04:47:36.794112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:47:36.796539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:36.798224 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ca2c87b-da02-4f49-8524-8482f06a8b81 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.972640 Sep 01 04:47:36.798994 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 192/365] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:35 2022] POST /compute/v2.1/servers => generated 110 bytes in 974 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:36.804188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cadfc90a-36e1-4f80-9777-bd102f5452bf req-6dea2338-51ce-47ee-9614-161508b27c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56be13bc-1e86-44b3-8e54-a2f677bb469e", "name": "network-vif-plugged", "status": "completed", "tag": "6f4d8c12-ccb6-427f-8a09-3816eba070bb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:36.834233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cadfc90a-36e1-4f80-9777-bd102f5452bf req-6dea2338-51ce-47ee-9614-161508b27c7d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.835041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cadfc90a-36e1-4f80-9777-bd102f5452bf req-6dea2338-51ce-47ee-9614-161508b27c7d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.835912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cadfc90a-36e1-4f80-9777-bd102f5452bf req-6dea2338-51ce-47ee-9614-161508b27c7d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.846237 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f97d7b4b-c4a6-4845-b5f5-69d92c6b01d8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 2051 microversion: 2.25 time: 0.817740 Sep 01 04:47:36.847300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 174/366] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:36 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 2051 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:36.855821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:36.858457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:36.865369 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cadfc90a-36e1-4f80-9777-bd102f5452bf req-6dea2338-51ce-47ee-9614-161508b27c7d service nova] Creating event network-vif-plugged:6f4d8c12-ccb6-427f-8a09-3816eba070bb for instance 56be13bc-1e86-44b3-8e54-a2f677bb469e on n-h2-820368-37 Sep 01 04:47:36.875620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.877087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.878023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.880290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:36.881918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:36.882462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:36.884002 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cadfc90a-36e1-4f80-9777-bd102f5452bf req-6dea2338-51ce-47ee-9614-161508b27c7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083488 Sep 01 04:47:36.895191 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 193/367] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:36.911478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Action: 'update', calling method: .version_select at 0x7fa7606af5e0>, body: {"quota_set": {"ram": 51200}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:37.027922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:37.044447 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c641f985-832b-4dea-81c1-8d84a11a87ee tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1282 microversion: 2.1 time: 0.195613 Sep 01 04:47:37.045420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 175/368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:36 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:37.051740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:37.060244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.061038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.062105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.063151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.063845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.064463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.098820 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5a07f99-d037-4725-a19f-18624545bbb9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.051960 Sep 01 04:47:37.103410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 176/369] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Sep 1 04:47:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:37.116633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:37.117298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:37.132975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.133498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.133962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.134726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.135265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.135714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.325456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:37.334282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.335264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.335892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.337153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.338833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.339559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.451406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8be090b2-1b9b-4452-acd5-33b7f339a6af tempest-QuotasAdminNegativeTest-816738191 tempest-QuotasAdminNegativeTest-816738191-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 200 len: 329 microversion: 2.1 time: 0.554540 Sep 01 04:47:37.454669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:37.460292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 194/370] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:36 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 329 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:37.465438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-37", "block_migration": "auto"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:37.468447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:37.475116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04c7e38c-b4c8-4b51-8301-41a7d15e63c4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.362259 Sep 01 04:47:37.476530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 177/371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:37 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:37.483849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.485016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.485940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.486981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:37.487633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:37.488207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:37.501449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b60dfe86-3f0e-499f-a7be-6c91f80edb85 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Action: 'update', calling method: .version_select at 0x7fa7605570d0>, body: {"quota_set": {"ram": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:37.516421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b60dfe86-3f0e-499f-a7be-6c91f80edb85 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '61d870d984fd4b08b128feec8353e564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b897104d2d484ff7ab252e746edb2734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b60dfe86-3f0e-499f-a7be-6c91f80edb85 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Request method failure captured: Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 HTTP/1.1 Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 25 Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlZ7c1_YAq5JcaL5oT0Nei2hh2mDptFHhqn25lNEJh3mT1F_exffLFUsbaV-yCHbEcgWvSYonmxZCEUiqTFTGSZoZqZyWvqzZ3i-XcSEsgITzXZ0edN0EV9y24o1H-DVwXV3iO9oOJCCX8KohfnFhRZm0sU1IrrbImj_J8iQ_WUFgw Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:37.526357 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b897104d2d484ff7ab252e746edb2734"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b897104d2d484ff7ab252e746edb2734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b897104d2d484ff7ab252e746edb2734 Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-570308668 Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 61d870d984fd4b08b128feec8353e564 Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-QuotasAdminNegativeTest-570308668-project Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: {"quota_set": {"ram": 0}} Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 01 04:47:37.528034 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'b897104d2d484ff7ab252e746edb2734', 'body': {'quota_set': {'ram': 0}}} Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:37.528881 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:37.530113 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:37.531332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b60dfe86-3f0e-499f-a7be-6c91f80edb85 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:37.533483 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b60dfe86-3f0e-499f-a7be-6c91f80edb85 tempest-QuotasAdminNegativeTest-570308668 tempest-QuotasAdminNegativeTest-570308668-project] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734" status: 403 len: 116 microversion: 2.1 time: 0.055414 Sep 01 04:47:37.536897 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 178/372] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:47:37 2022] PUT /compute/v2.1/os-quota-sets/b897104d2d484ff7ab252e746edb2734 => generated 116 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:47:37.747882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'flavor' on Instance uuid 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:47:37.847471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Going to try to live migrate instance to n-h2-820368-37 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:47:38.073410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:38.074204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:38.082930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:38.094990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:38.095560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:38.096110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:38.096979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:38.097572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:38.098093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:38.466615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:38.475767 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d09a5c6-aa0a-495c-af11-efb094aed7bc tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.406935 Sep 01 04:47:38.476351 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 179/373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:38 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:38.499750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:38.500671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:38.508354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:38.509086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:38.509670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:38.511199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:38.512302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:38.512895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:38.752949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:38.766782 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-721bb9e2-a121-4000-9017-5268059c154a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1317 microversion: 2.1 time: 0.269343 Sep 01 04:47:38.782062 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 180/374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:38 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:39.441062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1d99a8d8-472a-4c8f-bbe2-442cf35972db req-7f3ad99b-2741-417c-a189-1ea62ba2c183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4d3683-ee24-4efb-b0b5-84570963a2e0", "tag": "e6b41343-be2b-4425-b4c8-f91be80a10e3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:39.478842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d99a8d8-472a-4c8f-bbe2-442cf35972db req-7f3ad99b-2741-417c-a189-1ea62ba2c183 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:39.483079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d99a8d8-472a-4c8f-bbe2-442cf35972db req-7f3ad99b-2741-417c-a189-1ea62ba2c183 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:39.483888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d99a8d8-472a-4c8f-bbe2-442cf35972db req-7f3ad99b-2741-417c-a189-1ea62ba2c183 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:39.532063 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1d99a8d8-472a-4c8f-bbe2-442cf35972db req-7f3ad99b-2741-417c-a189-1ea62ba2c183 service nova] Creating event network-changed:e6b41343-be2b-4425-b4c8-f91be80a10e3 for instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 on n-h1-820368-37 Sep 01 04:47:39.554846 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1d99a8d8-472a-4c8f-bbe2-442cf35972db req-7f3ad99b-2741-417c-a189-1ea62ba2c183 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115902 Sep 01 04:47:39.558809 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 181/375] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:39.577793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:39.587244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:39.599494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:39.602056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:39.603081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:39.611750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:39.612617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:39.613419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:39.927942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:39.938734 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9196ee2b-4c96-4bbb-8bec-b3c234cba970 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.373385 Sep 01 04:47:39.941706 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 182/376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:39 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:39.953615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:39.955646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:39.968882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:39.971759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:39.973027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:39.974546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:39.975582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:39.977125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:40.202979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:40.211798 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff7b5ece-189b-4d06-8e4d-b4e5f90fe985 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1466 microversion: 2.1 time: 0.268668 Sep 01 04:47:40.215049 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 183/377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:39 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:40.236791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:40.237786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:40.244310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:40.245560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:40.246109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:40.246933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:40.247550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:40.248196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:40.461596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:40.469442 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f513af59-8ef0-4c20-80b2-e243334307a4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1467 microversion: 2.1 time: 0.236552 Sep 01 04:47:40.471525 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 184/378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:40 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:47:40.492343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1070108447"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:40.495522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:40.506769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:40.507631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:40.508260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:40.509172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:40.509819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:40.510451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:40.762931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:40.822828 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-641adfa0-b5b3-470a-ac09-b65fce9485d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "POST /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.331782 Sep 01 04:47:40.824112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 185/379] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:47:40 2022] POST /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 01 04:47:40.838605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fac74126-617d-40e9-afa3-0512ffe40b1b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760580820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:40.916204 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fac74126-617d-40e9-afa3-0512ffe40b1b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.083672 Sep 01 04:47:40.927207 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 186/380] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:40 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:40.972636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:40.973593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:40.988454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:40.989148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:40.992520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:40.994000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:41.006058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:41.006446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:41.571395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:41.581920 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d545fa2b-81e1-4269-b14b-73ce4b6f0f8e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.614042 Sep 01 04:47:41.582561 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 187/381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:40 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:47:41.934936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53c2490f-f8c4-4c71-887a-ebc057e740f8 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760848a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:42.019115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53c2490f-f8c4-4c71-887a-ebc057e740f8 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.088016 Sep 01 04:47:42.027213 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 188/382] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:41 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:42.602856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:42.603703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:42.614605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:42.615370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:42.615950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:42.618203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:42.620663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:42.621289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:42.911113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:42.920941 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c212590-4250-43ee-ab21-065b2cb6b9b2 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.322928 Sep 01 04:47:42.945923 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 189/383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:42 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:43.034690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eec8990c-3872-4cdd-abd7-7857bc9e9e2b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760580b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:43.107961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eec8990c-3872-4cdd-abd7-7857bc9e9e2b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.077709 Sep 01 04:47:43.116427 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 190/384] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:43 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:47:43.544181 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd621731-ba6d-4cbb-b15e-6d32f26cb57b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6/action" status: 202 len: 0 microversion: 2.25 time: 6.082398 Sep 01 04:47:43.545300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 195/385] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 04:47:37 2022] POST /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6/action => generated 0 bytes in 6084 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:47:43.556068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:43.557698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:43.572231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:43.574308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:43.577363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:43.578389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:43.579115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:43.579791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:43.943980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:43.944879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:43.960138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:43.966294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:43.968261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:43.972470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:43.973113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:43.973925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:44.604920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:44.614422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:44.618513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:44.620071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0708cbe-fee0-444a-a0a1-b0c0a6af041f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 1.069379 Sep 01 04:47:44.620648 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 191/386] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:43 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:44.648436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c589dc7f-727f-46bf-b75f-448e9e54432e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760580a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:44.668933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:44.691553 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9feb51dc-f45e-4b84-8655-ba02ac6f15ea tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.747092 Sep 01 04:47:44.713887 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 196/387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:43 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:44.722114 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c589dc7f-727f-46bf-b75f-448e9e54432e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.080024 Sep 01 04:47:44.723413 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 192/388] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:44 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:45.278559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9e1b620-07b2-4a92-8d57-d2a28aa09ed6 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1274868793", "id": 2105850866, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:45.314131 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9e1b620-07b2-4a92-8d57-d2a28aa09ed6 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.598760 Sep 01 04:47:45.317158 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 197/389] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:44 2022] POST /compute/v2.1/flavors => generated 430 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:45.326866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:45.336706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecedcab4-d0a8-4d3e-a191-55cbe66d114f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:45.384812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecedcab4-d0a8-4d3e-a191-55cbe66d114f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2105850866" status: 202 len: 0 microversion: 2.1 time: 0.056280 Sep 01 04:47:45.389229 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 193/390] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:47:45 2022] DELETE /compute/v2.1/flavors/2105850866 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:45.405041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07c76fca-ca6e-41e6-b370-401347bfc2ce tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:45.455367 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07c76fca-ca6e-41e6-b370-401347bfc2ce tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053818 Sep 01 04:47:45.458263 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 194/391] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:45.480304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80449fbd-70b2-4878-b45c-20cf9cdae242 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1313894031", "id": 24385836, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:45.518559 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80449fbd-70b2-4878-b45c-20cf9cdae242 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.042676 Sep 01 04:47:45.521114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 195/392] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:45 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:45.534060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e093e82-1e9c-48fd-8ff7-19f74bdfb151 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:45.583651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e093e82-1e9c-48fd-8ff7-19f74bdfb151 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.055408 Sep 01 04:47:45.587702 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 196/393] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:45 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:45.601376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b7fdfa7-db8c-4c60-bfea-6b7e51d75fdc tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:45.646369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-164384046", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:45.653376 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b7fdfa7-db8c-4c60-bfea-6b7e51d75fdc tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/24385836" status: 202 len: 0 microversion: 2.1 time: 0.055614 Sep 01 04:47:45.653997 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 197/394] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:47:45 2022] DELETE /compute/v2.1/flavors/24385836 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:47:45.667425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:45.668031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:45.695883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:45.696384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:45.696827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:45.697541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:45.697999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:45.698446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:45.770951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:46.472435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:46.473128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:46.473791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:46.474354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:46.474939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:46.496220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:46.498585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:46.500611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:46.504373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:46.504865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:46.505304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:46.527792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:46.543108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:46.563400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:46.570939 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a75ed0d4-4b64-4617-885b-d1f8861edc80 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 0.905138 Sep 01 04:47:46.572494 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 198/395] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:45 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:46.580904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eae03062-1f6f-48b2-8f77-8b0962ff0e7e tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:46.610226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eae03062-1f6f-48b2-8f77-8b0962ff0e7e tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035357 Sep 01 04:47:46.610834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:46.620274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 199/396] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:46.626966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:46.632807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:46.633424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:46.645306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:46.646691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:46.647388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:46.648410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:46.649256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:46.650122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:46.650257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:46.654029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:46.711171 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1adea04a-d0cf-4d96-9e8c-ea04d2f694fe tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318554 Sep 01 04:47:46.712477 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 198/397] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:47:46.717338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdf531ca-21e6-47b4-8363-c5d4e282200c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760414c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:46.773765 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdf531ca-21e6-47b4-8363-c5d4e282200c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.059995 Sep 01 04:47:46.774424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 199/398] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:46 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:46.962329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:46.973412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d207fdcf-c3bb-4571-a97a-38738cd5effb tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.346159 Sep 01 04:47:46.990361 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 200/399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:46 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:47.028178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd18aa79-34da-4dd8-814a-fddcf261cc1f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1233009215", "id": 1475354370, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:47.069684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd18aa79-34da-4dd8-814a-fddcf261cc1f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.077616 Sep 01 04:47:47.075628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 201/400] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:46 2022] POST /compute/v2.1/flavors => generated 429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:47.088496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9af356d7-e16f-46ec-93e8-0b7dd651c85d req-a8562687-e316-41eb-9590-1440eb8658fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6", "name": "network-vif-unplugged", "status": "completed", "tag": "769d5c39-23ff-4ba9-a1b2-dd29b194edd1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:47.102067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:47.117595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9af356d7-e16f-46ec-93e8-0b7dd651c85d req-a8562687-e316-41eb-9590-1440eb8658fb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.118198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9af356d7-e16f-46ec-93e8-0b7dd651c85d req-a8562687-e316-41eb-9590-1440eb8658fb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.120339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9af356d7-e16f-46ec-93e8-0b7dd651c85d req-a8562687-e316-41eb-9590-1440eb8658fb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.155874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9af356d7-e16f-46ec-93e8-0b7dd651c85d req-a8562687-e316-41eb-9590-1440eb8658fb service nova] Creating event network-vif-unplugged:769d5c39-23ff-4ba9-a1b2-dd29b194edd1 for instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 on n-h1-820368-37 Sep 01 04:47:47.162219 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9af356d7-e16f-46ec-93e8-0b7dd651c85d req-a8562687-e316-41eb-9590-1440eb8658fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084359 Sep 01 04:47:47.163391 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 202/401] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:47.175309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-095c516f-ce94-44b6-b7ec-70fa9060ca3f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.177458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-095c516f-ce94-44b6-b7ec-70fa9060ca3f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:47.223773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f6040de-b40a-4715-93d4-181af0bf342a tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-247569306", "id": 1073131517, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:47.283743 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f6040de-b40a-4715-93d4-181af0bf342a tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.508241 Sep 01 04:47:47.288133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 200/402] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:47:46 2022] POST /compute/v2.1/flavors => generated 448 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:47.400442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-095c516f-ce94-44b6-b7ec-70fa9060ca3f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:47.409345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.415925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.418288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.421093 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-095c516f-ce94-44b6-b7ec-70fa9060ca3f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1216 microversion: 2.1 time: 0.256395 Sep 01 04:47:47.427451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 203/403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1216 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:47.432832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.439580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.440709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0e0f429-2d0a-49f6-9221-c3e019efada2 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.441963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.450802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.483896 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0e0f429-2d0a-49f6-9221-c3e019efada2 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1475354370" status: 202 len: 0 microversion: 2.1 time: 0.054837 Sep 01 04:47:47.484480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 204/404] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:47:47 2022] DELETE /compute/v2.1/flavors/1475354370 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:47.510293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3b1e1e7a-f33c-4a98-9cbd-1227134a1635 req-85714498-068c-4457-a6c7-60c35063f7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4d3683-ee24-4efb-b0b5-84570963a2e0", "name": "network-vif-plugged", "status": "completed", "tag": "e6b41343-be2b-4425-b4c8-f91be80a10e3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:47.538918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b1e1e7a-f33c-4a98-9cbd-1227134a1635 req-85714498-068c-4457-a6c7-60c35063f7d1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.546736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b1e1e7a-f33c-4a98-9cbd-1227134a1635 req-85714498-068c-4457-a6c7-60c35063f7d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.547369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b1e1e7a-f33c-4a98-9cbd-1227134a1635 req-85714498-068c-4457-a6c7-60c35063f7d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.569168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3b1e1e7a-f33c-4a98-9cbd-1227134a1635 req-85714498-068c-4457-a6c7-60c35063f7d1 service nova] Creating event network-vif-plugged:e6b41343-be2b-4425-b4c8-f91be80a10e3 for instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 on n-h1-820368-37 Sep 01 04:47:47.571956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c15c6231-6a66-448e-b1d1-8e92d0bf6e35 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.282235 Sep 01 04:47:47.575342 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 201/405] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/os-services => generated 949 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:47.584672 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3b1e1e7a-f33c-4a98-9cbd-1227134a1635 req-85714498-068c-4457-a6c7-60c35063f7d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097270 Sep 01 04:47:47.589618 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 205/406] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:47.612855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ab0334d-b69d-4ff7-960e-94814bbcb837 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.689812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ab0334d-b69d-4ff7-960e-94814bbcb837 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.098598 Sep 01 04:47:47.704060 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 206/407] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:47.709031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.712801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.713441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.714035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.714953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.715377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.717710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.747359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=9 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:47.770317 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ea4dbe1-f68b-4d1a-abab-9bb962d82297 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-820368-37" status: 200 len: 581 microversion: 2.1 time: 0.064734 Sep 01 04:47:47.771317 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 207/408] 10.222.0.26 () {58 vars in 1174 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/os-services?host=n-d-820368-37 => generated 581 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:47.776289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.777426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:47.786508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.787348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.788165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.789059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.789997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.790574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.864144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5a70834-7e65-46b5-b0d5-69d26516634b tempest-FlavorsV255TestJSON-1682943462 tempest-FlavorsV255TestJSON-1682943462-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.881645 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5a70834-7e65-46b5-b0d5-69d26516634b tempest-FlavorsV255TestJSON-1682943462 tempest-FlavorsV255TestJSON-1682943462-project] 10.222.0.26 "GET /compute/v2.1/flavors/1073131517" status: 200 len: 448 microversion: 2.55 time: 0.303004 Sep 01 04:47:47.883037 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 202/409] 10.222.0.26 () {60 vars in 1199 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/flavors/1073131517 => generated 448 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:47.894923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62cd67a7-a456-4776-bd48-795aaf489ffb tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-387829385", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:47.930830 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62cd67a7-a456-4776-bd48-795aaf489ffb tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046357 Sep 01 04:47:47.932947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 203/410] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:47 2022] POST /compute/v2.1/flavors => generated 506 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:47.955873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:47.960474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.961348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.961986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.963024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:47.963742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:47.964370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:47.994501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:48.008168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:48.009797 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de514a86-30de-4e6e-93a5-7960ee1cf2a5 tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.064105 Sep 01 04:47:48.010030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:48.011963 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34604592-0424-45d9-b65a-87bc2b1bf2eb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 0.239555 Sep 01 04:47:48.012664 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 208/411] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:48.017617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b133d0e-6d26-4218-bbf9-fd09e96d600b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760557940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.020428 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 204/412] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:47:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:48.025823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a14b4081-4678-414a-adab-839ba405517c tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:48.077185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a14b4081-4678-414a-adab-839ba405517c tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1073131517" status: 200 len: 449 microversion: 2.55 time: 0.055392 Sep 01 04:47:48.078216 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 205/413] 10.222.0.26 () {62 vars in 1219 bytes} [Thu Sep 1 04:47:48 2022] PUT /compute/v2.1/flavors/1073131517 => generated 449 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:47:48.083727 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b133d0e-6d26-4218-bbf9-fd09e96d600b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.069732 Sep 01 04:47:48.084985 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 209/414] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:48.090529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.091562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:48.098434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b701510e-a8f0-4be5-8021-e014c454f183 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.100863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:48.101371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:48.101978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:48.102706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:48.103381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:48.104053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:48.128479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b701510e-a8f0-4be5-8021-e014c454f183 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/872a0625-f890-471f-9ee6-7304ca44a503" status: 202 len: 0 microversion: 2.1 time: 0.047090 Sep 01 04:47:48.129105 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 206/415] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:48 2022] DELETE /compute/v2.1/flavors/872a0625-f890-471f-9ee6-7304ca44a503 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:48.158488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.172036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:48.172964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:48.173475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:48.174798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:48.175267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:48.176611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:48.208547 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6dae4af8-3631-40f0-82dc-2f948deb5adb tempest-ServicesAdminTestJSON-1358438373 tempest-ServicesAdminTestJSON-1358438373-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.069909 Sep 01 04:47:48.217414 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 207/416] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/os-services => generated 949 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:48.217414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c7f3654-67d6-4ccb-a761-019424bad6e7 tempest-FlavorsV255TestJSON-1682943462 tempest-FlavorsV255TestJSON-1682943462-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.238579 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c7f3654-67d6-4ccb-a761-019424bad6e7 tempest-FlavorsV255TestJSON-1682943462 tempest-FlavorsV255TestJSON-1682943462-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.027885 Sep 01 04:47:48.239573 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 208/417] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:48.244187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39ea60fe-ba98-41ed-9e73-fef85aaf5615 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.292232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39ea60fe-ba98-41ed-9e73-fef85aaf5615 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.049517 Sep 01 04:47:48.302946 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 209/418] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:48.302946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a023aa09-ebf6-492f-9f08-0be4ff3fa9fe tempest-FlavorsV255TestJSON-1682943462 tempest-FlavorsV255TestJSON-1682943462-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.339943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a023aa09-ebf6-492f-9f08-0be4ff3fa9fe tempest-FlavorsV255TestJSON-1682943462 tempest-FlavorsV255TestJSON-1682943462-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.045135 Sep 01 04:47:48.351408 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 210/419] 10.222.0.26 () {60 vars in 1166 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:48.351845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a31b891-e0fc-4b03-ab67-7b5a96260423 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-118452341", "id": "d1f2cb6f-e28a-4fab-bd86-b6b6480407c6", "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:48.365383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:48.376353 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fec0dd52-ceab-47d1-9ca7-0bbf4b0ae198 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 0.290111 Sep 01 04:47:48.377414 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 210/420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:48.388472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-428520cb-3ee6-4b29-aa5e-85bc1cea457a tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.405052 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a31b891-e0fc-4b03-ab67-7b5a96260423 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.056863 Sep 01 04:47:48.406307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 211/421] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:48 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:48.423405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07aa9aca-412d-4493-aec7-cb7eddba181a tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.424624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-428520cb-3ee6-4b29-aa5e-85bc1cea457a tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1073131517" status: 202 len: 0 microversion: 2.55 time: 0.043449 Sep 01 04:47:48.430668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 211/422] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Sep 1 04:47:48 2022] DELETE /compute/v2.1/flavors/1073131517 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:47:48.450714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15614712-0e71-49a9-805e-97879a41cc4c tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.476105 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07aa9aca-412d-4493-aec7-cb7eddba181a tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/d1f2cb6f-e28a-4fab-bd86-b6b6480407c6" status: 202 len: 0 microversion: 2.1 time: 0.061773 Sep 01 04:47:48.476684 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 212/423] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:47:48 2022] DELETE /compute/v2.1/flavors/d1f2cb6f-e28a-4fab-bd86-b6b6480407c6 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:48.481482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.482098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:48.508377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:48.508700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:48.509286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:48.510070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:48.510564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:48.511112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:48.515089 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15614712-0e71-49a9-805e-97879a41cc4c tempest-FlavorsV255TestJSON-767546332 tempest-FlavorsV255TestJSON-767546332-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5802 microversion: 2.55 time: 0.076938 Sep 01 04:47:48.515985 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 212/424] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors/detail => generated 5802 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:48.520567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eae87af2-8ad3-4aef-841a-0422431e7df8 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.562282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eae87af2-8ad3-4aef-841a-0422431e7df8 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045181 Sep 01 04:47:48.562929 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 213/425] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:48.591374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac63f880-1b66-4f0d-a7c0-9a4fd0c0f466 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-683172305", "id": 1530078595, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:48.656404 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac63f880-1b66-4f0d-a7c0-9a4fd0c0f466 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.068723 Sep 01 04:47:48.657023 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 214/426] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:48 2022] POST /compute/v2.1/flavors => generated 413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:47:48.681631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56f6b11e-1bec-476e-9a44-60940c0554a3 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:48.687810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:48.700472 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85e75553-b6e6-4e2c-9bc5-d51f12b9f41f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1212 microversion: 2.1 time: 0.221035 Sep 01 04:47:48.705140 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56f6b11e-1bec-476e-9a44-60940c0554a3 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1530078595" status: 200 len: 413 microversion: 2.1 time: 0.039853 Sep 01 04:47:48.719549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 213/427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1212 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:48.720757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 215/428] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors/1530078595 => generated 413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:47:49.055773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:49.056544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:49.069034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.070091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.072086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:49.074044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.074649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.076809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:49.295532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8464a666-4742-402a-bcc1-6fce2a633058 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:49.339920 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8464a666-4742-402a-bcc1-6fce2a633058 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.610373 Sep 01 04:47:49.346051 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 214/429] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:48 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:49.359331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea10229f-a7e7-4be3-ada5-b6d1c48c0161 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7604d6700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:49.487635 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea10229f-a7e7-4be3-ada5-b6d1c48c0161 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.139863 Sep 01 04:47:49.495848 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 215/430] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:49 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:49.518773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d48523e5-91db-4879-bcfd-ce09c444e10a req-bb94ac2c-a4d2-40ee-824c-307a9dc8f0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6", "tag": "769d5c39-23ff-4ba9-a1b2-dd29b194edd1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:49.592668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:49.607568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:49.609030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:49.618502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:49.618719 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1de125ea-8b8e-4b44-b31f-b16f4c9e8218 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 0.568039 Sep 01 04:47:49.623795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d48523e5-91db-4879-bcfd-ce09c444e10a req-bb94ac2c-a4d2-40ee-824c-307a9dc8f0cd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.628249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d48523e5-91db-4879-bcfd-ce09c444e10a req-bb94ac2c-a4d2-40ee-824c-307a9dc8f0cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.629079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d48523e5-91db-4879-bcfd-ce09c444e10a req-bb94ac2c-a4d2-40ee-824c-307a9dc8f0cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:49.645611 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 216/431] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:49 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:49.654970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70031cf1-b96d-4c84-833b-ce2667a75e93 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:49.661311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d48523e5-91db-4879-bcfd-ce09c444e10a req-bb94ac2c-a4d2-40ee-824c-307a9dc8f0cd service nova] Creating event network-changed:769d5c39-23ff-4ba9-a1b2-dd29b194edd1 for instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 on n-h1-820368-37 Sep 01 04:47:49.680111 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d48523e5-91db-4879-bcfd-ce09c444e10a req-bb94ac2c-a4d2-40ee-824c-307a9dc8f0cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188900 Sep 01 04:47:49.684972 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 216/432] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:49.700043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:49.704742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:49.715512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70031cf1-b96d-4c84-833b-ce2667a75e93 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1530078595" status: 202 len: 0 microversion: 2.1 time: 0.068327 Sep 01 04:47:49.720672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.721651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.727897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:49.728853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.731468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.734259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:49.737907 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 217/433] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:47:49 2022] DELETE /compute/v2.1/flavors/1530078595 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:49.749812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:49.754739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:49.770064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.770564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.778921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:49.781209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:49.784884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:49.785770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:50.082212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:50.108571 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f80214ef-226b-405e-bf22-edde4c07cfe6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1268 microversion: 2.1 time: 0.369456 Sep 01 04:47:50.109736 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 218/434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:49 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1268 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:50.120539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b2c2875-63e1-480f-90e7-b697ab8ec0c2 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:50.201040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b2c2875-63e1-480f-90e7-b697ab8ec0c2 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089840 Sep 01 04:47:50.225896 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 219/435] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:50.488637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-892513cd-9039-4845-b47e-18a496d1a29c tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:50.502415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-892513cd-9039-4845-b47e-18a496d1a29c tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.274783 Sep 01 04:47:50.506213 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 220/436] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:47:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:50.523118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d07d3ac-7a24-4ce9-8c4a-c0f17e8521c5 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-460515905", "id": 1755112372, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:50.598824 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d07d3ac-7a24-4ce9-8c4a-c0f17e8521c5 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.088341 Sep 01 04:47:50.611891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 221/437] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:50 2022] POST /compute/v2.1/flavors => generated 429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:50.619233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-843d5e7f-54de-43b5-ba56-c9e43a80b69c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760580f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:50.742832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:50.751137 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31a59f20-6976-43fe-8aa7-4f68dad624b9 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1324 microversion: 2.1 time: 1.062225 Sep 01 04:47:50.751731 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 217/438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:49 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1324 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:50.785816 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-843d5e7f-54de-43b5-ba56-c9e43a80b69c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.171851 Sep 01 04:47:50.786417 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 222/439] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:50 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:50.819998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77292587-8e72-4319-a8bd-64ed3c68ae90 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "1755112372"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:50.851560 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-77292587-8e72-4319-a8bd-64ed3c68ae90 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] HTTP exception thrown: Flavor 1755112372 could not be found. Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77292587-8e72-4319-a8bd-64ed3c68ae90 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] Request method failure captured: Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 107 Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDluNUt9P--sFmYGy7omxfvlyVAyje2xjisswZXjwH8Y2l0dRJR9GRjHnzhWZ_2fw5TPY1k41LP8tAsrI1dR1ZdlC1k2ztqY6Z0VVg7tW-YGnW66l3LBvzBGejnOXM4CfYTzjKeV8fHJIl2KV7tX_y4Zd_lpxxNzb5o0Ss0f2jlA7Vo Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: ba3d0c0b364d4a369614586d21e2f7ea Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsAdminTestJSON-155273454 Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:47:50.861344 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba3d0c0b364d4a369614586d21e2f7ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba3d0c0b364d4a369614586d21e2f7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba3d0c0b364d4a369614586d21e2f7ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba3d0c0b364d4a369614586d21e2f7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsAdminTestJSON-155273454 Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: ba3d0c0b364d4a369614586d21e2f7ea Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-155273454 Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FlavorsAdminTestJSON-155273454-project Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 0e9ef4bd348f44a887f18ef92f914313 Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsAdminTestJSON-155273454-project Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "test", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "1755112372"}} Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:47:50.863264 n-d-820368-37 devstack@n-api.service[128863]: exception: Flavor 1755112372 could not be found. Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '1755112372'}}} Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1755112372 could not be found. Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:50.864229 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1755112372 could not be found. Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:47:50.865635 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:47:50.867073 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:47:50.867073 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:47:50.867073 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:47:50.867073 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1755112372 could not be found. Sep 01 04:47:50.867073 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:47:50.867073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77292587-8e72-4319-a8bd-64ed3c68ae90 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] Returning 400 to user: Flavor 1755112372 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:47:50.873549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77292587-8e72-4319-a8bd-64ed3c68ae90 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.076350 Sep 01 04:47:50.883048 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 223/440] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:50 2022] POST /compute/v2.1/servers => generated 81 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:47:50.890647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:50.891298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:50.937049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:50.937556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:50.937994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:50.938704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:50.950012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:50.955595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:51.359200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-879ac2a5-0526-49a4-91fe-76cb67b2baaa tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-224671568", "id": 1608081223, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:51.412403 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-879ac2a5-0526-49a4-91fe-76cb67b2baaa tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.655354 Sep 01 04:47:51.420282 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 218/441] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:50 2022] POST /compute/v2.1/flavors => generated 424 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:51.434255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ff8a9c9d-ff18-4917-b6b3-720f60664390 req-3bcfe272-7eda-464f-9474-8cf337be0306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "name": "network-vif-plugged", "status": "completed", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:51.469042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ff8a9c9d-ff18-4917-b6b3-720f60664390 req-3bcfe272-7eda-464f-9474-8cf337be0306 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:51.474434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ff8a9c9d-ff18-4917-b6b3-720f60664390 req-3bcfe272-7eda-464f-9474-8cf337be0306 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:51.475405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ff8a9c9d-ff18-4917-b6b3-720f60664390 req-3bcfe272-7eda-464f-9474-8cf337be0306 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:51.497239 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ff8a9c9d-ff18-4917-b6b3-720f60664390 req-3bcfe272-7eda-464f-9474-8cf337be0306 service nova] Creating event network-vif-plugged:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:47:51.503339 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ff8a9c9d-ff18-4917-b6b3-720f60664390 req-3bcfe272-7eda-464f-9474-8cf337be0306 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081316 Sep 01 04:47:51.504410 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 219/442] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:51.512502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7c1ca45-f6cd-4a4b-b7ef-173701452202 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:51.538450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7c1ca45-f6cd-4a4b-b7ef-173701452202 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1755112372" status: 202 len: 0 microversion: 2.1 time: 0.030474 Sep 01 04:47:51.539706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 220/443] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:47:51 2022] DELETE /compute/v2.1/flavors/1755112372 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:51.546436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:51.548656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:51.556472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:51.557312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:51.558143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:51.559151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:51.559812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:51.560433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:51.574973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:51.590962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:51.601293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:51.604252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36310db5-34b4-4125-a1a9-c6502fe24e22 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 0.718910 Sep 01 04:47:51.606628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 224/444] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:50 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:51.621682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-386df316-14a0-4763-bcf3-89599d751580 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:51.642249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-386df316-14a0-4763-bcf3-89599d751580 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033870 Sep 01 04:47:51.643716 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 225/445] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Sep 1 04:47:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:47:51.713748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa11efd0-aeae-45bb-badf-5c44813299a3 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:51.740639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa11efd0-aeae-45bb-badf-5c44813299a3 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.071390 Sep 01 04:47:51.741518 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 226/446] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:51 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:51.747630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae10645e-7444-454c-be34-9bee2a15959a tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-444623642", "id": 1262420842, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:51.781290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:51.784405 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae10645e-7444-454c-be34-9bee2a15959a tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.041278 Sep 01 04:47:51.788421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 227/447] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:51 2022] POST /compute/v2.1/flavors => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:51.798666 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a59b0f0-db9a-4a0e-9f89-7337ce05eef1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1274 microversion: 2.1 time: 0.257461 Sep 01 04:47:51.800317 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 221/448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:51 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:51.805273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:51.816907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:51.819398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c57884b0-3ae2-48e5-98f9-e003cbf1675a tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-479995037", "id": 1424667493, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:51.825168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:51.831839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:51.833062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:51.835463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:51.836220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:51.838259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:51.860588 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c57884b0-3ae2-48e5-98f9-e003cbf1675a tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.070817 Sep 01 04:47:51.861643 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 228/449] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:51 2022] POST /compute/v2.1/flavors => generated 414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:51.874228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff78c3da-0e06-43eb-aab0-9b5cd9772ee7 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:51.899192 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff78c3da-0e06-43eb-aab0-9b5cd9772ee7 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034809 Sep 01 04:47:51.903332 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 229/450] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Sep 1 04:47:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:47:51.917224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f567abe-9507-4cb1-8ac5-4888d36cec43 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760557ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.014173 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f567abe-9507-4cb1-8ac5-4888d36cec43 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.108583 Sep 01 04:47:52.021385 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 230/451] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:51 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:52.028344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0cedccb-3995-4a77-adb9-8d530fb63707 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1246563955", "id": 1729097188, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:52.055094 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0cedccb-3995-4a77-adb9-8d530fb63707 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.031658 Sep 01 04:47:52.056885 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 231/452] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:52.071076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7dce28d2-1d0a-44e1-8c36-974025c8fe4b tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Action: 'create', calling method: .version_select at 0x7fa76052c700>, body: {"keypair": {"name": "tempest-keypair-768765177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMfuWbrwo1OzWmySejA0DIDb81vWYQvm7SNcHXTj0ZuOdZXfMPnS6LDuovWCHgdx193p7y2C1evXyiANostf53N7mOVCHWG6YUrakQxiDwotpuEyyj7VB0g9pValBXu/Q=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:52.115543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7dce28d2-1d0a-44e1-8c36-974025c8fe4b tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Getting quotas for project 2827829d3ee04a6f8037be7c021a17f0. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:52.125877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7dce28d2-1d0a-44e1-8c36-974025c8fe4b tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Getting quotas for user 5d938ea24d3a4098bb7b932057afb841 and project 2827829d3ee04a6f8037be7c021a17f0. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:52.172965 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7dce28d2-1d0a-44e1-8c36-974025c8fe4b tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113461 Sep 01 04:47:52.175059 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 232/453] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:47:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:52.186548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8de9949e-e039-4d4f-b04e-75b41e0df9c7 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.201599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:52.210655 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39f9d2d5-a76c-4773-8350-d5d298ffa019 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 200 len: 1520 microversion: 2.1 time: 0.409016 Sep 01 04:47:52.231180 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8de9949e-e039-4d4f-b04e-75b41e0df9c7 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.040294 Sep 01 04:47:52.231180 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 233/454] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:52.231760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 222/455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:51 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:52.232397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5004ae60-6121-41e1-866b-cc951925fb69 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.249201 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5004ae60-6121-41e1-866b-cc951925fb69 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.018737 Sep 01 04:47:52.250456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'action', calling method: .version_select at 0x7fa761ab8dc0>, body: {"addFloatingIp": {"address": "172.25.9.181"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:52.253640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:52.256721 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 234/456] 10.222.0.26 () {58 vars in 1177 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:52.265026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f741f387-7986-4e18-8e19-fd84a37b7772 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.270408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:52.271203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:52.271809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:52.280820 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f741f387-7986-4e18-8e19-fd84a37b7772 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.022854 Sep 01 04:47:52.282064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:52.283132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:52.284296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:52.290791 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 235/457] 10.222.0.26 () {58 vars in 1171 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:52.297412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3a4b5de-945b-421d-b481-171dcbc2353b tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.312859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3a4b5de-945b-421d-b481-171dcbc2353b tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.020009 Sep 01 04:47:52.328757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 236/458] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:52.335518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af1a74b9-cbab-4f55-9a62-dcecfa969077 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.364064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af1a74b9-cbab-4f55-9a62-dcecfa969077 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.033521 Sep 01 04:47:52.365354 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 237/459] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:52.387740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-296adc72-efea-484f-abbb-36d626eb3091 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.422252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-296adc72-efea-484f-abbb-36d626eb3091 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.038837 Sep 01 04:47:52.443102 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 238/460] 10.222.0.26 () {58 vars in 1175 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:52.448131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:47:52.448938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquired lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:47:52.449970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33e3c209-79fb-41d4-ba8e-723f83f8593f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.486009 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33e3c209-79fb-41d4-ba8e-723f83f8593f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.039715 Sep 01 04:47:52.499705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 239/461] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:52.509510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6b54d9b-be78-4716-9345-ac594cf3ea99 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.567706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6b54d9b-be78-4716-9345-ac594cf3ea99 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.063090 Sep 01 04:47:52.572721 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 240/462] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:52.595455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b28c191f-f3b1-4070-bd31-2aa0041e5ff3 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.627788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:52.640205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b28c191f-f3b1-4070-bd31-2aa0041e5ff3 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1729097188" status: 202 len: 0 microversion: 2.1 time: 0.048630 Sep 01 04:47:52.641443 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 241/463] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:47:52 2022] DELETE /compute/v2.1/flavors/1729097188 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:52.646719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:52.647935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:52.657864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:52.658845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:52.660171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:52.661139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:52.661811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:52.662468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:53.144510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:53.154339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:53.160594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:53.161801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-172b5e0e-500b-464d-a080-4cbe73cbcfe7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 0.519200 Sep 01 04:47:53.162381 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 242/464] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:52 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:53.174345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d604544c-600f-4195-91e5-25efca9a6a7e tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:53.222632 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d604544c-600f-4195-91e5-25efca9a6a7e tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.052667 Sep 01 04:47:53.239953 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 243/465] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:53 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:53.247516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:53.248128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:53.271453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:53.271945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:53.272374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:53.273089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:53.273542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:53.273963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:54.602171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:54.612220 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-776541d8-d064-44b8-b6d7-5e7948319aad tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1316 microversion: 2.1 time: 1.368469 Sep 01 04:47:54.652651 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 244/466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:53 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1316 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:54.665320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c309983-21b6-4d39-b289-3897a6e918fa tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76052ca60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:54.761182 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c309983-21b6-4d39-b289-3897a6e918fa tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.107077 Sep 01 04:47:54.762408 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 245/467] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:54 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:54.774015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9c36d75-042e-48f2-829c-b628c88b1d6f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:54.831407 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9c36d75-042e-48f2-829c-b628c88b1d6f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1424667493" status: 202 len: 0 microversion: 2.1 time: 0.067245 Sep 01 04:47:54.842645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 246/468] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:47:54 2022] DELETE /compute/v2.1/flavors/1424667493 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:47:54.856878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:54.858341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:54.872567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:54.878076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:54.879015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:54.887700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:54.889179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:54.889942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:56.135331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:56.153936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:56.157066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:56.161452 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38588791-8a7f-4141-9f6e-eda2e78ec6ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1567 microversion: 2.25 time: 1.317406 Sep 01 04:47:56.173074 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 247/469] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:47:54 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1567 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:47:56.184557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68852a46-ccf0-46ed-b61a-49bcefbfddb2 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:56.269992 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68852a46-ccf0-46ed-b61a-49bcefbfddb2 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.095643 Sep 01 04:47:56.291384 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 248/470] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:47:56 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:56.300033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:56.302673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:47:56.314976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:56.316206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:56.321625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:56.322615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:56.323343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:56.326455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:56.641511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=19 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:57.142166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:47:57.158007 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-925aeca5-4a02-422a-b638-236d2edab222 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1316 microversion: 2.1 time: 0.864801 Sep 01 04:47:57.158849 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 249/471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:47:56 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1316 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:57.172185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a625316-2c1e-45ce-b63f-6685706bb406 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76052c940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:47:57.221889 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a625316-2c1e-45ce-b63f-6685706bb406 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.061424 Sep 01 04:47:57.222896 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 250/472] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:47:57 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:47:57.229829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1025441580", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "1262420842", "adminPass": "***", "networks": [{"uuid": "f37313c1-b941-40ce-9d59-af3b4f43452f"}], "security_groups": [{"name": "tempest-securitygroup--1052445457"}], "key_name": "tempest-keypair-768765177", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:57.740854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:57.836814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] validate_networks() for [('f37313c1-b941-40ce-9d59-af3b4f43452f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:47:58.184873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=20 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:47:58.981108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:47:59.211625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:47:59.213175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:47:59.214740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:47:59.215217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:47:59.216024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:47:59.243863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:59.245329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:59.246014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:59.247755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:47:59.248401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:47:59.251090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:47:59.288057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Getting quotas for project 2827829d3ee04a6f8037be7c021a17f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:47:59.297422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Getting quotas for user 5d938ea24d3a4098bb7b932057afb841 and project 2827829d3ee04a6f8037be7c021a17f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:47:59.325289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:47:59.327669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:47:59.423651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b44a44a-8f99-4f2b-bf9c-ccd2e6f19aec tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.199454 Sep 01 04:47:59.425218 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 251/473] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:47:59.430052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87f71378-8066-47fb-a868-a483a672399f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1929106068", "id": 707787339, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:59.462157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87f71378-8066-47fb-a868-a483a672399f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.034692 Sep 01 04:47:59.489809 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 252/474] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:59 2022] POST /compute/v2.1/flavors => generated 412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:47:59.786405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-732796045", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:47:59.867046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:48:00.624132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:48:00.624748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:48:00.632646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:48:00.634185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:48:00.634711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:48:00.661981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.662481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.662965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:00.663718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.664178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.664603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:00.672574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Updating instance_info_cache with network_info: [{"id": "6eeb6efa-2952-4167-9669-7d5af6905821", "address": "fa:16:3e:b2:7d:1e", "network": {"id": "7b76ca05-01a3-4b76-afa8-f7e1d1970480", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-383034209-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3380af7dd06d4c72855de9f45d9cf7b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6eeb6efa-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:48:00.698486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Releasing lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:48:00.699402 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac830081-596e-4533-8834-2a3de8396e77 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action" status: 202 len: 0 microversion: 2.1 time: 8.457088 Sep 01 04:48:00.700352 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 223/475] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:47:52 2022] POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action => generated 0 bytes in 8458 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 01 04:48:00.707811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Getting quotas for project 16489b907ac34075b138df3408066a64. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:00.713659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Getting quotas for user a4bd877eaf404b9b8989d063b14b0062 and project 16489b907ac34075b138df3408066a64. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:00.737756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:48:00.741792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:48:00.798779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa7604d6a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:00.803934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.804648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.805257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:00.806198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.807005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.807623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:00.809849 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cd4b12b-c6f4-46b8-b81f-df7a7f48ed4d tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318256 Sep 01 04:48:00.811038 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 253/476] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:48:00.834858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:00.837920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:00.852921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.853792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.854410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:00.855537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.856390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.857037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:00.866234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:00.895110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2de23ff8-8c57-42a5-be29-bc43be8cd5a2 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.193615 Sep 01 04:48:00.921102 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 224/477] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Sep 1 04:48:00 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:00.930829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8e7d9bcf-ecda-422e-9108-616134640ff0 req-813a654c-6c73-4169-b923-fd5cfb1503cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2eda1a9-f765-416e-843a-a16925ec4c08", "tag": "0342e640-737e-4ade-ad77-9f3f869c631b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:00.975724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e7d9bcf-ecda-422e-9108-616134640ff0 req-813a654c-6c73-4169-b923-fd5cfb1503cd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:00.986604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e7d9bcf-ecda-422e-9108-616134640ff0 req-813a654c-6c73-4169-b923-fd5cfb1503cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:00.989988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e7d9bcf-ecda-422e-9108-616134640ff0 req-813a654c-6c73-4169-b923-fd5cfb1503cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.048648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:01.051152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8e7d9bcf-ecda-422e-9108-616134640ff0 req-813a654c-6c73-4169-b923-fd5cfb1503cd service nova] Creating event network-changed:0342e640-737e-4ade-ad77-9f3f869c631b for instance e2eda1a9-f765-416e-843a-a16925ec4c08 on n-h1-820368-37 Sep 01 04:48:01.062749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:01.065726 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8e7d9bcf-ecda-422e-9108-616134640ff0 req-813a654c-6c73-4169-b923-fd5cfb1503cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143201 Sep 01 04:48:01.070833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:01.071144 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee3d56d9-2ed7-4c0e-8960-c62dcf54040e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1557 microversion: 2.25 time: 0.258924 Sep 01 04:48:01.072557 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 225/478] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:01.073451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 254/479] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:00 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1557 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:01.082089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b2aeb4b-276d-48a4-8b24-c2eafe9f4f44 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76052c4c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:01.085428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:01.091945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:01.100459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:01.101199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:01.102430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.103774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:01.104386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:01.105395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.188842 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b2aeb4b-276d-48a4-8b24-c2eafe9f4f44 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.112794 Sep 01 04:48:01.189855 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 255/480] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:01 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:01.198001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:01.198627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:01.217791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:01.218291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:01.218734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.219486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:01.219957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:01.220391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.405229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:01.421015 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2cad751-0261-4d21-9d8c-0569eaac0b1e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1316 microversion: 2.1 time: 0.345965 Sep 01 04:48:01.422357 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 226/481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:01 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:01.432177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-863b01b0-bbfa-4176-9645-28eab3fba1cb tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:01.464131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:01.468274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-863b01b0-bbfa-4176-9645-28eab3fba1cb tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.044494 Sep 01 04:48:01.480957 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb09cb0d-ed5b-403c-a189-02d82b82b6c8 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1316 microversion: 2.1 time: 0.289975 Sep 01 04:48:01.490063 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 227/482] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:01 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:01.505644 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 256/483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:01 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:01.508394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.181"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:01.512060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:01.521156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:01.522096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:01.522795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.523870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:01.523969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-724e8158-2b4d-435d-9bda-4f01e1490baf tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:01.524069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:01.524311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-724e8158-2b4d-435d-9bda-4f01e1490baf tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:01.524485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:01.619115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "refresh_cache-0e4d3683-ee24-4efb-b0b5-84570963a2e0" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:48:01.619522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquired lock "refresh_cache-0e4d3683-ee24-4efb-b0b5-84570963a2e0" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:48:01.961264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-724e8158-2b4d-435d-9bda-4f01e1490baf tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:01.984890 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-724e8158-2b4d-435d-9bda-4f01e1490baf tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1213 microversion: 2.1 time: 0.473855 Sep 01 04:48:01.985527 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 257/484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:01 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1213 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:02.000082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa7605f3820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:02.012034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.012947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.014368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.020117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.020938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.021731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.064823 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1ceb88c-579e-41ba-bd41-7f90a88920b5 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.075129 Sep 01 04:48:02.065442 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 258/485] 10.222.0.26 () {58 vars in 1139 bytes} [Thu Sep 1 04:48:01 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:02.070266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2ab7ebc-8663-4a31-b3f9-b4e92fa7b3e8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '.version_select at 0x7fa7608489d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:02.074754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2ab7ebc-8663-4a31-b3f9-b4e92fa7b3e8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.075626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2ab7ebc-8663-4a31-b3f9-b4e92fa7b3e8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.076225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2ab7ebc-8663-4a31-b3f9-b4e92fa7b3e8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.097503 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2ab7ebc-8663-4a31-b3f9-b4e92fa7b3e8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.030820 Sep 01 04:48:02.109108 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 259/486] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Sep 1 04:48:02 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:48:02.138826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe69f33b-9214-47c2-a6e8-6971729d0005 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:02.211756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe69f33b-9214-47c2-a6e8-6971729d0005 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.099967 Sep 01 04:48:02.213910 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 260/487] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:02 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:02.236171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa760848700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:02.240562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.251710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.252547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.253608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.254363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.255243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.314031 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e25b91f1-67ec-4113-aea6-fa6f8c895c98 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.093691 Sep 01 04:48:02.316268 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 261/488] 10.222.0.26 () {58 vars in 1145 bytes} [Thu Sep 1 04:48:02 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:48:02.323081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:02.327957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:02.337241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.337899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.338504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.339455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:02.340122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:02.340715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:02.929176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:02.975155 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b737b0a7-5f9a-4d14-918f-fe37164552e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 2051 microversion: 2.25 time: 0.644448 Sep 01 04:48:02.975839 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 262/489] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:02 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 2051 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:02.987760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b993d09c-d909-49df-ad6c-80806a44f51b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760580ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:03.101987 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b993d09c-d909-49df-ad6c-80806a44f51b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.124340 Sep 01 04:48:03.102667 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 263/490] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:02 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:03.117427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a3dfe16-3d0f-4800-9e02-d10bb775933a tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:03.175136 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a3dfe16-3d0f-4800-9e02-d10bb775933a tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/707787339" status: 202 len: 0 microversion: 2.1 time: 0.070749 Sep 01 04:48:03.178492 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 264/491] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:48:03 2022] DELETE /compute/v2.1/flavors/707787339 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:48:03.193005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa760432790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:03.198123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.198917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.199957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.201067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.201761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.202390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.233870 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8ce4c84-24f0-45fc-866b-132a969a5481 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.052682 Sep 01 04:48:03.235314 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 265/492] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Sep 1 04:48:03 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:03.249309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:03.250140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:03.258678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.259200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.259695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.260399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.260899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.262028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.789974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:03.805480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d56e7805-9798-4a76-a6a2-f0bab91e7a94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1316 microversion: 2.1 time: 0.567963 Sep 01 04:48:03.814972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 266/493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:03 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:03.831394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:03.832004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:03.840046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.840520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.841556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.843178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.843645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.844066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.941624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:03.955622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-320e29aa-3759-4fa6-b35c-e227f27bf078 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1322 microversion: 2.1 time: 0.140300 Sep 01 04:48:03.963037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 267/494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:03 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1322 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:03.971903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:03.973088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:03.983662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.984952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.985567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:03.987431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:03.988065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:03.989153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:04.128149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:04.138263 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c960c730-9b2d-4f46-bdc3-cdc7a4c4f285 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1271 microversion: 2.1 time: 0.179480 Sep 01 04:48:04.138979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 268/495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:03 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:04.163827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1125096410", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "541b0280-9b86-4b41-9f61-cdb1f531e297"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:04.241221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] validate_networks() for [('541b0280-9b86-4b41-9f61-cdb1f531e297', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:48:05.914238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:48:05.914858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:48:05.915169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:48:05.915576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:48:05.916700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:48:05.927731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:05.928472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:05.928908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:05.930143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:05.931857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:05.932304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:05.949169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:05.957327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:05.964132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for user ce4ece60266c4a9692b03d795cea8462 and project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:05.980104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:48:05.982289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:48:06.056039 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69baeaaa-c8db-432e-a2f8-b00fc97097fe tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.909568 Sep 01 04:48:06.063189 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 269/496] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:48:06.068690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5a81564-97ac-414e-8f5d-fc9fd4327b16 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:06.096324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5a81564-97ac-414e-8f5d-fc9fd4327b16 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.031427 Sep 01 04:48:06.097324 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 270/497] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:06 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:06.101749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa7604c1ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:06.105399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:06.105883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:06.106381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:06.107152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:06.107603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:06.108026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:06.138206 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbb0e6a7-2a35-4207-a0ad-f1342beb58e0 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.039504 Sep 01 04:48:06.139319 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 271/498] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 04:48:06 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:06.149122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4928e6a9-85cd-4417-8f63-f52292981176 req-7e48e184-199b-4b4b-b677-d00be99f2b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:06.160107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4928e6a9-85cd-4417-8f63-f52292981176 req-7e48e184-199b-4b4b-b677-d00be99f2b28 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:06.160594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4928e6a9-85cd-4417-8f63-f52292981176 req-7e48e184-199b-4b4b-b677-d00be99f2b28 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:06.161027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4928e6a9-85cd-4417-8f63-f52292981176 req-7e48e184-199b-4b4b-b677-d00be99f2b28 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:06.174032 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4928e6a9-85cd-4417-8f63-f52292981176 req-7e48e184-199b-4b4b-b677-d00be99f2b28 service nova] Creating event network-changed:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:48:06.180313 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4928e6a9-85cd-4417-8f63-f52292981176 req-7e48e184-199b-4b4b-b677-d00be99f2b28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039783 Sep 01 04:48:06.181625 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 272/499] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:06.187469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f5b9848-e927-45e9-b07c-bffcd426ce82 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76052c3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:06.256333 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f5b9848-e927-45e9-b07c-bffcd426ce82 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1455 microversion: 2.1 time: 0.073263 Sep 01 04:48:06.257213 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 273/500] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:06 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:06.263002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-728cd044-5012-49c6-8b93-698ff256f7a8 req-3b1aa38c-4580-4891-b94d-da8a506957e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2eda1a9-f765-416e-843a-a16925ec4c08", "name": "network-vif-plugged", "status": "completed", "tag": "0342e640-737e-4ade-ad77-9f3f869c631b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:06.279770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-728cd044-5012-49c6-8b93-698ff256f7a8 req-3b1aa38c-4580-4891-b94d-da8a506957e9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:06.280406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-728cd044-5012-49c6-8b93-698ff256f7a8 req-3b1aa38c-4580-4891-b94d-da8a506957e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:06.281575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-728cd044-5012-49c6-8b93-698ff256f7a8 req-3b1aa38c-4580-4891-b94d-da8a506957e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:06.297524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-728cd044-5012-49c6-8b93-698ff256f7a8 req-3b1aa38c-4580-4891-b94d-da8a506957e9 service nova] Creating event network-vif-plugged:0342e640-737e-4ade-ad77-9f3f869c631b for instance e2eda1a9-f765-416e-843a-a16925ec4c08 on n-h1-820368-37 Sep 01 04:48:06.310115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-728cd044-5012-49c6-8b93-698ff256f7a8 req-3b1aa38c-4580-4891-b94d-da8a506957e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050538 Sep 01 04:48:06.314058 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 274/501] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:06.333866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:06.335024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:06.342913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:06.343764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:06.345031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:06.346128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:06.347018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:06.347642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:07.133765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:07.148305 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12b544cf-25c5-4fc6-86f5-5ef7ef85c6ce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1316 microversion: 2.1 time: 0.831259 Sep 01 04:48:07.150464 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 275/502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:06 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:07.158099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:07.168362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:07.175904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:07.182681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:07.183447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:07.184346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:07.184952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:07.185527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:07.620411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:07.631098 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-553847e1-23c4-457b-8186-1fc6cd929211 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.478268 Sep 01 04:48:07.633615 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 276/503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:07 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:07.640232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:07.641249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:07.669245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:07.670124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:07.670946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:07.671832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:07.672406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:07.672933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:07.991879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:08.000360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c787f552-3641-4816-9a62-fcf8a0bf51b8 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1313 microversion: 2.1 time: 0.365405 Sep 01 04:48:08.009170 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.network.neutron [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] re-assign floating IP 172.25.9.181 from instance b226ce5f-32a5-45ae-b6bf-58bffea89558 Sep 01 04:48:08.016769 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 277/504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:07 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:08.027706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-be117ad1-e3f9-4947-95c0-28196202dc34 req-449f5679-ae82-46f8-8747-4a0690c6b177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f2d13a-31dc-46dc-bae8-28f77eb3e07f", "tag": "302d36ff-9585-45c6-8850-d28970bfa26c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:08.050785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be117ad1-e3f9-4947-95c0-28196202dc34 req-449f5679-ae82-46f8-8747-4a0690c6b177 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.051686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be117ad1-e3f9-4947-95c0-28196202dc34 req-449f5679-ae82-46f8-8747-4a0690c6b177 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.052318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be117ad1-e3f9-4947-95c0-28196202dc34 req-449f5679-ae82-46f8-8747-4a0690c6b177 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.069741 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-be117ad1-e3f9-4947-95c0-28196202dc34 req-449f5679-ae82-46f8-8747-4a0690c6b177 service nova] Creating event network-changed:302d36ff-9585-45c6-8850-d28970bfa26c for instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f on n-h1-820368-37 Sep 01 04:48:08.075170 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-be117ad1-e3f9-4947-95c0-28196202dc34 req-449f5679-ae82-46f8-8747-4a0690c6b177 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057570 Sep 01 04:48:08.076418 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 278/505] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:08.077538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:48:08.083222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.084188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:08.091503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.092282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.092907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.093796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.094427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.095057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.206993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:08.220949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:08.225496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:08.228427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-784d8582-a3c2-4c58-849d-2a92f08ba9e1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1258 microversion: 2.25 time: 0.150335 Sep 01 04:48:08.230267 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 279/506] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:08.238430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3427b796-5cab-4bc3-96c8-93b913a1251f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-13407653", "id": 247068869, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:08.276046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3427b796-5cab-4bc3-96c8-93b913a1251f tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.042940 Sep 01 04:48:08.284498 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 280/507] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:48:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:08.289460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa760580820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.296302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.296862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.297402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.298200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.298655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.299239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.327716 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b0e7164-bf2e-4cf9-88eb-ba01c1056e94 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.041836 Sep 01 04:48:08.334044 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 281/508] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:08.338783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b65a9ab1-c22e-44e2-968a-db135f69ea90 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760418dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.390209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b65a9ab1-c22e-44e2-968a-db135f69ea90 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1464 microversion: 2.1 time: 0.057177 Sep 01 04:48:08.391092 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 282/509] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1464 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:08.396687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.397366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:08.404116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.404605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.405038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.405771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.406229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.406657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.694025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:08.707476 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f223f4d5-367b-4a26-b630-a70d43882147 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1316 microversion: 2.1 time: 0.314829 Sep 01 04:48:08.707476 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 283/510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:08.712138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70f98bd3-cc67-4347-968f-b87ab37c9e97 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.748547 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70f98bd3-cc67-4347-968f-b87ab37c9e97 tempest-FlavorsAdminTestJSON-155273454 tempest-FlavorsAdminTestJSON-155273454-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.039431 Sep 01 04:48:08.774909 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 284/511] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:08.774909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa7604323a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.783309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.784065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.784658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.798581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.799487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.800082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.831593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Updating instance_info_cache with network_info: [{"id": "6eeb6efa-2952-4167-9669-7d5af6905821", "address": "fa:16:3e:b2:7d:1e", "network": {"id": "7b76ca05-01a3-4b76-afa8-f7e1d1970480", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-383034209-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3380af7dd06d4c72855de9f45d9cf7b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6eeb6efa-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:48:08.838447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=71,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:08.844575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:48:08.845765 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-612604b8-f41d-4520-8abe-a48be81409e3 tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h1-820368-37" status: 200 len: 867 microversion: 2.1 time: 0.076472 Sep 01 04:48:08.855104 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 285/512] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/os-hosts/n-h1-820368-37 => generated 867 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:08.863623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f75dae3b-08c2-4203-940a-5298cdc84a64 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760432670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.917527 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f75dae3b-08c2-4203-940a-5298cdc84a64 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 200 len: 1464 microversion: 2.1 time: 0.061070 Sep 01 04:48:08.919883 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 286/513] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:08.936088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd1215-d488-4a50-986c-4a4006f1ff37", "tag": "ec93a9f5-2b82-4781-b029-8627bd48ede6"}, {"name": "network-changed", "server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}, {"name": "network-changed", "server_uuid": "0e4d3683-ee24-4efb-b0b5-84570963a2e0", "tag": "e6b41343-be2b-4425-b4c8-f91be80a10e3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:08.950982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:08.951693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:08.952429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:08.967435 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Creating event network-changed:ec93a9f5-2b82-4781-b029-8627bd48ede6 for instance b9fd1215-d488-4a50-986c-4a4006f1ff37 on n-h2-820368-37 Sep 01 04:48:08.967949 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Creating event network-changed:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:48:08.968458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] Creating event network-changed:e6b41343-be2b-4425-b4c8-f91be80a10e3 for instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 on n-h1-820368-37 Sep 01 04:48:08.978729 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7822263f-03dd-446a-a4c7-7b93414db698 req-d6ef1c96-e8ad-4dd8-8ad1-974c5632a07c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.046160 Sep 01 04:48:08.980243 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 287/514] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:08.988521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:08.989233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:08.999762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:09.000862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:09.001689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:09.003758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:09.004661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:09.005122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:09.578477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:09.582410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:09.589639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20821c72-29e8-4f52-a9cf-663af6dfeefe tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.608185 Sep 01 04:48:09.590229 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 288/515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:08 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:09.610289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f99b172b-4296-4865-b515-c59523abf3f9 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:09.630704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f99b172b-4296-4865-b515-c59523abf3f9 tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/247068869" status: 202 len: 0 microversion: 2.1 time: 0.025319 Sep 01 04:48:09.631938 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 289/516] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:48:09 2022] DELETE /compute/v2.1/flavors/247068869 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:48:09.637766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Calling method '.version_select at 0x7fa760432790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:09.645466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:09.646192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:09.646630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:09.663456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:09.663947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:09.664721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:09.689074 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74410ae0-18b1-4052-87c8-ec93629597ef tempest-HostsAdminTestJSON-1469468593 tempest-HostsAdminTestJSON-1469468593-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h2-820368-37" status: 200 len: 867 microversion: 2.1 time: 0.055601 Sep 01 04:48:09.689986 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 290/517] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Sep 1 04:48:09 2022] GET /compute/v2.1/os-hosts/n-h2-820368-37 => generated 867 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:09.695339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:09.696009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:09.706617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:09.707179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:09.707623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:09.708347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:09.711235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:09.713178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.082275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:10.092801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e052f57-8d8c-413b-bcc5-b1ef7e643c35 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1480 microversion: 2.1 time: 0.401146 Sep 01 04:48:10.105938 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 291/518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:09 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1480 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:10.105938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:10.105938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:10.108092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.108646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.109184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.109995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.110502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.111024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.172693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Updating instance_info_cache with network_info: [{"id": "e6b41343-be2b-4425-b4c8-f91be80a10e3", "address": "fa:16:3e:31:80:c1", "network": {"id": "7b76ca05-01a3-4b76-afa8-f7e1d1970480", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-383034209-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3380af7dd06d4c72855de9f45d9cf7b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape6b41343-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:48:10.192945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Releasing lock "refresh_cache-0e4d3683-ee24-4efb-b0b5-84570963a2e0" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:48:10.194584 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-735edcd9-330c-4df7-a28e-dfb114876407 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0/action" status: 202 len: 0 microversion: 2.1 time: 8.702478 Sep 01 04:48:10.195549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 228/519] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:01 2022] POST /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0/action => generated 0 bytes in 8704 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:48:10.201662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:10.202701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:10.210660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.211450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.212096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.213044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.213806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.214535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.499159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:10.510974 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72748375-35fa-47cc-aa97-0bdc8f272a32 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1313 microversion: 2.1 time: 0.415230 Sep 01 04:48:10.512249 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 292/520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:10 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:10.520568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e20d6ac-02d4-4ad9-ab0a-0c9755322aad tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:10.590115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e20d6ac-02d4-4ad9-ab0a-0c9755322aad tempest-FlavorsAdminTestJSON-942845848 tempest-FlavorsAdminTestJSON-942845848-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.076365 Sep 01 04:48:10.592986 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 293/521] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:10 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:10.604968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:10.606447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:10.617027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:10.623136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.624815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.625529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.626781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.627618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.628570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.637585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:10.639772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:10.641098 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2dd5f65-bb2a-42b1-b05b-88cd4b229842 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.444250 Sep 01 04:48:10.642495 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 229/522] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:10 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:10.647952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'action', calling method: .version_select at 0x7fa761ab8e50>, body: {"removeFloatingIp": {"address": "172.25.9.181"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:10.840830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:10.855681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:10.866518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.867037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.867466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.871105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.872076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.873800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.915213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:10.927261 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-057d3cb8-2249-4174-926e-49cd539d1033 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1466 microversion: 2.1 time: 0.331265 Sep 01 04:48:10.927864 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 294/523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:10 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1466 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:10.940140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:10.942743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:10.957397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.958153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.958597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:10.959379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:10.959837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:10.960329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:11.250763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:11.263888 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a85ed14-dc70-4038-b57a-53d4a8adcc97 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.334076 Sep 01 04:48:11.265632 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 295/524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:10 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:11.288411 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] HTTP exception thrown: Floating IP 172.25.9.181 is not associated with instance b226ce5f-32a5-45ae-b6bf-58bffea89558. Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Request method failure captured: Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action HTTP/1.1 Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 49 Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlHSvQ82F0lv4qtM8UZLySue42uq0a9Ji7GVDzxJWzd7awVGIm4QklOkO2NUyla9dHGQ6xL6zpMStGJ9BHGhiSBiINsWBbTd4TOoqUWkdQRPebjI-oG13cA6GqcirkzMIRJlz66ZJlIHTfaEHAqrIHrNv7PUfPe5Wxw1FMGHxW8UEM Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:48:11.290356 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c8e8a3f51b486b930a4d445813e3a0 Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: {"removeFloatingIp": {"address": "172.25.9.181"}} Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:11.291760 n-d-820368-37 devstack@n-api.service[128862]: exception: Floating IP 172.25.9.181 is not associated with instance b226ce5f-32a5-45ae-b6bf-58bffea89558. Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b226ce5f-32a5-45ae-b6bf-58bffea89558', 'body': {'removeFloatingIp': {'address': '172.25.9.181'}}} Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.181 is not associated with instance b226ce5f-32a5-45ae-b6bf-58bffea89558. Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:11.292548 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.181 is not associated with instance b226ce5f-32a5-45ae-b6bf-58bffea89558. Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Returning 409 to user: Floating IP 172.25.9.181 is not associated with instance b226ce5f-32a5-45ae-b6bf-58bffea89558. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:11.293718 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07f93c6b-8bc1-46c0-bfaa-658ca98e4d51 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action" status: 409 len: 146 microversion: 2.1 time: 0.649246 Sep 01 04:48:11.294349 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 230/525] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:10 2022] POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action => generated 146 bytes in 651 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:11.301683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:11.302313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:11.309641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:11.310132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:11.310559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:11.311675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:11.312141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:11.312556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:11.548845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:11.549730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:11.561137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:11.561785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:11.562294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:11.562731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:11.563521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:11.564098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:11.564866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:11.583002 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b881bb18-5257-499e-af30-b443e8bd8ed3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1480 microversion: 2.1 time: 0.287741 Sep 01 04:48:11.600349 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 231/526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:11 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1480 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:11.609864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.181"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:11.879251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:11.886326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:11.886833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:11.887296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:11.888003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:11.888453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:11.888851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:12.129581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b11b4780-0165-436e-b26a-6eec5b0967aa tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1619 microversion: 2.1 time: 0.862384 Sep 01 04:48:12.148462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 296/527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:11 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1619 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:12.161437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a0c8b98d-a4ec-48f9-935f-e50be53693ce req-478d00e2-63e1-4f98-b3c9-395cd16351a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28faec93-25bd-420c-a9e7-85836885a76b", "tag": "60ba55a3-9242-45b7-bdc3-cca385154f4a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:12.173875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a0c8b98d-a4ec-48f9-935f-e50be53693ce req-478d00e2-63e1-4f98-b3c9-395cd16351a2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:12.174637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a0c8b98d-a4ec-48f9-935f-e50be53693ce req-478d00e2-63e1-4f98-b3c9-395cd16351a2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:12.175935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a0c8b98d-a4ec-48f9-935f-e50be53693ce req-478d00e2-63e1-4f98-b3c9-395cd16351a2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:12.191807 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a0c8b98d-a4ec-48f9-935f-e50be53693ce req-478d00e2-63e1-4f98-b3c9-395cd16351a2 service nova] Creating event network-changed:60ba55a3-9242-45b7-bdc3-cca385154f4a for instance 28faec93-25bd-420c-a9e7-85836885a76b on n-h1-820368-37 Sep 01 04:48:12.197325 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a0c8b98d-a4ec-48f9-935f-e50be53693ce req-478d00e2-63e1-4f98-b3c9-395cd16351a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047044 Sep 01 04:48:12.198810 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 297/528] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:12.206084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:12.207504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:12.216925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:12.217626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:12.218213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:12.219366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:12.219985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:12.220798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:12.227704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "refresh_cache-0e4d3683-ee24-4efb-b0b5-84570963a2e0" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:48:12.228109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquired lock "refresh_cache-0e4d3683-ee24-4efb-b0b5-84570963a2e0" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:48:12.467401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:12.478412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-398ff9c6-3c8d-49c2-988b-79add0c9d04b tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1313 microversion: 2.1 time: 0.277417 Sep 01 04:48:12.498964 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 298/529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:12 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:12.508906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:12.509519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:12.525298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:12.525800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:12.528991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:12.529741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:12.530215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:12.530646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:12.861170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:12.873286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:12.875945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:12.877587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d5ec401-2929-495a-8363-6f7fc5564f2c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.377536 Sep 01 04:48:12.878735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 299/530] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:12 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:12.896400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17db3549-17a4-42d0-a10c-299ee452e991 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: .version_select at 0x7fa760418ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2031985173", "policies": ["affinity"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:12.921256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-17db3549-17a4-42d0-a10c-299ee452e991 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:12.927872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-17db3549-17a4-42d0-a10c-299ee452e991 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:12.987871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:12.999048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-17db3549-17a4-42d0-a10c-299ee452e991 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:13.021222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-17db3549-17a4-42d0-a10c-299ee452e991 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:13.050791 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17db3549-17a4-42d0-a10c-299ee452e991 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.168053 Sep 01 04:48:13.051483 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 300/531] 10.222.0.26 () {60 vars in 1174 bytes} [Thu Sep 1 04:48:12 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:13.058844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:13.059761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:13.071215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:13.072665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:13.074710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:13.075720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:13.076972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:13.077569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:13.304350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:13.312545 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d33e447-49c1-4ecc-82b8-f478ad83f206 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.259710 Sep 01 04:48:13.313132 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 301/532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:13 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:13.329133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e3b838ac-7118-444e-bc19-57d085f57eac req-dc32cca6-50d8-46ba-bb6e-921ce2c1d52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f2d13a-31dc-46dc-bae8-28f77eb3e07f", "name": "network-vif-plugged", "status": "completed", "tag": "302d36ff-9585-45c6-8850-d28970bfa26c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:13.345140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3b838ac-7118-444e-bc19-57d085f57eac req-dc32cca6-50d8-46ba-bb6e-921ce2c1d52b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:13.346775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3b838ac-7118-444e-bc19-57d085f57eac req-dc32cca6-50d8-46ba-bb6e-921ce2c1d52b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:13.347274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3b838ac-7118-444e-bc19-57d085f57eac req-dc32cca6-50d8-46ba-bb6e-921ce2c1d52b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:13.363810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e3b838ac-7118-444e-bc19-57d085f57eac req-dc32cca6-50d8-46ba-bb6e-921ce2c1d52b service nova] Creating event network-vif-plugged:302d36ff-9585-45c6-8850-d28970bfa26c for instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f on n-h1-820368-37 Sep 01 04:48:13.369205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e3b838ac-7118-444e-bc19-57d085f57eac req-dc32cca6-50d8-46ba-bb6e-921ce2c1d52b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054626 Sep 01 04:48:13.369842 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 302/533] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:13.375331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:13.376403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:13.386163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:13.386646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:13.387371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:13.388287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:13.388933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:13.389175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:14.029507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:48:14.144097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:14.155155 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c4cd6c8-3473-48b2-a212-f7f2621eeeba tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1467 microversion: 2.1 time: 0.784006 Sep 01 04:48:14.158985 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 303/534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:13 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1467 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:14.169751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-916225123", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1c6aa3f2-600e-4852-8748-9e25b4070475"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:14.271638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:48:14.712624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:48:14.714043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:48:14.714764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:48:14.715340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:48:14.715973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:48:14.756508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:14.757639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:14.758262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:14.759527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:14.760159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:14.761078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:14.793194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:14.800422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:14.817614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Going to run 2 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:48:14.820448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:48:14.866387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128863) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 01 04:48:14.889908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:14.897278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:14.949829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:14.957059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:14.964772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Updating instance_info_cache with network_info: [{"id": "e6b41343-be2b-4425-b4c8-f91be80a10e3", "address": "fa:16:3e:31:80:c1", "network": {"id": "7b76ca05-01a3-4b76-afa8-f7e1d1970480", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-383034209-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3380af7dd06d4c72855de9f45d9cf7b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape6b41343-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:48:14.972027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=3c60da80-bd80-4e4a-94b1-fe33392994f5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:48:14.980057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Releasing lock "refresh_cache-0e4d3683-ee24-4efb-b0b5-84570963a2e0" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:48:14.981512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e70df3be-1186-4a98-ab8a-2b3e5abad6f4 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0/action" status: 202 len: 0 microversion: 2.1 time: 3.379761 Sep 01 04:48:14.986569 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 232/535] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:11 2022] POST /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0/action => generated 0 bytes in 3385 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:48:14.994592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:14.995747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:15.003937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.004790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.006841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.007990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.008760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.009367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.041671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:15.059470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:15.116672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:15.121875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:15.199454 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8800049c-2443-4466-9a7e-cc15f349659a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.037965 Sep 01 04:48:15.202869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 304/536] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:48:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:48:15.212061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:15.212677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:15.221137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.221627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.222053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.222757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.223352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.223662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.227956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:15.253523 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ce33489-4de9-4c2d-b269-84ef513a1c23 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1313 microversion: 2.1 time: 0.251795 Sep 01 04:48:15.254400 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 233/537] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:14 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:15.272900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-01f7a604-862c-4199-8fe9-29352887ab8c req-48dedd42-c9e6-40a9-9509-74448e06ed9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4d3683-ee24-4efb-b0b5-84570963a2e0", "tag": "e6b41343-be2b-4425-b4c8-f91be80a10e3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:15.311612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01f7a604-862c-4199-8fe9-29352887ab8c req-48dedd42-c9e6-40a9-9509-74448e06ed9a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.312383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01f7a604-862c-4199-8fe9-29352887ab8c req-48dedd42-c9e6-40a9-9509-74448e06ed9a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.314401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01f7a604-862c-4199-8fe9-29352887ab8c req-48dedd42-c9e6-40a9-9509-74448e06ed9a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.347403 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-01f7a604-862c-4199-8fe9-29352887ab8c req-48dedd42-c9e6-40a9-9509-74448e06ed9a service nova] Creating event network-changed:e6b41343-be2b-4425-b4c8-f91be80a10e3 for instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 on n-h1-820368-37 Sep 01 04:48:15.356599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-01f7a604-862c-4199-8fe9-29352887ab8c req-48dedd42-c9e6-40a9-9509-74448e06ed9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097593 Sep 01 04:48:15.358607 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 234/538] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:15.366696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1722378258"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:15.369579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:15.378940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.379728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.380526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.381562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.382194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.382817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.473897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:15.494790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:15.496834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:15.500373 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5137f69c-8b75-4543-ba97-a4e64a7909a8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.295925 Sep 01 04:48:15.501529 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 305/539] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:15 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:15.531026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:15.532190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:15.543327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.543946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.544606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.545406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.547020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.547983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.780471 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67150ae6-9a44-44cc-88a5-3a3b7afdb0f6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "POST /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e/action" status: 202 len: 0 microversion: 2.1 time: 0.414593 Sep 01 04:48:15.793102 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 235/540] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:15 2022] POST /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:48:15.855447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:15.866601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c6cddcd-add3-4395-8c4d-67a50d09e7de tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.346785 Sep 01 04:48:15.869899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 306/541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:15 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:15.890523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:15.892236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:15.906422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.908524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.909151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.909974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:15.912625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:15.913086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:15.974180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:48:16.125658 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9233c7f3-95e8-4a42-8abe-d9fa5af24375 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 204 len: 0 microversion: 2.1 time: 0.254329 Sep 01 04:48:16.126267 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 307/542] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:48:15 2022] DELETE /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:48:16.137932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:16.141487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Calling method '.version_select at 0x7fa760329b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:16.144775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:16.145802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Searching by: {'deleted': False, 'project_id': 'a917f0bb781a42879a605ffca90e436d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:48:16.146461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.147302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.148946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.149960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.152892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.153512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.166531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.167560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.168441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.169478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.170282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.171086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.222077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1eed197b-13a5-4be5-b84f-e43094a385bd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.426383 Sep 01 04:48:16.229710 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 236/543] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Sep 1 04:48:15 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:16.235561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-038a1554-b7b9-42cf-955b-ea2788d7464a req-288602d6-bd37-405e-9bb0-49b330fcb27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "name": "network-vif-unplugged", "status": "completed", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:16.247369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-038a1554-b7b9-42cf-955b-ea2788d7464a req-288602d6-bd37-405e-9bb0-49b330fcb27a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.247917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-038a1554-b7b9-42cf-955b-ea2788d7464a req-288602d6-bd37-405e-9bb0-49b330fcb27a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.249082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-038a1554-b7b9-42cf-955b-ea2788d7464a req-288602d6-bd37-405e-9bb0-49b330fcb27a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.272724 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-038a1554-b7b9-42cf-955b-ea2788d7464a req-288602d6-bd37-405e-9bb0-49b330fcb27a service nova] Creating event network-vif-unplugged:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:48:16.292467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-038a1554-b7b9-42cf-955b-ea2788d7464a req-288602d6-bd37-405e-9bb0-49b330fcb27a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061400 Sep 01 04:48:16.295078 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 237/544] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:16.322163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbe19cc6-cc9e-4358-8feb-bf58116cced9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76039a310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:16.341561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:48:16.399302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:16.416452 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbe19cc6-cc9e-4358-8feb-bf58116cced9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.119390 Sep 01 04:48:16.425531 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 238/545] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:16 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:16.431832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.181"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:16.437073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:16.450179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.451126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.451775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.452971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.453835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.454424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.487046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:48:16.488391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquired lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:48:16.525542 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f30f7057-585a-4b81-a55a-119d43b12b0a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.397492 Sep 01 04:48:16.539057 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 308/546] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:48:16 2022] GET /compute/v2.1/servers => generated 1001 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:16.801659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54ff3d53-f0c9-450c-a36e-477634c8a538 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Calling method '.version_select at 0x7fa760432550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:16.805363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54ff3d53-f0c9-450c-a36e-477634c8a538 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '080e7616d15348b1a8656542c8c68250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020d7ee3b2845f8a07c4f93a2ba8c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54ff3d53-f0c9-450c-a36e-477634c8a538 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Request method failure captured: Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmNEe_3qnGafSmScBU3FkmYpmvfpXaWr_oCSKGsFETNNWPlazmcC5j9gxZ2jEoitV6_nfrCg9bYDiEbHTdCqDVlenEpzjeCEg_hI44f6f9KsOcDo-I44guEtnM3JgR5wcgyhGCZp9I9tno_AonCLfTb3MDUNfmbwGIqnl7Ftkxj6kU Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:16.807492 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 080e7616d15348b1a8656542c8c68250 Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: action_args: {} Sep 01 04:48:16.808774 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:16.809539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 01 04:48:16.811217 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:16.812339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54ff3d53-f0c9-450c-a36e-477634c8a538 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:16.812339 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54ff3d53-f0c9-450c-a36e-477634c8a538 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.268801 Sep 01 04:48:16.812339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 309/547] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Sep 1 04:48:16 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:16.818187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:16.818938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:16.822010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:16.827069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.827552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.827986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:16.828688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:16.829136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:16.829553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.093010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.101240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74a91f59-1c6b-4a55-8482-cba01070cb69 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1463 microversion: 2.1 time: 0.290800 Sep 01 04:48:17.101807 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 310/548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:16 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1463 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:17.106389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:17.107042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:17.113215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.113731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.114160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.114843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.115326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.115869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.378175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.386400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.388180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.389685 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6e241a2-9f87-46ab-aac9-6e4bb0a2255a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.286978 Sep 01 04:48:17.390395 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 311/549] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:17 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:17.400801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:17.402009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:17.409251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.409744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.410160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.411238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.411687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.412103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.483135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.492481 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c2a8461-4822-4c7d-b2b8-10e6e73a4172 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1214 microversion: 2.1 time: 0.100761 Sep 01 04:48:17.500893 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 312/550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:17 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:17.559282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Calling method '.version_select at 0x7fa76035d0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:17.561354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.561892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.562323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.586096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.586917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.587522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.606344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.607069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.607617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.615871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45f54c8b-1e87-4763-9180-7ff755bd2896 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.121106 Sep 01 04:48:17.633445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 313/551] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:17.640881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caa48635-24a9-41f5-8459-d1e4dca222f0 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Calling method '.version_select at 0x7fa760383160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:17.642948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caa48635-24a9-41f5-8459-d1e4dca222f0 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '080e7616d15348b1a8656542c8c68250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020d7ee3b2845f8a07c4f93a2ba8c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caa48635-24a9-41f5-8459-d1e4dca222f0 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Request method failure captured: Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/n-d-820368-37/reboot HTTP/1.1 Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmNEe_3qnGafSmScBU3FkmYpmvfpXaWr_oCSKGsFETNNWPlazmcC5j9gxZ2jEoitV6_nfrCg9bYDiEbHTdCqDVlenEpzjeCEg_hI44f6f9KsOcDo-I44guEtnM3JgR5wcgyhGCZp9I9tno_AonCLfTb3MDUNfmbwGIqnl7Ftkxj6kU Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:17.645834 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 080e7616d15348b1a8656542c8c68250 Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'n-d-820368-37'} Sep 01 04:48:17.647414 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:17.648322 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 01 04:48:17.649638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:17.651958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caa48635-24a9-41f5-8459-d1e4dca222f0 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:17.652958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-caa48635-24a9-41f5-8459-d1e4dca222f0 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-820368-37/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018156 Sep 01 04:48:17.653736 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 314/552] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Sep 1 04:48:17 2022] GET /compute/v2.1/os-hosts/n-d-820368-37/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:17.665398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:17.666710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:17.675426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.675918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.676356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.677071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:17.677521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:17.678120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:17.904763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:17.913737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d196dd50-4afc-494d-834f-262ccf718fb3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.253226 Sep 01 04:48:17.918194 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 315/553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:17 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:18.032117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:48:18.091413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Calling method '.version_select at 0x7fa76036aa60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:18.105272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.105926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.106338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.126269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.126904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.127575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.147490 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70355e98-25c5-40da-90a5-ae97c91b7ea8 tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/16489b907ac34075b138df3408066a64?start=2022-08-31T04%3A48%3A17.115145&end=2022-09-02T04%3A48%3A17.115145" status: 200 len: 690 microversion: 2.1 time: 0.222193 Sep 01 04:48:18.151044 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 316/554] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Sep 1 04:48:17 2022] GET /compute/v2.1/os-simple-tenant-usage/16489b907ac34075b138df3408066a64?start=2022-08-31T04%3A48%3A17.115145&end=2022-09-02T04%3A48%3A17.115145 => generated 690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:18.159613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99de7061-1740-4505-8d6b-47769bc70ff3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760383160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:18.235639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99de7061-1740-4505-8d6b-47769bc70ff3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.085751 Sep 01 04:48:18.237018 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 317/555] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:18 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:18.420043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d10eed47-6194-4659-b77c-567c571e349c tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Calling method '.version_select at 0x7fa76036aaf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:18.422001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d10eed47-6194-4659-b77c-567c571e349c tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '19e4b8c178f741d79e9ba2a799664b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fdb4c7a2c4a8388e69025e60b346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d10eed47-6194-4659-b77c-567c571e349c tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Request method failure captured: Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/n-h1-820368-37/search HTTP/1.1 Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmPuv1l_x18YnkZ_mwvwEC1A8lrhq0HSWyXYraoLJIpgxsGLLbFaT5vFCh-bEhn7iij0V5z07Y2-a1w8yvqkEP0U3T01NxV1Qes0Us6cCkeugXhooXsbxX0hCzR0tR3KBMeqQepqX2W0_gMSC7NiXSSPm_XCBWvtUo-wtExkGjxBtM Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9c5fdb4c7a2c4a8388e69025e60b346d Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1559866657 Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:18.427012 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1559866657 Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9c5fdb4c7a2c4a8388e69025e60b346d Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1559866657 Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 19e4b8c178f741d79e9ba2a799664b6c Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 01 04:48:18.428553 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'n-h1-820368-37'} Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:18.429526 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 01 04:48:18.430838 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.432117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d10eed47-6194-4659-b77c-567c571e349c tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:18.433294 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d10eed47-6194-4659-b77c-567c571e349c tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-820368-37/search" status: 403 len: 117 microversion: 2.1 time: 0.193648 Sep 01 04:48:18.436360 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 318/556] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Sep 1 04:48:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-820368-37/search => generated 117 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:18.449082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-faeea59a-a453-491a-9fb1-3d20be2b4847 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Calling method '.version_select at 0x7fa76029bb80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:18.474022 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-faeea59a-a453-491a-9fb1-3d20be2b4847 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-faeea59a-a453-491a-9fb1-3d20be2b4847 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:48:18.481000 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hostname'} Sep 01 04:48:18.482405 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:48:18.483209 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 01 04:48:18.484307 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:18.485394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:18.488088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-faeea59a-a453-491a-9fb1-3d20be2b4847 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:18.489737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-faeea59a-a453-491a-9fb1-3d20be2b4847 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051821 Sep 01 04:48:18.491518 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 319/557] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Sep 1 04:48:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:18.497801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-aed1ef00-6516-49e6-bd79-10847a34889e req-fa8a1e7c-a983-42cf-b0a3-d6efd4de13b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:18.519715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aed1ef00-6516-49e6-bd79-10847a34889e req-fa8a1e7c-a983-42cf-b0a3-d6efd4de13b9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.521579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aed1ef00-6516-49e6-bd79-10847a34889e req-fa8a1e7c-a983-42cf-b0a3-d6efd4de13b9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.525205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aed1ef00-6516-49e6-bd79-10847a34889e req-fa8a1e7c-a983-42cf-b0a3-d6efd4de13b9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.549986 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-aed1ef00-6516-49e6-bd79-10847a34889e req-fa8a1e7c-a983-42cf-b0a3-d6efd4de13b9 service nova] Creating event network-changed:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:48:18.557112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-aed1ef00-6516-49e6-bd79-10847a34889e req-fa8a1e7c-a983-42cf-b0a3-d6efd4de13b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063782 Sep 01 04:48:18.558393 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 320/558] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:18.565927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '.version_select at 0x7fa76035daf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:18.580986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.582243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.582979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.600266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.601244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.601885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.618347 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f430902-1a32-4978-b84f-f71391c3dd91 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/16489b907ac34075b138df3408066a64?start=2022-08-31T04%3A48%3A17.115145&end=2022-09-02T04%3A48%3A17.115145" status: 200 len: 694 microversion: 2.1 time: 0.057492 Sep 01 04:48:18.620561 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 321/559] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Sep 1 04:48:18 2022] GET /compute/v2.1/os-simple-tenant-usage/16489b907ac34075b138df3408066a64?start=2022-08-31T04%3A48%3A17.115145&end=2022-09-02T04%3A48%3A17.115145 => generated 694 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:18.634930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fd5621ca-eef2-410d-84fb-68819ed3a767 req-f4a730f3-c8f4-4e60-9180-c268573f99cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4d3683-ee24-4efb-b0b5-84570963a2e0", "name": "network-vif-deleted", "tag": "e6b41343-be2b-4425-b4c8-f91be80a10e3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:18.650351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fd5621ca-eef2-410d-84fb-68819ed3a767 req-f4a730f3-c8f4-4e60-9180-c268573f99cb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.651313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fd5621ca-eef2-410d-84fb-68819ed3a767 req-f4a730f3-c8f4-4e60-9180-c268573f99cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.651950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fd5621ca-eef2-410d-84fb-68819ed3a767 req-f4a730f3-c8f4-4e60-9180-c268573f99cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.666216 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fd5621ca-eef2-410d-84fb-68819ed3a767 req-f4a730f3-c8f4-4e60-9180-c268573f99cb service nova] Creating event network-vif-deleted:e6b41343-be2b-4425-b4c8-f91be80a10e3 for instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 on n-h1-820368-37 Sep 01 04:48:18.675278 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fd5621ca-eef2-410d-84fb-68819ed3a767 req-f4a730f3-c8f4-4e60-9180-c268573f99cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052796 Sep 01 04:48:18.676721 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 322/560] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:18.685534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:18.686748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:18.695498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.696396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.697052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:18.698070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:18.698732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:18.699382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.100308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:19.114052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:19.117935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:19.119298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2693e4b5-d445-4bf9-ba12-42493db3216a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.440605 Sep 01 04:48:19.122111 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 323/561] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:18 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:19.139535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Calling method '.version_select at 0x7fa7603838b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.141950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.152760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.153911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.187848 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Request method failure captured: Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmQRSXImt-5AZZSJD25xslFt4fUi1F8ecCQSFKqpwxWQap5d02hfgyIBBjDQ5yV2Xpfj49NA_r8FAKRz41WtePBOtSTypl1TJUORn5Ip5R0iMFQr7EEcouiLq88EY_EDqnSsC14AzfrFpzo_Otq7nDOn4OSZCuCRqnMtikS-XvLr_A Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e4872ea64c8c4fcaa137ba4a7edce698 Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-791012438 Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:48:19.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-791012438 Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e4872ea64c8c4fcaa137ba4a7edce698 Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-791012438 Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 754a88df352e4f51857781ece264ed8d Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 01 04:48:19.191418 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.192544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:19.193940 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:19.193940 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:19.193940 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:19.193940 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 01 04:48:19.193940 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.193940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:19.194850 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-757b1a1e-f3f7-44d8-b65d-fa34eb7ec685 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.069278 Sep 01 04:48:19.196046 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 324/562] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:19.201302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e36fd15-e56a-4350-adae-8c70adfc14df tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Calling method '.version_select at 0x7fa760580040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.203598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e36fd15-e56a-4350-adae-8c70adfc14df tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '080e7616d15348b1a8656542c8c68250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020d7ee3b2845f8a07c4f93a2ba8c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e36fd15-e56a-4350-adae-8c70adfc14df tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Request method failure captured: Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/n-d-820368-37 HTTP/1.1 Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmNEe_3qnGafSmScBU3FkmYpmvfpXaWr_oCSKGsFETNNWPlazmcC5j9gxZ2jEoitV6_nfrCg9bYDiEbHTdCqDVlenEpzjeCEg_hI44f6f9KsOcDo-I44guEtnM3JgR5wcgyhGCZp9I9tno_AonCLfTb3MDUNfmbwGIqnl7Ftkxj6kU Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:19.205704 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 080e7616d15348b1a8656542c8c68250 Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'n-d-820368-37'} Sep 01 04:48:19.207201 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:19.207987 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 01 04:48:19.209230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.210309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e36fd15-e56a-4350-adae-8c70adfc14df tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:19.210309 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e36fd15-e56a-4350-adae-8c70adfc14df tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-820368-37" status: 403 len: 109 microversion: 2.1 time: 0.009999 Sep 01 04:48:19.213861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 325/563] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/os-hosts/n-d-820368-37 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:19.219904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-66206982-661e-4be4-8bbb-66f60bc1762d req-6371acc0-1041-40e3-97f9-ba536a0c8c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd1215-d488-4a50-986c-4a4006f1ff37", "name": "network-vif-plugged", "status": "completed", "tag": "ec93a9f5-2b82-4781-b029-8627bd48ede6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:19.230591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-66206982-661e-4be4-8bbb-66f60bc1762d req-6371acc0-1041-40e3-97f9-ba536a0c8c85 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.231198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-66206982-661e-4be4-8bbb-66f60bc1762d req-6371acc0-1041-40e3-97f9-ba536a0c8c85 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.231685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-66206982-661e-4be4-8bbb-66f60bc1762d req-6371acc0-1041-40e3-97f9-ba536a0c8c85 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.243384 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-66206982-661e-4be4-8bbb-66f60bc1762d req-6371acc0-1041-40e3-97f9-ba536a0c8c85 service nova] Creating event network-vif-plugged:ec93a9f5-2b82-4781-b029-8627bd48ede6 for instance b9fd1215-d488-4a50-986c-4a4006f1ff37 on n-h2-820368-37 Sep 01 04:48:19.250707 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-66206982-661e-4be4-8bbb-66f60bc1762d req-6371acc0-1041-40e3-97f9-ba536a0c8c85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034871 Sep 01 04:48:19.251904 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 326/564] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:19.258729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.259545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:19.266716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.267479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.268454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.269221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.269663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.270228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.302817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Updating instance_info_cache with network_info: [{"id": "6eeb6efa-2952-4167-9669-7d5af6905821", "address": "fa:16:3e:b2:7d:1e", "network": {"id": "7b76ca05-01a3-4b76-afa8-f7e1d1970480", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-383034209-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3380af7dd06d4c72855de9f45d9cf7b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6eeb6efa-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:48:19.321948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Releasing lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:48:19.323589 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc7155b6-874d-4be3-bf4c-fdb622c7896a tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action" status: 202 len: 0 microversion: 2.1 time: 2.896294 Sep 01 04:48:19.324675 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 239/565] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:16 2022] POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action => generated 0 bytes in 2898 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:48:19.333360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Calling method '.version_select at 0x7fa7606b8d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.359971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.360451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.360878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.382340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:19.402033 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-732f11e2-ad38-4fca-a758-dca18156dba2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1276 microversion: 2.1 time: 0.147281 Sep 01 04:48:19.408439 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 327/566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:19.423569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.434152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:19.435421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.435911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.436336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.452796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.453408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.454589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.458337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.459162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.459799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.543866 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53145a12-0959-4a24-9baa-b0d37662cb9b tempest-TenantUsagesTestJSON-258739740 tempest-TenantUsagesTestJSON-258739740-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-31T04%3A48%3A17.115145&end=2022-09-02T04%3A48%3A17.115145&detailed=1" status: 200 len: 5952 microversion: 2.1 time: 0.217199 Sep 01 04:48:19.550441 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 240/567] 10.222.0.26 () {58 vars in 1335 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-31T04%3A48%3A17.115145&end=2022-09-02T04%3A48%3A17.115145&detailed=1 => generated 5952 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:19.557915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Calling method '.version_select at 0x7fa7603f3ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.560536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.561223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.569361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.595806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.597741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.598421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.627404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.629202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.633302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.652243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43cc7b0a-4b97-4cb6-b548-b701beee082c tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.096254 Sep 01 04:48:19.654642 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 241/568] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:19.667719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45c75183-8792-4f1e-af96-6615cbeba2fa tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Calling method '.version_select at 0x7fa76040d8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.698509 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-45c75183-8792-4f1e-af96-6615cbeba2fa tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45c75183-8792-4f1e-af96-6615cbeba2fa tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:48:19.713659 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'nonexistent_hostname'} Sep 01 04:48:19.715028 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:19.715821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:19.716862 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:19.721716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45c75183-8792-4f1e-af96-6615cbeba2fa tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:19.724523 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45c75183-8792-4f1e-af96-6615cbeba2fa tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.066204 Sep 01 04:48:19.731394 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 242/569] 10.222.0.26 () {58 vars in 1191 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:19.739676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1b6ae1d-4a02-4076-9003-3242a9b12c9e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76084f8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.844088 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1b6ae1d-4a02-4076-9003-3242a9b12c9e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.109179 Sep 01 04:48:19.846214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 243/570] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:19.853406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05ba6483-5cbd-4520-b075-3d0b478914b3 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '.version_select at 0x7fa76040d820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.919172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:19.933589 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7230f9a7-f5fb-4637-b887-b6af24c11930 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.518265 Sep 01 04:48:19.934595 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 328/571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:19.948786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:19.951756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:19.987227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:19.993794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:19.996056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:19.999290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:20.002085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:20.002967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:20.061299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:48:20.202348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-644bca4b-5760-4bdc-b6c5-bd033e047545 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 204 len: 0 microversion: 2.1 time: 0.264737 Sep 01 04:48:20.204264 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 329/572] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:48:19 2022] DELETE /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:48:20.211949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c15898f1-b709-4a02-a48d-3710d1e031dc tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Calling method '.version_select at 0x7fa7604c1ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:20.213675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c15898f1-b709-4a02-a48d-3710d1e031dc tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '19e4b8c178f741d79e9ba2a799664b6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5fdb4c7a2c4a8388e69025e60b346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c15898f1-b709-4a02-a48d-3710d1e031dc tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Request method failure captured: Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmPuv1l_x18YnkZ_mwvwEC1A8lrhq0HSWyXYraoLJIpgxsGLLbFaT5vFCh-bEhn7iij0V5z07Y2-a1w8yvqkEP0U3T01NxV1Qes0Us6cCkeugXhooXsbxX0hCzR0tR3KBMeqQepqX2W0_gMSC7NiXSSPm_XCBWvtUo-wtExkGjxBtM Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9c5fdb4c7a2c4a8388e69025e60b346d Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1559866657 Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:20.215502 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9c5fdb4c7a2c4a8388e69025e60b346d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1559866657 Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9c5fdb4c7a2c4a8388e69025e60b346d Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1559866657 Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 19e4b8c178f741d79e9ba2a799664b6c Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 01 04:48:20.217108 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '1'} Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:20.218483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 01 04:48:20.219767 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.221998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c15898f1-b709-4a02-a48d-3710d1e031dc tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:20.221998 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c15898f1-b709-4a02-a48d-3710d1e031dc tempest-HypervisorAdminNegativeUnderV252Test-1559866657 tempest-HypervisorAdminNegativeUnderV252Test-1559866657-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011616 Sep 01 04:48:20.221998 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 330/573] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:48:20 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:20.225001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfcafb89-35f8-4e01-a334-bd81e073dbd9 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Calling method '.version_select at 0x7fa76026d1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:20.226822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfcafb89-35f8-4e01-a334-bd81e073dbd9 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '080e7616d15348b1a8656542c8c68250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020d7ee3b2845f8a07c4f93a2ba8c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfcafb89-35f8-4e01-a334-bd81e073dbd9 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Request method failure captured: Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/n-d-820368-37/shutdown HTTP/1.1 Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmNEe_3qnGafSmScBU3FkmYpmvfpXaWr_oCSKGsFETNNWPlazmcC5j9gxZ2jEoitV6_nfrCg9bYDiEbHTdCqDVlenEpzjeCEg_hI44f6f9KsOcDo-I44guEtnM3JgR5wcgyhGCZp9I9tno_AonCLfTb3MDUNfmbwGIqnl7Ftkxj6kU Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:20.228423 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 080e7616d15348b1a8656542c8c68250 Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'n-d-820368-37'} Sep 01 04:48:20.229835 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:20.233986 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 01 04:48:20.236400 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.240076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfcafb89-35f8-4e01-a334-bd81e073dbd9 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:20.240076 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfcafb89-35f8-4e01-a334-bd81e073dbd9 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-820368-37/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011606 Sep 01 04:48:20.240076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 331/574] 10.222.0.26 () {58 vars in 1197 bytes} [Thu Sep 1 04:48:20 2022] GET /compute/v2.1/os-hosts/n-d-820368-37/shutdown => generated 113 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:20.241568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:20.242465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:20.250236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:20.250704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:20.251199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:20.252071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:20.252790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:20.255551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:20.298045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05ba6483-5cbd-4520-b075-3d0b478914b3 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/c0c510ee-b23d-4d34-aedf-75ec434c594c" status: 200 len: 184 microversion: 2.1 time: 0.450387 Sep 01 04:48:20.298727 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 244/575] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:48:19 2022] GET /compute/v2.1/os-floating-ips/c0c510ee-b23d-4d34-aedf-75ec434c594c => generated 184 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:20.309833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:20.311345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:20.313496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:20.326879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:20.327847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:20.328525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:20.329598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:20.330543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:20.331371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:20.610371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:20.641880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:20.644492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:20.646145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-607f15bb-6089-4d9e-8012-838d520be0f4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.412874 Sep 01 04:48:20.647518 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 332/576] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:20 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:20.658571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Calling method '.version_select at 0x7fa760383f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:20.661905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:20.663099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:20.664076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:20.674308 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] HTTP exception thrown: No hypervisor matching '99d269ac-de80-4690-9bd3-8d09313269f1' could be found. Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Request method failure captured: Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/99d269ac-de80-4690-9bd3-8d09313269f1/servers HTTP/1.1 Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmQRSXImt-5AZZSJD25xslFt4fUi1F8ecCQSFKqpwxWQap5d02hfgyIBBjDQ5yV2Xpfj49NA_r8FAKRz41WtePBOtSTypl1TJUORn5Ip5R0iMFQr7EEcouiLq88EY_EDqnSsC14AzfrFpzo_Otq7nDOn4OSZCuCRqnMtikS-XvLr_A Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e4872ea64c8c4fcaa137ba4a7edce698 Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-791012438 Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:48:20.676058 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4872ea64c8c4fcaa137ba4a7edce698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-791012438 Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e4872ea64c8c4fcaa137ba4a7edce698 Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-791012438 Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 754a88df352e4f51857781ece264ed8d Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: exception: No hypervisor matching '99d269ac-de80-4690-9bd3-8d09313269f1' could be found. Sep 01 04:48:20.677704 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '99d269ac-de80-4690-9bd3-8d09313269f1'} Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '99d269ac-de80-4690-9bd3-8d09313269f1' could be found. Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.678563 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.679991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.679991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.679991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:20.679991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:20.679991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '99d269ac-de80-4690-9bd3-8d09313269f1' could be found. Sep 01 04:48:20.679991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.681535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] Returning 404 to user: No hypervisor matching '99d269ac-de80-4690-9bd3-8d09313269f1' could be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:20.682601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83224bdd-6fd8-4f21-97cd-0cb2a5c3a115 tempest-HypervisorAdminNegativeUnderV252Test-791012438 tempest-HypervisorAdminNegativeUnderV252Test-791012438-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/99d269ac-de80-4690-9bd3-8d09313269f1/servers" status: 404 len: 123 microversion: 2.1 time: 0.033244 Sep 01 04:48:20.683500 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 333/577] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Sep 1 04:48:20 2022] GET /compute/v2.1/os-hypervisors/99d269ac-de80-4690-9bd3-8d09313269f1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:20.689076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58f072f8-300f-4068-b9c8-06002238bc2b tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Calling method '.version_select at 0x7fa76023ab80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:20.711996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-58f072f8-300f-4068-b9c8-06002238bc2b tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58f072f8-300f-4068-b9c8-06002238bc2b tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:48:20.715759 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hostname'} Sep 01 04:48:20.717375 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:48:20.718302 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 01 04:48:20.719633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:20.721070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:20.724338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58f072f8-300f-4068-b9c8-06002238bc2b tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:20.726129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58f072f8-300f-4068-b9c8-06002238bc2b tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.041490 Sep 01 04:48:20.729757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 334/578] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 04:48:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:20.749011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Action: 'action', calling method: .version_select at 0x7fa761af0f70>, body: {"removeFloatingIp": {"address": "172.25.9.181"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:21.226733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:21.236956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0b53072-48a7-430c-b5ea-d0329d21ce22 tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1469 microversion: 2.1 time: 0.936578 Sep 01 04:48:21.239210 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 245/579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:20 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1469 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:21.246355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:21.247272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:21.253801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.254603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.255344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.256239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.256881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.257490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.369262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:21.378157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:21.388369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.389605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.390393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.392519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.395046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.395725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.402839 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea92e697-fd90-40ee-9800-58c7341f369b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1276 microversion: 2.1 time: 0.144308 Sep 01 04:48:21.404160 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 246/580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:21 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:21.425426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f622334-f2cd-4cf0-8420-592330ebab22 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Calling method '.version_select at 0x7fa760317280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:21.429632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f622334-f2cd-4cf0-8420-592330ebab22 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '080e7616d15348b1a8656542c8c68250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020d7ee3b2845f8a07c4f93a2ba8c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f622334-f2cd-4cf0-8420-592330ebab22 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Request method failure captured: Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts/n-d-820368-37/startup HTTP/1.1 Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmNEe_3qnGafSmScBU3FkmYpmvfpXaWr_oCSKGsFETNNWPlazmcC5j9gxZ2jEoitV6_nfrCg9bYDiEbHTdCqDVlenEpzjeCEg_hI44f6f9KsOcDo-I44guEtnM3JgR5wcgyhGCZp9I9tno_AonCLfTb3MDUNfmbwGIqnl7Ftkxj6kU Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:48:21.437743 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 080e7616d15348b1a8656542c8c68250 Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'n-d-820368-37'} Sep 01 04:48:21.439192 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:21.440140 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 01 04:48:21.441293 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:21.444588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f622334-f2cd-4cf0-8420-592330ebab22 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:21.445625 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f622334-f2cd-4cf0-8420-592330ebab22 tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-820368-37/startup" status: 403 len: 110 microversion: 2.1 time: 0.039692 Sep 01 04:48:21.453053 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 247/581] 10.222.0.26 () {58 vars in 1194 bytes} [Thu Sep 1 04:48:21 2022] GET /compute/v2.1/os-hosts/n-d-820368-37/startup => generated 110 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:21.469092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-905dd877-3ae3-402a-b80a-a86cb49c5238 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760414ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:21.537858 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-905dd877-3ae3-402a-b80a-a86cb49c5238 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.083022 Sep 01 04:48:21.538429 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 248/582] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:21 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:21.547083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:21.551847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:21.561210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.561687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.562332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.563230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.563825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.564518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.917742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:21.923916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:21.931950 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-65452674-5d38-4753-ac0d-264a231e0ae4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1390 microversion: 2.1 time: 0.391563 Sep 01 04:48:21.932912 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 249/583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:21 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:21.951367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-26557b01-be36-470b-91ac-b7698d36e39a req-aaf4c125-7bdf-4b58-b096-4d312ad778d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28faec93-25bd-420c-a9e7-85836885a76b", "name": "network-vif-plugged", "status": "completed", "tag": "60ba55a3-9242-45b7-bdc3-cca385154f4a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:21.968049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-26557b01-be36-470b-91ac-b7698d36e39a req-aaf4c125-7bdf-4b58-b096-4d312ad778d1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:21.968701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-26557b01-be36-470b-91ac-b7698d36e39a req-aaf4c125-7bdf-4b58-b096-4d312ad778d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:21.969350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-26557b01-be36-470b-91ac-b7698d36e39a req-aaf4c125-7bdf-4b58-b096-4d312ad778d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:21.988762 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-26557b01-be36-470b-91ac-b7698d36e39a req-aaf4c125-7bdf-4b58-b096-4d312ad778d1 service nova] Creating event network-vif-plugged:60ba55a3-9242-45b7-bdc3-cca385154f4a for instance 28faec93-25bd-420c-a9e7-85836885a76b on n-h1-820368-37 Sep 01 04:48:21.995167 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-26557b01-be36-470b-91ac-b7698d36e39a req-aaf4c125-7bdf-4b58-b096-4d312ad778d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047620 Sep 01 04:48:21.995646 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 250/584] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:22.001556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8257150c-c8dc-427c-b0c8-2c124c29e1dd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Calling method '.version_select at 0x7fa7603f3a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:22.015511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:48:22.016264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquired lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:48:22.017571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8257150c-c8dc-427c-b0c8-2c124c29e1dd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8257150c-c8dc-427c-b0c8-2c124c29e1dd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:48:22.020400 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'nonexistent_hostname'} Sep 01 04:48:22.022055 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:48:22.022788 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 01 04:48:22.023994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:22.025070 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.027560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8257150c-c8dc-427c-b0c8-2c124c29e1dd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:22.027560 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8257150c-c8dc-427c-b0c8-2c124c29e1dd tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.029678 Sep 01 04:48:22.028405 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 251/585] 10.222.0.26 () {58 vars in 1215 bytes} [Thu Sep 1 04:48:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:22.033968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:22.034803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:22.043498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:22.044088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:22.044596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:22.045948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:22.047237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:22.048345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:22.449639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:22.465770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:22.479546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:22.481418 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48914f92-23ca-48b1-a18c-6cb953581049 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1362 microversion: 2.25 time: 0.451877 Sep 01 04:48:22.487637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 252/586] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:22 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:22.503449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70c8390a-03e1-4114-a48d-0af463134d98 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Action: 'update', calling method: .version_select at 0x7fa7603f3430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70c8390a-03e1-4114-a48d-0af463134d98 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-820368-37 HTTP/1.1 Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 51 Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:48:22.514747 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: {"status": "enable", "maintenance_mode": "invalid"} Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:22.516126 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'n-d-820368-37', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'disable', Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Enable', Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Disable', Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance: Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'invalid' Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:22.516936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:22.518860 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70c8390a-03e1-4114-a48d-0af463134d98 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:22.522288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70c8390a-03e1-4114-a48d-0af463134d98 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-820368-37" status: 400 len: 199 microversion: 2.1 time: 0.028456 Sep 01 04:48:22.525999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 253/587] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:48:22 2022] PUT /compute/v2.1/os-hosts/n-d-820368-37 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:48:22.550801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:22.554916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:22.575374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:22.575974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:22.577890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:22.578798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:22.581698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:22.582285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:22.956664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4bd877eaf404b9b8989d063b14b0062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16489b907ac34075b138df3408066a64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:22.965532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d36d768d-b2fc-48d8-bf57-eddc47b5d68f tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 200 len: 1469 microversion: 2.1 time: 0.437173 Sep 01 04:48:22.966566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 254/588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:22 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:22.974389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:22.974730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:22.983612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:22.984111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:22.984604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:22.985240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:22.985686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:22.986224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:23.343104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:23.384863 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d15cfbdb-ff04-46ba-821c-696fe7c861ae tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 0.417479 Sep 01 04:48:23.388128 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 255/589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:22 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:23.405593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dd8dbdb-2b54-48d9-976e-5d977eec93d4 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Action: 'update', calling method: .version_select at 0x7fa7604eab80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dd8dbdb-2b54-48d9-976e-5d977eec93d4 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-820368-37 HTTP/1.1 Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 51 Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:48:23.421645 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: {"status": "invalid", "maintenance_mode": "enable"} Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:23.423156 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'n-d-820368-37', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'disable', Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Enable', Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'Disable', Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance: Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'invalid' Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:23.424149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:23.425846 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dd8dbdb-2b54-48d9-976e-5d977eec93d4 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2dd8dbdb-2b54-48d9-976e-5d977eec93d4 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-820368-37" status: 400 len: 189 microversion: 2.1 time: 0.032800 Sep 01 04:48:23.427294 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 256/590] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:48:23 2022] PUT /compute/v2.1/os-hosts/n-d-820368-37 => generated 189 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:48:23.430996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4427b8e0-f5ba-4bb1-b307-ddad686d7f78 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7603293a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:23.500320 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4427b8e0-f5ba-4bb1-b307-ddad686d7f78 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.073612 Sep 01 04:48:23.509178 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 257/591] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:23 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:23.516705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:23.517852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:23.525722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:23.526518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:23.527208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:23.528085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:23.528978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:23.529609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:23.732251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:48:23.961416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:23.972350 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5eee45ec-777e-4695-a9a1-08f9c653d782 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1589 microversion: 2.1 time: 0.461904 Sep 01 04:48:23.974915 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 258/592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:23 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1589 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:23.982146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c005de29-53e8-44e5-8531-1ecbd9ea2abc req-da4d87f0-3b50-48ab-bea9-c4b22a4bbfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f2d13a-31dc-46dc-bae8-28f77eb3e07f", "name": "network-vif-deleted", "tag": "302d36ff-9585-45c6-8850-d28970bfa26c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:24.011644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c005de29-53e8-44e5-8531-1ecbd9ea2abc req-da4d87f0-3b50-48ab-bea9-c4b22a4bbfe5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:24.012459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c005de29-53e8-44e5-8531-1ecbd9ea2abc req-da4d87f0-3b50-48ab-bea9-c4b22a4bbfe5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:24.013153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c005de29-53e8-44e5-8531-1ecbd9ea2abc req-da4d87f0-3b50-48ab-bea9-c4b22a4bbfe5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:24.040092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c005de29-53e8-44e5-8531-1ecbd9ea2abc req-da4d87f0-3b50-48ab-bea9-c4b22a4bbfe5 service nova] Creating event network-vif-deleted:302d36ff-9585-45c6-8850-d28970bfa26c for instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f on n-h1-820368-37 Sep 01 04:48:24.054246 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c005de29-53e8-44e5-8531-1ecbd9ea2abc req-da4d87f0-3b50-48ab-bea9-c4b22a4bbfe5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075629 Sep 01 04:48:24.058443 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 259/593] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:24.068502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67de9f68-d474-4bd2-9a2d-a4f4e408e30f tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Action: 'update', calling method: .version_select at 0x7fa7602d0d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:24.074376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67de9f68-d474-4bd2-9a2d-a4f4e408e30f tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '080e7616d15348b1a8656542c8c68250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0020d7ee3b2845f8a07c4f93a2ba8c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67de9f68-d474-4bd2-9a2d-a4f4e408e30f tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Request method failure captured: Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/n-d-820368-37 HTTP/1.1 Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 50 Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmNEe_3qnGafSmScBU3FkmYpmvfpXaWr_oCSKGsFETNNWPlazmcC5j9gxZ2jEoitV6_nfrCg9bYDiEbHTdCqDVlenEpzjeCEg_hI44f6f9KsOcDo-I44guEtnM3JgR5wcgyhGCZp9I9tno_AonCLfTb3MDUNfmbwGIqnl7Ftkxj6kU Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:48:24.085163 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0020d7ee3b2845f8a07c4f93a2ba8c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0020d7ee3b2845f8a07c4f93a2ba8c68 Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-815915630 Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 080e7616d15348b1a8656542c8c68250 Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-815915630-project Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: {"status": "enable", "maintenance_mode": "enable"} Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 01 04:48:24.086744 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'n-d-820368-37', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:24.087629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 01 04:48:24.088885 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:24.094581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67de9f68-d474-4bd2-9a2d-a4f4e408e30f tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:24.100109 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67de9f68-d474-4bd2-9a2d-a4f4e408e30f tempest-HostsAdminNegativeTestJSON-815915630 tempest-HostsAdminNegativeTestJSON-815915630-project] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-820368-37" status: 403 len: 111 microversion: 2.1 time: 0.037651 Sep 01 04:48:24.102149 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 260/594] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:48:24 2022] PUT /compute/v2.1/os-hosts/n-d-820368-37 => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:24.111678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:24.112791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:24.123302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:24.124463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:24.126961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:24.128672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:24.129399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:24.130106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:24.912589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:24.924584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:24.927026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:24.928713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a056576-6f42-4305-9ce1-8bbfaadd9385 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1559 microversion: 2.25 time: 0.823471 Sep 01 04:48:24.930027 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 261/595] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:24 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1559 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:24.942717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-594e99c1-3ee1-4c02-ae4a-85dfaaa4c279 req-cfea7c0b-a1ba-4073-b275-950549b326d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:24.963692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-594e99c1-3ee1-4c02-ae4a-85dfaaa4c279 req-cfea7c0b-a1ba-4073-b275-950549b326d1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:24.964662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-594e99c1-3ee1-4c02-ae4a-85dfaaa4c279 req-cfea7c0b-a1ba-4073-b275-950549b326d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:24.965480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-594e99c1-3ee1-4c02-ae4a-85dfaaa4c279 req-cfea7c0b-a1ba-4073-b275-950549b326d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:24.984527 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-594e99c1-3ee1-4c02-ae4a-85dfaaa4c279 req-cfea7c0b-a1ba-4073-b275-950549b326d1 service nova] Creating event network-changed:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:48:24.991810 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-594e99c1-3ee1-4c02-ae4a-85dfaaa4c279 req-cfea7c0b-a1ba-4073-b275-950549b326d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059063 Sep 01 04:48:24.992938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 262/596] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:25.003483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.004491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] [instance: 81f2d13a-31dc-46dc-bae8-28f77eb3e07f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.012862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.013353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.013789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.014496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.014993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.015419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.036288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] HTTP exception thrown: Instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f could not be found. Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Request method failure captured: Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f HTTP/1.1 Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDl6_v1ORqbb_SqP-uVzp_BQndCTD1ubDGt67IZIN5tpN6W6TYDTK00Ry93my3L_QXgCAy5MVIvIormqJ_f2Y0yOYw4lDglh2uMsLkUQDuy_TNASc4t2GW4po2NrOZ7Ida96GA04pgcJxeo2Vp2TLCYjmmdFCgyoWnfvgPLH5fgHmqw Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 16489b907ac34075b138df3408066a64 Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TenantUsagesTestJSON-463219732 Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:48:25.038245 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16489b907ac34075b138df3408066a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16489b907ac34075b138df3408066a64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16489b907ac34075b138df3408066a64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16489b907ac34075b138df3408066a64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TenantUsagesTestJSON-463219732 Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 16489b907ac34075b138df3408066a64 Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TenantUsagesTestJSON-463219732 Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TenantUsagesTestJSON-463219732-project Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a4bd877eaf404b9b8989d063b14b0062 Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TenantUsagesTestJSON-463219732-project Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f could not be found. Sep 01 04:48:25.039648 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '81f2d13a-31dc-46dc-bae8-28f77eb3e07f'} Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f could not be found. Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:25.040525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f could not be found. Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f could not be found. Sep 01 04:48:25.042637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.045100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] Returning 404 to user: Instance 81f2d13a-31dc-46dc-bae8-28f77eb3e07f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:25.045100 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5152b18-6fd1-4487-8b06-8e3e5d0648dd tempest-TenantUsagesTestJSON-463219732 tempest-TenantUsagesTestJSON-463219732-project] 10.222.0.26 "GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f" status: 404 len: 111 microversion: 2.1 time: 0.045448 Sep 01 04:48:25.045100 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 263/597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:24 2022] GET /compute/v2.1/servers/81f2d13a-31dc-46dc-bae8-28f77eb3e07f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:25.060475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.064592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.074466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.075070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.075574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.076400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.076858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.077319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.128870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=56 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:25.208822 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60b03fa9-6bc8-493b-8848-3f5bbf1cff17 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166970 Sep 01 04:48:25.209657 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 264/598] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:48:25 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:25.224222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bbda82c1-c8c6-4398-a0b8-8d4643386d70 req-ec84e4c0-62b1-4bf6-8192-418aeaa04165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56be13bc-1e86-44b3-8e54-a2f677bb469e", "name": "network-vif-plugged", "status": "completed", "tag": "6f4d8c12-ccb6-427f-8a09-3816eba070bb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:25.235067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Updating instance_info_cache with network_info: [{"id": "6eeb6efa-2952-4167-9669-7d5af6905821", "address": "fa:16:3e:b2:7d:1e", "network": {"id": "7b76ca05-01a3-4b76-afa8-f7e1d1970480", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-383034209-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3380af7dd06d4c72855de9f45d9cf7b2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6eeb6efa-29", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:48:25.248644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Releasing lock "refresh_cache-b226ce5f-32a5-45ae-b6bf-58bffea89558" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:48:25.249522 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-279fdd44-90d6-499d-9d29-4a0c83a1433e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action" status: 202 len: 0 microversion: 2.1 time: 4.516085 Sep 01 04:48:25.249637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbda82c1-c8c6-4398-a0b8-8d4643386d70 req-ec84e4c0-62b1-4bf6-8192-418aeaa04165 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.250533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbda82c1-c8c6-4398-a0b8-8d4643386d70 req-ec84e4c0-62b1-4bf6-8192-418aeaa04165 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.251274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbda82c1-c8c6-4398-a0b8-8d4643386d70 req-ec84e4c0-62b1-4bf6-8192-418aeaa04165 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.251464 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 335/599] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:20 2022] POST /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558/action => generated 0 bytes in 4521 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:48:25.261249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-130a5d41-1492-4422-a522-69db65d18a81 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Action: 'update', calling method: .version_select at 0x7fa76023a790>, body: {"status": null, "maintenance_mode": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-130a5d41-1492-4422-a522-69db65d18a81 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-hosts/n-d-820368-37 HTTP/1.1 Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 42 Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:48:25.266805 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: {"status": null, "maintenance_mode": null} Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 01 04:48:25.268389 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'n-d-820368-37', 'body': {'status': None, 'maintenance_mode': None}} Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'disable', Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'Enable', Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'Disable', Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance: Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi None Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.269198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.270601 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.271692 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:48:25.271692 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:48:25.271692 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 01 04:48:25.271692 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.276620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bbda82c1-c8c6-4398-a0b8-8d4643386d70 req-ec84e4c0-62b1-4bf6-8192-418aeaa04165 service nova] Creating event network-vif-plugged:6f4d8c12-ccb6-427f-8a09-3816eba070bb for instance 56be13bc-1e86-44b3-8e54-a2f677bb469e on n-h2-820368-37 Sep 01 04:48:25.278310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-130a5d41-1492-4422-a522-69db65d18a81 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:25.279639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-130a5d41-1492-4422-a522-69db65d18a81 tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-820368-37" status: 400 len: 127 microversion: 2.1 time: 0.026361 Sep 01 04:48:25.285811 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 336/600] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 1 04:48:25 2022] PUT /compute/v2.1/os-hosts/n-d-820368-37 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:48:25.287048 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bbda82c1-c8c6-4398-a0b8-8d4643386d70 req-ec84e4c0-62b1-4bf6-8192-418aeaa04165 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074961 Sep 01 04:48:25.289113 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 265/601] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:25.297729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9d1ecd1-2916-4ba1-9171-f8d6bc32d5a9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760317b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.302402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.308283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.325624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.327958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.330701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.331902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.333710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.335803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.369851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:25.376165 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9d1ecd1-2916-4ba1-9171-f8d6bc32d5a9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.083377 Sep 01 04:48:25.378267 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 266/602] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:25 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:25.386641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.387436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.398297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.398995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.408764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.410261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.411108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.411764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.730544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:25.739450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-229ea144-8d10-4236-a968-3220eccafd0f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 0.452156 Sep 01 04:48:25.740411 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 337/603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:25 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:25.758788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.759557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.779366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.779878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.780367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.781194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.781683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.782107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.785099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:25.809921 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-694620b9-1de0-4483-9759-961cdbe13e03 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 2054 microversion: 2.25 time: 0.428689 Sep 01 04:48:25.811135 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 267/604] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:25 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 2054 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:25.813843 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] HTTP exception thrown: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.818262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f4a87be-35c7-4c95-9ee3-dbe80453b64a tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Action: 'update', calling method: .version_select at 0x7fa7603f3a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:25.824317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.hosts [None req-8f4a87be-35c7-4c95-9ee3-dbe80453b64a tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Enabling host nonexistent_hostname. Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Request method failure captured: Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 HTTP/1.1 Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlHSvQ82F0lv4qtM8UZLySue42uq0a9Ji7GVDzxJWzd7awVGIm4QklOkO2NUyla9dHGQ6xL6zpMStGJ9BHGhiSBiINsWBbTd4TOoqUWkdQRPebjI-oG13cA6GqcirkzMIRJlz66ZJlIHTfaEHAqrIHrNv7PUfPe5Wxw1FMGHxW8UEM Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:25.824799 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 09c8e8a3f51b486b930a4d445813e3a0 Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.826240 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e4d3683-ee24-4efb-b0b5-84570963a2e0'} Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:25.827214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.828658 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.830222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Returning 404 to user: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:25.830222 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e5196b0-d36d-41d5-b204-7397f448aaf1 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 404 len: 111 microversion: 2.1 time: 0.071926 Sep 01 04:48:25.833980 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 338/605] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:48:25 2022] DELETE /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:25.841128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8f4a87be-35c7-4c95-9ee3-dbe80453b64a tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:25.841808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f4a87be-35c7-4c95-9ee3-dbe80453b64a tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Request method failure captured: Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 50 Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDmORBN-qSM8vtSuaK2745Wqg5xYwmSqxctWLX2J2q6qdNgUKNLxt-OzI3DAEkwYL3daIHRbZd_0ykIlfE8rbcdWujGtWMVYs_wltySaiF6dOrkn9gI6eQ0DsIAKMKtoaSPtUyQdRGBls8MzNF0aXYSgqZXGBgGbSZZpAMMc5k3k3sw Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:48:25.844012 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ad9ed2b09f7493c8da8fa74df476e8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1ad9ed2b09f7493c8da8fa74df476e8e Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1844169165 Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9e199be25ca44cb4bf48107cb165cba4 Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1844169165-project-admin Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: {"status": "enable", "maintenance_mode": "enable"} Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:25.845972 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 01 04:48:25.847088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:25.848354 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 01 04:48:25.849745 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.850684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.852842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f4a87be-35c7-4c95-9ee3-dbe80453b64a tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:25.854897 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f4a87be-35c7-4c95-9ee3-dbe80453b64a tempest-HostsAdminNegativeTestJSON-1844169165 tempest-HostsAdminNegativeTestJSON-1844169165-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041481 Sep 01 04:48:25.855024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.855499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.859616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.859776 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 268/606] 10.222.0.26 () {60 vars in 1211 bytes} [Thu Sep 1 04:48:25 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:25.859863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.869891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.870360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.880912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:25.884310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: 0e4d3683-ee24-4efb-b0b5-84570963a2e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:25.909803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.913941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.914626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.915872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:25.917458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:25.918836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:25.964028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] HTTP exception thrown: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Request method failure captured: Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 HTTP/1.1 Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlHSvQ82F0lv4qtM8UZLySue42uq0a9Ji7GVDzxJWzd7awVGIm4QklOkO2NUyla9dHGQ6xL6zpMStGJ9BHGhiSBiINsWBbTd4TOoqUWkdQRPebjI-oG13cA6GqcirkzMIRJlz66ZJlIHTfaEHAqrIHrNv7PUfPe5Wxw1FMGHxW8UEM Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:48:25.971256 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c8e8a3f51b486b930a4d445813e3a0 Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.972546 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '0e4d3683-ee24-4efb-b0b5-84570963a2e0'} Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:25.973256 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. Sep 01 04:48:25.974506 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:25.978019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Returning 404 to user: Instance 0e4d3683-ee24-4efb-b0b5-84570963a2e0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:25.979350 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62f8e8f7-61ab-4f57-89cb-118a361ea206 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0" status: 404 len: 111 microversion: 2.1 time: 0.121446 Sep 01 04:48:25.980768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 269/607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:25 2022] GET /compute/v2.1/servers/0e4d3683-ee24-4efb-b0b5-84570963a2e0 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:26.005512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c217b04-ae00-47b7-9405-5348573ba084 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '.version_select at 0x7fa760329d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:26.343629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:26.367230 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8e9d22e-ac0e-4459-b127-2c630e057170 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 2054 microversion: 2.25 time: 0.532060 Sep 01 04:48:26.379297 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 339/608] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:25 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 2054 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:26.674004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8091fb41-964a-4973-9c1d-157c90c821af tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Action: 'create', calling method: .version_select at 0x7fa7606694c0>, body: {"keypair": {"name": "tempest-keypair-546227315", "type": "ssh", "user_id": "6ee238e50f2e45a4bdce356519ffc014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3EqnWaRM09wHnMJEdx7J2vNClBhPvhUe8/zlu+xSF7WnSoTJbzc/EqEkwlxKe6WdVG4XfYG4ksaMHT2xC+zqR6S6CmFmavnMf9XBydZgzFiDXtxXQJP5dnGzxgcAQ94w=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:26.704517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8091fb41-964a-4973-9c1d-157c90c821af tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Getting quotas for project 75ce9da58e3549f0ab16dafd11075233. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:26.714651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8091fb41-964a-4973-9c1d-157c90c821af tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Getting quotas for user d5e6f33774d34763a6d7886886d5d752 and project 75ce9da58e3549f0ab16dafd11075233. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:26.756152 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8091fb41-964a-4973-9c1d-157c90c821af tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.378951 Sep 01 04:48:26.758738 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 340/609] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 04:48:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 382 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 04:48:26.768141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3f59a819-93da-4d95-ada9-548c0c397f49 req-523f4f09-b1e9-4b6b-93f5-84734be53590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c60da80-bd80-4e4a-94b1-fe33392994f5", "tag": "24a63565-8087-45ad-8826-15aafe9285c1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:26.786776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f59a819-93da-4d95-ada9-548c0c397f49 req-523f4f09-b1e9-4b6b-93f5-84734be53590 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:26.788439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f59a819-93da-4d95-ada9-548c0c397f49 req-523f4f09-b1e9-4b6b-93f5-84734be53590 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:26.789292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f59a819-93da-4d95-ada9-548c0c397f49 req-523f4f09-b1e9-4b6b-93f5-84734be53590 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:26.814975 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3f59a819-93da-4d95-ada9-548c0c397f49 req-523f4f09-b1e9-4b6b-93f5-84734be53590 service nova] Creating event network-changed:24a63565-8087-45ad-8826-15aafe9285c1 for instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 on n-h1-820368-37 Sep 01 04:48:26.822538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3f59a819-93da-4d95-ada9-548c0c397f49 req-523f4f09-b1e9-4b6b-93f5-84734be53590 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061515 Sep 01 04:48:26.824388 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 341/610] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:26.830123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20361a24-a775-4af4-8f59-20aeb893adde tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7601ae0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:26.888353 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20361a24-a775-4af4-8f59-20aeb893adde tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.062542 Sep 01 04:48:26.889734 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 342/611] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:26 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:26.910831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:26.931803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:26.935112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:26.938451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:26.942440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:26.943565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:26.945304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.015329 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27ec6faf-dd4b-4e1f-9fc6-6fe1bd101e50 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.122769 Sep 01 04:48:27.025799 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 343/612] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Sep 1 04:48:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:48:27.033330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:27.037079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:27.054409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.058507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.059399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.064628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.066436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.068001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.405085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:27.413466 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3b35f02-34b9-4f2e-b7d1-b6920b889c31 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 0.386125 Sep 01 04:48:27.414471 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 344/613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:27 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:27.419180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af4db522-b48c-44f9-82aa-9639759b807e tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Action: 'create', calling method: .version_select at 0x7fa76026db80>, body: {"keypair": {"name": "tempest-keypair-916666328", "type": "ssh", "user_id": "6ee238e50f2e45a4bdce356519ffc014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSyVgL2w46sv4kok1LMkhdPHrzi/FJ/EwKhx4tfYOssH6la+WbrTspCuRWafz3OobPXBDkG7ucesK8908BUSrZXUUkvxwlItf3PzLmWFqnoDZh0IB47UohYENIljktWMQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:27.435624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-af4db522-b48c-44f9-82aa-9639759b807e tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Getting quotas for project 75ce9da58e3549f0ab16dafd11075233. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:27.441337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-af4db522-b48c-44f9-82aa-9639759b807e tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Getting quotas for user d5e6f33774d34763a6d7886886d5d752 and project 75ce9da58e3549f0ab16dafd11075233. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:27.529280 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af4db522-b48c-44f9-82aa-9639759b807e tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.113312 Sep 01 04:48:27.536646 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 345/614] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 04:48:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 04:48:27.550568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2f5f2383-5b3b-4aff-86fc-796cd5b45c3a req-2a7e7b89-bfd8-4fd5-ace4-dbfe3088e434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fe5a6c-9184-463d-89db-ec54804eb733", "tag": "5c882909-c5ef-46f8-877b-055f7e5fcc2e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:27.566203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2f5f2383-5b3b-4aff-86fc-796cd5b45c3a req-2a7e7b89-bfd8-4fd5-ace4-dbfe3088e434 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.566919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2f5f2383-5b3b-4aff-86fc-796cd5b45c3a req-2a7e7b89-bfd8-4fd5-ace4-dbfe3088e434 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.568187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2f5f2383-5b3b-4aff-86fc-796cd5b45c3a req-2a7e7b89-bfd8-4fd5-ace4-dbfe3088e434 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.591187 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2f5f2383-5b3b-4aff-86fc-796cd5b45c3a req-2a7e7b89-bfd8-4fd5-ace4-dbfe3088e434 service nova] Creating event network-changed:5c882909-c5ef-46f8-877b-055f7e5fcc2e for instance 41fe5a6c-9184-463d-89db-ec54804eb733 on n-h1-820368-37 Sep 01 04:48:27.606787 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2f5f2383-5b3b-4aff-86fc-796cd5b45c3a req-2a7e7b89-bfd8-4fd5-ace4-dbfe3088e434 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067660 Sep 01 04:48:27.614741 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 346/615] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:27.629829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:27.632073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:27.634316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c217b04-ae00-47b7-9405-5348573ba084 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/c0c510ee-b23d-4d34-aedf-75ec434c594c" status: 202 len: 0 microversion: 2.1 time: 1.648267 Sep 01 04:48:27.635894 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 270/616] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:48:25 2022] DELETE /compute/v2.1/os-floating-ips/c0c510ee-b23d-4d34-aedf-75ec434c594c => generated 0 bytes in 1651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:48:27.641193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bd75c1e-7ee3-4ac6-bed1-e58a4aa6b1b5 tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Calling method '.version_select at 0x7fa7602d0e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:27.650269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.653633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.655138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.659618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.662360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.663026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.681973 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1bd75c1e-7ee3-4ac6-bed1-e58a4aa6b1b5 tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-546227315?user_id=6ee238e50f2e45a4bdce356519ffc014" status: 200 len: 511 microversion: 2.10 time: 0.044513 Sep 01 04:48:27.694726 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 271/617] 10.222.0.26 () {60 vars in 1337 bytes} [Thu Sep 1 04:48:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-546227315?user_id=6ee238e50f2e45a4bdce356519ffc014 => generated 511 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:48:27.711479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:27.712078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:27.724768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.725529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.728202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.731377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:27.731916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:27.732913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:27.770469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:48:27.836808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6807303b-3737-4efd-a701-bbfddb82188c tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b/action" status: 202 len: 0 microversion: 2.25 time: 0.220343 Sep 01 04:48:27.839694 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 347/618] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 04:48:27 2022] POST /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:48:27.869480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8dab616b-e699-4062-968c-74c64f57864d tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Action: 'create', calling method: .version_select at 0x7fa76052cd30>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-801244212", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ7Ozjk0RyQPIUEGDXVTXvCY/SIN5M5L4LwYexpCe2mr/ncK9EQctZzYf2BGNGboTJHSpVntMWBllWppWgAHPKpVfl37nO3nL8SntczxMh8hsuaKCTIim9L65Y9HnFrwQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:27.980325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8dab616b-e699-4062-968c-74c64f57864d tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Getting quotas for project 75ce9da58e3549f0ab16dafd11075233. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:27.990800 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-658615e5-80f9-434f-bd63-7511404d9702 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 204 len: 0 microversion: 2.1 time: 0.294470 Sep 01 04:48:27.992666 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 272/619] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:48:27 2022] DELETE /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:48:27.997857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8dab616b-e699-4062-968c-74c64f57864d tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Getting quotas for user d5e6f33774d34763a6d7886886d5d752 and project 75ce9da58e3549f0ab16dafd11075233. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:28.000886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:28.004893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:28.019911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.020409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.020845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.024099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.024576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.025008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.053643 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8dab616b-e699-4062-968c-74c64f57864d tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.211897 Sep 01 04:48:28.056081 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 348/620] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 04:48:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 04:48:28.071226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c906057-9621-4df1-81ad-6ab3224bf80a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760669e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:28.153762 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c906057-9621-4df1-81ad-6ab3224bf80a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.094737 Sep 01 04:48:28.154351 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 349/621] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:28 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:28.161449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:28.162179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:28.195171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.195812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.196265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.197035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.201846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.203260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.485210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:28.512908 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81c49f8f-7c20-4b7e-a4ff-16e0fea5f7bf tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 2059 microversion: 2.25 time: 0.518687 Sep 01 04:48:28.516263 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 273/622] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:27 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 2059 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:28.525212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:28.534421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:28.543566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.544293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.547531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.549076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.549966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.553674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.727189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:28.735656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14c119f3-d92c-40a0-b5fc-9132a1c37bbd tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1524 microversion: 2.1 time: 0.580123 Sep 01 04:48:28.751440 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 350/623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:28 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1524 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:28.757176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-778b03a9-f058-4a4a-8507-efa7185b81fc tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Calling method '.version_select at 0x7fa76052cd30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:28.761143 n-d-820368-37 devstack@n-api.service[128863]: WARNING oslo_db.sqlalchemy.utils [None req-778b03a9-f058-4a4a-8507-efa7185b81fc tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 01 04:48:28.765836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:28.770045 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-778b03a9-f058-4a4a-8507-efa7185b81fc tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs?user_id=6ee238e50f2e45a4bdce356519ffc014" status: 200 len: 724 microversion: 2.10 time: 0.017159 Sep 01 04:48:28.771356 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 351/624] 10.222.0.26 () {60 vars in 1259 bytes} [Thu Sep 1 04:48:28 2022] GET /compute/v2.1/os-keypairs?user_id=6ee238e50f2e45a4bdce356519ffc014 => generated 724 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:48:28.776355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:28.777364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:28.785788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.786627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.787351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:28.788213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:28.788992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:28.789562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:29.380944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:29.396262 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35946530-d518-41f8-8e5e-1ea8828e6f94 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 0.623565 Sep 01 04:48:29.397107 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 352/625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:28 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:29.404663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:29.413459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6436bfa0-112c-433c-9441-bbacd6d89339 tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Calling method '.version_select at 0x7fa7607853a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:29.441552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:29.447400 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6436bfa0-112c-433c-9441-bbacd6d89339 tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-801244212" status: 204 len: 0 microversion: 2.10 time: 0.049225 Sep 01 04:48:29.452046 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 353/626] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Sep 1 04:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-801244212 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:48:29.456886 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b612f970-0ab3-4023-9811-c59164c78c24 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 200 len: 1589 microversion: 2.1 time: 0.935334 Sep 01 04:48:29.458784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-37467a8f-90dc-4008-918b-fca3091e8dba req-8dfa65b7-aa06-44a9-a76f-748960eafee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fd1215-d488-4a50-986c-4a4006f1ff37", "tag": "ec93a9f5-2b82-4781-b029-8627bd48ede6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:29.461054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 274/627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:28 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 1589 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:29.483402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a28ce181-1f4c-49c3-9e8d-7b6aec540f4a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760317310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:29.490871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37467a8f-90dc-4008-918b-fca3091e8dba req-8dfa65b7-aa06-44a9-a76f-748960eafee4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:29.491376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37467a8f-90dc-4008-918b-fca3091e8dba req-8dfa65b7-aa06-44a9-a76f-748960eafee4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:29.492207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37467a8f-90dc-4008-918b-fca3091e8dba req-8dfa65b7-aa06-44a9-a76f-748960eafee4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:29.523345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-37467a8f-90dc-4008-918b-fca3091e8dba req-8dfa65b7-aa06-44a9-a76f-748960eafee4 service nova] Creating event network-changed:ec93a9f5-2b82-4781-b029-8627bd48ede6 for instance b9fd1215-d488-4a50-986c-4a4006f1ff37 on n-h2-820368-37 Sep 01 04:48:29.530326 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-37467a8f-90dc-4008-918b-fca3091e8dba req-8dfa65b7-aa06-44a9-a76f-748960eafee4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080133 Sep 01 04:48:29.531244 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 354/628] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:29.561654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-848ddcc7-5fdc-4f4b-8ca5-bf460181595e tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Calling method '.version_select at 0x7fa76023a0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:29.616224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-848ddcc7-5fdc-4f4b-8ca5-bf460181595e tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916666328?user_id=6ee238e50f2e45a4bdce356519ffc014" status: 204 len: 0 microversion: 2.10 time: 0.073686 Sep 01 04:48:29.620833 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 355/629] 10.222.0.26 () {60 vars in 1340 bytes} [Thu Sep 1 04:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916666328?user_id=6ee238e50f2e45a4bdce356519ffc014 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:48:29.625998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:29.636062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:29.636221 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a28ce181-1f4c-49c3-9e8d-7b6aec540f4a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.169775 Sep 01 04:48:29.636780 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 275/630] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:29 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:29.644351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:29.645539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:29.645837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:29.646662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:29.647256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:29.647934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:29.661716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4819790-399b-4e2a-9614-cd7729fca410 tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] Calling method '.version_select at 0x7fa7602d09d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:29.758785 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4819790-399b-4e2a-9614-cd7729fca410 tempest-KeyPairsV210TestJSON-297307717 tempest-KeyPairsV210TestJSON-297307717-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-546227315?user_id=6ee238e50f2e45a4bdce356519ffc014" status: 204 len: 0 microversion: 2.10 time: 0.102455 Sep 01 04:48:29.761108 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 276/631] 10.222.0.26 () {60 vars in 1340 bytes} [Thu Sep 1 04:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-546227315?user_id=6ee238e50f2e45a4bdce356519ffc014 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:48:29.785760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:29.788097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:29.808078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:29.809043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:29.809773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:29.810680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:29.811339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:29.812134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:29.886478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:29.908203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-440b13be-c40c-4b38-a2d8-53f11e98db1b tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 2039 microversion: 2.25 time: 0.285766 Sep 01 04:48:29.927004 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 356/632] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:29 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 2039 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:29.946417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-37", "block_migration": "auto"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:29.962067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:30.006809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:30.007593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:30.007761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:30.008482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:30.019643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:30.020159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:30.501283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'flavor' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:30.712841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:30.743739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc012e23-ca6a-4c3a-8b21-73747f09422e tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1524 microversion: 2.1 time: 0.978514 Sep 01 04:48:30.744176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Going to try to live migrate instance to n-h2-820368-37 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:48:30.770897 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 277/633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:29 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1524 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:30.791897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:30.796912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:30.824553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:30.825754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:30.826655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:30.829171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:30.830989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:30.859320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:31.784080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:31.794311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d222e333-b943-4029-a0e5-42ba1cf92f7b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 1.021754 Sep 01 04:48:31.804281 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 278/634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:30 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:31.810636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0169eeaa-b18f-4bc0-90ef-ad31c9913d1f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760259790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:31.914832 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0169eeaa-b18f-4bc0-90ef-ad31c9913d1f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.109165 Sep 01 04:48:31.926014 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 279/635] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:31 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:31.936838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6d81efbf-25e7-407c-8b37-76bac707ed07 req-4023bf5a-642c-49c7-835d-73002b1f8642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b226ce5f-32a5-45ae-b6bf-58bffea89558", "name": "network-vif-deleted", "tag": "6eeb6efa-2952-4167-9669-7d5af6905821"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:31.962331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6d81efbf-25e7-407c-8b37-76bac707ed07 req-4023bf5a-642c-49c7-835d-73002b1f8642 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:31.963202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6d81efbf-25e7-407c-8b37-76bac707ed07 req-4023bf5a-642c-49c7-835d-73002b1f8642 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:31.963945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6d81efbf-25e7-407c-8b37-76bac707ed07 req-4023bf5a-642c-49c7-835d-73002b1f8642 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:31.976708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6d81efbf-25e7-407c-8b37-76bac707ed07 req-4023bf5a-642c-49c7-835d-73002b1f8642 service nova] Creating event network-vif-deleted:6eeb6efa-2952-4167-9669-7d5af6905821 for instance b226ce5f-32a5-45ae-b6bf-58bffea89558 on n-h2-820368-37 Sep 01 04:48:31.982572 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6d81efbf-25e7-407c-8b37-76bac707ed07 req-4023bf5a-642c-49c7-835d-73002b1f8642 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054196 Sep 01 04:48:31.984024 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 280/636] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:31.995012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:32.003213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:32.019223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:32.019968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:32.020579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:32.021527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:32.022173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:32.022815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:32.029589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:32.065195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:32.065859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:32.066324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:32.066875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lazy-loading 'fault' on Instance uuid b226ce5f-32a5-45ae-b6bf-58bffea89558 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:32.253884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8e8a3f51b486b930a4d445813e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3380af7dd06d4c72855de9f45d9cf7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:32.265504 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5912933-b957-4ef1-99bd-fae8e9b96be6 tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 200 len: 1313 microversion: 2.1 time: 0.279722 Sep 01 04:48:32.280260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 281/637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:31 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:32.825652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:32.827282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:32.845385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:32.846587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:32.846587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:32.854437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:32.856293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:32.856764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:33.262154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:33.281136 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bc4b67f-b83e-4970-b41d-560151a05887 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 0.459825 Sep 01 04:48:33.298505 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 282/638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:32 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:48:33.313937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8053158b-5154-48cf-86e8-6560b46617d3 req-2a2c1d5f-73af-4688-bc83-9bda7b9d4e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fe5a6c-9184-463d-89db-ec54804eb733", "name": "network-vif-plugged", "status": "completed", "tag": "5c882909-c5ef-46f8-877b-055f7e5fcc2e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:33.333740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8053158b-5154-48cf-86e8-6560b46617d3 req-2a2c1d5f-73af-4688-bc83-9bda7b9d4e23 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:33.334572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8053158b-5154-48cf-86e8-6560b46617d3 req-2a2c1d5f-73af-4688-bc83-9bda7b9d4e23 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:33.335260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8053158b-5154-48cf-86e8-6560b46617d3 req-2a2c1d5f-73af-4688-bc83-9bda7b9d4e23 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:33.356404 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8053158b-5154-48cf-86e8-6560b46617d3 req-2a2c1d5f-73af-4688-bc83-9bda7b9d4e23 service nova] Creating event network-vif-plugged:5c882909-c5ef-46f8-877b-055f7e5fcc2e for instance 41fe5a6c-9184-463d-89db-ec54804eb733 on n-h1-820368-37 Sep 01 04:48:33.367893 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8053158b-5154-48cf-86e8-6560b46617d3 req-2a2c1d5f-73af-4688-bc83-9bda7b9d4e23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066413 Sep 01 04:48:33.369657 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 283/639] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:33.378416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57662813-c16a-49f7-80df-e7616ab553ed tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760414ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:33.462079 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57662813-c16a-49f7-80df-e7616ab553ed tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.090748 Sep 01 04:48:33.473116 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 284/640] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:33 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:33.480625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:33.481769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] [instance: b226ce5f-32a5-45ae-b6bf-58bffea89558] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:33.490212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:33.490722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:33.491196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:33.492647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:33.493513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:33.493928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:33.515397 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] HTTP exception thrown: Instance b226ce5f-32a5-45ae-b6bf-58bffea89558 could not be found. Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Request method failure captured: Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 HTTP/1.1 Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlHSvQ82F0lv4qtM8UZLySue42uq0a9Ji7GVDzxJWzd7awVGIm4QklOkO2NUyla9dHGQ6xL6zpMStGJ9BHGhiSBiINsWBbTd4TOoqUWkdQRPebjI-oG13cA6GqcirkzMIRJlz66ZJlIHTfaEHAqrIHrNv7PUfPe5Wxw1FMGHxW8UEM Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:48:33.517481 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3380af7dd06d4c72855de9f45d9cf7b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 3380af7dd06d4c72855de9f45d9cf7b2 Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1095426430 Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09c8e8a3f51b486b930a4d445813e3a0 Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1095426430-project Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b226ce5f-32a5-45ae-b6bf-58bffea89558 could not be found. Sep 01 04:48:33.519207 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b226ce5f-32a5-45ae-b6bf-58bffea89558'} Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b226ce5f-32a5-45ae-b6bf-58bffea89558 could not be found. Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:33.520209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b226ce5f-32a5-45ae-b6bf-58bffea89558 could not be found. Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b226ce5f-32a5-45ae-b6bf-58bffea89558 could not be found. Sep 01 04:48:33.521895 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:48:33.524372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] Returning 404 to user: Instance b226ce5f-32a5-45ae-b6bf-58bffea89558 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:33.524372 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a924782-96a3-4d13-ab9d-e0190ab320ba tempest-FloatingIPsAssociationTestJSON-1095426430 tempest-FloatingIPsAssociationTestJSON-1095426430-project] 10.222.0.26 "GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558" status: 404 len: 111 microversion: 2.1 time: 0.044895 Sep 01 04:48:33.524372 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 285/641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:33 2022] GET /compute/v2.1/servers/b226ce5f-32a5-45ae-b6bf-58bffea89558 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:48:33.946855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Calling method '.version_select at 0x7fa760329af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:33.948830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:33.949409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:33.950301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:33.980231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:33.981041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:33.982327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:33.999448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.000298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.001091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.011636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ce4c07b-91f7-489b-89d1-7beaf41ae688 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.223728 Sep 01 04:48:34.013089 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 286/642] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:33 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:48:34.032431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Calling method '.version_select at 0x7fa7604ead30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:34.035469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.036244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.036903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.065771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.068695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.069274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.118591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.119730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.120449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.130037 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05fff1ec-6262-4999-90bd-d24fe4409fb3 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-820368-37/servers" status: 200 len: 434 microversion: 2.1 time: 0.106813 Sep 01 04:48:34.138933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 287/643] 10.222.0.26 () {58 vars in 1215 bytes} [Thu Sep 1 04:48:34 2022] GET /compute/v2.1/os-hypervisors/n-h1-820368-37/servers => generated 434 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:34.144800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Calling method '.version_select at 0x7fa7602a88b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:34.152739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.153254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.153704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.186503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.188173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.189068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.205938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.207207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.208108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.257034 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fd7fc32-d770-4213-a519-026149af210e tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.116207 Sep 01 04:48:34.268071 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 288/644] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:48:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:34.274612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Calling method '.version_select at 0x7fa7603f33a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:34.276924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.278180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.278851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.304013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.305602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.306299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.327035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-035c5a63-1332-4537-957f-9c6b2b575689 tempest-HypervisorAdminUnderV252Test-555287732 tempest-HypervisorAdminUnderV252Test-555287732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h1-820368-37/search" status: 200 len: 105 microversion: 2.1 time: 0.054407 Sep 01 04:48:34.336588 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 289/645] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Sep 1 04:48:34 2022] GET /compute/v2.1/os-hypervisors/n-h1-820368-37/search => generated 105 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:34.350762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:34.351913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:34.372257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.373241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.387408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.388919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.389416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.399303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.862110 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3be75e59-0195-4a79-ba51-efb81208257a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b/action" status: 202 len: 0 microversion: 2.25 time: 4.926414 Sep 01 04:48:34.863967 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 357/646] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 04:48:29 2022] POST /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b/action => generated 0 bytes in 4929 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:48:34.872295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f52c28e3-7590-494a-92a7-38a00397e848 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600d2b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:34.896746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:34.912533 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7555d20-d231-44f6-bc87-fb96c03f6912 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1318 microversion: 2.1 time: 0.569023 Sep 01 04:48:34.913470 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 290/647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:34 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:34.930237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:34.931025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:34.943921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.944415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.944859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.945550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:34.945994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:34.951050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:34.991614 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f52c28e3-7590-494a-92a7-38a00397e848 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.126086 Sep 01 04:48:34.992636 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 358/648] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:34 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:35.524794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-abc4bb63-8aea-4a59-a1f8-7d593271c76a req-cf491c6c-dc45-4d9d-bc61-a25909a507fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c60da80-bd80-4e4a-94b1-fe33392994f5", "name": "network-vif-plugged", "status": "completed", "tag": "24a63565-8087-45ad-8826-15aafe9285c1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:35.554408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-abc4bb63-8aea-4a59-a1f8-7d593271c76a req-cf491c6c-dc45-4d9d-bc61-a25909a507fe service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:35.554925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-abc4bb63-8aea-4a59-a1f8-7d593271c76a req-cf491c6c-dc45-4d9d-bc61-a25909a507fe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:35.555349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-abc4bb63-8aea-4a59-a1f8-7d593271c76a req-cf491c6c-dc45-4d9d-bc61-a25909a507fe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:35.578001 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-abc4bb63-8aea-4a59-a1f8-7d593271c76a req-cf491c6c-dc45-4d9d-bc61-a25909a507fe service nova] Creating event network-vif-plugged:24a63565-8087-45ad-8826-15aafe9285c1 for instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 on n-h1-820368-37 Sep 01 04:48:35.604544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-abc4bb63-8aea-4a59-a1f8-7d593271c76a req-cf491c6c-dc45-4d9d-bc61-a25909a507fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082811 Sep 01 04:48:35.605849 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 359/649] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:35.656994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:35.741612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:35.746418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:35.753753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5d8f1dd-eaf6-43fe-a26d-fba9c80fb551 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 0.834600 Sep 01 04:48:35.769209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 291/650] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:34 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:35.937316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:35.938021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:35.953103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:35.958154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:35.959422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:35.961651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:35.962398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:35.963702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:36.009655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-551c6a36-6259-4eb6-820c-cc8822f7cc9e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7602535e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:36.119271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-551c6a36-6259-4eb6-820c-cc8822f7cc9e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.115007 Sep 01 04:48:36.119858 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 292/651] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:36 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:36.672941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:36.684581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4014e137-37d6-4e5d-828c-9d30538e7edb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1468 microversion: 2.1 time: 0.753289 Sep 01 04:48:36.703484 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 360/652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:35 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1468 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:36.712870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:36.713483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:36.725965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:36.726473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:36.726922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:36.727652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:36.729847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:36.731427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:36.779549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:36.780158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:36.797771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:36.800470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:36.801429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:36.806569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:36.807111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:36.807551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:36.974445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=26 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:37.303834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:37.315739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:37.316944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-259c035d-8059-43f8-8f4c-ed8405e42f71 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 200 len: 1318 microversion: 2.1 time: 0.607695 Sep 01 04:48:37.318228 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 293/653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:36 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:37.325558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7735225c-9b4d-41f3-b3a5-eb8da6837eb3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760317280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:37.337510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:37.348899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:37.350423 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a57f909a-eca2-4bb1-bee3-f61b02b167d1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 0.575494 Sep 01 04:48:37.351175 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 361/654] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:36 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:48:37.420151 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7735225c-9b4d-41f3-b3a5-eb8da6837eb3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.099018 Sep 01 04:48:37.420735 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 294/655] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:37 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:38.339710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:38.340839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:38.352029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:38.362118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:38.366317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:38.369267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:38.372289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:38.376231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:38.378212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:38.378567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:38.381500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:38.394239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:38.394732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:38.395207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:38.395926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:38.396380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:38.396801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:39.429401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:39.438207 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01b6ae78-f413-4673-8a69-614db04212ef tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 200 len: 1467 microversion: 2.1 time: 1.104130 Sep 01 04:48:39.438792 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 362/656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:38 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 1467 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:39.469742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a5b9e18-c92f-4a52-b5c0-2d3eb442d540 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760056940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:39.550777 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a5b9e18-c92f-4a52-b5c0-2d3eb442d540 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.092662 Sep 01 04:48:39.551745 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 363/657] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:39 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:39.562918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:39.575936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:39.577235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:39.581225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Searching by: {'reservation_id': 'r-7alppl4q', 'deleted': False, 'project_id': 'a917f0bb781a42879a605ffca90e436d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:48:39.588511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:39.592398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:39.593652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23aeb849-984a-4135-8f06-1b73895b943a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 1.221731 Sep 01 04:48:39.595806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:39.599901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:39.600048 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 295/658] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:38 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:39.600705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:39.602254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:39.603486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:39.604636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:39.864549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:39.886428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:48:40.072295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-62390337-782e-493f-8a2e-51a6f7025972 req-dff0838a-d266-49f2-9845-8eef46d3a89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28faec93-25bd-420c-a9e7-85836885a76b", "name": "network-vif-unplugged", "status": "completed", "tag": "60ba55a3-9242-45b7-bdc3-cca385154f4a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:40.076352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:40.102220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62390337-782e-493f-8a2e-51a6f7025972 req-dff0838a-d266-49f2-9845-8eef46d3a89b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:40.105320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62390337-782e-493f-8a2e-51a6f7025972 req-dff0838a-d266-49f2-9845-8eef46d3a89b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:40.105968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62390337-782e-493f-8a2e-51a6f7025972 req-dff0838a-d266-49f2-9845-8eef46d3a89b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:40.113506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:40.113994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:40.127097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:40.151675 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-62390337-782e-493f-8a2e-51a6f7025972 req-dff0838a-d266-49f2-9845-8eef46d3a89b service nova] Creating event network-vif-unplugged:60ba55a3-9242-45b7-bdc3-cca385154f4a for instance 28faec93-25bd-420c-a9e7-85836885a76b on n-h1-820368-37 Sep 01 04:48:40.162852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-62390337-782e-493f-8a2e-51a6f7025972 req-dff0838a-d266-49f2-9845-8eef46d3a89b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099767 Sep 01 04:48:40.176863 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 296/659] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:48:40.567876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70f7c036-cf19-4e03-bc54-57af4a762cd0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7602a8ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:40.673559 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70f7c036-cf19-4e03-bc54-57af4a762cd0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.110360 Sep 01 04:48:40.675099 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 297/660] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:40 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:48:40.684010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:40.687831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:40.708232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:40.709208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:40.709971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:40.713411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:40.714258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:40.714904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:40.916369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9a8dd51-9c03-49bc-b86e-0a6a67447ae8 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-7alppl4q" status: 200 len: 2928 microversion: 2.1 time: 1.363330 Sep 01 04:48:40.917027 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 364/661] 10.222.0.26 () {58 vars in 1197 bytes} [Thu Sep 1 04:48:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7alppl4q => generated 2928 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:40.942771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-684116f9-0d0f-4414-8ba3-35010e675940 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:41.026421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_groups [None req-684116f9-0d0f-4414-8ba3-35010e675940 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Querying cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) for 2 instances {{(pid=128863) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 01 04:48:41.034291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684116f9-0d0f-4414-8ba3-35010e675940 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:41.036048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684116f9-0d0f-4414-8ba3-35010e675940 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:41.040668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684116f9-0d0f-4414-8ba3-35010e675940 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:41.199637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:41.209585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:41.211088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:41.217554 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e16c1e7-aa8b-4651-b410-c0119fac1200 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 0.540592 Sep 01 04:48:41.218104 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 298/662] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:40 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:41.675691 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-684116f9-0d0f-4414-8ba3-35010e675940 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/1c6aa3f2-600e-4852-8748-9e25b4070475" status: 200 len: 266 microversion: 2.1 time: 0.737181 Sep 01 04:48:41.677089 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 365/663] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:48:40 2022] GET /compute/v2.1/os-server-groups/1c6aa3f2-600e-4852-8748-9e25b4070475 => generated 266 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:41.697244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:41.700610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:41.720297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:41.722487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:41.725365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:41.726516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:41.727308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:41.728485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:41.739688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cbe98c2-2b86-49a3-94ef-99d20386ece3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7601fa790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:41.890117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cbe98c2-2b86-49a3-94ef-99d20386ece3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.179906 Sep 01 04:48:41.891112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 366/664] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:41 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:42.160009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-176878b6-a63b-494f-a92d-84f2d376e12d tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 200 len: 1621 microversion: 2.1 time: 0.474249 Sep 01 04:48:42.160614 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 299/665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:41 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 1621 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:42.198922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:42.200652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:42.224938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:42.224938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:42.254180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:42.260846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:42.262306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:42.274947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:42.275630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:42.276257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:42.284643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:42.285141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:42.285570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:42.286290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:42.286736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:42.287175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:42.839518 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c29fa27-9dda-425a-92a2-1f35c7230edd tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 200 len: 1620 microversion: 2.1 time: 0.661653 Sep 01 04:48:42.841640 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 367/666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:42 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 1620 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:42.855873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00fda2bf-dffb-4a36-ab7a-4d360555a9e0 req-7156acec-fb0d-44de-a207-da090556ab33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28faec93-25bd-420c-a9e7-85836885a76b", "tag": "60ba55a3-9242-45b7-bdc3-cca385154f4a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:42.902927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00fda2bf-dffb-4a36-ab7a-4d360555a9e0 req-7156acec-fb0d-44de-a207-da090556ab33 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:42.909351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:42.914369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00fda2bf-dffb-4a36-ab7a-4d360555a9e0 req-7156acec-fb0d-44de-a207-da090556ab33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:42.917090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00fda2bf-dffb-4a36-ab7a-4d360555a9e0 req-7156acec-fb0d-44de-a207-da090556ab33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:42.927846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:42.946058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:42.955159 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fef2deb-49ae-456e-8a1c-a755c4ff89e2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 0.707634 Sep 01 04:48:42.959103 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 300/667] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:42 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:42.965675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-00fda2bf-dffb-4a36-ab7a-4d360555a9e0 req-7156acec-fb0d-44de-a207-da090556ab33 service nova] Creating event network-changed:60ba55a3-9242-45b7-bdc3-cca385154f4a for instance 28faec93-25bd-420c-a9e7-85836885a76b on n-h1-820368-37 Sep 01 04:48:42.988186 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00fda2bf-dffb-4a36-ab7a-4d360555a9e0 req-7156acec-fb0d-44de-a207-da090556ab33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142624 Sep 01 04:48:42.989666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 368/668] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:43.015297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3a6b2d7-3e81-415c-ab59-31b854ed3db5 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: .version_select at 0x7fa760235ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1628953800", "policies": ["anti-affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:43.020504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-732b7e07-31e6-4717-a091-eedefd894ceb tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7604423a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:43.058681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:43.121795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e3a6b2d7-3e81-415c-ab59-31b854ed3db5 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:43.130779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e3a6b2d7-3e81-415c-ab59-31b854ed3db5 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:43.150711 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-732b7e07-31e6-4717-a091-eedefd894ceb tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.159632 Sep 01 04:48:43.151322 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 369/669] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:42 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:43.362767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e3a6b2d7-3e81-415c-ab59-31b854ed3db5 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:43.368351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e3a6b2d7-3e81-415c-ab59-31b854ed3db5 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:43.393161 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3a6b2d7-3e81-415c-ab59-31b854ed3db5 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.430479 Sep 01 04:48:43.394373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 301/670] 10.222.0.26 () {60 vars in 1174 bytes} [Thu Sep 1 04:48:42 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:43.981434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1726965787", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f7f96ce1-feb2-4706-9f46-385e1a8cb15b"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:43.987258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:43.989105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:44.014487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:44.036034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:44.038522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:44.041157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:44.043524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:44.045140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:44.141212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:48:44.948006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:48:44.948298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:48:44.953552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:48:44.954350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:48:44.955475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:48:44.997183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:45.001658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:45.005862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:45.007075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:45.007796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:45.017989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:45.096137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:45.109884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:45.151282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Going to run 2 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:48:45.163389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:48:45.288003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:45.294701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:45.357062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:45.381620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:45.385208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:45.392967 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06fa1944-3ee9-4563-891f-ac168e146ce5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 1.410956 Sep 01 04:48:45.412583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:45.418703 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 302/671] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:43 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:48:45.425291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:45.434159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f156169c-f889-4abd-b7e9-a48f1ce7fdce tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760208ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:45.469678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=44e5f1ec-18a2-448a-af16-c682e9b8383a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:48:45.554401 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f156169c-f889-4abd-b7e9-a48f1ce7fdce tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.128437 Sep 01 04:48:45.568746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 303/672] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:45 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:45.644693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:45.668829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:45.757010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:45.789269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:45.795271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:45.852645 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5329c49d-e67d-4774-a209-c311c26801fd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.876389 Sep 01 04:48:45.858690 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 370/673] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:48:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1883 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:48:45.862605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:45.874011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:45.874849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Searching by: {'deleted': False, 'project_id': 'a917f0bb781a42879a605ffca90e436d'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:48:45.939672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:45.940223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:45.940643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:45.941463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:45.941950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:45.942320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:46.233469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:48:46.424556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:46.425321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:46.438558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:46.439223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:46.439834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:46.440698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:46.441007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:46.470810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:46.517242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d04eef0-51a1-4b40-9c0d-b82c0225d69e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.658534 Sep 01 04:48:46.531429 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 304/674] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:48:45 2022] GET /compute/v2.1/servers => generated 1663 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:46.544535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-185fab1d-8dbd-44ea-a3c0-b35b71594aa1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:46.545153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-185fab1d-8dbd-44ea-a3c0-b35b71594aa1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:46.702106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-185fab1d-8dbd-44ea-a3c0-b35b71594aa1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:46.710248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-185fab1d-8dbd-44ea-a3c0-b35b71594aa1 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1219 microversion: 2.1 time: 0.170214 Sep 01 04:48:46.711775 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 305/675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:46 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:46.718203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cdb2024-42c4-4daa-aee0-a0bf6d546a44 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760253280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:46.793305 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cdb2024-42c4-4daa-aee0-a0bf6d546a44 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.080178 Sep 01 04:48:46.794055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 306/676] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:46 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:47.127058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:47.156921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:47.179298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:47.182954 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41b668be-21da-45e8-9f20-b27a5a175a12 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 0.763496 Sep 01 04:48:47.185187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 371/677] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:46 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:47.732982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d98788a5-a9c6-4118-b4de-6ccc19fe3ba7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:47.733878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d98788a5-a9c6-4118-b4de-6ccc19fe3ba7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:47.814301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65e50f4e-beb0-4a0c-ae41-e95d3cce35ed tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7604423a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:47.950573 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65e50f4e-beb0-4a0c-ae41-e95d3cce35ed tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.138922 Sep 01 04:48:47.951424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 372/678] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:47 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:48.208437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:48.209165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:48.232118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:48.235169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:48.237289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:48.243014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:48.244915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:48.248277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:48.354293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d98788a5-a9c6-4118-b4de-6ccc19fe3ba7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:48.372759 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d98788a5-a9c6-4118-b4de-6ccc19fe3ba7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1219 microversion: 2.1 time: 0.639877 Sep 01 04:48:48.378920 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 307/679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:47 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1219 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:48.966414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52a9a07f-49f8-48cb-b239-a21a1762668c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760208d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:49.091011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52a9a07f-49f8-48cb-b239-a21a1762668c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.128530 Sep 01 04:48:49.093054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 308/680] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:48 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:49.401331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:49.402582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:49.413507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:49.423696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:49.424917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:49.428708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:49.432447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:49.434445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:49.436310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:49.449717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:49.451636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:49.455504 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f113eebb-1453-407e-98d8-bae7f0f095fc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 1.252739 Sep 01 04:48:49.475359 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 373/681] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:48 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:48:49.615346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:49.869417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:49.884980 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b19521ab-46d0-41f4-a4a4-d7f2c0df863c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1271 microversion: 2.1 time: 0.487845 Sep 01 04:48:49.889403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 309/682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:49 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1271 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:50.109395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6edb98ed-e514-4aad-ada1-4a90bd518b4d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7601aee50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:50.347862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6edb98ed-e514-4aad-ada1-4a90bd518b4d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.244178 Sep 01 04:48:50.362183 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 374/683] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:50 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:50.481587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:50.483012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:50.501574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:50.504899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:50.505612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:50.506804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:50.509163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:50.510455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:50.917280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:50.918033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:50.936781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:50.939985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:50.940711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:50.946154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:50.948120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:50.951600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:51.505729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:51.517909 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9de5320a-8315-4576-9ef1-6002b9995590 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1277 microversion: 2.1 time: 0.602928 Sep 01 04:48:51.523237 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 375/684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:50 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1277 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:48:51.528643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32c3d8a0-3835-4f22-9987-ea59e36a6a93 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760056550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:51.608681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32c3d8a0-3835-4f22-9987-ea59e36a6a93 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.084046 Sep 01 04:48:51.609911 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 376/685] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:51 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:52.161942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:52.179741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:52.185515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:52.189801 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03767701-0e2c-4912-89a7-eae3ad6b9eeb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 1.712157 Sep 01 04:48:52.191885 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 310/686] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:50 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:48:52.496547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2026c53a-2d75-4c6c-b212-4e1f5cef20c7 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Calling method '.version_select at 0x7fa760383040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:52.541123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:52.541735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:52.554402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:52.554933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:52.560315 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2026c53a-2d75-4c6c-b212-4e1f5cef20c7 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] HTTP exception thrown: Image not found. Sep 01 04:48:52.566467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:52.568110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:52.568767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:52.569828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2026c53a-2d75-4c6c-b212-4e1f5cef20c7 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Request method failure captured: Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/3b569863-adc3-4160-a794-47354ee7eb79/metadata/os_distro HTTP/1.1 Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm0V5op3pu7khh2zKA-5aHJQDRGt2PNuHtcSoNSMW9k4762-ILvaGR-MhW-3Q1ooQcMikSuBWIrOuEOJeoj6xTCPRoK7-op0CcJVbw4pPtXTHsup3JMw0HmHkZBSyxDrKpodWlDZrHuYRgq1V7oZY2pyAT8cIOpuPusNC-G6nlfjko Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:52.575110 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bcbfe75b30004f79b2a0aaa5ef489bab Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'image_id': '3b569863-adc3-4160-a794-47354ee7eb79', 'id': 'os_distro'} Sep 01 04:48:52.576620 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.577568 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3b569863-adc3-4160-a794-47354ee7eb79 Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.578845 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b569863-adc3-4160-a794-47354ee7eb79 could not be found. Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:52.581168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:48:52.582552 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.589834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2026c53a-2d75-4c6c-b212-4e1f5cef20c7 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:52.595197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2026c53a-2d75-4c6c-b212-4e1f5cef20c7 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] 10.222.0.26 "DELETE /compute/v2.1/images/3b569863-adc3-4160-a794-47354ee7eb79/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.370148 Sep 01 04:48:52.597516 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 377/687] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Sep 1 04:48:52 2022] DELETE /compute/v2.1/images/3b569863-adc3-4160-a794-47354ee7eb79/metadata/os_distro => generated 62 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:52.622392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27370fba-1fa4-4942-99a1-82f14264a4fc tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Calling method '.version_select at 0x7fa760383280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:52.668969 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-27370fba-1fa4-4942-99a1-82f14264a4fc tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] HTTP exception thrown: Image not found. Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27370fba-1fa4-4942-99a1-82f14264a4fc tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Request method failure captured: Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/images/14e65749-0759-4f1a-9215-fcac7460f1f0/metadata/os_version HTTP/1.1 Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm0V5op3pu7khh2zKA-5aHJQDRGt2PNuHtcSoNSMW9k4762-ILvaGR-MhW-3Q1ooQcMikSuBWIrOuEOJeoj6xTCPRoK7-op0CcJVbw4pPtXTHsup3JMw0HmHkZBSyxDrKpodWlDZrHuYRgq1V7oZY2pyAT8cIOpuPusNC-G6nlfjko Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:52.671049 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bcbfe75b30004f79b2a0aaa5ef489bab Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'image_id': '14e65749-0759-4f1a-9215-fcac7460f1f0', 'id': 'os_version'} Sep 01 04:48:52.672574 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.674349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 14e65749-0759-4f1a-9215-fcac7460f1f0 Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.675633 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14e65749-0759-4f1a-9215-fcac7460f1f0 could not be found. Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:52.676970 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.678256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27370fba-1fa4-4942-99a1-82f14264a4fc tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:52.679519 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27370fba-1fa4-4942-99a1-82f14264a4fc tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] 10.222.0.26 "GET /compute/v2.1/images/14e65749-0759-4f1a-9215-fcac7460f1f0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.075177 Sep 01 04:48:52.679519 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 378/688] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Sep 1 04:48:52 2022] GET /compute/v2.1/images/14e65749-0759-4f1a-9215-fcac7460f1f0/metadata/os_version => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:52.695719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-532fceac-ead4-4d24-8b42-8e344f445956 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7606694c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:52.768970 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-532fceac-ead4-4d24-8b42-8e344f445956 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.090012 Sep 01 04:48:52.779985 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 379/689] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:52 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:52.785479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33beb76c-4e48-4320-bbf7-983ebadbf170 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Calling method '.version_select at 0x7fa760936430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:52.829454 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-33beb76c-4e48-4320-bbf7-983ebadbf170 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] HTTP exception thrown: Image not found. Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33beb76c-4e48-4320-bbf7-983ebadbf170 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Request method failure captured: Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/images/8a020676-d832-4c54-b585-41e44e0a5f77/metadata HTTP/1.1 Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm0V5op3pu7khh2zKA-5aHJQDRGt2PNuHtcSoNSMW9k4762-ILvaGR-MhW-3Q1ooQcMikSuBWIrOuEOJeoj6xTCPRoK7-op0CcJVbw4pPtXTHsup3JMw0HmHkZBSyxDrKpodWlDZrHuYRgq1V7oZY2pyAT8cIOpuPusNC-G6nlfjko Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:52.831709 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bcbfe75b30004f79b2a0aaa5ef489bab Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'image_id': '8a020676-d832-4c54-b585-41e44e0a5f77'} Sep 01 04:48:52.833287 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.834262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8a020676-d832-4c54-b585-41e44e0a5f77 Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.835569 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a020676-d832-4c54-b585-41e44e0a5f77 could not be found. Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:52.837079 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.838417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33beb76c-4e48-4320-bbf7-983ebadbf170 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:52.839664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33beb76c-4e48-4320-bbf7-983ebadbf170 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] 10.222.0.26 "GET /compute/v2.1/images/8a020676-d832-4c54-b585-41e44e0a5f77/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051923 Sep 01 04:48:52.839664 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 380/690] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:48:52 2022] GET /compute/v2.1/images/8a020676-d832-4c54-b585-41e44e0a5f77/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:52.845361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c93fb2e-51c4-452f-a78e-33a6d0a43de8 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Action: 'update_all', calling method: .version_select at 0x7fa760056940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:52.901154 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0c93fb2e-51c4-452f-a78e-33a6d0a43de8 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] HTTP exception thrown: Image not found. Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c93fb2e-51c4-452f-a78e-33a6d0a43de8 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Request method failure captured: Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/images/8b097873-4b80-4afd-8e17-199300f4c705/metadata HTTP/1.1 Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 57 Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm0V5op3pu7khh2zKA-5aHJQDRGt2PNuHtcSoNSMW9k4762-ILvaGR-MhW-3Q1ooQcMikSuBWIrOuEOJeoj6xTCPRoK7-op0CcJVbw4pPtXTHsup3JMw0HmHkZBSyxDrKpodWlDZrHuYRgq1V7oZY2pyAT8cIOpuPusNC-G6nlfjko Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:52.903289 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bcbfe75b30004f79b2a0aaa5ef489bab Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:48:52.904608 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'image_id': '8b097873-4b80-4afd-8e17-199300f4c705', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.905584 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8b097873-4b80-4afd-8e17-199300f4c705 Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:52.906936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b097873-4b80-4afd-8e17-199300f4c705 could not be found. Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:52.908728 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:48:52.910029 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:52.912395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c93fb2e-51c4-452f-a78e-33a6d0a43de8 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:52.913681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c93fb2e-51c4-452f-a78e-33a6d0a43de8 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] 10.222.0.26 "PUT /compute/v2.1/images/8b097873-4b80-4afd-8e17-199300f4c705/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072314 Sep 01 04:48:52.914279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 381/691] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:48:52 2022] PUT /compute/v2.1/images/8b097873-4b80-4afd-8e17-199300f4c705/metadata => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 04:48:52.924446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cf0edda-c2a1-4c38-8f47-034b4faf7af9 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Action: 'update', calling method: .version_select at 0x7fa7600d2ee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:52.998753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3cf0edda-c2a1-4c38-8f47-034b4faf7af9 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] HTTP exception thrown: Image not found. Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cf0edda-c2a1-4c38-8f47-034b4faf7af9 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Request method failure captured: Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/images/65e2ba3f-13b1-45ee-b4b8-3f7893486089/metadata/os_distro HTTP/1.1 Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 30 Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm0V5op3pu7khh2zKA-5aHJQDRGt2PNuHtcSoNSMW9k4762-ILvaGR-MhW-3Q1ooQcMikSuBWIrOuEOJeoj6xTCPRoK7-op0CcJVbw4pPtXTHsup3JMw0HmHkZBSyxDrKpodWlDZrHuYRgq1V7oZY2pyAT8cIOpuPusNC-G6nlfjko Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:53.001101 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bcbfe75b30004f79b2a0aaa5ef489bab Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: {"meta": {"os_distro": "alt"}} Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:48:53.003073 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'image_id': '65e2ba3f-13b1-45ee-b4b8-3f7893486089', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:53.003984 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65e2ba3f-13b1-45ee-b4b8-3f7893486089 Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:53.004995 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65e2ba3f-13b1-45ee-b4b8-3f7893486089 could not be found. Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:53.006151 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:48:53.007253 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.009512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cf0edda-c2a1-4c38-8f47-034b4faf7af9 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:53.010515 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cf0edda-c2a1-4c38-8f47-034b4faf7af9 tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] 10.222.0.26 "PUT /compute/v2.1/images/65e2ba3f-13b1-45ee-b4b8-3f7893486089/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.090482 Sep 01 04:48:53.014665 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 382/692] 10.222.0.26 () {60 vars in 1310 bytes} [Thu Sep 1 04:48:52 2022] PUT /compute/v2.1/images/65e2ba3f-13b1-45ee-b4b8-3f7893486089/metadata/os_distro => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 04:48:53.030240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea19cf33-5fed-45a6-bf29-6632cdad017a tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Action: 'create', calling method: .version_select at 0x7fa760056670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:53.061844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:53.074528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ea19cf33-5fed-45a6-bf29-6632cdad017a tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] HTTP exception thrown: Image not found. Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea19cf33-5fed-45a6-bf29-6632cdad017a tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Request method failure captured: Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/images/0cbf98ea-4971-48e4-9e2a-51f57938fdbc/metadata HTTP/1.1 Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 57 Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm0V5op3pu7khh2zKA-5aHJQDRGt2PNuHtcSoNSMW9k4762-ILvaGR-MhW-3Q1ooQcMikSuBWIrOuEOJeoj6xTCPRoK7-op0CcJVbw4pPtXTHsup3JMw0HmHkZBSyxDrKpodWlDZrHuYRgq1V7oZY2pyAT8cIOpuPusNC-G6nlfjko Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:48:53.076904 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3fdfa3d6ff84bf28bd8524ca159c307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c3fdfa3d6ff84bf28bd8524ca159c307 Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-969169908 Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bcbfe75b30004f79b2a0aaa5ef489bab Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-969169908-project Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:48:53.078455 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'image_id': '0cbf98ea-4971-48e4-9e2a-51f57938fdbc', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:53.079651 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0cbf98ea-4971-48e4-9e2a-51f57938fdbc Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:48:53.080999 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0cbf98ea-4971-48e4-9e2a-51f57938fdbc could not be found. Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:48:53.082208 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:48:53.083869 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:48:53.086431 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3cbb793c-fbaa-4f4e-bd2c-c41d3d71fc2f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1277 microversion: 2.1 time: 0.538425 Sep 01 04:48:53.088147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 311/693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:52 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1277 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:53.088530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea19cf33-5fed-45a6-bf29-6632cdad017a tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:48:53.089561 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea19cf33-5fed-45a6-bf29-6632cdad017a tempest-ImagesMetadataNegativeTestJSON-969169908 tempest-ImagesMetadataNegativeTestJSON-969169908-project] 10.222.0.26 "POST /compute/v2.1/images/0cbf98ea-4971-48e4-9e2a-51f57938fdbc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069185 Sep 01 04:48:53.090729 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 383/694] 10.222.0.26 () {60 vars in 1281 bytes} [Thu Sep 1 04:48:53 2022] POST /compute/v2.1/images/0cbf98ea-4971-48e4-9e2a-51f57938fdbc/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:48:53.215280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:53.216120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:53.232433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:53.235505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:53.241884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:53.244609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:53.245192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:53.250569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:53.797537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecb8fd3d-010b-43f2-8b29-ef4d64f4dd32 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600d2700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:53.886164 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecb8fd3d-010b-43f2-8b29-ef4d64f4dd32 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.092314 Sep 01 04:48:53.887973 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 384/695] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:53 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:48:53.981072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:54.017558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:54.027074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:54.032595 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7376a32-8491-4999-b7df-a1bcc461bc67 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 0.822602 Sep 01 04:48:54.033548 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 312/696] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:53 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:54.128456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:54.129094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:54.152026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:54.152521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:54.153164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:54.154066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:54.154680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:54.155289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:54.380551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:54.396205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fa94de4-15ab-40f3-9f6b-f3cd4fb19d50 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1277 microversion: 2.1 time: 0.273433 Sep 01 04:48:54.397392 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 385/697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:54 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:54.907137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a198ac4-40e1-4403-a9c8-b5db117eb513 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600e03a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:55.009800 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a198ac4-40e1-4403-a9c8-b5db117eb513 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.111197 Sep 01 04:48:55.010630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 313/698] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:54 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:55.069664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:55.071076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:55.084934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:55.089115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:55.090509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:55.093167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:55.095346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:55.098056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:55.100219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:55.420023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:55.420309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:55.430620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:55.432632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:55.433177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:55.436017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:55.439518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:55.442491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:55.805654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:56.009151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:56.038085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10549e3d-317d-4dca-a2d4-89edaba25116 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1277 microversion: 2.1 time: 0.624250 Sep 01 04:48:56.052847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 314/699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:55 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1277 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:48:56.062509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93c6a0ca-aac1-4f0e-ad77-b6e29c23f9f4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600cb9d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:56.094467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:56.172316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93c6a0ca-aac1-4f0e-ad77-b6e29c23f9f4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1455 microversion: 2.1 time: 0.117913 Sep 01 04:48:56.173520 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 315/700] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:56 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:56.264865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:56.281087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:56.283978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:56.288641 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc74acab-b505-48b5-988a-2824fc7aaca4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1569 microversion: 2.25 time: 1.224241 Sep 01 04:48:56.292384 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 386/701] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:55 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1569 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:57.061402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:57.062160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:57.074012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:57.074506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:57.077486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:57.078458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:57.080405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:57.083249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:57.194964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31d65c90-4778-403e-a0b0-02db6c83b627 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760669a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:57.448488 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31d65c90-4778-403e-a0b0-02db6c83b627 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1464 microversion: 2.1 time: 0.263934 Sep 01 04:48:57.456614 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 387/702] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:57 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1464 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:48:57.466749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:57.467891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:57.486551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:57.487368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:57.488172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:57.489221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:57.492109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:57.492791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:58.365635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:48:58.383302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:58.395754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c5785c4-c9bb-41f8-8378-2587f396012e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 1.339510 Sep 01 04:48:58.396342 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 316/703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:57 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:58.433713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dba167f5-5ea6-40e6-9899-f2030deeb34d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600cb700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:58.448018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:58.511601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:58.515708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:58.525906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41e2276a-01b0-4efb-9d6b-f0faf36b55a4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1544 microversion: 2.25 time: 1.060242 Sep 01 04:48:58.526560 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 388/704] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:57 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1544 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:58.583327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-399ce7c9-bda5-4816-87c6-03844de0e2c2 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '.version_select at 0x7fa7601fa790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:58.590347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-399ce7c9-bda5-4816-87c6-03844de0e2c2 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:58.591422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-399ce7c9-bda5-4816-87c6-03844de0e2c2 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:58.595260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-399ce7c9-bda5-4816-87c6-03844de0e2c2 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:58.616635 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dba167f5-5ea6-40e6-9899-f2030deeb34d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 200 len: 1464 microversion: 2.1 time: 0.216220 Sep 01 04:48:58.619008 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 317/705] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:48:58 2022] GET /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 1464 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:58.650592 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-399ce7c9-bda5-4816-87c6-03844de0e2c2 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.093732 Sep 01 04:48:58.656666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 389/706] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Sep 1 04:48:58 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:48:58.677613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:58.678235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:58.683135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:58.684120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:58.706622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:58.707482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:58.708117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:58.710207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:58.713878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:58.714333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:58.714589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:58.715394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:58.716070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:58.720338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:58.721123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:58.727408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:59.404057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:48:59.425464 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ba610c6-21ce-47f7-bc94-46a62a6e6fd0 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 2039 microversion: 2.25 time: 0.754789 Sep 01 04:48:59.437284 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 390/707] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:48:58 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 2039 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:48:59.456946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-400cb703-0c8b-44ec-8460-c077299a2417 req-bb993054-3521-4f99-93bd-e117cae90436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e5f1ec-18a2-448a-af16-c682e9b8383a", "tag": "1c5038ed-f14c-405c-ad41-af3508fed97c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:59.463675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:59.500701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-400cb703-0c8b-44ec-8460-c077299a2417 req-bb993054-3521-4f99-93bd-e117cae90436 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:59.501799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-400cb703-0c8b-44ec-8460-c077299a2417 req-bb993054-3521-4f99-93bd-e117cae90436 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:59.502740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-400cb703-0c8b-44ec-8460-c077299a2417 req-bb993054-3521-4f99-93bd-e117cae90436 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:59.503479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94c36491-fe49-4f5b-838e-5db704136199 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1466 microversion: 2.1 time: 0.845271 Sep 01 04:48:59.504150 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 318/708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:58 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1466 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:48:59.509024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:48:59.516586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:59.518827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-400cb703-0c8b-44ec-8460-c077299a2417 req-bb993054-3521-4f99-93bd-e117cae90436 service nova] Creating event network-changed:1c5038ed-f14c-405c-ad41-af3508fed97c for instance 44e5f1ec-18a2-448a-af16-c682e9b8383a on n-h2-820368-37 Sep 01 04:48:59.527489 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-400cb703-0c8b-44ec-8460-c077299a2417 req-bb993054-3521-4f99-93bd-e117cae90436 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088052 Sep 01 04:48:59.528634 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 391/709] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:48:59.538162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b634efa7-941f-46c4-a5f8-1f42fb7335c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Action: 'create', calling method: .version_select at 0x7fa760043820>, body: {"keypair": {"name": "tempest-keypair-1896213627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/1MstgANVr3Jzzmu7yIVWyWG8/9UhO02TjDtoK++HVIVEY7AoddERv1a+3vLCrQh1C8vBS3DmrhaAt4TALsR1sDuhSnVi2jtf7AxMyHAHtqZC7gXoqrsQ0VEE3uNQSFA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:59.539742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:59.540245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:59.540680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:59.541397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:59.541847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:59.542269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:59.560998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b634efa7-941f-46c4-a5f8-1f42fb7335c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:48:59.568010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b634efa7-941f-46c4-a5f8-1f42fb7335c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for user ce4ece60266c4a9692b03d795cea8462 and project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:48:59.623537 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b634efa7-941f-46c4-a5f8-1f42fb7335c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.093241 Sep 01 04:48:59.630267 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 392/710] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 04:48:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 04:48:59.648726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1166213136"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:48:59.652459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:48:59.664632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:59.665332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:59.665997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:59.666816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:48:59.667463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:48:59.668006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:48:59.920051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:48:59.931028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2bebe63c-e1e4-417d-a079-76b3a237ff98 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.425715 Sep 01 04:48:59.941760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 319/711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:48:59 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:00.052724 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac0c9f8c-46fc-4bf0-b090-0afce5a89f4e tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "POST /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.420640 Sep 01 04:49:00.058694 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 393/712] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:48:59 2022] POST /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:49:00.064837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f311c31-1526-4b0f-97e0-1e05bf82fc47 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7601c8ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:00.119802 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f311c31-1526-4b0f-97e0-1e05bf82fc47 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.059186 Sep 01 04:49:00.120397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 320/713] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:00 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:00.959047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:00.964161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:01.017273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:01.019131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:01.021713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:01.023469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:01.025492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:01.027386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:01.050797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9416cc45-b7e2-45ca-be97-be0f8754c04c req-1af6ef48-323f-4e35-af87-c6f66e3ba28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56be13bc-1e86-44b3-8e54-a2f677bb469e", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4d8c12-ccb6-427f-8a09-3816eba070bb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:01.091907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9416cc45-b7e2-45ca-be97-be0f8754c04c req-1af6ef48-323f-4e35-af87-c6f66e3ba28a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:01.092639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9416cc45-b7e2-45ca-be97-be0f8754c04c req-1af6ef48-323f-4e35-af87-c6f66e3ba28a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:01.094500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9416cc45-b7e2-45ca-be97-be0f8754c04c req-1af6ef48-323f-4e35-af87-c6f66e3ba28a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:01.156739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9416cc45-b7e2-45ca-be97-be0f8754c04c req-1af6ef48-323f-4e35-af87-c6f66e3ba28a service nova] Creating event network-vif-unplugged:6f4d8c12-ccb6-427f-8a09-3816eba070bb for instance 56be13bc-1e86-44b3-8e54-a2f677bb469e on n-h2-820368-37 Sep 01 04:49:01.193724 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9416cc45-b7e2-45ca-be97-be0f8754c04c req-1af6ef48-323f-4e35-af87-c6f66e3ba28a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155231 Sep 01 04:49:01.204259 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 321/714] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:49:01.227923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-204d89fe-a05a-4c96-acf9-9c7f7472bb04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760208af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:01.382012 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-204d89fe-a05a-4c96-acf9-9c7f7472bb04 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.167766 Sep 01 04:49:01.383170 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 322/715] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:01 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:01.649476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:01.681076 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ebf03b9-ef6c-4836-9539-9d00fd40ecd9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.729792 Sep 01 04:49:01.705916 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 394/716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:00 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:01.856815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f7850622-5b34-4c83-9406-87950bc2f9f6 req-e8cdf732-c41a-4232-bc05-927f67e63d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d0e8a1-2431-49af-8292-4f43d3c5876d", "tag": "bb286f0f-d08d-4166-b089-02b82c4bbeb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:01.896942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f7850622-5b34-4c83-9406-87950bc2f9f6 req-e8cdf732-c41a-4232-bc05-927f67e63d41 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:01.898426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f7850622-5b34-4c83-9406-87950bc2f9f6 req-e8cdf732-c41a-4232-bc05-927f67e63d41 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:01.899434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f7850622-5b34-4c83-9406-87950bc2f9f6 req-e8cdf732-c41a-4232-bc05-927f67e63d41 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:01.937322 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f7850622-5b34-4c83-9406-87950bc2f9f6 req-e8cdf732-c41a-4232-bc05-927f67e63d41 service nova] Creating event network-changed:bb286f0f-d08d-4166-b089-02b82c4bbeb2 for instance e8d0e8a1-2431-49af-8292-4f43d3c5876d on n-h1-820368-37 Sep 01 04:49:01.953372 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f7850622-5b34-4c83-9406-87950bc2f9f6 req-e8cdf732-c41a-4232-bc05-927f67e63d41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102118 Sep 01 04:49:01.979775 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 323/717] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:02.411485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d44e5e24-8b9b-4a1a-ac51-bd81df770075 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7604c1790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:02.651919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d44e5e24-8b9b-4a1a-ac51-bd81df770075 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.247485 Sep 01 04:49:02.697506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 395/718] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:02 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:02.718928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:02.720554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:02.739946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:02.741158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:02.742987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:02.744529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:02.745517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:02.746471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:03.628271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:03.656244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2377996e-e83a-45e9-b25d-223456028fce tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.946538 Sep 01 04:49:03.661424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 324/719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:02 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:03.683286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a82314e0-1979-4d4b-ba85-462590cf132c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760056700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:03.762634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a82314e0-1979-4d4b-ba85-462590cf132c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.081792 Sep 01 04:49:03.763610 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 396/720] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:03 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:04.706191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:04.706813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:04.727343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:04.728119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:04.728763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:04.729852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:04.730485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:04.732407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:04.783410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e29957d-8367-477b-a6e7-ecd9bcc21fe4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76080f1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:04.856010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e29957d-8367-477b-a6e7-ecd9bcc21fe4 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.077314 Sep 01 04:49:04.856515 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 397/721] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:04 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:05.577615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:05.589595 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c5f443c-12b7-45aa-bfa1-d78130659166 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.890833 Sep 01 04:49:05.605024 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 325/722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:04 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:05.828459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-387283224", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "541b0280-9b86-4b41-9f61-cdb1f531e297"}], "security_groups": [{"name": "tempest-securitygroup--1443127162"}], "key_name": "tempest-keypair-1896213627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:05.875210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c1de498-1312-4a3a-9151-40dd695af691 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600e70d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:05.972953 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c1de498-1312-4a3a-9151-40dd695af691 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.102162 Sep 01 04:49:05.975767 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 326/723] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:05 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:06.268739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] validate_networks() for [('541b0280-9b86-4b41-9f61-cdb1f531e297', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:06.634065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:06.636387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:06.646105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:06.647416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:06.648860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:06.649825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:06.650643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:06.653491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:07.155882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:07.172310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-caf627f2-cbb4-4632-9391-a91e058c1b9f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.551457 Sep 01 04:49:07.176627 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 327/724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:06 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:07.222754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6dd1cc38-b0ae-4542-b27d-104293b753ce tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600885e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:07.417388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:07.417955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:07.418616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:07.419278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:07.419690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:07.421120 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6dd1cc38-b0ae-4542-b27d-104293b753ce tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.211904 Sep 01 04:49:07.424446 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 328/725] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:07 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:07.441290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:07.441780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:07.442212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:07.442969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:07.443433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:07.443855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:07.491052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:07.497047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for user ce4ece60266c4a9692b03d795cea8462 and project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:07.511095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:07.517089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:07.612178 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6cad249-f6cd-4c9e-b846-542aa5aae806 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.788916 Sep 01 04:49:07.616600 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 398/726] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:49:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:49:07.627423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14f7ba76-94db-43b1-9407-e3005666be06 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:07.634981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14f7ba76-94db-43b1-9407-e3005666be06 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:07.801147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14f7ba76-94db-43b1-9407-e3005666be06 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:07.818378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14f7ba76-94db-43b1-9407-e3005666be06 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:07.820189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14f7ba76-94db-43b1-9407-e3005666be06 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:07.826713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14f7ba76-94db-43b1-9407-e3005666be06 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1285 microversion: 2.25 time: 0.203474 Sep 01 04:49:07.842392 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 329/727] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:07 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:08.204373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:08.205531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:08.234770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:08.237191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:08.240281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:08.243087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:08.247773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:08.250714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:08.452345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8990ef1d-2418-4d41-8dce-555075673a7b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7603171f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:08.600899 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8990ef1d-2418-4d41-8dce-555075673a7b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.160034 Sep 01 04:49:08.607767 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 330/728] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:08 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:08.757500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:08.776170 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b14f06f-4cf0-43fe-b2b2-c72e14df22c4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.579868 Sep 01 04:49:08.790922 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 399/729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:08 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:08.850243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:08.851123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:08.865618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:08.866655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:08.866655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:08.872305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:08.872822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:08.873269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:09.096361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:09.112064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:09.113983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:09.115327 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5663bb2e-213c-4b78-8067-4dbdf332e926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1289 microversion: 2.25 time: 0.269498 Sep 01 04:49:09.119705 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 331/730] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:08 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1289 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:49:09.621479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ac631dd-4d36-420d-bc44-ce7b972ffeb0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760383dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:09.694588 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ac631dd-4d36-420d-bc44-ce7b972ffeb0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.078108 Sep 01 04:49:09.706001 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 400/731] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:09 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:09.811649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:09.812327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:09.827969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:09.829720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:09.831042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:09.833007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:09.834857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:09.836676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:10.146486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:10.147253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:10.163050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:10.164961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:10.164961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:10.164961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:10.165752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:10.166347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:10.173067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:10.371006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:10.385572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:10.395702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:10.397788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98a6bd11-830e-4fa3-96ae-3c72e994ed7b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1345 microversion: 2.25 time: 0.256103 Sep 01 04:49:10.398954 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 401/732] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:10 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1345 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:49:10.404735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-580c2ad7-805a-4db3-8477-2fd56d752839 req-84633df1-ba77-4463-852b-7366e5e710f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e5f1ec-18a2-448a-af16-c682e9b8383a", "name": "network-vif-plugged", "status": "completed", "tag": "1c5038ed-f14c-405c-ad41-af3508fed97c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:10.422736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-580c2ad7-805a-4db3-8477-2fd56d752839 req-84633df1-ba77-4463-852b-7366e5e710f5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:10.428593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-580c2ad7-805a-4db3-8477-2fd56d752839 req-84633df1-ba77-4463-852b-7366e5e710f5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:10.430151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-580c2ad7-805a-4db3-8477-2fd56d752839 req-84633df1-ba77-4463-852b-7366e5e710f5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:10.455154 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-580c2ad7-805a-4db3-8477-2fd56d752839 req-84633df1-ba77-4463-852b-7366e5e710f5 service nova] Creating event network-vif-plugged:1c5038ed-f14c-405c-ad41-af3508fed97c for instance 44e5f1ec-18a2-448a-af16-c682e9b8383a on n-h2-820368-37 Sep 01 04:49:10.472642 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-580c2ad7-805a-4db3-8477-2fd56d752839 req-84633df1-ba77-4463-852b-7366e5e710f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072101 Sep 01 04:49:10.473780 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 402/733] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:10.544370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:10.561646 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5d5a704-91c7-44b2-abc7-540ca54f5748 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.753830 Sep 01 04:49:10.562865 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 332/734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:09 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:10.716364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78f590fe-9887-4f59-b648-3e9da9aa4ef9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7603c8040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:10.801887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78f590fe-9887-4f59-b648-3e9da9aa4ef9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.091078 Sep 01 04:49:10.802750 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 403/735] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:10 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:11.421480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:11.422089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:11.432907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:11.437449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:11.438152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:11.439398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:11.441113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:11.445316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:11.600689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:11.601632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:11.619836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:11.620548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:11.621191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:11.621731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:11.622705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:11.623439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:11.624085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:11.630313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:11.635259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:11.640510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ac67d5a-c083-4320-9b30-4a80d2593813 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1343 microversion: 2.25 time: 0.222901 Sep 01 04:49:11.642257 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 333/736] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:11 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1343 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:11.822056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cbd2d0c-b127-460b-8afb-dcd31b1a18f9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600e7160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:11.884591 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cbd2d0c-b127-460b-8afb-dcd31b1a18f9 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.066285 Sep 01 04:49:11.898183 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 334/737] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:11 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:12.250093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:12.268122 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4c3995c-4bf2-478f-9ee3-b8bf579c7eb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.671903 Sep 01 04:49:12.269314 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 404/738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:11 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:12.668955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:12.669665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:12.681144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:12.682020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:12.691694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:12.692883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:12.693468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:12.694044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:12.889510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:12.904609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:12.906388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:12.911197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bdc63c1-8adf-4946-a441-07e13d755d0b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760179670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:12.915105 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-178f0a95-9f31-4477-9761-7488f640d909 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1343 microversion: 2.25 time: 0.245879 Sep 01 04:49:12.915992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 335/739] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:12 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1343 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:12.975553 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9bdc63c1-8adf-4946-a441-07e13d755d0b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.072331 Sep 01 04:49:12.976634 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 405/740] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:12 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:13.306531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:13.307182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:13.316596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:13.320895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:13.322220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:13.324839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:13.326137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:13.328637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:13.331311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:13.938084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:13.940615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:13.956739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:13.959552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:13.960225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:13.961325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:13.963470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:13.963911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:14.159353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:14.190420 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07f70ee7-b7b4-4857-b0fe-03f21dd44529 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.887895 Sep 01 04:49:14.212710 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 336/741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:13 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:14.228957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe5f710d-af34-4517-a0f7-49fb4814bf4b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600cb550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:14.329837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe5f710d-af34-4517-a0f7-49fb4814bf4b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.114583 Sep 01 04:49:14.331526 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 337/742] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:14 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:14.356640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:14.371462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:14.378971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:14.380532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-281e8346-0e7f-4d65-8b9d-f1b9d29ea316 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1343 microversion: 2.25 time: 0.446697 Sep 01 04:49:14.381614 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 406/743] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:13 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1343 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:49:15.232627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:15.233861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:15.245237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:15.248843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:15.249506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:15.253174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:15.253860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:15.258747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:15.273894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:15.352107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b4a2c9c-4132-467c-8fc4-731b57f167e3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600565e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:15.435220 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b4a2c9c-4132-467c-8fc4-731b57f167e3 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.088552 Sep 01 04:49:15.437472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 407/744] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:15 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:15.456172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:15.457135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:15.471894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:15.473392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:15.477437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:15.478471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:15.494869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:15.498203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:15.839115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:15.855913 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54ff9ed1-1e4a-40f9-8762-32f595d532db tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.628182 Sep 01 04:49:15.865889 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 338/745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:15 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:15.951595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d56ea181-567e-4888-ac1e-ffa9c8f38a4c req-607c7e53-1e4d-461e-8a1c-d147fce42bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "name": "network-vif-plugged", "status": "completed", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:15.981199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d56ea181-567e-4888-ac1e-ffa9c8f38a4c req-607c7e53-1e4d-461e-8a1c-d147fce42bb4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:15.988423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d56ea181-567e-4888-ac1e-ffa9c8f38a4c req-607c7e53-1e4d-461e-8a1c-d147fce42bb4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:15.989123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d56ea181-567e-4888-ac1e-ffa9c8f38a4c req-607c7e53-1e4d-461e-8a1c-d147fce42bb4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:16.018252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d56ea181-567e-4888-ac1e-ffa9c8f38a4c req-607c7e53-1e4d-461e-8a1c-d147fce42bb4 service nova] Creating event network-vif-plugged:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:49:16.024729 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d56ea181-567e-4888-ac1e-ffa9c8f38a4c req-607c7e53-1e4d-461e-8a1c-d147fce42bb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082040 Sep 01 04:49:16.035632 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 339/746] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:16.458278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0701fbe6-157d-45ab-b062-783e5b81937a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76009a4c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:16.572985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:16.597506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:16.602588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:16.604051 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0701fbe6-157d-45ab-b062-783e5b81937a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.151196 Sep 01 04:49:16.605072 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 340/747] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:16 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:16.611387 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d6e3368-89ba-431f-821c-3677d344345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 1.172488 Sep 01 04:49:16.622120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 408/748] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:15 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:16.886257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:16.887031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:16.901739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:16.914016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:16.923284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:16.926448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:16.926982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:16.927676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:17.628748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf8c2dbe-d34a-4064-8de1-f75043c06605 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600d24c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:17.649331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:17.664081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:17.807052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:18.123471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:18.134571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5119094-c215-4903-a1c7-cabf4154335b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 1.252943 Sep 01 04:49:18.153641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 341/749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:16 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:18.184645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:18.206494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:18.238556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:18.238556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:18.238556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:18.240445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:18.241165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:18.242331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:19.815274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:19.849334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:19.858362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:19.868314 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13bf1023-8126-40ce-8d6d-261b3cb2621a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 1.713407 Sep 01 04:49:19.892582 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 342/750] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:18 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:19.897777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e8cf803e-f0c2-45d0-9bc6-02c3a8dcb448 req-bf60ddd3-bf92-435d-b244-097b3c2dfeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90982816-19d1-448f-bd4a-7cda5aab3e2a", "tag": "30294c27-aeaa-49f8-874e-b14aeb855c61"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:19.976767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e8cf803e-f0c2-45d0-9bc6-02c3a8dcb448 req-bf60ddd3-bf92-435d-b244-097b3c2dfeea service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:19.977525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e8cf803e-f0c2-45d0-9bc6-02c3a8dcb448 req-bf60ddd3-bf92-435d-b244-097b3c2dfeea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:19.977970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e8cf803e-f0c2-45d0-9bc6-02c3a8dcb448 req-bf60ddd3-bf92-435d-b244-097b3c2dfeea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:20.043248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e8cf803e-f0c2-45d0-9bc6-02c3a8dcb448 req-bf60ddd3-bf92-435d-b244-097b3c2dfeea service nova] Creating event network-changed:30294c27-aeaa-49f8-874e-b14aeb855c61 for instance 90982816-19d1-448f-bd4a-7cda5aab3e2a on n-h1-820368-37 Sep 01 04:49:20.085353 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e8cf803e-f0c2-45d0-9bc6-02c3a8dcb448 req-bf60ddd3-bf92-435d-b244-097b3c2dfeea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183525 Sep 01 04:49:20.090562 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 343/751] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:20.123401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:20.124342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:20.164355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:20.164850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:20.175295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:20.179386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:20.181560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:20.189154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:20.989381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:21.021440 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b60f874-f4a4-47fe-ae59-014626b19128 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.916912 Sep 01 04:49:21.040670 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 344/752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:20 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:21.045682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-96ee0cfd-023a-4636-a637-4af50e8a3dea req-a782027e-7d90-45fa-a415-6be0f903697f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d0e8a1-2431-49af-8292-4f43d3c5876d", "name": "network-vif-plugged", "status": "completed", "tag": "bb286f0f-d08d-4166-b089-02b82c4bbeb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:21.097019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96ee0cfd-023a-4636-a637-4af50e8a3dea req-a782027e-7d90-45fa-a415-6be0f903697f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:21.111141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96ee0cfd-023a-4636-a637-4af50e8a3dea req-a782027e-7d90-45fa-a415-6be0f903697f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:21.121365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-96ee0cfd-023a-4636-a637-4af50e8a3dea req-a782027e-7d90-45fa-a415-6be0f903697f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:21.165317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-96ee0cfd-023a-4636-a637-4af50e8a3dea req-a782027e-7d90-45fa-a415-6be0f903697f service nova] Creating event network-vif-plugged:bb286f0f-d08d-4166-b089-02b82c4bbeb2 for instance e8d0e8a1-2431-49af-8292-4f43d3c5876d on n-h1-820368-37 Sep 01 04:49:21.175907 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-96ee0cfd-023a-4636-a637-4af50e8a3dea req-a782027e-7d90-45fa-a415-6be0f903697f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133814 Sep 01 04:49:21.177136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 345/753] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:21.235841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:21.240771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:21.287610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:21.288102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:21.288530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:21.289245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:21.289693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:21.290109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:22.819838 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf8c2dbe-d34a-4064-8de1-f75043c06605 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 5.196347 Sep 01 04:49:22.830486 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 409/754] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:17 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 5203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:22.833733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:22.834589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:22.836671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:22.859521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:22.860229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:22.861895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:22.864928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:22.865578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:22.868806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:23.396778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:23.414048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:23.415664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:23.428112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2534b855-5892-42ea-9e29-a817d434fbcf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 2.248962 Sep 01 04:49:23.428752 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 346/755] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:21 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:23.794483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:23.807882 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-611e4a2d-b4f6-47bd-87f9-b041be6ac5eb tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1319 microversion: 2.1 time: 0.983253 Sep 01 04:49:23.813082 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 410/756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:22 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1319 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:23.837553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b441b26-2d86-4fbe-ba57-6bd326274837 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7601c8f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:23.947221 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b441b26-2d86-4fbe-ba57-6bd326274837 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.113528 Sep 01 04:49:23.948368 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 347/757] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:23 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:24.458749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:24.459357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:24.467489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:24.467979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:24.468413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:24.469118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:24.490380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:24.499385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:24.860957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:24.864366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:24.879741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:24.885971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:24.886826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:24.889604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:24.891705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:24.896522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:25.408826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:25.434919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:25.458263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:25.459729 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38ea49aa-a67e-442e-8cc8-5d8b1c5fc1d8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 1.005493 Sep 01 04:49:25.460638 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 411/758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:24 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:25.472278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd277b18-66ef-4491-89d1-6c6df2d46617 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bf24d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:25.595858 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd277b18-66ef-4491-89d1-6c6df2d46617 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.134036 Sep 01 04:49:25.597094 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 412/759] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:25 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:26.082495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:26.110846 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-140c8102-2dd1-465e-9a17-3e58e4615b97 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1468 microversion: 2.1 time: 1.260446 Sep 01 04:49:26.116703 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 348/760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:24 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1468 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:26.140477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:26.142515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:26.186600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1645129794", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "59c92b9b-a4b3-4189-97d1-ab9f2663410e"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:26.190727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:26.195831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:26.218128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:26.220292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:26.232576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:26.242058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:26.348473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] validate_networks() for [('59c92b9b-a4b3-4189-97d1-ab9f2663410e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:27.552850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:27.569200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74b9708f-0405-4535-87ec-f4634a0b2b6f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 200 len: 1469 microversion: 2.1 time: 1.428226 Sep 01 04:49:27.638814 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 349/761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:26 2022] GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 1469 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:27.977683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1975467702", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d85331bd-fb06-4841-92d7-0758031f2664"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:28.171964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] validate_networks() for [('d85331bd-fb06-4841-92d7-0758031f2664', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:29.673755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:29.682775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:29.683975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:29.684718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:29.687510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:29.708441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:29.710825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:29.711563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:29.714980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:29.739971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:29.740727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:29.808693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:29.832794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for user 6c067efaa01740ee9284a943d574f086 and project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:29.921530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:29.925457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:30.180590 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-302600ed-a6c5-4d9b-8e9b-a59ed5801f46 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.428859 Sep 01 04:49:30.184051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 413/762] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:49:30.192829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:30.195868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:30.202006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:30.202990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:30.204269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:30.205576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:30.206152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:30.234322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:30.236409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:30.237868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:30.238368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:30.239134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:30.239573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:30.244802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:30.245291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:30.247037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:30.247571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:30.248654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:30.252226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:30.325491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:30.350221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for user fcfdd4deb06b413d9585d204bd614e06 and project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:30.405775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:30.422798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:30.591613 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e26aff7-fef8-4b5b-addf-e53b164ee763 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.940891 Sep 01 04:49:30.595516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 350/763] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:49:30.610006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76dad9b7-df12-4dc7-b9d1-bf545712878b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7602083a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:30.736137 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76dad9b7-df12-4dc7-b9d1-bf545712878b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1455 microversion: 2.1 time: 0.136978 Sep 01 04:49:30.737089 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 351/764] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:30 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:30.759710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:30.781073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:30.784540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Searching by: {'reservation_id': 'r-8kc7bgrp', 'deleted': False, 'project_id': 'a917f0bb781a42879a605ffca90e436d'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:49:30.797196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:30.806195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:30.807052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:30.810641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:30.811581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:30.812214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:31.102926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:31.127525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:31.131867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:31.138088 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f025491d-22f2-407c-9df0-755b00a95bb7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 0.952675 Sep 01 04:49:31.143773 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 414/765] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:30 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:31.180243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7d32087-372c-4c4d-9922-8ed9998be935 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:31.180823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7d32087-372c-4c4d-9922-8ed9998be935 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:31.327840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:49:31.651586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7d32087-372c-4c4d-9922-8ed9998be935 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:31.665259 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7d32087-372c-4c4d-9922-8ed9998be935 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1211 microversion: 2.1 time: 0.507851 Sep 01 04:49:31.666149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 415/766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:31 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1211 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:31.706531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf97423b-a783-442c-91c5-51d4f2e2b18b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:31.716267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf97423b-a783-442c-91c5-51d4f2e2b18b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:31.792306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:31.835071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:31.840051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:31.844070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:32.248101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf97423b-a783-442c-91c5-51d4f2e2b18b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:32.270145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf97423b-a783-442c-91c5-51d4f2e2b18b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1208 microversion: 2.1 time: 0.574605 Sep 01 04:49:32.270787 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 416/767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:31 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1208 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:32.332943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28b38b69-68a3-4434-911e-4db4ea3c1b90 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bf24f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:32.864679 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5979a8f-f6d0-4c79-ad82-7b5f5429bd52 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-8kc7bgrp" status: 200 len: 2930 microversion: 2.1 time: 2.116829 Sep 01 04:49:32.865598 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 352/768] 10.222.0.26 () {58 vars in 1197 bytes} [Thu Sep 1 04:49:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8kc7bgrp => generated 2930 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:32.873616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:32.874231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:32.897115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:32.897625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:32.906951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:32.908659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:32.909158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:32.909598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:33.306202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:33.334211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:33.341940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:33.356726 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e33e759-30e1-4c79-9dda-9f205e207376 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 0.483336 Sep 01 04:49:33.359630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 353/769] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:32 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:33.366126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:33.394839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:33.451057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:33.453656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:33.455073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:33.471682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:33.473856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:33.474531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:33.768255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:33.785521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-994ce762-ee3c-4f6a-a874-a73846ef5be7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1271 microversion: 2.1 time: 0.415101 Sep 01 04:49:33.804888 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 354/770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:33 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1271 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:33.820964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31c7ed05-ce9c-4a4e-bb47-cd28e7b6942e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:33.897402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-31c7ed05-ce9c-4a4e-bb47-cd28e7b6942e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Querying cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) for 2 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 01 04:49:33.898125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31c7ed05-ce9c-4a4e-bb47-cd28e7b6942e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:33.901399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31c7ed05-ce9c-4a4e-bb47-cd28e7b6942e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:33.902031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31c7ed05-ce9c-4a4e-bb47-cd28e7b6942e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:33.974265 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31c7ed05-ce9c-4a4e-bb47-cd28e7b6942e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/f7f96ce1-feb2-4706-9f46-385e1a8cb15b" status: 200 len: 271 microversion: 2.1 time: 0.167713 Sep 01 04:49:33.980928 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 355/771] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:49:33 2022] GET /compute/v2.1/os-server-groups/f7f96ce1-feb2-4706-9f46-385e1a8cb15b => generated 271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:33.993604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:33.994431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:34.004106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:34.007898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:34.008486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:34.009983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:34.010569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:34.012934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:34.632597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:34.660636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1def66a6-0b8f-4f18-b5c4-c65c1a1ea167 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1260 microversion: 2.1 time: 0.672839 Sep 01 04:49:34.668508 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 356/772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:33 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1260 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:34.692405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:34.697803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:34.716156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:34.719597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:34.720310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:34.721277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:34.721949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:34.723051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:36.150951 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b414535d-5d87-41bf-a6be-5f823ed2938c tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 200 len: 1622 microversion: 2.1 time: 1.480824 Sep 01 04:49:36.151564 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 357/773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:34 2022] GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 1622 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:36.168886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:36.180115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:36.193567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:36.203808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:36.204536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:36.208279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:36.209079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:36.210762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:37.414548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:37.426466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:37.430272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:37.438749 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14c7ee7e-9387-464b-bca2-aa7ac6027a0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 1.282124 Sep 01 04:49:37.440160 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 358/774] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:36 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:37.447794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:37.454864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:37.466768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:37.467536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:37.468205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:37.471499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:37.472260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:37.475278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:38.057815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:38.075461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60eafff7-0489-4aee-80d1-171b05172080 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1311 microversion: 2.1 time: 0.633918 Sep 01 04:49:38.079504 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 359/775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:37 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1311 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:38.085997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:38.086956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:38.096962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:38.097832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:38.106537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:38.111600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:38.112242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:38.112816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:38.120351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:38.367674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:38.377711 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25fdeea3-8397-4393-a7d9-2a44a95c2846 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 0.296282 Sep 01 04:49:38.378948 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 360/776] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:38 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:38.405322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:38.407594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:38.422918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:38.423655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:38.424615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:38.427134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:38.434741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:38.435562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:38.847531 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cd6e23f-94f0-4a58-84d6-5561953979d6 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 200 len: 1621 microversion: 2.1 time: 0.445384 Sep 01 04:49:38.848413 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 361/777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:38 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 1621 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:38.857552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8f1ea6d5-1a63-403a-b912-f67b43178721 req-7af0e627-1dbf-454f-a357-3516d30f063b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90982816-19d1-448f-bd4a-7cda5aab3e2a", "name": "network-vif-plugged", "status": "completed", "tag": "30294c27-aeaa-49f8-874e-b14aeb855c61"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:38.900980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8f1ea6d5-1a63-403a-b912-f67b43178721 req-7af0e627-1dbf-454f-a357-3516d30f063b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:38.911204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8f1ea6d5-1a63-403a-b912-f67b43178721 req-7af0e627-1dbf-454f-a357-3516d30f063b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:38.911842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8f1ea6d5-1a63-403a-b912-f67b43178721 req-7af0e627-1dbf-454f-a357-3516d30f063b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:38.949589 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8f1ea6d5-1a63-403a-b912-f67b43178721 req-7af0e627-1dbf-454f-a357-3516d30f063b service nova] Creating event network-vif-plugged:30294c27-aeaa-49f8-874e-b14aeb855c61 for instance 90982816-19d1-448f-bd4a-7cda5aab3e2a on n-h1-820368-37 Sep 01 04:49:38.960103 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8f1ea6d5-1a63-403a-b912-f67b43178721 req-7af0e627-1dbf-454f-a357-3516d30f063b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110411 Sep 01 04:49:38.963231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 362/778] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:38.975033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bd5bc0b7-6e0b-4d36-a826-452f3a9d85eb req-2c07181b-b6b5-42ab-803c-e7d0eb0e0086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66d0bed-10fc-4364-a359-3a67b537dca5", "tag": "fbeca0e3-8257-4bb7-accb-1ba5f853687d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:39.024766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bd5bc0b7-6e0b-4d36-a826-452f3a9d85eb req-2c07181b-b6b5-42ab-803c-e7d0eb0e0086 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:39.025327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bd5bc0b7-6e0b-4d36-a826-452f3a9d85eb req-2c07181b-b6b5-42ab-803c-e7d0eb0e0086 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:39.025990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bd5bc0b7-6e0b-4d36-a826-452f3a9d85eb req-2c07181b-b6b5-42ab-803c-e7d0eb0e0086 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:39.055788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bd5bc0b7-6e0b-4d36-a826-452f3a9d85eb req-2c07181b-b6b5-42ab-803c-e7d0eb0e0086 service nova] Creating event network-changed:fbeca0e3-8257-4bb7-accb-1ba5f853687d for instance a66d0bed-10fc-4364-a359-3a67b537dca5 on n-h2-820368-37 Sep 01 04:49:39.070067 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bd5bc0b7-6e0b-4d36-a826-452f3a9d85eb req-2c07181b-b6b5-42ab-803c-e7d0eb0e0086 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105521 Sep 01 04:49:39.072816 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 363/779] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:39.083515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:39.093659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:39.118779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:39.119602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:39.120208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:39.121104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:39.121855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:39.122807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:39.763662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:39.930660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:39.950616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:39.957958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:39.984959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f302014-2de8-4682-b409-0951c16f5fd8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1411 microversion: 2.25 time: 0.883847 Sep 01 04:49:39.990753 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 364/780] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:39 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1411 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:40.024825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:40.029327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:40.056716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:40.059805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:40.067917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:40.077523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:40.078248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:40.081116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:40.512309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:40.529612 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b6b57df-0fc2-494f-8b46-15a0f07a38a1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1311 microversion: 2.1 time: 0.531246 Sep 01 04:49:40.530702 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 365/781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:39 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1311 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:40.540698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-242234121", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "e2eda1a9-f765-416e-843a-a16925ec4c08"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:41.019751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:41.116376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=45 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:41.779996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:41.781046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:42.254242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:45.152356 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28b38b69-68a3-4434-911e-4db4ea3c1b90 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1464 microversion: 2.1 time: 12.858790 Sep 01 04:49:45.154656 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 417/782] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:32 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1464 bytes in 12883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:45.171980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:45.176624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:45.191663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:45.192294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:45.192691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:45.193311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:45.194201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:45.194832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:45.195485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:45.858795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:45.869919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-558e2d46-94d5-470f-a037-252b548eaf8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 0.713860 Sep 01 04:49:45.870772 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 418/783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:45 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:45.877925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:45.884522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:45.894604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:45.895541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:45.896164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:45.905478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:45.906210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:45.906846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.063313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:46.064789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:46.065473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:46.066045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:46.066611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:46.072914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:46.092840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.093617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.095005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.099274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.099996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.100585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.153167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:46.163464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:46.194820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:46.203686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:46.226489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:46.242196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:46.245426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:46.252266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-573d5f34-6088-4a3f-9511-5bed12ea9d33 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1607 microversion: 2.25 time: 0.379589 Sep 01 04:49:46.258333 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 419/784] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:49:45 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1607 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:49:46.272450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5a886de8-37f4-4f15-9dcd-429c2ac16c02 req-eae6e2ff-da18-4b92-be95-01482b351886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c6db0a-5d7e-4421-898b-2b390a63fac6", "tag": "c6366995-3ffc-4d77-be2f-8cbbbef5bfdf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:46.279558 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46125048-c748-4ade-8dca-c72c9ee48fed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.746814 Sep 01 04:49:46.280452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 366/785] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:49:46.287411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:46.288341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:46.298516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.299374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.300091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.300985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.301665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.303196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.322583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a886de8-37f4-4f15-9dcd-429c2ac16c02 req-eae6e2ff-da18-4b92-be95-01482b351886 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.329926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a886de8-37f4-4f15-9dcd-429c2ac16c02 req-eae6e2ff-da18-4b92-be95-01482b351886 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.332666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a886de8-37f4-4f15-9dcd-429c2ac16c02 req-eae6e2ff-da18-4b92-be95-01482b351886 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.362309 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5a886de8-37f4-4f15-9dcd-429c2ac16c02 req-eae6e2ff-da18-4b92-be95-01482b351886 service nova] Creating event network-changed:c6366995-3ffc-4d77-be2f-8cbbbef5bfdf for instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 on n-h2-820368-37 Sep 01 04:49:46.433576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5a886de8-37f4-4f15-9dcd-429c2ac16c02 req-eae6e2ff-da18-4b92-be95-01482b351886 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172257 Sep 01 04:49:46.434848 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 420/786] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:46.441202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ed80af1-06aa-4552-8e94-c81aee825207 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bfc0820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:46.532565 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ed80af1-06aa-4552-8e94-c81aee825207 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 200 len: 1464 microversion: 2.1 time: 0.095999 Sep 01 04:49:46.535824 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 421/787] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:46 2022] GET /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 1464 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:46.555223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:46.556506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:46.557136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:46.578578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.584554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.585235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.586591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.586849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74d9d6e4-823c-4dcc-98f1-faa82324c593 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1311 microversion: 2.1 time: 0.304002 Sep 01 04:49:46.587434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.600010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.600772 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 367/788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:46 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1311 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:46.612089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38cd60d1-5b3d-4fd9-a5f3-717c9c4a006d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:46.612827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38cd60d1-5b3d-4fd9-a5f3-717c9c4a006d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:46.830681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f7591e5-3a0a-4b9b-b39c-5b10acf80641 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.293320 Sep 01 04:49:46.839019 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 422/789] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 04:49:46 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:49:46.839019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:46.840424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:46.860761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.862547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.863307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.864789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.867738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.869221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.886498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38cd60d1-5b3d-4fd9-a5f3-717c9c4a006d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:46.914518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38cd60d1-5b3d-4fd9-a5f3-717c9c4a006d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1216 microversion: 2.1 time: 0.319942 Sep 01 04:49:46.917102 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 368/790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:46 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1216 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:46.930652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:46.930983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:46.958751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.962876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.963358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:46.964099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:46.964557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:46.964981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:48.467153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:48.475393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:48.477557 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a7a3cd0-6ab5-4624-8687-a8fbd20a770f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 1.559103 Sep 01 04:49:48.492276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 369/791] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:46 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:48.498436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c88de06b-b39c-4358-b1b2-19a0239767b4 req-7e448efa-6a66-46d4-b494-696584e0c4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66d0bed-10fc-4364-a359-3a67b537dca5", "name": "network-vif-plugged", "status": "completed", "tag": "fbeca0e3-8257-4bb7-accb-1ba5f853687d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:48.505470 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6663f9cb-d432-4978-9182-f066b38b7753 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1467 microversion: 2.1 time: 1.663736 Sep 01 04:49:48.506449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 423/792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:46 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1467 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:48.510931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c88de06b-b39c-4358-b1b2-19a0239767b4 req-7e448efa-6a66-46d4-b494-696584e0c4ad service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:48.511632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c88de06b-b39c-4358-b1b2-19a0239767b4 req-7e448efa-6a66-46d4-b494-696584e0c4ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:48.512618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c88de06b-b39c-4358-b1b2-19a0239767b4 req-7e448efa-6a66-46d4-b494-696584e0c4ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:48.522255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:48.525083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:48.527251 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c88de06b-b39c-4358-b1b2-19a0239767b4 req-7e448efa-6a66-46d4-b494-696584e0c4ad service nova] Creating event network-vif-plugged:fbeca0e3-8257-4bb7-accb-1ba5f853687d for instance a66d0bed-10fc-4364-a359-3a67b537dca5 on n-h2-820368-37 Sep 01 04:49:48.541094 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c88de06b-b39c-4358-b1b2-19a0239767b4 req-7e448efa-6a66-46d4-b494-696584e0c4ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047167 Sep 01 04:49:48.547395 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 370/793] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:48.548098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:48.548625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:48.549062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:48.549786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:48.553082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:48.553588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:48.554952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:48.555802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:48.562591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:48.565519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:48.566347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:48.567299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:48.567909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:48.568474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:48.728127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:48.738045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7115702b-295a-463b-b2e8-8bc6d2adfdb7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1268 microversion: 2.1 time: 0.188118 Sep 01 04:49:48.743270 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 371/794] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:48 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:48.768560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6d99e79-6686-44cd-b722-86b8343c4885 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600e7e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.016941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6d99e79-6686-44cd-b722-86b8343c4885 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?changes-since=2022-09-01T04%3A47%3A07Z" status: 200 len: 2329 microversion: 2.1 time: 0.269207 Sep 01 04:49:49.016941 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 372/795] 10.222.0.26 () {58 vars in 1199 bytes} [Thu Sep 1 04:49:48 2022] GET /compute/v2.1/images?changes-since=2022-09-01T04%3A47%3A07Z => generated 2329 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:49.029724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-690edf84-6e0b-46ac-bd45-d93c77146526 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760207b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.183721 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-690edf84-6e0b-46ac-bd45-d93c77146526 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-65210179" status: 200 len: 483 microversion: 2.1 time: 0.158105 Sep 01 04:49:49.192265 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 373/796] 10.222.0.26 () {58 vars in 1227 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-65210179 => generated 483 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:49.197807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-652078a0-1200-4a1b-8bdd-aa166f577f77 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600e0310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.347823 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-652078a0-1200-4a1b-8bdd-aa166f577f77 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?server=d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 958 microversion: 2.1 time: 0.154102 Sep 01 04:49:49.350552 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 374/797] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/images?server=d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 958 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:49.365230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a275ddd7-988e-4671-81b3-0605b7055c47 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa76009a670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.449029 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a275ddd7-988e-4671-81b3-0605b7055c47 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 485 microversion: 2.1 time: 0.088123 Sep 01 04:49:49.449909 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 375/798] 10.222.0.26 () {58 vars in 1317 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 485 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:49.464688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9725ca0-1f00-454c-b816-c64b98bf9689 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7601c8c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.514620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:49.524220 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67db25b2-acd4-4f5a-b03c-efae0b13ee80 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1311 microversion: 2.1 time: 1.016523 Sep 01 04:49:49.527752 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 424/799] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:48 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1311 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:49.543232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.545830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:49.562853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:49.563896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:49.564815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:49.567828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:49.568749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:49.571975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:49.585388 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9725ca0-1f00-454c-b816-c64b98bf9689 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 485 microversion: 2.1 time: 0.126192 Sep 01 04:49:49.586327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 376/800] 10.222.0.26 () {58 vars in 1303 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 485 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:49.603444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56ac5daa-c60b-4255-af39-ecd586f1fd72 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760088dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:49.972512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:49.984037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91a2a68b-5874-4cc6-b7d1-f73836ed1d86 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 0.454298 Sep 01 04:49:49.987037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 425/801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:50.009908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.016049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:50.032133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:50.035190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56ac5daa-c60b-4255-af39-ecd586f1fd72 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.438610 Sep 01 04:49:50.037858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:50.038322 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 377/802] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:50.047082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:50.048188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:50.050225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:50.050788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:50.058478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c0c9b01c-da1d-44d5-b27e-5f39d4143634 req-1ebffe59-b2d4-4594-ba90-78b8604c7076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90982816-19d1-448f-bd4a-7cda5aab3e2a", "tag": "30294c27-aeaa-49f8-874e-b14aeb855c61"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:50.091388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c0c9b01c-da1d-44d5-b27e-5f39d4143634 req-1ebffe59-b2d4-4594-ba90-78b8604c7076 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:50.098252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c0c9b01c-da1d-44d5-b27e-5f39d4143634 req-1ebffe59-b2d4-4594-ba90-78b8604c7076 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:50.098838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c0c9b01c-da1d-44d5-b27e-5f39d4143634 req-1ebffe59-b2d4-4594-ba90-78b8604c7076 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:50.138569 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c0c9b01c-da1d-44d5-b27e-5f39d4143634 req-1ebffe59-b2d4-4594-ba90-78b8604c7076 service nova] Creating event network-changed:30294c27-aeaa-49f8-874e-b14aeb855c61 for instance 90982816-19d1-448f-bd4a-7cda5aab3e2a on n-h1-820368-37 Sep 01 04:49:50.159152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c0c9b01c-da1d-44d5-b27e-5f39d4143634 req-1ebffe59-b2d4-4594-ba90-78b8604c7076 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114460 Sep 01 04:49:50.160185 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 378/803] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:50.172627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fba380f-980c-4ce0-bd1f-ae816485b527 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760088a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.351679 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fba380f-980c-4ce0-bd1f-ae816485b527 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.186846 Sep 01 04:49:50.354305 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 379/804] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 04:49:50 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:50.382874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de71035f-2419-42a8-a6ec-20d6f09c334f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7603f3820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.460235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:50.480914 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28c0047c-549b-4080-817b-65847b926c34 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.483832 Sep 01 04:49:50.499569 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 426/805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:49 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:50.527828 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de71035f-2419-42a8-a6ec-20d6f09c334f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.162548 Sep 01 04:49:50.528474 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 380/806] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:49:50 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:50.544944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe694dba-6f0c-47ff-bfe1-fcac0f71ed8c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bfc09d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.569465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.570923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:50.585684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:50.587027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:50.589746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:50.591460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:50.592097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:50.595716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:50.752124 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe694dba-6f0c-47ff-bfe1-fcac0f71ed8c tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?changes-since=2022-09-01T04%3A47%3A00Z" status: 200 len: 7012 microversion: 2.1 time: 0.211357 Sep 01 04:49:50.755961 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 427/807] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Sep 1 04:49:50 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-01T04%3A47%3A00Z => generated 7012 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:50.777878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3df2ef58-7a25-4915-85c7-bb32f68898c0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760056040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.873282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3df2ef58-7a25-4915-85c7-bb32f68898c0 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-65210179" status: 200 len: 663 microversion: 2.1 time: 0.100399 Sep 01 04:49:50.876545 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 428/808] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 04:49:50 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-65210179 => generated 663 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:50.890567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d3c8b0f-e308-4f43-ab4b-356616ac0f19 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7605fedc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:50.985213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:51.020766 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11ebebb3-bcae-48b9-8c62-06dc5e6f3dac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1311 microversion: 2.1 time: 0.467523 Sep 01 04:49:51.032525 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 381/809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:50 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1311 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:51.033148 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d3c8b0f-e308-4f43-ab4b-356616ac0f19 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1467 microversion: 2.1 time: 0.145818 Sep 01 04:49:51.035042 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 429/810] 10.222.0.26 () {58 vars in 1338 bytes} [Thu Sep 1 04:49:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1467 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:51.039491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.040099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:51.053147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:51.054739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:51.055317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:51.056179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:51.056704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:51.057310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:51.067637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44e960ab-47cb-4adf-802a-4d0658deca7b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bfc0af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.161629 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44e960ab-47cb-4adf-802a-4d0658deca7b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1467 microversion: 2.1 time: 0.115330 Sep 01 04:49:51.162327 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 430/811] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1467 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:51.178282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5ef8a28-a4b2-40ca-acbd-59fc9b8879fc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bf26e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.296082 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5ef8a28-a4b2-40ca-acbd-59fc9b8879fc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.121430 Sep 01 04:49:51.312098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 431/812] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:51.319780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a78b387-c183-498c-a422-16532e6d3067 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600568b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.400203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a78b387-c183-498c-a422-16532e6d3067 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.085094 Sep 01 04:49:51.412546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:51.413293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de876ea1-790d-4a40-adfc-dff20731b213 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 0.379666 Sep 01 04:49:51.413699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 432/813] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:51.418194 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 382/814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:51.419843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4926e506-6c93-44ad-bf35-8d5746397f42 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bfc0ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.472498 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4926e506-6c93-44ad-bf35-8d5746397f42 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/a6ef865c-7f44-4aad-804f-11f5772882db" status: 200 len: 784 microversion: 2.1 time: 0.057207 Sep 01 04:49:51.483270 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 433/815] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/images/a6ef865c-7f44-4aad-804f-11f5772882db => generated 784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:51.489093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cdd320e-0be5-429a-8d61-eee6fdbbc928 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760207550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.522984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.522984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:51.542377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:51.543194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:51.543750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:51.544651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:51.545244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:51.545860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:51.573348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cdd320e-0be5-429a-8d61-eee6fdbbc928 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 835 microversion: 2.1 time: 0.088860 Sep 01 04:49:51.573935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 383/816] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/images/detail?limit=1 => generated 835 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:49:51.593229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29614c0c-df60-4b14-9e95-67f1de9decd6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7600cb3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:51.791166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:51.814168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f94429c2-7209-472e-b9c1-841b26a9fe66 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.296677 Sep 01 04:49:51.836803 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 434/817] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:51 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:51.843375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-81322bc3-f382-468d-98ef-3d163c1e8d5a req-38bd1aed-2aba-46b2-8714-056066f463fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c6db0a-5d7e-4421-898b-2b390a63fac6", "name": "network-vif-plugged", "status": "completed", "tag": "c6366995-3ffc-4d77-be2f-8cbbbef5bfdf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:51.855744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-81322bc3-f382-468d-98ef-3d163c1e8d5a req-38bd1aed-2aba-46b2-8714-056066f463fe service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:51.856408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-81322bc3-f382-468d-98ef-3d163c1e8d5a req-38bd1aed-2aba-46b2-8714-056066f463fe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:51.857017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-81322bc3-f382-468d-98ef-3d163c1e8d5a req-38bd1aed-2aba-46b2-8714-056066f463fe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:51.881896 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-81322bc3-f382-468d-98ef-3d163c1e8d5a req-38bd1aed-2aba-46b2-8714-056066f463fe service nova] Creating event network-vif-plugged:c6366995-3ffc-4d77-be2f-8cbbbef5bfdf for instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 on n-h2-820368-37 Sep 01 04:49:51.892789 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-81322bc3-f382-468d-98ef-3d163c1e8d5a req-38bd1aed-2aba-46b2-8714-056066f463fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054590 Sep 01 04:49:51.893420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 435/818] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:52.046935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:52.047926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:52.061675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.064839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.069453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:52.070500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.071271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.071957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:52.402480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:52.413572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-943c3a51-121b-4aae-afa4-fd7fad8878d6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1495 microversion: 2.1 time: 0.373078 Sep 01 04:49:52.414173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 436/819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:52 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:52.441409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:52.442285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:52.469145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.470469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.471208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:52.472307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.473260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.474552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:52.590079 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29614c0c-df60-4b14-9e95-67f1de9decd6 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad" status: 204 len: 0 microversion: 2.1 time: 1.001667 Sep 01 04:49:52.590927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 384/820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:51 2022] DELETE /compute/v2.1/images/c61deddd-82f8-4a21-8cfa-a6ff5c576bad => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:49:52.682605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:52.683282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:52.711103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.711474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.711916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:52.712668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.713123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.713550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:52.715371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:52.725217 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7359920-fae8-4252-935a-76b8e422ce84 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 0.291178 Sep 01 04:49:52.740514 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 437/821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:52 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:52.745365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5c67632-3e23-4f8f-8f19-a400e81c8cff tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa75bf26c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:52.928343 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f6b850a-d662-4134-a376-2b4cfa5eb3ef tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1648 microversion: 2.1 time: 0.336206 Sep 01 04:49:52.946265 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 385/822] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:52 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1648 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:52.957964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:52.958574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:52.991535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:52.992391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:52.992989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.006099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.006952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.008355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.256230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:53.266223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04731838-fc3c-4620-8fd9-1d71f005de73 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.317890 Sep 01 04:49:53.267476 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 386/823] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:52 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:53.279276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:53.280363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:53.308058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.308551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.308999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.309799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.310295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.310685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.605787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a86966ba-7b5a-4d49-ab02-5d90f1a1cd41 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1648 microversion: 2.1 time: 0.336251 Sep 01 04:49:53.606599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 387/824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:53 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1648 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:53.632371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:53.636951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.637653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.638276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.639270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.639911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.640419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.677662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-129dee0f-463b-4a3b-b7ec-28d3862cf455 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.052789 Sep 01 04:49:53.678764 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 388/825] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:49:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:53.700973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-37", "block_migration": true, "disk_over_commit": false}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:53.705325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:53.715888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.716714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.717342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.719187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.721440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.722132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.788845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lazy-loading 'flavor' on Instance uuid a66d0bed-10fc-4364-a359-3a67b537dca5 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:49:53.806620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Going to try to live migrate instance to n-h1-820368-37 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:49:53.821296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5c67632-3e23-4f8f-8f19-a400e81c8cff tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec" status: 204 len: 0 microversion: 2.1 time: 1.079806 Sep 01 04:49:53.826181 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 438/826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:52 2022] DELETE /compute/v2.1/images/d0c2d78b-3c7e-4ca1-87e4-801f5a9decec => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:49:53.832645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:53.834007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:53.851703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.852486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.857196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.858324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:53.859017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:53.860423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:53.992577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:54.105681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:54.115729 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36c14d0f-24e6-4f72-b9f7-949bb18b1e19 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1308 microversion: 2.1 time: 0.287831 Sep 01 04:49:54.130717 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 439/827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:53 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:54.143426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996e9172-ee1c-416b-9042-7bbe43cae42a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7605fe310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:55.181215 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-996e9172-ee1c-416b-9042-7bbe43cae42a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b" status: 204 len: 0 microversion: 2.1 time: 1.042767 Sep 01 04:49:55.181804 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 440/828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:54 2022] DELETE /compute/v2.1/images/b8a163d7-2cb7-45b9-81dd-bf9701a1e65b => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:49:55.186700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3346789d-740b-4ae1-956f-d5dc8067ba09 req-7dbd452f-a36d-488c-b945-3665a5663db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "name": "network-vif-unplugged", "status": "completed", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:55.197208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3346789d-740b-4ae1-956f-d5dc8067ba09 req-7dbd452f-a36d-488c-b945-3665a5663db0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.197947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3346789d-740b-4ae1-956f-d5dc8067ba09 req-7dbd452f-a36d-488c-b945-3665a5663db0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.198617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3346789d-740b-4ae1-956f-d5dc8067ba09 req-7dbd452f-a36d-488c-b945-3665a5663db0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.212064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3346789d-740b-4ae1-956f-d5dc8067ba09 req-7dbd452f-a36d-488c-b945-3665a5663db0 service nova] Creating event network-vif-unplugged:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:49:55.219224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3346789d-740b-4ae1-956f-d5dc8067ba09 req-7dbd452f-a36d-488c-b945-3665a5663db0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035193 Sep 01 04:49:55.220119 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 441/829] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:55.229064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:55.230060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:55.238382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.239186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.239859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.240964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.241777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.242524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.420081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:55.428930 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab0e7bd3-49c9-44be-a9b8-15623f33c8d2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.204211 Sep 01 04:49:55.429735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 442/830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:55 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:55.435058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-32ca8052-e21e-40ae-92ff-1130eb810923 req-50508a51-a4a8-4349-a5a7-6cebbafd00be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ab2aaef-db86-4580-8099-fa33d9244919", "tag": "b62a06ba-4246-49bc-8430-ee36a9926b18"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:55.444961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-32ca8052-e21e-40ae-92ff-1130eb810923 req-50508a51-a4a8-4349-a5a7-6cebbafd00be service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.445439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-32ca8052-e21e-40ae-92ff-1130eb810923 req-50508a51-a4a8-4349-a5a7-6cebbafd00be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.445982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-32ca8052-e21e-40ae-92ff-1130eb810923 req-50508a51-a4a8-4349-a5a7-6cebbafd00be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.457944 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-32ca8052-e21e-40ae-92ff-1130eb810923 req-50508a51-a4a8-4349-a5a7-6cebbafd00be service nova] Creating event network-changed:b62a06ba-4246-49bc-8430-ee36a9926b18 for instance 5ab2aaef-db86-4580-8099-fa33d9244919 on n-h2-820368-37 Sep 01 04:49:55.463580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-32ca8052-e21e-40ae-92ff-1130eb810923 req-50508a51-a4a8-4349-a5a7-6cebbafd00be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031955 Sep 01 04:49:55.464624 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 443/831] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:55.534615 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5aacde38-d68a-4328-8128-7bb2e370f104 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5/action" status: 202 len: 0 microversion: 2.1 time: 1.847683 Sep 01 04:49:55.536617 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 389/832] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:49:53 2022] POST /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5/action => generated 0 bytes in 1850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:49:55.545280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:55.546004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:55.554997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.555775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.556436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.557317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.557960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.558369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.589962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-368346ce-ef61-4852-8570-447568f5f9af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Action: 'create', calling method: .version_select at 0x7fa7601faa60>, body: {"keypair": {"name": "tempest-keypair-1017395731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB2xzBWl/Lw6g/94JmfnG9MXFgidBv7HM/trV5DJCetvRoHcIjXmue5QnLhChBWNbnlhIW+Vw/R85zXjivIVnXKPjCEBZKTkoxoqOcFLtgS4d9WSaZrw5B+V2rah8J9bA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:55.607527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-368346ce-ef61-4852-8570-447568f5f9af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Getting quotas for project c55b43bf6a8240428ac269fbe2d10db3. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:55.612780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-368346ce-ef61-4852-8570-447568f5f9af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Getting quotas for user 5f10e75ab3564762b0fcc3f712f62cd7 and project c55b43bf6a8240428ac269fbe2d10db3. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:55.640244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-368346ce-ef61-4852-8570-447568f5f9af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174722 Sep 01 04:49:55.641306 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 444/833] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:49:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:49:55.651790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:55.652768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:55.660838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.661331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.661946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.662651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.663341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.663980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.697626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:49:55.769910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:55.777911 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a082b08f-64f2-43cf-903a-8d650d0d05cd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1487 microversion: 2.1 time: 0.237874 Sep 01 04:49:55.778486 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 390/834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:55 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1487 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:55.783192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:55.784124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:55.798683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.799460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.800147 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-efdb6e7f-6754-4c0e-bf91-2778fc4c960d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 204 len: 0 microversion: 2.1 time: 0.157295 Sep 01 04:49:55.800382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.801089 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 445/835] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:49:55 2022] DELETE /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:49:55.801695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.802294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.802857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.808691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:55.809427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:55.817105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.817895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.818550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.819737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.820521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.821195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.880393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:55.934328 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04b604ea-5437-4826-b0dd-70350a42f9f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6/action" status: 202 len: 0 microversion: 2.1 time: 0.131430 Sep 01 04:49:55.935410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 446/836] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:49:55 2022] POST /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:49:55.941604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:55.942402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:55.949344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.949933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.950430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:55.951248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:55.951839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:55.952328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:56.337649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:56.341249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:56.357697 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21a0ca3b-bec7-4303-9fdc-53c91863698d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.578129 Sep 01 04:49:56.357955 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99245cce-2b64-449b-baa9-125360aecea1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1472 microversion: 2.1 time: 0.421023 Sep 01 04:49:56.358763 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 391/837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:55 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:56.358906 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 447/838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:55 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:56.367763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:56.368688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:56.377009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:56.377493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:56.377920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:56.378618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:56.379089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:56.379502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:56.450312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:56.451161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:56.457993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:56.459008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:56.459450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:56.460154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:56.460604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:56.461027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:56.570225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:56.580801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70d2cede-846f-4e97-ad83-2722094697ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1492 microversion: 2.1 time: 0.220805 Sep 01 04:49:56.581399 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 448/839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:56 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1492 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:56.654197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:56.667060 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3f67c7b-4966-47a8-856c-e22d8e58d4b3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.219248 Sep 01 04:49:56.682166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 392/840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:56 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:49:57.086077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:57.086620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:57.093375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:57.094840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:57.095467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:57.096617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:57.097255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:57.097828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:57.132361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:49:57.232287 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2367824-8b7f-42c1-9c43-351bdb7ed45a tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 204 len: 0 microversion: 2.1 time: 0.151448 Sep 01 04:49:57.232887 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 449/841] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:49:57 2022] DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:49:57.364912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-968944610", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "1608081223", "adminPass": "***", "networks": [{"uuid": "f37313c1-b941-40ce-9d59-af3b4f43452f"}], "security_groups": [{"name": "tempest-securitygroup--1052445457"}], "key_name": "tempest-keypair-768765177", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:57.378595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:57.381859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:57.382608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:57.390584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:57.391479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:57.391905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:57.392798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:57.393435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:57.394033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:57.623917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] validate_networks() for [('f37313c1-b941-40ce-9d59-af3b4f43452f', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:57.725550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:57.734638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92507e64-d870-4e1d-ab68-2ea96b3680ef tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1472 microversion: 2.1 time: 0.357250 Sep 01 04:49:57.748145 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 450/842] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:57 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:57.755861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:57.762937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:57.770011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:57.770807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:57.771490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:57.772778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:57.773245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:57.773668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.027000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:58.036420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-990b4ac1-c926-4af8-b377-5cdb84d7afd4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.286846 Sep 01 04:49:58.037133 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 451/843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:57 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:58.044747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:58.045360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:58.062687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:58.063452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:58.064670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.065481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:58.066038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:58.066461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.238040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:58.238602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:58.239378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:58.239891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:58.240377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:58.250718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:58.251729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:58.252232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.253068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:58.253630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:58.254272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.271128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:58.274648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Getting quotas for project 2827829d3ee04a6f8037be7c021a17f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:58.279488 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1748f6b3-0e99-4fa1-8cb9-733b3c89e5e4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1492 microversion: 2.1 time: 0.241170 Sep 01 04:49:58.279935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Getting quotas for user 5d938ea24d3a4098bb7b932057afb841 and project 2827829d3ee04a6f8037be7c021a17f0. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:58.280258 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 452/844] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:58 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1492 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:58.285916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:58.286508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:58.294011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:58.294498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:58.294953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.295815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:58.296265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:58.296680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:58.302380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:58.305022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:58.361726 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9be99ea9-decf-4639-9577-e5c22c8d68d2 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.003419 Sep 01 04:49:58.363819 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 393/845] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:49:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:49:58.371353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-806926502", "imageRef": "8839eed8-9e71-49ac-89eb-a750acd8cd5b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f558454e-e00d-4f4e-b0c9-a23b775728bb"}], "security_groups": [{"name": "tempest-securitygroup--2143142645"}], "key_name": "tempest-keypair-1017395731", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:58.444456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:58.453412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6cc770cf-53d5-499d-8c11-b36e54090b39 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.171687 Sep 01 04:49:58.454241 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 453/846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:58 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:58.459367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e100b795-a1e8-4f54-b9f2-4de768ea7189 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:58.460399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e100b795-a1e8-4f54-b9f2-4de768ea7189 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:58.529379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e100b795-a1e8-4f54-b9f2-4de768ea7189 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:58.539167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e100b795-a1e8-4f54-b9f2-4de768ea7189 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1263 microversion: 2.1 time: 0.083378 Sep 01 04:49:58.539756 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 454/847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:58 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:58.541449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] validate_networks() for [('f558454e-e00d-4f4e-b0c9-a23b775728bb', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:58.689081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-274660615", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:49:58.746739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:49:59.108474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:59.108970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:59.109468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:59.109902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:59.110331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:59.136209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.137069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.137759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.138972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.139617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.140231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.151594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:49:59.152168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:49:59.152956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:49:59.153494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:49:59.154162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:49:59.162008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Getting quotas for project 747b081cee084466bbfc7580e4814a35. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:59.167592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.168153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Getting quotas for user 3fdd9d166a1b486f90483a3b25e4ad11 and project 747b081cee084466bbfc7580e4814a35. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:59.168930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.169975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.171498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.172651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.173838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.182372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:59.184852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:59.201633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Getting quotas for project c55b43bf6a8240428ac269fbe2d10db3. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:49:59.208631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Getting quotas for user 5f10e75ab3564762b0fcc3f712f62cd7 and project c55b43bf6a8240428ac269fbe2d10db3. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:49:59.226995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:49:59.230407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8839eed8-9e71-49ac-89eb-a750acd8cd5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:49:59.237839 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13d03330-6f3c-42ca-a4d8-fb7566096542 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697011 Sep 01 04:49:59.239510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 455/848] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:49:59.244515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.245140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:59.254446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.255118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.255741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.257214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.257891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.258934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.317968 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1974d896-2e2f-498f-81f9-3884ee54ecd4 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.952276 Sep 01 04:49:59.332166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 394/849] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:49:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:49:59.340251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.340899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:59.350545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.351341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.361262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.362498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.364366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.364968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.523336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:59.549784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7278332-417a-4c7c-bae9-345fbff1315a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1472 microversion: 2.1 time: 0.309123 Sep 01 04:49:59.555852 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 456/850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:59.568486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-573584c1-c9b0-4b70-9918-e6a668588a9d tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.569096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-573584c1-c9b0-4b70-9918-e6a668588a9d tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:59.590738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:49:59.622866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:59.633609 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d57b877f-2934-48d0-ab8b-52833f0b7222 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.305336 Sep 01 04:49:59.634453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 395/851] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:59.673935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.675066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:59.677147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-573584c1-c9b0-4b70-9918-e6a668588a9d tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:59.686876 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-573584c1-c9b0-4b70-9918-e6a668588a9d tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1222 microversion: 2.1 time: 0.127765 Sep 01 04:49:59.687936 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 457/852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:59.701931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.702481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.702966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.705075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.705695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.706217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.706970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a92d764f-41aa-402b-bd33-86218d8d7586 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.707841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a92d764f-41aa-402b-bd33-86218d8d7586 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:59.817446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a92d764f-41aa-402b-bd33-86218d8d7586 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:59.832423 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a92d764f-41aa-402b-bd33-86218d8d7586 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1245 microversion: 2.1 time: 0.131234 Sep 01 04:49:59.835184 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 458/853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1245 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:59.848099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.849133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:49:59.865933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.866534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.869796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.870961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:49:59.871530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:49:59.871974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:49:59.966734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:49:59.976685 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4b50d50-f893-41e8-9874-10c0f5dc753a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1492 microversion: 2.1 time: 0.324015 Sep 01 04:49:59.979745 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 396/854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1492 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:49:59.990455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:49:59.993072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:00.007521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.008219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.009916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.017899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.018647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.019138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.122725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:00.138940 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92f2e82b-e27f-4fc8-92a7-370189fc958e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.301628 Sep 01 04:50:00.140317 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 459/855] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:00.168222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:00.186466 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf814cdd-a27c-4e13-955d-21b99ba999bc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1323 microversion: 2.1 time: 0.205277 Sep 01 04:50:00.187401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 397/856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:49:59 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:00.581103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:00.582660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:00.607366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.608060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.608713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.610355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.611299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.611876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.664305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:00.669098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:00.687390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.699674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.700123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.700881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.701328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.701745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.831482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:00.841081 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d57526af-11fa-4578-9e38-10927e9ee780 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1472 microversion: 2.1 time: 0.266493 Sep 01 04:50:00.848382 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 460/857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:00 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:00.854386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:00.855028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:00.863606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.864340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.865049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.866444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:00.867098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:00.867685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:00.938734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:00.954200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:00.959486 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41a9ade5-56b6-40e3-b06a-248ce65133ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.303977 Sep 01 04:50:00.960685 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 398/858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:00 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:00.976584 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b44d825e-714f-4da4-af24-4c937838b5ed tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1274 microversion: 2.1 time: 0.126045 Sep 01 04:50:00.977197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 461/859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:00 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:00.988859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:00.989567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:00.999918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.001328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.002002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.004088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.007050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:01.007050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:01.007252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.007252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.018193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.018688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.019324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.020216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.022587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.023079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.100939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:01.109304 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9f1a175-487e-42cc-a025-a010c18f4fe9 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1297 microversion: 2.1 time: 0.147082 Sep 01 04:50:01.111345 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 399/860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:00 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1297 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:01.167000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:01.167611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:01.180350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.181240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.181976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.182825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.185162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.185622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.220160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:01.229086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bce0aed6-fcd4-4a6a-bfa5-c3afa3d7531c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 200 len: 1472 microversion: 2.1 time: 0.228749 Sep 01 04:50:01.229823 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 462/861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:00 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:01.235562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:01.236384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:01.242545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.243274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.243990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.244887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.245527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.246137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.621140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:01.634003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:01.644994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ca89f08-26a3-4fb4-9cf5-1c0ace7dae86 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.476508 Sep 01 04:50:01.653002 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e64535e-a35b-41a4-a222-572244a495e5 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.421852 Sep 01 04:50:01.654790 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 463/862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:01 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:01.664214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 400/863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:01 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:01.674283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1115775656"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:01.678253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:01.684738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.685228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.685664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.686429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.687095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.688496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.709612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:01.864896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:01.866957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:01.869869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:01.890379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.899017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.899937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.901072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:01.905994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:01.909878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:01.998748 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bf46103-0d58-4835-9597-9f31676c18f0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6/action" status: 202 len: 0 microversion: 2.1 time: 0.342354 Sep 01 04:50:01.999471 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 464/864] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:50:01 2022] POST /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:50:02.012126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:02.012830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:02.035457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:02.036327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:02.036977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:02.037968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:02.038613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:02.040990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:02.868849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:02.880279 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f61b748-c54a-43c0-8a23-d8b37fc5350d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.872277 Sep 01 04:50:02.883383 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 465/865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:01 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:02.887669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:02.898580 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb758480-416d-4f25-a560-dc0e5d052618 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1472 microversion: 2.1 time: 1.039883 Sep 01 04:50:02.902487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:02.911688 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 401/866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:01 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1472 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:02.915841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:02.918035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d341cfa5-bc22-4f10-9e3b-30ed8296bfb0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7602599d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:02.940079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:02.940690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:02.941616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:02.942564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:02.943283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:02.943922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.055701 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d341cfa5-bc22-4f10-9e3b-30ed8296bfb0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.142567 Sep 01 04:50:03.056424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 402/867] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:02 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:03.061216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:03.076987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:03.115581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.121808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.124366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.125843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.129771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.131641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.323387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:03.341640 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c02772ce-4d8e-45d9-94e3-1284ca83f8f6 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1280 microversion: 2.1 time: 0.448519 Sep 01 04:50:03.355266 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 466/868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:02 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:03.361285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ba52161c-ab6e-469f-b380-631bc536299a req-60860569-5d9a-48c0-a888-12fc74c15e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab2aaef-db86-4580-8099-fa33d9244919", "name": "network-vif-plugged", "status": "completed", "tag": "b62a06ba-4246-49bc-8430-ee36a9926b18"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:03.384479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ba52161c-ab6e-469f-b380-631bc536299a req-60860569-5d9a-48c0-a888-12fc74c15e63 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.385324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ba52161c-ab6e-469f-b380-631bc536299a req-60860569-5d9a-48c0-a888-12fc74c15e63 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.386144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ba52161c-ab6e-469f-b380-631bc536299a req-60860569-5d9a-48c0-a888-12fc74c15e63 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.411815 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ba52161c-ab6e-469f-b380-631bc536299a req-60860569-5d9a-48c0-a888-12fc74c15e63 service nova] Creating event network-vif-plugged:b62a06ba-4246-49bc-8430-ee36a9926b18 for instance 5ab2aaef-db86-4580-8099-fa33d9244919 on n-h2-820368-37 Sep 01 04:50:03.416756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:03.425563 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ba52161c-ab6e-469f-b380-631bc536299a req-60860569-5d9a-48c0-a888-12fc74c15e63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068755 Sep 01 04:50:03.426342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 467/869] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:03.439432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:03.440278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:03.450997 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a1d16ae-dc51-4459-9b23-bc44f84bce20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1303 microversion: 2.1 time: 0.391435 Sep 01 04:50:03.454506 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 403/870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:03 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1303 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:03.456098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.456706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.457257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.458073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.463502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.466819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:03.467418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.472176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:03.491751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.492450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.492898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:03.493955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:03.494401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:03.494830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:04.999067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:05.011212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8fee0ee-0ccb-4a14-9c56-305441498ff0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 1.581418 Sep 01 04:50:05.012712 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 468/871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:03 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:05.022404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:05.029500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:05.038529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.039290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.039758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.040544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.041240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.042009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.043287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:05.059039 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44f8f54d-e5ad-4a34-a118-0fa0f10d9dd4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 1.601341 Sep 01 04:50:05.073535 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 404/872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:03 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:05.091465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:05.092650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:05.107044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.108128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.108815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.109866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.110546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.111156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.149263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.150076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.150699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.151505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lazy-loading 'fault' on Instance uuid 56be13bc-1e86-44b3-8e54-a2f677bb469e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:05.390924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:05.400793 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7ef321e-e21b-4ea3-b339-12a7a0fcc00d tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1307 microversion: 2.1 time: 0.319716 Sep 01 04:50:05.401878 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 405/873] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:05 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:05.407396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a01e595d-fc47-40d4-b191-d20db6a8085f req-a9697ab5-e182-48e5-b104-265697791668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26874bdb-4cfa-4522-ac41-5370de3e8c8c", "tag": "31f29742-91ff-49c1-b6a5-677ff0d64164"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:05.438230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a01e595d-fc47-40d4-b191-d20db6a8085f req-a9697ab5-e182-48e5-b104-265697791668 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.450109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a01e595d-fc47-40d4-b191-d20db6a8085f req-a9697ab5-e182-48e5-b104-265697791668 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.452206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a01e595d-fc47-40d4-b191-d20db6a8085f req-a9697ab5-e182-48e5-b104-265697791668 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.482175 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a01e595d-fc47-40d4-b191-d20db6a8085f req-a9697ab5-e182-48e5-b104-265697791668 service nova] Creating event network-changed:31f29742-91ff-49c1-b6a5-677ff0d64164 for instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c on n-h1-820368-37 Sep 01 04:50:05.488132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a01e595d-fc47-40d4-b191-d20db6a8085f req-a9697ab5-e182-48e5-b104-265697791668 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084646 Sep 01 04:50:05.493497 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 406/874] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:05.501905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:05.511422 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9db69ba0-f569-4cd7-8a14-2f41d7a783e2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.496089 Sep 01 04:50:05.511651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c69c29d7-a66f-4a01-b739-02ff2c95ef08 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7603294c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:05.512708 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 469/875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:05 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:05.517801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:05.518645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:05.540278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.541030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.542328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.543313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.544144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.544742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.575827 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c69c29d7-a66f-4a01-b739-02ff2c95ef08 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.080781 Sep 01 04:50:05.577352 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 407/876] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:05 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:05.583452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b1feeb59-931b-4d20-a73c-dd00def9c3f3 req-36bc6e55-33f7-4fcf-8b6a-d920dfab52c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56be13bc-1e86-44b3-8e54-a2f677bb469e", "name": "network-vif-deleted", "tag": "6f4d8c12-ccb6-427f-8a09-3816eba070bb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:05.595367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b1feeb59-931b-4d20-a73c-dd00def9c3f3 req-36bc6e55-33f7-4fcf-8b6a-d920dfab52c5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.596030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b1feeb59-931b-4d20-a73c-dd00def9c3f3 req-36bc6e55-33f7-4fcf-8b6a-d920dfab52c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.596620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b1feeb59-931b-4d20-a73c-dd00def9c3f3 req-36bc6e55-33f7-4fcf-8b6a-d920dfab52c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.622910 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b1feeb59-931b-4d20-a73c-dd00def9c3f3 req-36bc6e55-33f7-4fcf-8b6a-d920dfab52c5 service nova] Creating event network-vif-deleted:6f4d8c12-ccb6-427f-8a09-3816eba070bb for instance 56be13bc-1e86-44b3-8e54-a2f677bb469e on n-h2-820368-37 Sep 01 04:50:05.629030 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b1feeb59-931b-4d20-a73c-dd00def9c3f3 req-36bc6e55-33f7-4fcf-8b6a-d920dfab52c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050182 Sep 01 04:50:05.630258 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 408/877] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:05.645061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:05.645955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:05.664212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.664896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.665510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.666752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:05.667430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:05.668007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:05.952616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:05.997784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61035f21-f6d6-4e15-be5e-80ac0b9fab76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.482064 Sep 01 04:50:06.001099 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 470/878] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:05 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:06.032030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:06.041294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:06.041959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:06.043408 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e171efbd-0741-4f39-9f13-214a11e863eb tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.411315 Sep 01 04:50:06.048985 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 409/879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:05 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:06.049787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.050284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.050776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.052472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.053645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.054215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.091904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:06.092877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:06.103638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.106570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.108997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.110951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.111961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.114506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.471864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:06.475393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:06.482570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:06.486044 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32ce135c-242c-4693-ba92-e2853c6d8f8f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.398776 Sep 01 04:50:06.488404 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 410/880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:06 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:06.504293 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61791b7d-c675-4533-afeb-a080d6096f03 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1316 microversion: 2.1 time: 0.453224 Sep 01 04:50:06.505791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:06.505953 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 471/881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:06 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:06.506425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:06.514070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.514564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.515022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.515770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.521986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.522620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.540821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:06.541745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:06.548804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.549296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.549732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.550436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.557484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.559371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.571029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:06.571345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:06.571782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:06.572237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lazy-loading 'fault' on Instance uuid 56be13bc-1e86-44b3-8e54-a2f677bb469e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:06.675960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:06.687639 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18e82c8e-7815-4789-ab6c-a48738ca1f45 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 200 len: 1307 microversion: 2.1 time: 0.193210 Sep 01 04:50:06.688796 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 411/882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:06 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:06.707411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135cedf0-4e4e-494a-a032-5a6daa55fba4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7602530d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:06.781662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-135cedf0-4e4e-494a-a032-5a6daa55fba4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.078680 Sep 01 04:50:06.787201 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 412/883] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:06 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:06.797277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:06.817072 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed4b3e79-954d-4278-9f8f-aa022c6aeb06 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.280110 Sep 01 04:50:06.817659 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 472/884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:06 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:07.030995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.031899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.042085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.042643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.043079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.043811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.044506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.044689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.071367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.073050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.083625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.084394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.085351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.086353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.087007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.087663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.367228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:07.368716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:07.379604 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ac43f51-4d57-46f1-9b34-fcc8329978a2 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.315688 Sep 01 04:50:07.382178 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 473/885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:07.403054 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ebd3470-cbee-4dd9-bec2-c2a176a76d87 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.383303 Sep 01 04:50:07.404388 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 413/886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:07.530820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.531576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.536462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.537188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.539542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.540245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.540748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.541668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.542460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.543141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.543829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.544716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.545331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.546379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.559751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.560937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.821774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:07.826113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:07.833890 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a84d88b4-eeeb-42b6-ac4f-7af34d6092a3 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.307062 Sep 01 04:50:07.834392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9884542-cdee-43a0-9428-c7725d261ad3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1466 microversion: 2.1 time: 0.303082 Sep 01 04:50:07.835521 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 414/887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1466 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:07.839611 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 474/888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:07.840742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5a3ff2fe-a2ba-4735-95ed-832cee965732 req-98c1738d-e8d2-4ffb-a232-27239401b9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fd1215-d488-4a50-986c-4a4006f1ff37", "name": "network-vif-deleted", "tag": "ec93a9f5-2b82-4781-b029-8627bd48ede6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:07.853752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.854493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: 56be13bc-1e86-44b3-8e54-a2f677bb469e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.855485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a3ff2fe-a2ba-4735-95ed-832cee965732 req-98c1738d-e8d2-4ffb-a232-27239401b9ed service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.856227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a3ff2fe-a2ba-4735-95ed-832cee965732 req-98c1738d-e8d2-4ffb-a232-27239401b9ed service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.856816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a3ff2fe-a2ba-4735-95ed-832cee965732 req-98c1738d-e8d2-4ffb-a232-27239401b9ed service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.867782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.868584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.869375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.869777 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5a3ff2fe-a2ba-4735-95ed-832cee965732 req-98c1738d-e8d2-4ffb-a232-27239401b9ed service nova] Creating event network-vif-deleted:ec93a9f5-2b82-4781-b029-8627bd48ede6 for instance b9fd1215-d488-4a50-986c-4a4006f1ff37 on n-h2-820368-37 Sep 01 04:50:07.870465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.871256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.872096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.876413 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5a3ff2fe-a2ba-4735-95ed-832cee965732 req-98c1738d-e8d2-4ffb-a232-27239401b9ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039503 Sep 01 04:50:07.877678 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 415/889] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:07.884363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1cbc100-2c67-43c7-a42e-ab2ca075926d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7603f3c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.902674 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] HTTP exception thrown: Instance 56be13bc-1e86-44b3-8e54-a2f677bb469e could not be found. Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Request method failure captured: Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e HTTP/1.1 Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlDkQqp8HGFKHrRnwMJcOJEXeeJgExLQ3htt3TYGHQXsHZ-Tqa8phScAKYQBEx3NnxmIcS2pRQM37XGYi6wHOW9xBHMqgj0KyjYAwp8OMASSIt8KDr3Z_vq9_GtWYvsdBPv1MGeWUztbczEU7m4Wvz56GQevLd3siuKlSsDBpbP_gk Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c882395ab5974b498cb5d90f4caaad30 Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListImageFiltersTestJSON-1458214317 Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:50:07.904697 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListImageFiltersTestJSON-1458214317 Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c882395ab5974b498cb5d90f4caaad30 Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1458214317 Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListImageFiltersTestJSON-1458214317-project Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ccd6c72e968c494dac827579cb5af129 Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListImageFiltersTestJSON-1458214317-project Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 56be13bc-1e86-44b3-8e54-a2f677bb469e could not be found. Sep 01 04:50:07.906458 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '56be13bc-1e86-44b3-8e54-a2f677bb469e'} Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56be13bc-1e86-44b3-8e54-a2f677bb469e could not be found. Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:07.907461 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56be13bc-1e86-44b3-8e54-a2f677bb469e could not be found. Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56be13bc-1e86-44b3-8e54-a2f677bb469e could not be found. Sep 01 04:50:07.909361 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:07.911675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Returning 404 to user: Instance 56be13bc-1e86-44b3-8e54-a2f677bb469e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:07.912998 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9fbc9ae-87f0-4a9b-9ee6-7e17668e7468 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e" status: 404 len: 111 microversion: 2.1 time: 0.072133 Sep 01 04:50:07.913743 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 475/890] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/56be13bc-1e86-44b3-8e54-a2f677bb469e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:50:07.919009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.919869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.932397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.932896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.933332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.934032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.934486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.935198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.941346 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1cbc100-2c67-43c7-a42e-ab2ca075926d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.061713 Sep 01 04:50:07.941908 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 416/891] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:07.946261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:07.947009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:07.954087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.954623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.955347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:07.956341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:07.957054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:07.957667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.164059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:08.174420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98055168-55c6-480d-9263-8b1e9ab6aded tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.258921 Sep 01 04:50:08.174948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a3b389a-e469-496c-89cd-8df4244d2583 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1619 microversion: 2.1 time: 0.231938 Sep 01 04:50:08.175812 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 417/892] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1619 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:08.180533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:08.181248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:08.187239 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 476/893] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:07 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:08.188434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.189130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.189744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.190621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.191281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.191872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.225459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:50:08.312344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-822141961", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["e2eda1a9-f765-416e-843a-a16925ec4c08"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:08.363000 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38674a96-e876-4e29-9814-3fbd65942a7f tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 204 len: 0 microversion: 2.1 time: 0.182798 Sep 01 04:50:08.364151 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 418/894] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:50:08 2022] DELETE /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:08.379366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:08.380772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:08.392517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:50:08.393384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.393855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.394281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.396498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.396498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.397933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.676996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:08.686456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5fa83c5-bfb5-442b-bef2-dc82589d47d5 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1473 microversion: 2.1 time: 0.318073 Sep 01 04:50:08.687428 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 419/895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:08 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:08.692390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:08.692991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:08.700229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.700711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.701138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.701830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.702273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.702690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.786872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:50:08.787309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:50:08.787775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:50:08.788194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:50:08.788643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:50:08.797733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.798209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.798742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.799611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.800060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.800478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.834795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:08.840793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:08.856143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:50:08.858576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:50:08.896732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:08.904984 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c38d2e9e-5fb2-403b-aada-1b65897ac3ff tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.216163 Sep 01 04:50:08.905745 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 420/896] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:08 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:08.910605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:08.911231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:08.920535 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2eb05a7e-5ee8-4830-a208-d81d4c5dc386 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612359 Sep 01 04:50:08.922456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.923120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.923609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.924438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.925019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.925483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.927500 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 477/897] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:50:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:50:08.932586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-96610c08-161e-4c33-bfe1-88d2d503e01c req-569b0e7d-915f-4ea9-9ab1-f7a4a188677c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c6db0a-5d7e-4421-898b-2b390a63fac6", "name": "network-vif-plugged", "status": "completed", "tag": "c6366995-3ffc-4d77-be2f-8cbbbef5bfdf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:08.956584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-96610c08-161e-4c33-bfe1-88d2d503e01c req-569b0e7d-915f-4ea9-9ab1-f7a4a188677c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.957158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-96610c08-161e-4c33-bfe1-88d2d503e01c req-569b0e7d-915f-4ea9-9ab1-f7a4a188677c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.957656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-96610c08-161e-4c33-bfe1-88d2d503e01c req-569b0e7d-915f-4ea9-9ab1-f7a4a188677c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.970794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-96610c08-161e-4c33-bfe1-88d2d503e01c req-569b0e7d-915f-4ea9-9ab1-f7a4a188677c service nova] Creating event network-vif-plugged:c6366995-3ffc-4d77-be2f-8cbbbef5bfdf for instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 on n-h2-820368-37 Sep 01 04:50:08.976167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-96610c08-161e-4c33-bfe1-88d2d503e01c req-569b0e7d-915f-4ea9-9ab1-f7a4a188677c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047103 Sep 01 04:50:08.977404 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 478/898] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:08.983562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:08.984655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:08.992969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.993963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.995468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:08.997240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:08.998081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:08.998869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:09.187822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:09.218337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:09.248537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:09.255744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:09.262028 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60566037-a143-4080-b2cb-a37d5b216f50 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.283178 Sep 01 04:50:09.275150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aaa2a668-eaab-4cc6-8876-1feb0722a677 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.357342 Sep 01 04:50:09.275150 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 421/900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:08 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:09.275662 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 479/900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:08 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:09.275662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a08c2f3a-2e45-4e37-9c1a-10dbcf155374 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa760442550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:09.282983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00f7deb8-2576-4dfe-b93a-23b98c8d6285 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:09.282983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00f7deb8-2576-4dfe-b93a-23b98c8d6285 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:09.335061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a08c2f3a-2e45-4e37-9c1a-10dbcf155374 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.067342 Sep 01 04:50:09.336085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 480/901] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:09 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:09.346398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:09.347450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:09.354388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:09.355398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:09.356230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:09.357229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:09.357884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:09.358314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:09.375045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00f7deb8-2576-4dfe-b93a-23b98c8d6285 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:09.394976 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00f7deb8-2576-4dfe-b93a-23b98c8d6285 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1216 microversion: 2.1 time: 0.126699 Sep 01 04:50:09.394976 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 422/902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:09 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1216 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:09.545388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:09.554499 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17e77eda-66f8-44ca-a718-30eae17bf656 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.216515 Sep 01 04:50:09.567459 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 481/903] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:09 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:09.709933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:09.711397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:09.739817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:09.740545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:09.741196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:09.741973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:09.742501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:09.743000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:09.907227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:09.917412 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d0d56ee-c0d0-4944-93b0-cc6f16e88f96 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1473 microversion: 2.1 time: 0.212857 Sep 01 04:50:09.918023 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 423/904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:09 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1473 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:09.925556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:09.926242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:09.933203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:09.933681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:09.934108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:09.934789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:09.935265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:09.935685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.100784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:10.113235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e4a70f1-3b39-4cef-b989-9066fd433c8f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.191203 Sep 01 04:50:10.114828 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 482/905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:09 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:10.302060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:10.303456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:10.304475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:10.305091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:10.311207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.311665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.312192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.312700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.314292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.314613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.315123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.318302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.318782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.319570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.320033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.320489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.337058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:10.570641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:10.572930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:10.581672 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46c4e193-e736-40a9-83c1-c7a37725e9e0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.283488 Sep 01 04:50:10.582466 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 424/906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:10 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:10.587327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8325eb7-2179-4a46-a287-ff08eb3a3811 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7602a8550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:10.589451 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b7b7928-ad49-4d9a-94a7-8829f9adc337 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.288787 Sep 01 04:50:10.599022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 483/907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:10 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:10.599022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:10.599022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:10.608245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.608762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.609209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.610659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.611143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.611748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.646104 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8325eb7-2179-4a46-a287-ff08eb3a3811 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.062462 Sep 01 04:50:10.647103 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 425/908] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:10 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:10.652049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:10.652741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:10.660199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.660677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.661103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.661796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.662259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.662767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.686411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:10.695608 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6139898b-712b-4c19-b9ab-df2feeb71fde tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1212 microversion: 2.1 time: 0.103980 Sep 01 04:50:10.696378 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 484/909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:10 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:10.935971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:10.939301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:10.940099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:10.952334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-624aaae5-4c32-445c-b74a-bbac84e4e7bd tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.302284 Sep 01 04:50:10.956251 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 426/910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:10 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:10.970591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.973223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.973700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:10.974765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:10.977402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:10.979631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:11.136114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:11.136751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:11.152763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:11.153523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:11.154446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:11.154663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:11.155155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:11.155579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:11.833379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:11.843817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8faa732-e0f8-42eb-a99e-8917347d4529 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.711504 Sep 01 04:50:11.849692 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 427/911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:11 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:11.855175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:11.863883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:11.880812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:11.881743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:11.882406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:11.883404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:11.884065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:11.894589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.102290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:12.122744 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88bee614-8d2b-4ed6-a39b-e65a817d20a1 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1473 microversion: 2.1 time: 1.187860 Sep 01 04:50:12.123786 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 485/912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:10 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1473 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:12.135684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:12.136940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:12.151407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.152066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.152503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.153222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.153948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.154511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.545867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:12.558318 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ee17d37-ca8e-45b5-b997-596bb6dff838 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.707249 Sep 01 04:50:12.559353 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 428/913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:11 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:12.566029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9840e8db-ec51-4488-a5f9-b4eccb1f84ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7600e7160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:12.586520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:12.601376 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d82ba5f1-c7f2-4dcc-962d-d0759eb4de68 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.476411 Sep 01 04:50:12.602293 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 486/914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:12 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:12.618784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:12.619703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:12.626576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.629942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.630383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.631152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.631773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.632378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.689997 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9840e8db-ec51-4488-a5f9-b4eccb1f84ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.113984 Sep 01 04:50:12.698053 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 429/915] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:12 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:12.704833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:12.705452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:12.733212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.733963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.734507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.735741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.736195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.736614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.873943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:12.883765 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f0961fe-037d-4134-9ef9-adf5caff9eba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1274 microversion: 2.1 time: 0.280068 Sep 01 04:50:12.884368 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 487/916] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:12 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:12.891611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:12.892972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:12.903182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.903946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.904556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:12.905435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:12.906164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:12.906807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.782840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:13.805995 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18b6c69e-7ea0-4a8e-ac64-71287be0a43e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 1.110988 Sep 01 04:50:13.811446 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 430/917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:12 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:13.828736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1c67c4ca-ff3d-45d8-b6bb-9cb354ad23b2 req-d5ef5a56-8c67-44e8-a33c-3df7454c4689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097ef7b-4b03-45a6-8523-061e05076ef1", "name": "network-vif-deleted", "tag": "a7fec20f-4f59-4f93-ab56-d244061c6c57"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:13.857524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c67c4ca-ff3d-45d8-b6bb-9cb354ad23b2 req-d5ef5a56-8c67-44e8-a33c-3df7454c4689 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:13.858320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c67c4ca-ff3d-45d8-b6bb-9cb354ad23b2 req-d5ef5a56-8c67-44e8-a33c-3df7454c4689 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:13.859622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c67c4ca-ff3d-45d8-b6bb-9cb354ad23b2 req-d5ef5a56-8c67-44e8-a33c-3df7454c4689 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.863397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:13.871853 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d706e52-ff8d-43fd-841f-8287dfcd10df tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.986426 Sep 01 04:50:13.875675 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 488/918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:12 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:13.881020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:13.889503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:13.895325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:13.902617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:13.903967 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1c67c4ca-ff3d-45d8-b6bb-9cb354ad23b2 req-d5ef5a56-8c67-44e8-a33c-3df7454c4689 service nova] Creating event network-vif-deleted:a7fec20f-4f59-4f93-ab56-d244061c6c57 for instance d097ef7b-4b03-45a6-8523-061e05076ef1 on n-h2-820368-37 Sep 01 04:50:13.908064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:13.908502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.909828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:13.910523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:13.912029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.917506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1c67c4ca-ff3d-45d8-b6bb-9cb354ad23b2 req-d5ef5a56-8c67-44e8-a33c-3df7454c4689 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102207 Sep 01 04:50:13.919954 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 431/919] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:13.925818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:13.941612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:13.953640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:13.954553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:13.955261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.956219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:13.959683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:13.960421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.990945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:13.991855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:13.992538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:13.993254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lazy-loading 'fault' on Instance uuid d097ef7b-4b03-45a6-8523-061e05076ef1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:14.311546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd6c72e968c494dac827579cb5af129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c882395ab5974b498cb5d90f4caaad30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:14.319693 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3726b295-1773-4905-81bf-89d4ee1e67dc tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 200 len: 1308 microversion: 2.1 time: 0.442431 Sep 01 04:50:14.325334 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 489/920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:13 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:14.346490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:14.348429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:14.378867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:14.379231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:14.384180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:14.385286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:14.385920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:14.386509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:15.127211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:15.141407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6481419-3b73-4f1e-8d27-1c63a25140be tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 1.219897 Sep 01 04:50:15.142041 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 432/921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:13 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:15.155323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba3d5816-4d9e-4238-bc3c-72cb3c2e07f1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7600e79d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:15.277648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba3d5816-4d9e-4238-bc3c-72cb3c2e07f1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.131853 Sep 01 04:50:15.279080 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 433/922] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:15 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:15.293758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:15.295538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:15.310839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:15.314174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:15.314769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:15.317577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:15.318207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:15.318750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:15.767930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:15.779019 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42f53516-c172-412f-adeb-18e1f7df940f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 1.451924 Sep 01 04:50:15.780071 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 490/923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:14 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:15.788907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-138bc1ca-98ef-45a6-a0bd-c9b84c8943b0 req-f10b197a-e7fb-43df-b084-7cda9a06d887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4b80bb-15cc-49d3-bc27-ad6a5f06884e", "tag": "73b4e919-25ce-4ea5-8eb1-05a49bc73fd1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:15.802358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-138bc1ca-98ef-45a6-a0bd-c9b84c8943b0 req-f10b197a-e7fb-43df-b084-7cda9a06d887 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:15.803302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-138bc1ca-98ef-45a6-a0bd-c9b84c8943b0 req-f10b197a-e7fb-43df-b084-7cda9a06d887 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:15.804422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-138bc1ca-98ef-45a6-a0bd-c9b84c8943b0 req-f10b197a-e7fb-43df-b084-7cda9a06d887 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:15.839199 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-138bc1ca-98ef-45a6-a0bd-c9b84c8943b0 req-f10b197a-e7fb-43df-b084-7cda9a06d887 service nova] Creating event network-changed:73b4e919-25ce-4ea5-8eb1-05a49bc73fd1 for instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e on n-h1-820368-37 Sep 01 04:50:15.846295 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-138bc1ca-98ef-45a6-a0bd-c9b84c8943b0 req-f10b197a-e7fb-43df-b084-7cda9a06d887 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064551 Sep 01 04:50:15.847943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 491/924] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:15.853841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:15.855187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:15.865464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:15.866486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:15.867192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:15.868169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:15.869132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:15.869807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.179131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:16.192242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2904a775-346a-441e-a083-606f5aaea562 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.910103 Sep 01 04:50:16.210580 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 434/925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:15 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:16.222664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.223973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:16.239011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.239859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.240489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.242167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.242848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.243516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.314272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:16.328387 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32c3c469-3e03-41d1-8483-ba3b498e39cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.478613 Sep 01 04:50:16.329601 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 492/926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:15 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:16.336391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.337543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:16.353995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.354937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.355834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.356722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.357337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.358697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.671157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:16.689237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73321dd3-dabe-4104-81b1-05cab7d7ab93 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.476821 Sep 01 04:50:16.707482 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 435/927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:16.713882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.714523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] [instance: d097ef7b-4b03-45a6-8523-061e05076ef1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:16.732942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:16.739058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.739556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.739992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.740710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.741163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.741587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.754718 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8528568a-00bc-432f-b15a-f81d011c3153 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 2346 microversion: 2.25 time: 0.423443 Sep 01 04:50:16.773652 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 493/928] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 2346 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:16.785954 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] HTTP exception thrown: Instance d097ef7b-4b03-45a6-8523-061e05076ef1 could not be found. Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Request method failure captured: Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 HTTP/1.1 Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlDkQqp8HGFKHrRnwMJcOJEXeeJgExLQ3htt3TYGHQXsHZ-Tqa8phScAKYQBEx3NnxmIcS2pRQM37XGYi6wHOW9xBHMqgj0KyjYAwp8OMASSIt8KDr3Z_vq9_GtWYvsdBPv1MGeWUztbczEU7m4Wvz56GQevLd3siuKlSsDBpbP_gk Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c882395ab5974b498cb5d90f4caaad30 Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListImageFiltersTestJSON-1458214317 Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:16.788262 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c882395ab5974b498cb5d90f4caaad30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListImageFiltersTestJSON-1458214317 Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c882395ab5974b498cb5d90f4caaad30 Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1458214317 Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListImageFiltersTestJSON-1458214317-project Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ccd6c72e968c494dac827579cb5af129 Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListImageFiltersTestJSON-1458214317-project Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d097ef7b-4b03-45a6-8523-061e05076ef1 could not be found. Sep 01 04:50:16.789769 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd097ef7b-4b03-45a6-8523-061e05076ef1'} Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d097ef7b-4b03-45a6-8523-061e05076ef1 could not be found. Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:16.790551 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d097ef7b-4b03-45a6-8523-061e05076ef1 could not be found. Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d097ef7b-4b03-45a6-8523-061e05076ef1 could not be found. Sep 01 04:50:16.791913 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:16.793139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.793139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:16.795753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Returning 404 to user: Instance d097ef7b-4b03-45a6-8523-061e05076ef1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:16.797279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f0ba826-f9b2-4bf4-907e-ffd4f3fcb76b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1" status: 404 len: 111 microversion: 2.1 time: 0.088583 Sep 01 04:50:16.798092 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 436/929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/servers/d097ef7b-4b03-45a6-8523-061e05076ef1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:50:16.800642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.801037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.801724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.802611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.803100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.803529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.808774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e15bef20-4268-42cf-896c-a57b9a040d66 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa760088670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.859942 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e15bef20-4268-42cf-896c-a57b9a040d66 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.060564 Sep 01 04:50:16.861208 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 437/930] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:16.866375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6d3bcc4b-3eca-43fb-9721-42333044e6b8 req-27e9fe98-815d-4d5c-94c6-b2cbf6a68db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd10316-4a5a-4a44-a224-0fadecdb17a8", "tag": "383ad9a4-5173-41a7-9f7b-41d4b144fe12"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:16.877899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6d3bcc4b-3eca-43fb-9721-42333044e6b8 req-27e9fe98-815d-4d5c-94c6-b2cbf6a68db6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.878566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6d3bcc4b-3eca-43fb-9721-42333044e6b8 req-27e9fe98-815d-4d5c-94c6-b2cbf6a68db6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.879257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6d3bcc4b-3eca-43fb-9721-42333044e6b8 req-27e9fe98-815d-4d5c-94c6-b2cbf6a68db6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.891629 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6d3bcc4b-3eca-43fb-9721-42333044e6b8 req-27e9fe98-815d-4d5c-94c6-b2cbf6a68db6 service nova] Creating event network-changed:383ad9a4-5173-41a7-9f7b-41d4b144fe12 for instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 on n-h1-820368-37 Sep 01 04:50:16.897140 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6d3bcc4b-3eca-43fb-9721-42333044e6b8 req-27e9fe98-815d-4d5c-94c6-b2cbf6a68db6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034078 Sep 01 04:50:16.897968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 438/931] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:16.903362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.907976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.909170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.909853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.911979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.912669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.913310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.944093 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9107701-9b6b-4a96-862c-4764d5ca264e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.044666 Sep 01 04:50:16.952657 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 439/932] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:50:16.959261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:16.960135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:16.967454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.968063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.968598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:16.969523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:16.970082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:16.970605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:17.146646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:17.155307 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f6d3192-2991-4c91-8a27-af4d90f4fa0e tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.375122 Sep 01 04:50:17.157360 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 494/933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:17.204712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9f7f087-4024-4c90-b90e-3fc787e68e56 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760557310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:17.620305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:17.646933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f79bbc74-37b7-4fa1-9537-3704b50e1acc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.691601 Sep 01 04:50:17.647756 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 440/934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:16 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:17.664368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:17.665780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:17.689020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:17.689828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:17.690413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:17.691339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:17.691959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:17.692550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:17.730784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9f7f087-4024-4c90-b90e-3fc787e68e56 tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/images/b40b1317-f6fc-45e3-80dc-222caaa9faed" status: 204 len: 0 microversion: 2.1 time: 0.543501 Sep 01 04:50:17.731668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 495/935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:17 2022] DELETE /compute/v2.1/images/b40b1317-f6fc-45e3-80dc-222caaa9faed => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:17.739864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:17.744554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:17.756718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:17.757208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:17.758134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:17.758958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:17.759925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:17.760369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:18.364713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:18.384808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a0870fe-756e-4514-9893-79cd1da3ce72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.651784 Sep 01 04:50:18.387176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 496/936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:17 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:18.404825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:18.405713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:18.419046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:18.423016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:18.424326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:18.428818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:18.430642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:18.431156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:18.431871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:18.450226 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26db9998-583e-42fe-ad63-7330f0735a32 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.790587 Sep 01 04:50:18.451351 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 441/937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:17 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:18.461733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-935ebc82-da12-4dc3-80f5-b15fd036a42a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa760b28f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:18.804942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:18.815679 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fe53708-5190-4acb-8532-52fb7bad0b3c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.427103 Sep 01 04:50:18.824544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 497/938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:18 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:18.844998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c611fdb4-889b-44db-8d91-7beae7d3c9dd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7601ae280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:18.871187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:18.872193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=22 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:19.042456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-935ebc82-da12-4dc3-80f5-b15fd036a42a tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/images/2022b7d9-e147-4191-a8a3-134d620c587f" status: 204 len: 0 microversion: 2.1 time: 0.589826 Sep 01 04:50:19.043057 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 442/939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:18 2022] DELETE /compute/v2.1/images/2022b7d9-e147-4191-a8a3-134d620c587f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:19.048258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66d0bed-10fc-4364-a359-3a67b537dca5", "name": "network-vif-unplugged", "status": "completed", "tag": "fbeca0e3-8257-4bb7-accb-1ba5f853687d"}, {"name": "network-changed", "server_uuid": "a66d0bed-10fc-4364-a359-3a67b537dca5", "tag": "fbeca0e3-8257-4bb7-accb-1ba5f853687d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:19.073088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.073487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.077302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.099891 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] Creating event network-vif-unplugged:fbeca0e3-8257-4bb7-accb-1ba5f853687d for instance a66d0bed-10fc-4364-a359-3a67b537dca5 on n-h2-820368-37 Sep 01 04:50:19.102102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] Creating event network-changed:fbeca0e3-8257-4bb7-accb-1ba5f853687d for instance a66d0bed-10fc-4364-a359-3a67b537dca5 on n-h2-820368-37 Sep 01 04:50:19.109630 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-38c2d95c-bc0c-4ff7-aa1d-ccce443c1655 req-cfe07cde-5d08-4da8-b469-70eaaaee562b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064965 Sep 01 04:50:19.111375 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 443/940] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:19.114551 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c611fdb4-889b-44db-8d91-7beae7d3c9dd tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.286755 Sep 01 04:50:19.115167 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 498/941] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:18 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:19.119026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:19.120417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:19.128633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:19.129168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:19.132176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.133276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.134014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.135066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.135755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.136413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.143644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.144137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.144572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.145283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.145736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.146155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.392658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:19.407487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:19.428555 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0e6aa8c-87c6-47e6-a230-b4d53b5bc823 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.311034 Sep 01 04:50:19.429471 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 444/942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:19 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:19.450026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-be4dc07d-4fb7-436a-9940-a2fa005ac730 req-e7651b92-58bc-4836-b388-2aa0e4386279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c42042-270f-4a18-934a-eea8c16522c6", "tag": "e52d6985-0139-404c-9a48-2be473f5440f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:19.450693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:19.463921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-be4dc07d-4fb7-436a-9940-a2fa005ac730 req-e7651b92-58bc-4836-b388-2aa0e4386279 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.464506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-be4dc07d-4fb7-436a-9940-a2fa005ac730 req-e7651b92-58bc-4836-b388-2aa0e4386279 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.466668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-be4dc07d-4fb7-436a-9940-a2fa005ac730 req-e7651b92-58bc-4836-b388-2aa0e4386279 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.467719 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-887d4f0a-5bf7-4f38-b65e-c28782ef3631 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.351269 Sep 01 04:50:19.468327 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 499/943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:19 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:19.481619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9534cd61-4521-425d-a6c9-e62695bc677b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] Calling method '.version_select at 0x7fa7604c19d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:19.490334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-be4dc07d-4fb7-436a-9940-a2fa005ac730 req-e7651b92-58bc-4836-b388-2aa0e4386279 service nova] Creating event network-changed:e52d6985-0139-404c-9a48-2be473f5440f for instance 98c42042-270f-4a18-934a-eea8c16522c6 on n-h2-820368-37 Sep 01 04:50:19.496161 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-be4dc07d-4fb7-436a-9940-a2fa005ac730 req-e7651b92-58bc-4836-b388-2aa0e4386279 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051046 Sep 01 04:50:19.497185 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 445/944] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:19.503609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:19.504572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:19.513761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.514634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.515386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.516831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.517414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.517840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.747869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:19.756852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-561d0d1d-b4f4-455b-93b1-b6b0fecd8d00 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.258391 Sep 01 04:50:19.757678 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 446/945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:19 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:19.776127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:19.776736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:19.784338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.784742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.785173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.785881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:19.786331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:19.786753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:19.981498 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9534cd61-4521-425d-a6c9-e62695bc677b tempest-ListImageFiltersTestJSON-1458214317 tempest-ListImageFiltersTestJSON-1458214317-project] 10.222.0.26 "DELETE /compute/v2.1/images/e910b7ab-e24a-41a3-aca8-77e6a2a3365a" status: 204 len: 0 microversion: 2.1 time: 0.511770 Sep 01 04:50:19.986394 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 500/946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:19 2022] DELETE /compute/v2.1/images/e910b7ab-e24a-41a3-aca8-77e6a2a3365a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:19.993723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:19.994474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:20.003100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.004187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.004918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.005962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.007016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.007990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.046066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:20.055631 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a569613-3bb1-4bbc-b127-b12f4bc58da3 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.284407 Sep 01 04:50:20.070133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 447/947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:19 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:20.131849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2b25858-83f9-440b-be65-9e42312d5b4a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa7602d0940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:20.203927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:20.213308 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-654f2d2c-9896-41ba-9245-c84219a73f61 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.224524 Sep 01 04:50:20.213901 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 501/948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:19 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:20.214203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2b25858-83f9-440b-be65-9e42312d5b4a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.086107 Sep 01 04:50:20.214981 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 448/949] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:20 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:20.462035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:20.468877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:20.495392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:20.495649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:20.505040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.505040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.505040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.505040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.507748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.507748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.511252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:20.528130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.530808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.533187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.534504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.534985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.535411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.834718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:20.845172 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a627ddb4-b4f2-4df0-985a-e9eb728b38cf tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.391506 Sep 01 04:50:20.850328 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 502/950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:20 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:20.860911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:20.867052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:20.878038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.878921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.879714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.881120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:20.882155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:20.882959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:20.891855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:21.020574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:21.030842 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbc23cd1-26aa-4264-92aa-7145aab5d4fc tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.542512 Sep 01 04:50:21.032375 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 449/951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:20 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:21.039686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3b64175b-0d39-44dc-aaf2-f668ce506078 req-fcfaae45-62a7-43ab-ae1b-c93803e10d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4b80bb-15cc-49d3-bc27-ad6a5f06884e", "name": "network-vif-plugged", "status": "completed", "tag": "73b4e919-25ce-4ea5-8eb1-05a49bc73fd1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:21.050678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b64175b-0d39-44dc-aaf2-f668ce506078 req-fcfaae45-62a7-43ab-ae1b-c93803e10d06 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.051412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b64175b-0d39-44dc-aaf2-f668ce506078 req-fcfaae45-62a7-43ab-ae1b-c93803e10d06 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.051817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b64175b-0d39-44dc-aaf2-f668ce506078 req-fcfaae45-62a7-43ab-ae1b-c93803e10d06 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.077798 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3b64175b-0d39-44dc-aaf2-f668ce506078 req-fcfaae45-62a7-43ab-ae1b-c93803e10d06 service nova] Creating event network-vif-plugged:73b4e919-25ce-4ea5-8eb1-05a49bc73fd1 for instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e on n-h1-820368-37 Sep 01 04:50:21.092468 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3b64175b-0d39-44dc-aaf2-f668ce506078 req-fcfaae45-62a7-43ab-ae1b-c93803e10d06 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054122 Sep 01 04:50:21.095228 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 450/952] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:21.102500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:21.103160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:21.121767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.123255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.124941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.125779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.126439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.126917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.152693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:21.166062 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66e3cf41-824f-4be1-b42c-e61aa893c47d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.314227 Sep 01 04:50:21.167294 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 503/953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:20 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:21.230392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22cc12a3-7772-4fc2-a0ca-75776a8740a5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa760383430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:21.316443 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22cc12a3-7772-4fc2-a0ca-75776a8740a5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.090477 Sep 01 04:50:21.318913 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 504/954] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:21 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:21.324010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:21.324797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:21.331960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.332860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.333635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.334331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.334788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.335298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.433196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:21.444271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67f330b9-cad5-4da4-829d-21a047df3234 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.347682 Sep 01 04:50:21.444861 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 451/955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:21 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:21.530983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:21.541927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bef0963d-9861-4785-adae-b86c87b51802 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1371 microversion: 2.1 time: 0.221763 Sep 01 04:50:21.543506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 505/956] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:21 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:21.834344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "364ec36f-36cd-4af3-a497-9eba98d2523b", "device": "/dev/xvdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:21.838226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:21.853825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.854318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.857662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.858712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.859469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.869778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:21.870823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:21.874521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.879218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.891763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.892697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:21.893655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:21.896223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:21.896873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:22.664552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:22.679190 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61f44f87-b670-438d-ac4a-0454dd8b9ca0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.813131 Sep 01 04:50:22.683247 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 506/957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:21 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:22.696176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:22.696780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:22.720886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:22.721653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:22.722378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:22.724707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:22.725226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:22.726659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:22.747744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-612206a7-c192-4b89-b449-84fea4f478ce tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "POST /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.917611 Sep 01 04:50:22.756004 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 452/958] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Sep 1 04:50:21 2022] POST /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:50:22.763121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:22.763887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:22.773903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:22.774402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:22.775288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:22.777095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:22.777904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:22.779630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:23.581193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:23.593091 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e61b0f5c-0c2c-45f8-92a2-570acb018312 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.835167 Sep 01 04:50:23.604592 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 453/959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:22 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:23.626847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60bcdc83-c3cd-419f-96b7-b90aac78b838 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bf1d0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:23.645374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:23.704360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4eb977b-320d-45b3-9727-595727902185 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 1.013773 Sep 01 04:50:23.728423 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 507/960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:22 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:23.734602 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60bcdc83-c3cd-419f-96b7-b90aac78b838 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.128245 Sep 01 04:50:23.735817 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 454/961] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:23 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:23.754233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:23.758456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:23.762189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:23.799941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:23.800823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:23.810368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:23.811491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:23.812157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:23.813234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:23.950316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b6aa706-2e24-46ba-8c4f-9ff2b547c2f6 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa7601ae5e0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN33UnDTROAsymhDgk5otaB0xT+Gua4AJRee01MQDCgBTgzIRq/fGYWKhXBdxoxCMda0GY+KOVISWkwGm7kaVwCZ4aH2DA619RCBrGYQNSrzjl/Z6mJFWOoJcfza5N4rQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b6aa706-2e24-46ba-8c4f-9ff2b547c2f6 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 257 Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:50:23.957303 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:50:23.958769 n-d-820368-37 devstack@n-api.service[128863]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN33UnDTROAsymhDgk5otaB0xT+Gua4AJRee01MQDCgBTgzIRq/fGYWKhXBdxoxCMda0GY+KOVISWkwGm7kaVwCZ4aH2DA619RCBrGYQNSrzjl/Z6mJFWOoJcfza5N4rQ=="}} Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN33UnDTROAsymhDgk5otaB0xT+Gua4AJRee01MQDCgBTgzIRq/fGYWKhXBdxoxCMda0GY+KOVISWkwGm7kaVwCZ4aH2DA619RCBrGYQNSrzjl/Z6mJFWOoJcfza5N4rQ=='}}} Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:23.959493 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:23.960561 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:50:23.964587 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:50:23.967087 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 01 04:50:23.967087 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:23.969172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b6aa706-2e24-46ba-8c4f-9ff2b547c2f6 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:23.970469 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b6aa706-2e24-46ba-8c4f-9ff2b547c2f6 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.239799 Sep 01 04:50:23.981112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 508/962] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:23 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:50:23.989169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:23.990171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:24.000699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.001927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.002586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.003941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.004766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.005389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.424925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:24.434314 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12dc6363-a8d9-417f-b9b7-2e4c18b8c8c9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.697262 Sep 01 04:50:24.451775 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 455/963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:23 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:24.462170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:24.463129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:24.478047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.480051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:24.481725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.482668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.483434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.483887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.486422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.497883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:24.500324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ee01c3f-7b5e-4fbf-9aaf-86fe13a7b500 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1556 microversion: 2.1 time: 0.513840 Sep 01 04:50:24.503869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 509/964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:23 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1556 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:24.527260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa75bf26d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-927520692", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:24.558954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:24.570087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for user 7f5573be98c545c5853c9f9de2fd4b26 and project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:24.595458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 2166 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-927520692", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:50:24.612295 n-d-820368-37 devstack@n-api.service[128863]: exception: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-927520692', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:24.614790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:24.617345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:24.621054 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7de329c1-9ebd-4c4a-a2de-51a8853e1c21 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.107745 Sep 01 04:50:24.628580 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 510/965] 10.222.0.26 () {60 vars in 1160 bytes} [Thu Sep 1 04:50:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:50:24.636340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:24.638489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:24.651136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.651743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.652234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.653673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.654189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.654741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.863210 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1830da78-911c-4cad-9df7-6e9a424abb54 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232346 Sep 01 04:50:24.864913 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 511/966] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:50:24 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:24.891839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b62deb26-274c-45c9-98f9-a5e6ee13291d tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa75bf26310>, body: {"keypair": {"name": "tempest-keypair-1735702792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXU+50yTu5RU1v7T21/Sktl3AwHjtIVfrUXBTl/s9CzMRX698uYwd3l1T/y/a0Ysb0Ru/Ta4gU2s65sXHvnTTEetY54GSzXODdlGCGz09vDYV/DvtscBEBJUPdYXlWt4Q=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:24.914714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:24.923474 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26ec2846-d8eb-4865-9150-62ec7fe3d66a tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.469765 Sep 01 04:50:24.936006 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 456/967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:24 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:24.946112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b62deb26-274c-45c9-98f9-a5e6ee13291d tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:24.951179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:24.952042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:24.958253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b62deb26-274c-45c9-98f9-a5e6ee13291d tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for user 7f5573be98c545c5853c9f9de2fd4b26 and project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:24.963222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.963728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.964158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:24.964899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:24.965350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:24.965971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:25.042767 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b62deb26-274c-45c9-98f9-a5e6ee13291d tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162184 Sep 01 04:50:25.052450 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 512/968] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:25.055172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:25.055797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:25.087170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:25.087545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:25.088111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:25.089369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:25.090068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:25.090566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:25.315960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:25.325005 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80f7ff0b-d2bf-4ea4-8b69-38eb01f8c585 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.387671 Sep 01 04:50:25.329973 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 457/969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:24 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:25.338401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24969186-403a-4b5d-b22b-9e796de2e352 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bf1ff70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:25.433851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24969186-403a-4b5d-b22b-9e796de2e352 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.102431 Sep 01 04:50:25.441929 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 458/970] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:25 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:25.454790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa75bf23430>, body: {"keypair": {"name": "tempest-keypair-1735702792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEliz94p07+7o/xHrOETXVHLAHW7kwVTEAibHRK6Nv7axA7TKOauyX2QBR1cpm3kKkcJ59yrKQ9YPmkji4zzeZr1rOiSjFebCYBvEikPl10dXGsez3XDTtf6Kofb0++PA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:25.460872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:25.476170 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70f17e6d-75be-422e-8b62-b848beb9796e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.431643 Sep 01 04:50:25.495156 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 513/971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:25 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:25.507096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:25.515720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for user 7f5573be98c545c5853c9f9de2fd4b26 and project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:25.520524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:25.524124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:25.547509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:25.548125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:25.548578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:25.549302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:25.549753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:25.556982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:25.568941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] HTTP exception thrown: Key pair 'tempest-keypair-1735702792' already exists. Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 273 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-keypair-1735702792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEliz94p07+7o/xHrOETXVHLAHW7kwVTEAibHRK6Nv7axA7TKOauyX2QBR1cpm3kKkcJ59yrKQ9YPmkji4zzeZr1rOiSjFebCYBvEikPl10dXGsez3XDTtf6Kofb0++PA=="}} Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: exception: Key pair 'tempest-keypair-1735702792' already exists. Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1735702792', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEliz94p07+7o/xHrOETXVHLAHW7kwVTEAibHRK6Nv7axA7TKOauyX2QBR1cpm3kKkcJ59yrKQ9YPmkji4zzeZr1rOiSjFebCYBvEikPl10dXGsez3XDTtf6Kofb0++PA=='}}} Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7f5573be98c545c5853c9f9de2fd4b26-tempest-keypair-1735702792' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 01 04:50:25.574209 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi session.flush() Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result.read() Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 01 04:50:25.580925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7f5573be98c545c5853c9f9de2fd4b26-tempest-keypair-1735702792' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 1, 4, 50, 25, 549128), 'updated_at': None, 'name': 'tempest-keypair-1735702792', 'user_id': '7f5573be98c545c5853c9f9de2fd4b26', 'fingerprint': '70:66:49:04:bb:f1:45:ef:e8:3c:dd:4f:37:50:6a:4b', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEliz94p07+7o/xHrOETXVHLAHW7kwVTEAibHRK6Nv7axA7TKOauyX2QBR1cpm3kKkcJ59yrKQ9YPmkji4zzeZr1rOiSjFebCYBvEikPl10dXGsez3XDTtf6Kofb0++PA==', 'type': 'ssh'}] Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair.create() Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._create() Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1735702792' already exists. Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 01 04:50:25.584903 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1735702792' already exists. Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1735702792' already exists. Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 409 to user: Key pair 'tempest-keypair-1735702792' already exists. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:25.592852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f4edbe6-2efd-4727-b769-7bb670f605d2 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.135282 Sep 01 04:50:25.616426 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 459/972] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:25 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:50:25.635291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a0d683f-bb95-421c-8336-5953371f44d0 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Calling method '.version_select at 0x7fa75bf23310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:25.671403 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a0d683f-bb95-421c-8336-5953371f44d0 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735702792" status: 202 len: 0 microversion: 2.1 time: 0.051892 Sep 01 04:50:25.683489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 460/973] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:50:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735702792 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:50:25.689832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c09654f6-f8f7-41fa-8382-1c4bb33d2107 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa760b28f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZHYUom4Cv8n7O6QA2YRanoElbKwOGu37numZhn/iZyqGXQf5PfvzaK12CiFb1Hcp+M8cUHo+lqng1SfceH94COUQnjJoGgGuhYBwaibLK7Jx/YFlf1lovYhisDFvRKfg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c09654f6-f8f7-41fa-8382-1c4bb33d2107 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 247 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZHYUom4Cv8n7O6QA2YRanoElbKwOGu37numZhn/iZyqGXQf5PfvzaK12CiFb1Hcp+M8cUHo+lqng1SfceH94COUQnjJoGgGuhYBwaibLK7Jx/YFlf1lovYhisDFvRKfg=="}} Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZHYUom4Cv8n7O6QA2YRanoElbKwOGu37numZhn/iZyqGXQf5PfvzaK12CiFb1Hcp+M8cUHo+lqng1SfceH94COUQnjJoGgGuhYBwaibLK7Jx/YFlf1lovYhisDFvRKfg=='}}} Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:50:25.696868 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c09654f6-f8f7-41fa-8382-1c4bb33d2107 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:25.700916 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c09654f6-f8f7-41fa-8382-1c4bb33d2107 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013619 Sep 01 04:50:25.708880 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 461/974] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:50:25.714407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa75bf1d700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1132643962", "public_key": " "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:25.744568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:25.752258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for user 7f5573be98c545c5853c9f9de2fd4b26 and project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:25.856131 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 95 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1132643962", "public_key": " "}} Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: exception: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1132643962', 'public_key': ' '}}} Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.861153 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:25.865273 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd5f034b-56de-4d63-a94c-abc11013115e tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.153534 Sep 01 04:50:25.870732 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 462/975] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Sep 1 04:50:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:50:25.882076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2482ec31-27a6-48ec-bcda-3b177742015b tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa75bf1df70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEzgQmovsvdLXsCUtXQDRMzNGYlphmhEzM8TpaQeup3uLV7SNqIX+gsrKHIFclWOcF4XMRcqqpBcQVd9S7d2RqhmUdEHmaacVdcRjizoQDjkr2kYxbk/Sx0tASXXwjAhw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2482ec31-27a6-48ec-bcda-3b177742015b tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 507 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEzgQmovsvdLXsCUtXQDRMzNGYlphmhEzM8TpaQeup3uLV7SNqIX+gsrKHIFclWOcF4XMRcqqpBcQVd9S7d2RqhmUdEHmaacVdcRjizoQDjkr2kYxbk/Sx0tASXXwjAhw=="}} Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEzgQmovsvdLXsCUtXQDRMzNGYlphmhEzM8TpaQeup3uLV7SNqIX+gsrKHIFclWOcF4XMRcqqpBcQVd9S7d2RqhmUdEHmaacVdcRjizoQDjkr2kYxbk/Sx0tASXXwjAhw=='}}} Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 01 04:50:25.894555 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 01 04:50:25.897953 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:25.902722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2482ec31-27a6-48ec-bcda-3b177742015b tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:25.908261 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2482ec31-27a6-48ec-bcda-3b177742015b tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.034083 Sep 01 04:50:25.915467 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 463/976] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:25 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:50:25.927058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-64573c1d-7fc1-4131-9747-56b4a15c1adb req-418bd42f-75f0-409e-8e34-7689bcf5e4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26874bdb-4cfa-4522-ac41-5370de3e8c8c", "name": "network-vif-plugged", "status": "completed", "tag": "31f29742-91ff-49c1-b6a5-677ff0d64164"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:25.952659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64573c1d-7fc1-4131-9747-56b4a15c1adb req-418bd42f-75f0-409e-8e34-7689bcf5e4c8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:25.953460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64573c1d-7fc1-4131-9747-56b4a15c1adb req-418bd42f-75f0-409e-8e34-7689bcf5e4c8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:25.954214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64573c1d-7fc1-4131-9747-56b4a15c1adb req-418bd42f-75f0-409e-8e34-7689bcf5e4c8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:25.981438 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-64573c1d-7fc1-4131-9747-56b4a15c1adb req-418bd42f-75f0-409e-8e34-7689bcf5e4c8 service nova] Creating event network-vif-plugged:31f29742-91ff-49c1-b6a5-677ff0d64164 for instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c on n-h1-820368-37 Sep 01 04:50:25.997822 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-64573c1d-7fc1-4131-9747-56b4a15c1adb req-418bd42f-75f0-409e-8e34-7689bcf5e4c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080764 Sep 01 04:50:25.999952 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 464/977] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:26.016673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Action: 'create', calling method: .version_select at 0x7fa75bf1f820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-511719182", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:26.042527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:26.056728 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d66a6065-899c-4833-99ce-95c0eff1a5a9 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.560292 Sep 01 04:50:26.058738 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 514/978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:25 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:26.069884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:26.073789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:26.074593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:26.087963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Getting quotas for user 7f5573be98c545c5853c9f9de2fd4b26 and project 348a276fc2a94464b947c11bdc7c434a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:26.094235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:26.094634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:26.095282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:26.097176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:26.097813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:26.100222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:26.131964 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 117 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-511719182", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: exception: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-511719182', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Sep 01 04:50:26.134831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 01 04:50:26.138756 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.142734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:26.144741 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23f97a48-7dc2-4817-b11c-0a81e3325772 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.141744 Sep 01 04:50:26.151126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 465/979] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:50:26.164521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-130e697b-c800-41b5-b31e-ac87ca64d713 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Calling method '.version_select at 0x7fa75bf00d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:26.195006 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-130e697b-c800-41b5-b31e-ac87ca64d713 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-438382029 not found for user 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-130e697b-c800-41b5-b31e-ac87ca64d713 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Request method failure captured: Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-438382029 HTTP/1.1 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDoOkR_5jaxfbXBPK6Hs8bZsFl1cSBkAz8MSz041VcR2h6sMIQ2Cq48rv9VPucu62SLJ_NxO0jgBrF-YenoL68Etip45G_gDL_mPpeSLxny1Qb3b1_jHKRw4Z6IpbCROfkDmGM6_fA2DB-AtkBZIWRBQ8rgfFZa7HWKGfIlTtR6a0pQ Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/348a276fc2a94464b947c11bdc7c434a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 348a276fc2a94464b947c11bdc7c434a Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1162074409 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1162074409-project Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: exception: Keypair tempest-keypair-non-existent-438382029 not found for user 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'tempest-keypair-non-existent-438382029'} Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-438382029 not found for user 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.197341 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-438382029 not found for user 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-438382029 not found for user 7f5573be98c545c5853c9f9de2fd4b26 Sep 01 04:50:26.201208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:26.205579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-130e697b-c800-41b5-b31e-ac87ca64d713 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] Returning 404 to user: Keypair tempest-keypair-non-existent-438382029 not found for user 7f5573be98c545c5853c9f9de2fd4b26 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:26.206456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-130e697b-c800-41b5-b31e-ac87ca64d713 tempest-KeyPairsNegativeTestJSON-1162074409 tempest-KeyPairsNegativeTestJSON-1162074409-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-438382029" status: 404 len: 144 microversion: 2.1 time: 0.047718 Sep 01 04:50:26.207083 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 466/980] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 04:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-438382029 => generated 144 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:50:26.352142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:26.352877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:26.361892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:26.362379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:26.362811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:26.379600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:26.381285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:26.381708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:26.663125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:26.676020 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab673b82-fe43-4320-9a20-0ce029e7e9df tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.614342 Sep 01 04:50:26.676909 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 515/981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:26 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:26.686138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cbff2e4-4ad0-4026-a6bd-5a25494e9742 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bfc09d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:26.763228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cbff2e4-4ad0-4026-a6bd-5a25494e9742 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1412 microversion: 2.1 time: 0.085033 Sep 01 04:50:26.763812 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 516/982] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:26 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:26.772148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:26.773170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:26.776244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:26.785586 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f6c1ac9-c638-4d78-bd4a-5f471813c5ac tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.437097 Sep 01 04:50:26.798914 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 467/983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:26 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:26.816130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:26.816980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:26.820652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:26.821962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:26.822640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:26.824700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.085154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:27.085762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:27.091255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:27.115028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.115543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.115982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.116775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.117227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.117646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.139128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:27.148297 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0904aab7-0bb6-414f-9fe9-db546f9ef2f4 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1389 microversion: 2.1 time: 0.383234 Sep 01 04:50:27.153814 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 517/984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:26 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1389 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:27.162704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-68909aa4-1169-4023-a95d-9edc2c725c75 req-43f35cb0-2f56-4766-b205-d8623405b9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4b80bb-15cc-49d3-bc27-ad6a5f06884e", "tag": "73b4e919-25ce-4ea5-8eb1-05a49bc73fd1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:27.183474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-68909aa4-1169-4023-a95d-9edc2c725c75 req-43f35cb0-2f56-4766-b205-d8623405b9e9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.183954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-68909aa4-1169-4023-a95d-9edc2c725c75 req-43f35cb0-2f56-4766-b205-d8623405b9e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.184437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-68909aa4-1169-4023-a95d-9edc2c725c75 req-43f35cb0-2f56-4766-b205-d8623405b9e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.204200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-68909aa4-1169-4023-a95d-9edc2c725c75 req-43f35cb0-2f56-4766-b205-d8623405b9e9 service nova] Creating event network-changed:73b4e919-25ce-4ea5-8eb1-05a49bc73fd1 for instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e on n-h1-820368-37 Sep 01 04:50:27.211534 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-68909aa4-1169-4023-a95d-9edc2c725c75 req-43f35cb0-2f56-4766-b205-d8623405b9e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055999 Sep 01 04:50:27.212147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 518/985] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:27.357695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:27.375736 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0963670f-f749-4415-93a5-5058f05211f6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.294855 Sep 01 04:50:27.376330 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 468/986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:27 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:27.698452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:27.699502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:27.706933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.707772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.708731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.709745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.710444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.711114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.778151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8f89569-c75b-462d-8f70-9f2989a32144 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bf1d0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:27.897539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8f89569-c75b-462d-8f70-9f2989a32144 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1421 microversion: 2.1 time: 0.123470 Sep 01 04:50:27.901586 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 469/987] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:27 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:27.914460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:27.916097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:27.927024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.928058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.928676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:27.929779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:27.930421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:27.931780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:28.194319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:28.209762 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab38745f-85a2-4b35-935c-0bc656b38ea8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1505 microversion: 2.1 time: 0.302698 Sep 01 04:50:28.222948 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 470/988] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:27 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:28.226876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b766ecce-2f58-4ef5-a43a-ec578b613718 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bf15160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:28.293708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:28.301173 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b766ecce-2f58-4ef5-a43a-ec578b613718 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 200 len: 1421 microversion: 2.1 time: 0.088257 Sep 01 04:50:28.302408 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 471/989] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:50:28 2022] GET /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:28.308755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2171c20b-0b5d-4b51-9c2a-61636a35d9f3 req-63c81f57-620a-435d-8f51-965fa2189686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c42042-270f-4a18-934a-eea8c16522c6", "name": "network-vif-plugged", "status": "completed", "tag": "e52d6985-0139-404c-9a48-2be473f5440f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:28.324906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c867aa7-840a-40c7-80fa-5245abb77e76 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.630568 Sep 01 04:50:28.344366 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 519/990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:27 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:28.352828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2171c20b-0b5d-4b51-9c2a-61636a35d9f3 req-63c81f57-620a-435d-8f51-965fa2189686 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:28.354743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2171c20b-0b5d-4b51-9c2a-61636a35d9f3 req-63c81f57-620a-435d-8f51-965fa2189686 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:28.357323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2171c20b-0b5d-4b51-9c2a-61636a35d9f3 req-63c81f57-620a-435d-8f51-965fa2189686 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:28.365356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:28.369769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:28.388747 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2171c20b-0b5d-4b51-9c2a-61636a35d9f3 req-63c81f57-620a-435d-8f51-965fa2189686 service nova] Creating event network-vif-plugged:e52d6985-0139-404c-9a48-2be473f5440f for instance 98c42042-270f-4a18-934a-eea8c16522c6 on n-h2-820368-37 Sep 01 04:50:28.390581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:28.391536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:28.392201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:28.395960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:28.396972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:28.400878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:28.409982 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2171c20b-0b5d-4b51-9c2a-61636a35d9f3 req-63c81f57-620a-435d-8f51-965fa2189686 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102496 Sep 01 04:50:28.411521 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 472/991] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:28.418085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c5d5ceb-dda1-44bd-896d-eb7c12d69650 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bf1f0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:28.842538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:28.854108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72489ab4-d195-4620-8079-2f465317ae12 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1588 microversion: 2.1 time: 0.508131 Sep 01 04:50:28.867460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 520/992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:28 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1588 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:28.879253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:28.879866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:28.886724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:28.887340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:28.887806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:28.888508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:28.889172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:28.889790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.239012 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c5d5ceb-dda1-44bd-896d-eb7c12d69650 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 204 len: 0 microversion: 2.1 time: 0.825763 Sep 01 04:50:29.239614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:29.240146 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 473/993] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:28 2022] DELETE /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:29.247751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.248779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:29.254250 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af92493c-c426-4df8-ab29-e4ccb6506f02 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.385454 Sep 01 04:50:29.254782 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 521/994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:28 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:29.257117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.258040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.258713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.259762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.260446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.261279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.404807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5ca0d55-ee0f-419a-8763-db939c585d6f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162836 Sep 01 04:50:29.405416 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 474/995] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:50:29 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:29.419143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.419884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:29.439618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.440567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.441167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.443564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.444437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.445069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.454716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Calling method '.version_select at 0x7fa75bf39b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.470027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.470987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.471654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.473440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.474028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.475392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.511619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ded92f63-afce-4430-9059-853277acbb5c tempest-AbsoluteLimitsTestJSON-577319715 tempest-AbsoluteLimitsTestJSON-577319715-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.255403 Sep 01 04:50:29.513678 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 522/996] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 1 04:50:29 2022] GET /compute/v2.1/limits => generated 511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:29.519787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.520674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:29.549663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.551354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.552737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.555801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.557521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.559479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.635385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:50:29.669542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:29.694596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be3d24d4-de8f-430c-897d-549c327f2417 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1495 microversion: 2.1 time: 0.265689 Sep 01 04:50:29.706701 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 475/997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:29 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1495 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:29.717744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.719780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:29.727728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.728230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.728679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.730692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.731224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.731659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.788470 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60aa7494-62cf-47d3-b2ad-4a99897ae421 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 204 len: 0 microversion: 2.1 time: 0.272346 Sep 01 04:50:29.790118 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 523/998] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:50:29 2022] DELETE /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:29.825045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13ce84c4-dd07-4300-bc9e-ca82074cf972 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '.version_select at 0x7fa76006bf70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.834499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ce84c4-dd07-4300-bc9e-ca82074cf972 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.836047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ce84c4-dd07-4300-bc9e-ca82074cf972 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.838661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ce84c4-dd07-4300-bc9e-ca82074cf972 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.863372 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13ce84c4-dd07-4300-bc9e-ca82074cf972 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.068029 Sep 01 04:50:29.865129 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 524/999] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:50:29 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:29.878984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:29.880018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:29.892702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.893493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.894377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.895427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:29.896077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:29.896780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:29.922855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:30.360799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:30.368782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-312c5ca1-40fa-4700-bc22-4fee53168e33 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.662687 Sep 01 04:50:30.382632 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 476/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:29 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:30.388357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-728692753", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d85331bd-fb06-4841-92d7-0758031f2664"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:30.415072 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b92584b5-dd17-4c66-96e7-a04ca6266242 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1648 microversion: 2.1 time: 0.540149 Sep 01 04:50:30.416157 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 525/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:29 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1648 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:30.477970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:30.481005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:30.490266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:30.491045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:30.491930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:30.492775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] validate_networks() for [('d85331bd-fb06-4841-92d7-0758031f2664', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:50:30.493780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:30.494448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:30.495071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:30.811850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:30.821057 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75c0791c-4c09-4667-88b0-950c816a14ea tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1316 microversion: 2.1 time: 0.403763 Sep 01 04:50:30.831603 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 526/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:30 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:30.842790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-add588b3-a034-43bb-90b3-7562655b678f req-0bfecc1a-de5b-45e4-9370-d4f2b8ff45e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd10316-4a5a-4a44-a224-0fadecdb17a8", "name": "network-vif-plugged", "status": "completed", "tag": "383ad9a4-5173-41a7-9f7b-41d4b144fe12"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:30.855783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-add588b3-a034-43bb-90b3-7562655b678f req-0bfecc1a-de5b-45e4-9370-d4f2b8ff45e7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:30.856539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-add588b3-a034-43bb-90b3-7562655b678f req-0bfecc1a-de5b-45e4-9370-d4f2b8ff45e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:30.857129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-add588b3-a034-43bb-90b3-7562655b678f req-0bfecc1a-de5b-45e4-9370-d4f2b8ff45e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:30.871301 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-add588b3-a034-43bb-90b3-7562655b678f req-0bfecc1a-de5b-45e4-9370-d4f2b8ff45e7 service nova] Creating event network-vif-plugged:383ad9a4-5173-41a7-9f7b-41d4b144fe12 for instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 on n-h1-820368-37 Sep 01 04:50:30.877040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-add588b3-a034-43bb-90b3-7562655b678f req-0bfecc1a-de5b-45e4-9370-d4f2b8ff45e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039666 Sep 01 04:50:30.878289 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 527/1003] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:30.884615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-649782093", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "59c92b9b-a4b3-4189-97d1-ab9f2663410e"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:30.992066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] validate_networks() for [('59c92b9b-a4b3-4189-97d1-ab9f2663410e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:50:31.419422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:50:31.419961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:50:31.420548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:50:31.421136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:50:31.421864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:50:31.435105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:31.438437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:31.439467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:31.442036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:31.444420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:31.445418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:31.509667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:31.523155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for user fcfdd4deb06b413d9585d204bd614e06 and project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:31.553172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:50:31.555901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:50:31.648737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aad66b71-6ee0-4de2-b452-34ff6fbc8709 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264586 Sep 01 04:50:31.653138 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 477/1004] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:50:31.679978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:31.680512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:31.703835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:31.704648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:31.705706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:31.707249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:31.709749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:31.711579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:31.989572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:32.005734 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bd08e94-16a1-43be-9fc6-1681da26fe9e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1588 microversion: 2.1 time: 0.345974 Sep 01 04:50:32.022188 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 478/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:31 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1588 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:32.032527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6a2b3d56-c8e6-4c98-8545-0cf9eaed5f30 req-25dfa5c1-9839-4902-b565-7adc7d59054b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26874bdb-4cfa-4522-ac41-5370de3e8c8c", "tag": "31f29742-91ff-49c1-b6a5-677ff0d64164"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:32.045458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a2b3d56-c8e6-4c98-8545-0cf9eaed5f30 req-25dfa5c1-9839-4902-b565-7adc7d59054b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.045950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a2b3d56-c8e6-4c98-8545-0cf9eaed5f30 req-25dfa5c1-9839-4902-b565-7adc7d59054b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.046373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a2b3d56-c8e6-4c98-8545-0cf9eaed5f30 req-25dfa5c1-9839-4902-b565-7adc7d59054b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.063640 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6a2b3d56-c8e6-4c98-8545-0cf9eaed5f30 req-25dfa5c1-9839-4902-b565-7adc7d59054b service nova] Creating event network-changed:31f29742-91ff-49c1-b6a5-677ff0d64164 for instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c on n-h1-820368-37 Sep 01 04:50:32.067704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:50:32.068209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:50:32.069034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:50:32.069684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:50:32.071104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:50:32.071284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6a2b3d56-c8e6-4c98-8545-0cf9eaed5f30 req-25dfa5c1-9839-4902-b565-7adc7d59054b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047944 Sep 01 04:50:32.072304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 479/1006] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:32.079866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:32.081248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:32.091072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.091862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.092536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.093536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.095923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.096809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.104202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.104694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.105125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.105851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.106302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.106739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.157937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:32.169304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for user 6c067efaa01740ee9284a943d574f086 and project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:32.220587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:50:32.230376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:50:32.353375 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed8a9014-f400-4468-88db-28e5a0aced71 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473395 Sep 01 04:50:32.355986 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 528/1007] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:50:32.367293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3c2442f-e720-4ad5-a3f5-a71c5cdc3e2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:32.368090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3c2442f-e720-4ad5-a3f5-a71c5cdc3e2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:32.427107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:32.444902 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d9fe40d-3daa-499f-a39e-539e7e058aac tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1322 microversion: 2.1 time: 0.370856 Sep 01 04:50:32.446690 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 480/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:32 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:32.490861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:32.496402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:32.519104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.520230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.522419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.523760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:32.524447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:32.525265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:32.749948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3c2442f-e720-4ad5-a3f5-a71c5cdc3e2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:32.771879 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3c2442f-e720-4ad5-a3f5-a71c5cdc3e2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1207 microversion: 2.1 time: 0.414412 Sep 01 04:50:32.774753 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 529/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:32 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1207 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:32.783405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d93403c-4ff8-42b0-8e51-43f53219ca0a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:32.784974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d93403c-4ff8-42b0-8e51-43f53219ca0a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:33.041639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d93403c-4ff8-42b0-8e51-43f53219ca0a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:33.049185 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d93403c-4ff8-42b0-8e51-43f53219ca0a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1210 microversion: 2.1 time: 0.271610 Sep 01 04:50:33.050103 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 530/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:32 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1210 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:33.057084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bebc56c9-1470-475e-be99-bcdcbf03f544 req-f3895736-262a-4771-9da8-78c852f10dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c6db0a-5d7e-4421-898b-2b390a63fac6", "name": "network-vif-unplugged", "status": "completed", "tag": "c6366995-3ffc-4d77-be2f-8cbbbef5bfdf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:33.089613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bebc56c9-1470-475e-be99-bcdcbf03f544 req-f3895736-262a-4771-9da8-78c852f10dcf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.090329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bebc56c9-1470-475e-be99-bcdcbf03f544 req-f3895736-262a-4771-9da8-78c852f10dcf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.090747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bebc56c9-1470-475e-be99-bcdcbf03f544 req-f3895736-262a-4771-9da8-78c852f10dcf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.147767 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bebc56c9-1470-475e-be99-bcdcbf03f544 req-f3895736-262a-4771-9da8-78c852f10dcf service nova] Creating event network-vif-unplugged:c6366995-3ffc-4d77-be2f-8cbbbef5bfdf for instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 on n-h2-820368-37 Sep 01 04:50:33.157598 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bebc56c9-1470-475e-be99-bcdcbf03f544 req-f3895736-262a-4771-9da8-78c852f10dcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105858 Sep 01 04:50:33.158223 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 531/1011] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:33.282708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:33.295530 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ace53a54-9deb-4b4e-9413-d9782de7cc92 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1466 microversion: 2.1 time: 0.832168 Sep 01 04:50:33.299214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 481/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:32 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1466 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:33.321221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:33.321931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:33.340475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.340966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.344015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.379894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.380403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.380871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.472088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:33.481435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:33.499889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.500386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.500809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.501519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.510292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.513219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.843787 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e84a3a5a-b0a5-4343-8fc3-06688ea6899e tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1619 microversion: 2.1 time: 0.528409 Sep 01 04:50:33.863128 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 532/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:33 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1619 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:33.869916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:33.870712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:33.890840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:33.897273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.897765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.901393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.903085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:33.919118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:33.919799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:33.963196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:33.980244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cdaf2ce-d84f-48a3-afdf-e3e6f8debae0 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1471 microversion: 2.1 time: 0.512923 Sep 01 04:50:34.015001 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 482/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:33 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1471 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:34.029750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:34.030283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:34.054396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.056993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.057466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.059831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.060312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.060738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.110543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Request method failure captured: Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8/diagnostics HTTP/1.1 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDn17f7nivWXyMfc1WAhwh4m1fbsg7ZN9sz2Yu3eKsMzA517YyjRrQ91Fl5zeI-3dKixaSNSXx9iv45fUkUZzRCfcsTFVx2OJmPgjv_Tg0jkOogTbT3JU6V0yjgy1X6q_sS_J8e1_ofPz23cVE-SBD0JtekjyJwiaG-aWz9UX-RRpuY Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 747b081cee084466bbfc7580e4814a35 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1644727628 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/747b081cee084466bbfc7580e4814a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/747b081cee084466bbfc7580e4814a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_747b081cee084466bbfc7580e4814a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/747b081cee084466bbfc7580e4814a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1644727628 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 747b081cee084466bbfc7580e4814a35 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1644727628 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerDiagnosticsNegativeTest-1644727628-project Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 3fdd9d166a1b486f90483a3b25e4ad11 Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1644727628-project Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': 'fdd10316-4a5a-4a44-a224-0fadecdb17a8'} Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:34.118794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:34.123954 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:34.123954 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:34.123954 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:50:34.123954 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:50:34.123954 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 01 04:50:34.123954 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:34.125520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:34.126565 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86b472cd-b714-48a0-8cb4-219c9e91be64 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.110273 Sep 01 04:50:34.132834 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 483/1015] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:50:34 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8/diagnostics => generated 117 bytes in 117 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:50:34.138487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:34.140678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:34.168371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.168865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.169302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.176203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.183102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.183747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.250391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:34.267969 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec0e22ca-dd10-40f3-83f7-949044581c89 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.403193 Sep 01 04:50:34.268820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 533/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:33 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:34.292083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1400384050", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e2eda1a9-f765-416e-843a-a16925ec4c08"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:34.394433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:34.407392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1822cb61-4d91-4430-96c6-7c55512c5c30 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1262 microversion: 2.1 time: 0.269790 Sep 01 04:50:34.408297 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 484/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:34 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1262 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:34.423922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:50:34.425154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:34.427713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:34.459185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.463643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.464709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.470801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.471761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.472464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.563989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:50:34.675818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:34.762602 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aaf4880d-13af-4604-a25c-016627b977b8 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 204 len: 0 microversion: 2.1 time: 0.349338 Sep 01 04:50:34.763492 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 485/1018] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:50:34 2022] DELETE /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:34.771797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0d972ac2-b34b-4056-997d-340d3b626b5e req-e366dde6-e6cb-4a5c-8ec5-601efb8efc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c6db0a-5d7e-4421-898b-2b390a63fac6", "name": "network-vif-deleted", "tag": "c6366995-3ffc-4d77-be2f-8cbbbef5bfdf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:34.783724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d972ac2-b34b-4056-997d-340d3b626b5e req-e366dde6-e6cb-4a5c-8ec5-601efb8efc7d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.784885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d972ac2-b34b-4056-997d-340d3b626b5e req-e366dde6-e6cb-4a5c-8ec5-601efb8efc7d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.785688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d972ac2-b34b-4056-997d-340d3b626b5e req-e366dde6-e6cb-4a5c-8ec5-601efb8efc7d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.801906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0d972ac2-b34b-4056-997d-340d3b626b5e req-e366dde6-e6cb-4a5c-8ec5-601efb8efc7d service nova] Creating event network-vif-deleted:c6366995-3ffc-4d77-be2f-8cbbbef5bfdf for instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 on n-h2-820368-37 Sep 01 04:50:34.808249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0d972ac2-b34b-4056-997d-340d3b626b5e req-e366dde6-e6cb-4a5c-8ec5-601efb8efc7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042960 Sep 01 04:50:34.809627 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 486/1019] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:34.815875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:34.816876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:34.819393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:34.827281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.828556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.829362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:34.830586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:34.831228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:34.831824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:35.097813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:50:35.098333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:50:35.099110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:50:35.099420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:50:35.099901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:50:35.115232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:35.119019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:35.125060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:35.126089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:35.129655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:35.130214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:35.233679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:35.257935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Getting quotas for user be2a7c5e7b394b9b9b44aef2156c7515 and project a917f0bb781a42879a605ffca90e436d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:35.289061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:50:35.291755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:50:35.371095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:35.386328 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6dc1d230-15ac-4e96-bf2e-d4c6c47a84e2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102677 Sep 01 04:50:35.398265 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1b5f8a0-1153-4685-980f-4d012edd7ac1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1477 microversion: 2.1 time: 0.587262 Sep 01 04:50:35.398849 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 487/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:34 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1477 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:35.412506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 534/1021] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:50:35.429968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdd674c7-6283-4d41-92a9-fb3a2b0b4bb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:35.434896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdd674c7-6283-4d41-92a9-fb3a2b0b4bb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:35.461102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:35.463076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:35.474763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:35.490866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:35.491752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:35.493173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:35.493803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:35.494379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:35.896986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdd674c7-6283-4d41-92a9-fb3a2b0b4bb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:35.905652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:35.911663 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdd674c7-6283-4d41-92a9-fb3a2b0b4bb4 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1217 microversion: 2.1 time: 0.504402 Sep 01 04:50:35.923546 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43503a1c-1ac7-4052-b273-7496a9d2fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1265 microversion: 2.1 time: 0.468829 Sep 01 04:50:35.923861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 535/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:35 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1217 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:35.923953 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 488/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:35 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1265 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:35.933870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:35.934428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:35.952452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:35.953273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:35.953963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:35.954912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:35.956374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:35.957888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:36.129916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:36.142392 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59fe7ca3-c687-4e9d-b0ef-051100f7c954 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1268 microversion: 2.1 time: 0.220149 Sep 01 04:50:36.144065 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 536/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:35 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1268 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:36.425419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:36.426783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:36.449380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:36.449811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:36.450247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:36.456891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:36.457591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:36.457819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:36.946172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:36.946772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:36.954486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:36.956399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:36.957261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:36.958396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:36.959328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:36.960233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:37.269813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:37.279068 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1be108c4-fd5b-4e2d-b69f-8605a63d18ef tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1265 microversion: 2.1 time: 0.337048 Sep 01 04:50:37.300897 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 537/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:36 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:37.308126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:37.308733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:37.320207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:37.320928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:37.321529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:37.322388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:37.323155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:37.324395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:37.445739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:37.462346 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ed6a139-b899-49d0-bd5c-ce25c41b12b3 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1477 microversion: 2.1 time: 1.041715 Sep 01 04:50:37.481968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 489/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:36 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1477 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:37.496964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:37.497844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:37.526027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:37.537500 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06effdf1-f991-47d3-b091-a43d65b1aa5e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1269 microversion: 2.1 time: 0.233339 Sep 01 04:50:37.538098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 538/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:37 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1269 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:37.545838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:37.546341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:37.553676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:37.557060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:37.561757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:37.566022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:37.773555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:37.787699 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d7d57bd-7f0d-4d66-af54-1fd9617f9701 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1268 microversion: 2.1 time: 0.303704 Sep 01 04:50:37.796262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 490/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:37 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1268 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:38.301654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:38.302288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:38.311634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:38.312649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:38.313259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:38.314628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:38.315276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:38.316115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:38.495775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:38.497079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:38.510753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:38.513241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:38.515480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:38.517614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:38.518275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:38.518962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:38.826127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:38.838685 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68382e8c-d5cb-4283-aeac-40720b67c6a1 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1435 microversion: 2.1 time: 0.348686 Sep 01 04:50:38.855159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 491/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:38 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1435 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:38.871987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:38.872968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:38.880375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:38.881310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:38.881962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:38.883190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:38.883881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:38.884539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.134743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:39.148016 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f54c1ef8-0697-4a50-9a2e-fa32faff4d8b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1275 microversion: 2.1 time: 0.291006 Sep 01 04:50:39.148869 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 492/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:38 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:39.153679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-113d8d1b-2a42-4fa0-aa74-70fd6e98198a req-bd3b7dc7-95f6-4e76-b5e7-0f64d70c425d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd10316-4a5a-4a44-a224-0fadecdb17a8", "name": "network-vif-deleted", "tag": "383ad9a4-5173-41a7-9f7b-41d4b144fe12"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:39.159654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:39.170061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4acd4af9-7d67-4743-a19f-7b0e8f651675 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.873727 Sep 01 04:50:39.173992 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 539/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:38 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:39.180048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:39.185479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-113d8d1b-2a42-4fa0-aa74-70fd6e98198a req-bd3b7dc7-95f6-4e76-b5e7-0f64d70c425d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:39.191418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:39.193038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-113d8d1b-2a42-4fa0-aa74-70fd6e98198a req-bd3b7dc7-95f6-4e76-b5e7-0f64d70c425d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:39.193627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-113d8d1b-2a42-4fa0-aa74-70fd6e98198a req-bd3b7dc7-95f6-4e76-b5e7-0f64d70c425d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.205522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:39.206012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:39.206442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.216647 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-113d8d1b-2a42-4fa0-aa74-70fd6e98198a req-bd3b7dc7-95f6-4e76-b5e7-0f64d70c425d service nova] Creating event network-vif-deleted:383ad9a4-5173-41a7-9f7b-41d4b144fe12 for instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 on n-h1-820368-37 Sep 01 04:50:39.218130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:39.220173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:39.220820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.242309 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-113d8d1b-2a42-4fa0-aa74-70fd6e98198a req-bd3b7dc7-95f6-4e76-b5e7-0f64d70c425d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091976 Sep 01 04:50:39.250594 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 493/1032] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:39.748497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:39.767450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85c0d770-7898-45b3-82fb-016a90368917 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.588675 Sep 01 04:50:39.770838 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 540/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:39 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:39.864964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:39.865850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:39.872747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:39.873380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:39.873915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.876131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:39.876853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:39.877674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.923195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:39.923930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:39.924576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:39.925839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lazy-loading 'fault' on Instance uuid fdd10316-4a5a-4a44-a224-0fadecdb17a8 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:40.104817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fdd9d166a1b486f90483a3b25e4ad11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '747b081cee084466bbfc7580e4814a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:40.123050 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd5240a3-56e6-4ded-86b6-5151e646e4ef tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 200 len: 1312 microversion: 2.1 time: 0.264339 Sep 01 04:50:40.126597 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 494/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:39 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:40.169818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:40.170726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:40.180622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:40.184244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:40.185022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:40.185987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:40.189482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:40.190251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:40.195727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:40.196333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:40.208752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:40.209532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:40.209972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:40.210702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:40.215599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:40.216045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:40.378421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:40.393123 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcb56e9a-efdc-47e8-a475-dea079ed75a6 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1275 microversion: 2.1 time: 0.226987 Sep 01 04:50:40.400673 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 541/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:40 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:40.407759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:40.409155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:40.416790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:40.417401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:40.418110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:40.419390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:40.420081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:40.420702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:40.838312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:40.865928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1c5aac0-4c51-4a0e-a234-39f80b086ed7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.671689 Sep 01 04:50:40.873158 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 495/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:40 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:41.050406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:41.088290 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd036c5d-d45e-4476-bf71-58a60d114539 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 2424 microversion: 2.25 time: 0.685701 Sep 01 04:50:41.091894 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 542/1037] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:40 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 2424 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:41.099737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:41.104149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:41.114806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.115567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.116441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.118318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.119092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.119678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.157046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0be03871-2b4e-48ab-aa70-579f0dec2f94 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Action: 'create', calling method: .version_select at 0x7fa75bf0baf0>, body: {"keypair": {"name": "tempest-keypair-1663476022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8qUiyBd6cH+Zk2jSE2yHmfBwcsrdu+Gwm9C1IB/bRpfjasBjEZN6XGG42ZAWLoQVNu7/25s2N6MkndBH56D4+PypxnEB7OED/xDU5tkOxn/qsHzGZlQzToCfFJ+gWafg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:41.179075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0be03871-2b4e-48ab-aa70-579f0dec2f94 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Getting quotas for project 5d249f0206964985b5f6ebd59e1e7269. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:50:41.186611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0be03871-2b4e-48ab-aa70-579f0dec2f94 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Getting quotas for user 1b306ffc96ba4bb4a7d631f19d43072b and project 5d249f0206964985b5f6ebd59e1e7269. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:50:41.225943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0be03871-2b4e-48ab-aa70-579f0dec2f94 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.342788 Sep 01 04:50:41.229166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 496/1038] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:50:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:41.243096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-37", "block_migration": "auto"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:41.250231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:41.270742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.271352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.272799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.277481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.278174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.278761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.354438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'flavor' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:41.379281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Going to try to live migrate instance to n-h2-820368-37 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:50:41.483709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:41.553354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:41.567721 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4418fb0b-1e89-4a56-9130-c1d8dbfa8d5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.474684 Sep 01 04:50:41.568861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 543/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:41 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:41.586156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:41.587158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] [instance: fdd10316-4a5a-4a44-a224-0fadecdb17a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:41.621113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.623737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.624389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.627839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.628456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.628976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.726956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] HTTP exception thrown: Instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 could not be found. Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Request method failure captured: Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 HTTP/1.1 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDn17f7nivWXyMfc1WAhwh4m1fbsg7ZN9sz2Yu3eKsMzA517YyjRrQ91Fl5zeI-3dKixaSNSXx9iv45fUkUZzRCfcsTFVx2OJmPgjv_Tg0jkOogTbT3JU6V0yjgy1X6q_sS_J8e1_ofPz23cVE-SBD0JtekjyJwiaG-aWz9UX-RRpuY Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 747b081cee084466bbfc7580e4814a35 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1644727628 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/747b081cee084466bbfc7580e4814a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/747b081cee084466bbfc7580e4814a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_747b081cee084466bbfc7580e4814a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/747b081cee084466bbfc7580e4814a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1644727628 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 747b081cee084466bbfc7580e4814a35 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1644727628 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiagnosticsNegativeTest-1644727628-project Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3fdd9d166a1b486f90483a3b25e4ad11 Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1644727628-project Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 could not be found. Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'fdd10316-4a5a-4a44-a224-0fadecdb17a8'} Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 could not be found. Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 could not be found. Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:41.736555 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 could not be found. Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] Returning 404 to user: Instance fdd10316-4a5a-4a44-a224-0fadecdb17a8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dd5a85c-9017-4b27-a66d-8aef6864a379 tempest-ServerDiagnosticsNegativeTest-1644727628 tempest-ServerDiagnosticsNegativeTest-1644727628-project] 10.222.0.26 "GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8" status: 404 len: 111 microversion: 2.1 time: 0.168038 Sep 01 04:50:41.741572 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 544/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:41 2022] GET /compute/v2.1/servers/fdd10316-4a5a-4a44-a224-0fadecdb17a8 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:50:41.748517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:41.749261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:41.764437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.765039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.765749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:41.766847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:41.767504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:41.768110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:42.435580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:42.445887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db278612-0911-4d08-9917-f333f1864945 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.706232 Sep 01 04:50:42.448530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 545/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:41 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:42.455476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e84dcf95-8217-4de0-b4fc-7cc3a3a90e21 req-299944b2-3f45-4390-82f9-47e1d2989eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259cb86c-0712-4582-847a-96d54ed7c4f0", "tag": "f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:42.472250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e84dcf95-8217-4de0-b4fc-7cc3a3a90e21 req-299944b2-3f45-4390-82f9-47e1d2989eb4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:42.473062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e84dcf95-8217-4de0-b4fc-7cc3a3a90e21 req-299944b2-3f45-4390-82f9-47e1d2989eb4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:42.473654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e84dcf95-8217-4de0-b4fc-7cc3a3a90e21 req-299944b2-3f45-4390-82f9-47e1d2989eb4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:42.489265 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e84dcf95-8217-4de0-b4fc-7cc3a3a90e21 req-299944b2-3f45-4390-82f9-47e1d2989eb4 service nova] Creating event network-changed:f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c for instance 259cb86c-0712-4582-847a-96d54ed7c4f0 on n-h2-820368-37 Sep 01 04:50:42.495640 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e84dcf95-8217-4de0-b4fc-7cc3a3a90e21 req-299944b2-3f45-4390-82f9-47e1d2989eb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044924 Sep 01 04:50:42.497140 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 546/1042] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:42.509109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:42.510013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:42.522431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:42.523926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:42.524914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:42.529110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:42.530475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:42.531570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.346421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:43.373480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-002db9c3-8285-4cc8-8c17-5d95755bc9c3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.866245 Sep 01 04:50:43.391774 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 547/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:42 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:43.414354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1d2c40f5-724c-4aa8-8027-3ced9bd101d6 req-a55ab3f1-625d-4f8a-a79f-c4e398e193d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7738b864-3cdf-4c60-b8cd-3cbfc92a81c9", "tag": "1104478b-f5c0-4743-aae4-152e2a2dd154"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:43.441247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d2c40f5-724c-4aa8-8027-3ced9bd101d6 req-a55ab3f1-625d-4f8a-a79f-c4e398e193d3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.441943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d2c40f5-724c-4aa8-8027-3ced9bd101d6 req-a55ab3f1-625d-4f8a-a79f-c4e398e193d3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.442282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d2c40f5-724c-4aa8-8027-3ced9bd101d6 req-a55ab3f1-625d-4f8a-a79f-c4e398e193d3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.468805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1d2c40f5-724c-4aa8-8027-3ced9bd101d6 req-a55ab3f1-625d-4f8a-a79f-c4e398e193d3 service nova] Creating event network-changed:1104478b-f5c0-4743-aae4-152e2a2dd154 for instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 on n-h1-820368-37 Sep 01 04:50:43.482576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1d2c40f5-724c-4aa8-8027-3ced9bd101d6 req-a55ab3f1-625d-4f8a-a79f-c4e398e193d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088203 Sep 01 04:50:43.486237 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 548/1044] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:43.498274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:43.499271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:43.515173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.516276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.516733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.517453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.517904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.518349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.569396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:43.800371 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38fe351a-a5c2-441b-9aec-81a96b7cd4f8 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/action" status: 202 len: 0 microversion: 2.25 time: 2.569365 Sep 01 04:50:43.801555 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 497/1045] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 04:50:41 2022] POST /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/action => generated 0 bytes in 2571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:43.809520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:43.816245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:43.825362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.826026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.826456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.827195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.828377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.829706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.957461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:43.970591 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7848f3a0-3acf-4a53-9069-268ba9ec2ae5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.482966 Sep 01 04:50:43.972033 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 549/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:43 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:43.977548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:43.978149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:43.984829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.985591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.986022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:43.986767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:43.987388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:43.987812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:44.156567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:44.165260 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2b83a5c-80a9-4026-81fa-881b5e3bbd5d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.361573 Sep 01 04:50:44.179505 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 498/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:43 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:44.283661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:44.312281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:44.314399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:44.317266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce9d2940-4791-4458-b6ac-11ae76a6bd63 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.343843 Sep 01 04:50:44.318678 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 550/1048] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:43 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:44.398692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:44.400003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:44.410367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:44.411212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:44.411836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:44.412701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:44.413305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:44.413876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:44.579321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-07b02605-239a-4f9f-b959-80dc921b58fd req-dc9b6fc9-10f4-4352-b04a-d9a424ff613b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5034886-1ed0-4985-988a-617e6bb57178", "tag": "8207761b-ec9f-48b6-ab48-3831645f3314"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:44.590341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-07b02605-239a-4f9f-b959-80dc921b58fd req-dc9b6fc9-10f4-4352-b04a-d9a424ff613b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:44.590813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-07b02605-239a-4f9f-b959-80dc921b58fd req-dc9b6fc9-10f4-4352-b04a-d9a424ff613b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:44.591455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-07b02605-239a-4f9f-b959-80dc921b58fd req-dc9b6fc9-10f4-4352-b04a-d9a424ff613b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:44.607267 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-07b02605-239a-4f9f-b959-80dc921b58fd req-dc9b6fc9-10f4-4352-b04a-d9a424ff613b service nova] Creating event network-changed:8207761b-ec9f-48b6-ab48-3831645f3314 for instance c5034886-1ed0-4985-988a-617e6bb57178 on n-h2-820368-37 Sep 01 04:50:44.617977 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-07b02605-239a-4f9f-b959-80dc921b58fd req-dc9b6fc9-10f4-4352-b04a-d9a424ff613b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041922 Sep 01 04:50:44.621569 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 551/1049] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:44.694547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:44.728364 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5178635c-8d84-47c2-9f61-cedb14fb94e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.334582 Sep 01 04:50:44.748803 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 499/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:44 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:44.994285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:44.995664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:45.009499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.010126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.010787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.019114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.019686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.020309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.159223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:45.187281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:45.188502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:45.202763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.203703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.204354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.206664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.207800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.209134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.365338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:45.373409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a2b9ee1-9976-43db-9151-6b056d5a0e3a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.384969 Sep 01 04:50:45.378028 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 552/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:44 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:45.383881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:45.389472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:45.404827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.405907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.406637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.407617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.408087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.408523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.514523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:45.523548 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8b1ae41-66dc-4d8a-ba5f-cc48a252eafc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.341766 Sep 01 04:50:45.524497 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 500/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:45 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:45.615720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:45.625970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:45.627925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:45.629407 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d84204f-cb49-42b7-9272-2aaaeba73302 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.250173 Sep 01 04:50:45.630126 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 553/1053] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:45 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:45.706145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c4703bd-db18-4159-ac4b-465bd2c76037 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:45.715311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c4703bd-db18-4159-ac4b-465bd2c76037 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.189653 Sep 01 04:50:45.719255 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 501/1054] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:50:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:45.751203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:45.752036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:45.759548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.760442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.761104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.762177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:45.774043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:45.775008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:45.902839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:45.950207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:45.962379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10ceac4a-79ed-4c89-afe1-7aa3ec8d15b5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.215764 Sep 01 04:50:45.963649 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 554/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:45 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:46.345059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cf1f51a-b3fe-424f-ba06-05700f2dc8d8 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-322378547", "imageRef": "50b856a1-a2c2-40cd-940b-c84a4dfaf003", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:46.396381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:46.396990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:46.403714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.404432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.404941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.405579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.406393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.406518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.416212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-7cf1f51a-b3fe-424f-ba06-05700f2dc8d8 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:50:46.679764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:46.688852 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f5e64ba-6bc7-4e7d-bf95-7527304c0f0e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.296563 Sep 01 04:50:46.689432 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 555/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:46 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:46.694408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:46.695323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:46.701542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.702057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.702460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.704001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.704661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.705253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.717408 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7cf1f51a-b3fe-424f-ba06-05700f2dc8d8 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cf1f51a-b3fe-424f-ba06-05700f2dc8d8 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] Request method failure captured: Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 142 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDolZ1aFFIDzDPGQmQC0ttFRbpa5ppGnMnANuAzl4UdtaBrmtm27d8ox7a4GiAJha9aCK2j_3QIdlsaA-ffpU8paJZ7k9YxXKJ2jrwCDgV-UYPg4cRUCcv1kRnUur5-662D2NKBFT6-raBdumVb-yUUbJF_55ivoBQCtUVBDJ3VyHV8 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f8dbb257b41f4653b86b45a5016ee6dd Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FlavorsV2NegativeTest-1256910834 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8dbb257b41f4653b86b45a5016ee6dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8dbb257b41f4653b86b45a5016ee6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8dbb257b41f4653b86b45a5016ee6dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8dbb257b41f4653b86b45a5016ee6dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FlavorsV2NegativeTest-1256910834 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f8dbb257b41f4653b86b45a5016ee6dd Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1256910834 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FlavorsV2NegativeTest-1256910834-project Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 21f03b86199143769101ad3bfaddb884 Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FlavorsV2NegativeTest-1256910834-project Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-322378547", "imageRef": "50b856a1-a2c2-40cd-940b-c84a4dfaf003", "flavorRef": "452"}} Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: exception: Flavor's memory is too small for requested image. Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-322378547', 'imageRef': '50b856a1-a2c2-40cd-940b-c84a4dfaf003', 'flavorRef': '452'}}} Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:46.719709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cf1f51a-b3fe-424f-ba06-05700f2dc8d8 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:50:46.724503 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cf1f51a-b3fe-424f-ba06-05700f2dc8d8 tempest-FlavorsV2NegativeTest-1256910834 tempest-FlavorsV2NegativeTest-1256910834-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.381998 Sep 01 04:50:46.725809 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 502/1057] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:50:46 2022] POST /compute/v2.1/servers => generated 93 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:50:46.731806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:46.732572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:46.740420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.741169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.741800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.742660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.743310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.743920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.939591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:46.951801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a07965e3-3d42-43f9-bc5d-e265320be454 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.260955 Sep 01 04:50:46.957741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:46.966251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 556/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:46 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:46.968678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:46.970129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:46.971342 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c480905c-af70-4cac-b2ef-b7b23c427a44 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.244856 Sep 01 04:50:46.972006 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 503/1059] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:46 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:46.988191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:46.989018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:46.995548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.996242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.996902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:46.997785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:46.998242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:46.999036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:47.147697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:47.158566 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c345acb2-a686-4e83-9db0-24c5f84e8291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.176643 Sep 01 04:50:47.159819 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 557/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:46 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:47.713779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:47.715516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:47.723289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:47.724280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:47.735847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:47.747305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:47.748025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:47.748478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:47.792232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:47.940006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:47.949886 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c870f60-04f3-4d51-85e1-1d2666e6c3a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.239952 Sep 01 04:50:47.951743 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 504/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:47 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:47.974450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:47.975818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:47.982962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:47.983758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:47.984655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:47.985680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:47.986360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:47.987030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:47.996450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:47.997181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:48.006479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.007160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.007584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.008363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.009154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.009817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.261740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:48.273628 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b373d1cf-2e3a-4086-9aa9-6bc5cab61638 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.301750 Sep 01 04:50:48.274239 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 558/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:47 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:48.291190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:48.291810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:48.303221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.303973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.304701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.305645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.306273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.306848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.315953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:48.336324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:48.340710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:48.345401 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0646075-a1bf-493e-a0c4-eeab6e67366e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.353451 Sep 01 04:50:48.347329 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 505/1063] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:47 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:48.485164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:48.494366 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81d4596c-128c-4438-9843-56de166338a8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.217604 Sep 01 04:50:48.495426 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 559/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:48 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:48.973862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:48.975055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:48.975932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:48.976671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.977151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.977643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.978498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.979003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.979416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.987734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.988372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.990327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:48.991880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:48.994027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:48.994734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:49.020596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-959ded09-acbf-41b3-b3a9-753da2c0f43c tempest-AZV2TestJSON-34046388 tempest-AZV2TestJSON-34046388-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.234424 Sep 01 04:50:49.021742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 506/1065] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Sep 1 04:50:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:50:49.298072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:49.298697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:49.306233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:49.306735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:49.307199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:49.307915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:49.308372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:49.308793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:49.453029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:49.462994 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9dbf3049-e33a-48fe-b920-4960782726eb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.494069 Sep 01 04:50:49.476524 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 560/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:48 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:49.476524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:49.476524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:49.478875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:49.479401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:49.479973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:49.480967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:49.481423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:49.481847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:49.778300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:49.793957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3a63af5-8af9-4734-81be-f924b374f65d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.500049 Sep 01 04:50:49.800363 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 507/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:49 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:49.808532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:49.811672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:49.820830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:49.821335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:49.821778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:49.822505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:49.823002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:49.823571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:50.443962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:50.456627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:50.458495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:50.460374 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45663f24-5efb-45c6-a749-812cdbdad926 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.993347 Sep 01 04:50:50.461476 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 561/1068] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:49 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:50.467295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c1e3f67a-db8e-46d7-86f6-2524022f3d0b req-05845eb3-9d56-4a2a-a95f-93409b2cd592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7738b864-3cdf-4c60-b8cd-3cbfc92a81c9", "name": "network-vif-plugged", "status": "completed", "tag": "1104478b-f5c0-4743-aae4-152e2a2dd154"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:50.478183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1e3f67a-db8e-46d7-86f6-2524022f3d0b req-05845eb3-9d56-4a2a-a95f-93409b2cd592 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:50.479056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1e3f67a-db8e-46d7-86f6-2524022f3d0b req-05845eb3-9d56-4a2a-a95f-93409b2cd592 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:50.479765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1e3f67a-db8e-46d7-86f6-2524022f3d0b req-05845eb3-9d56-4a2a-a95f-93409b2cd592 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:50.495890 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c1e3f67a-db8e-46d7-86f6-2524022f3d0b req-05845eb3-9d56-4a2a-a95f-93409b2cd592 service nova] Creating event network-vif-plugged:1104478b-f5c0-4743-aae4-152e2a2dd154 for instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 on n-h1-820368-37 Sep 01 04:50:50.503222 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c1e3f67a-db8e-46d7-86f6-2524022f3d0b req-05845eb3-9d56-4a2a-a95f-93409b2cd592 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039814 Sep 01 04:50:50.504615 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 562/1069] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:50.511203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:50.512792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:50.522091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:50.523177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:50.523786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:50.525091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:50.525712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:50.526303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:50.759200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:50.775054 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91d2decb-aa64-4f07-ac9c-21a2f9f6b9fa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.971976 Sep 01 04:50:50.776611 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 508/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:49 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:50.818036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:50.818834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:50.828550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:50.829096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:50.829807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:50.830775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:50.831297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:50.831969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:50.967933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:50.977910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dff74e69-586d-4ef3-8bc8-31d448057c44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.471373 Sep 01 04:50:50.978992 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 563/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:50 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:51.029257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:51.038774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8eed2ec0-418c-4ab7-b0e4-e00abc307c65 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.226128 Sep 01 04:50:51.039630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 509/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:50 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:51.492119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:51.493671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:51.503591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:51.504694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:51.505631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:51.507110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:51.508630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:51.509512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:51.755346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:51.767412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:51.769141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:51.771230 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a66fcb75-689a-46db-89fc-66667dcc50c1 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.287504 Sep 01 04:50:51.772359 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 564/1073] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:51 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:51.797942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:51.799344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:51.802120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:51.820276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:51.821983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:51.822690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:51.825267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:51.825971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:51.826939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.016250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:52.020889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:52.022152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:52.026226 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d74ad2b9-7851-493e-a408-c8794893585d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.233447 Sep 01 04:50:52.027299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 510/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:51 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:52.029375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.029862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.030297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.031200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.031809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.032237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.063045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:52.064137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:52.076646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.077372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.077956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.080253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.083572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.084960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.383220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:52.394520 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17320470-928f-46ca-bed8-bee7040cda3c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.391454 Sep 01 04:50:52.397634 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 565/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:52 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:52.466686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:52.480215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-815e7bf6-0b56-4fea-b64f-930763bb4c2c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1317 microversion: 2.1 time: 0.423504 Sep 01 04:50:52.481591 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 511/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:52 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:52.665872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-932236f4-21b0-46ae-bf34-14ae3f3333af req-d1cfc014-1b34-4185-b1d3-86e935fc8ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259cb86c-0712-4582-847a-96d54ed7c4f0", "name": "network-vif-plugged", "status": "completed", "tag": "f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:52.691126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-932236f4-21b0-46ae-bf34-14ae3f3333af req-d1cfc014-1b34-4185-b1d3-86e935fc8ad4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.691645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-932236f4-21b0-46ae-bf34-14ae3f3333af req-d1cfc014-1b34-4185-b1d3-86e935fc8ad4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.692079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-932236f4-21b0-46ae-bf34-14ae3f3333af req-d1cfc014-1b34-4185-b1d3-86e935fc8ad4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.733160 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-932236f4-21b0-46ae-bf34-14ae3f3333af req-d1cfc014-1b34-4185-b1d3-86e935fc8ad4 service nova] Creating event network-vif-plugged:f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c for instance 259cb86c-0712-4582-847a-96d54ed7c4f0 on n-h2-820368-37 Sep 01 04:50:52.748894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-932236f4-21b0-46ae-bf34-14ae3f3333af req-d1cfc014-1b34-4185-b1d3-86e935fc8ad4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084318 Sep 01 04:50:52.753410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 566/1077] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:52.796996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:52.797672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:52.805756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.817563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.818368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:52.820100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:52.820739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:52.821396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.049231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:53.050414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:53.072437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:53.075568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:53.079165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.081665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:53.082407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:53.084928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.207341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:53.229899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:53.233544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:53.239459 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d099b1f-69de-4748-9786-3733635a1d6e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.448172 Sep 01 04:50:53.245743 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 512/1078] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:52 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:50:53.436188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:53.437708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:53.453017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:53.454837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:53.457181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.461653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:53.463591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:53.464900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.472959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:53.485992 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-466d377b-3346-4d61-91ff-d76ecc457fc9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.441960 Sep 01 04:50:53.486609 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 567/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:53 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:53.503938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:53.505061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:53.518288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:53.518791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:53.519270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.519991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:53.524272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:53.524529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:53.540775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:53.884578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:53.914180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31071b08-e3fe-43ba-bd67-c611bb2f0b25 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.483143 Sep 01 04:50:53.916115 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 513/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:53 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:53.989440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:54.008792 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d398d26-3b7f-4fe8-9a9b-f3caab2e896d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1465 microversion: 2.1 time: 0.507694 Sep 01 04:50:54.010377 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 568/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:53 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1465 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:54.038611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:54.039254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:54.047192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.047693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.048131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.048977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.049791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.049921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.227449 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e263310f-5507-4913-a17b-5ae707e6fc99 tempest-ServersOnMultiNodesTest-647037552 tempest-ServersOnMultiNodesTest-647037552-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1618 microversion: 2.1 time: 0.193157 Sep 01 04:50:54.228825 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 514/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:54 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1618 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:54.250574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:54.251707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:54.259343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.262762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.263835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.264811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.265545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.266191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.282849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:54.284713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:54.300192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.301207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.301958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.303181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.305434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.306385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.336997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:50:54.509790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b095436b-e9df-4a44-8a35-9c4b22e4858b tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 204 len: 0 microversion: 2.1 time: 0.263195 Sep 01 04:50:54.516216 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 569/1083] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:50:54 2022] DELETE /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:50:54.531422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:54.533239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:54.550255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.551073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.551518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.552510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.552973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.553401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.694446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:54.714094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:54.716024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:54.717740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ce0124d-3e38-408f-b089-5679a783b0ab tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.440068 Sep 01 04:50:54.718974 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 515/1084] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:54 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:50:54.725161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:54.730579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:54.747595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.748338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.748944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.749959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.750624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.751238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.836892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:54.853940 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c9f6476-ba9b-4d20-ba50-f22f07dc5a7c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1307 microversion: 2.1 time: 0.338762 Sep 01 04:50:54.858953 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 570/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:54 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:54.944513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:54.946600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:54.967970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.969408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.976189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:54.977316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:54.982369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:54.983562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:55.147086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:55.170879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b8fe301-4067-4c42-81a8-3fe1e7d027fa tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1471 microversion: 2.1 time: 0.450121 Sep 01 04:50:55.171608 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 516/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:54 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:55.357655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:55.374070 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b272c781-6db7-482c-82d8-84ff032b3454 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.437413 Sep 01 04:50:55.387809 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 571/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:54 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:50:55.745179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:55.746322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:55.759875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:55.764836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:55.766082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:55.767820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:55.768495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:55.769127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:55.879365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:55.880361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:55.907719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:55.911487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:55.911983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:55.913182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:55.913182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:55.913563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:55.913938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:56.084467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:56.095232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:56.107823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:56.115301 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e776f19a-edff-4e0e-a354-957ebd186c9d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.373857 Sep 01 04:50:56.123608 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 517/1088] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:55 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:56.133609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4358d4d7-2e99-4afb-b802-6aec3a9dc57c req-cab8e7b3-d133-45ef-8b1e-bc866e016abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5034886-1ed0-4985-988a-617e6bb57178", "name": "network-vif-plugged", "status": "completed", "tag": "8207761b-ec9f-48b6-ab48-3831645f3314"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:56.169100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4358d4d7-2e99-4afb-b802-6aec3a9dc57c req-cab8e7b3-d133-45ef-8b1e-bc866e016abd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:56.171892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4358d4d7-2e99-4afb-b802-6aec3a9dc57c req-cab8e7b3-d133-45ef-8b1e-bc866e016abd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:56.175116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4358d4d7-2e99-4afb-b802-6aec3a9dc57c req-cab8e7b3-d133-45ef-8b1e-bc866e016abd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:56.205983 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4358d4d7-2e99-4afb-b802-6aec3a9dc57c req-cab8e7b3-d133-45ef-8b1e-bc866e016abd service nova] Creating event network-vif-plugged:8207761b-ec9f-48b6-ab48-3831645f3314 for instance c5034886-1ed0-4985-988a-617e6bb57178 on n-h2-820368-37 Sep 01 04:50:56.216589 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4358d4d7-2e99-4afb-b802-6aec3a9dc57c req-cab8e7b3-d133-45ef-8b1e-bc866e016abd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091518 Sep 01 04:50:56.221857 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 518/1089] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:50:56.243455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:56.244254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:56.252615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:56.254919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:56.255552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:56.267900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:56.269590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:56.273381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:56.525251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:56.538683 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f43a9f45-beab-479f-bb40-8baf4c08d56e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1486 microversion: 2.1 time: 0.665552 Sep 01 04:50:56.542633 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 572/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:55 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1486 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:56.571834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:56.572993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:56.592997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:56.593887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:56.594410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:56.598433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:56.599055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:56.599583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:57.112722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:57.123974 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce5bd203-6224-418b-9430-97c1c09e3627 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1471 microversion: 2.1 time: 0.900409 Sep 01 04:50:57.124882 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 519/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:56 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1471 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:57.130222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-387eaae8-c2cf-4b69-84aa-da6d1df9dd68 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:57.137508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:57.154502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8b42d4a-6c64-4d86-9f72-838b48d0c6de tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.606697 Sep 01 04:50:57.155431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387eaae8-c2cf-4b69-84aa-da6d1df9dd68 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:57.156160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387eaae8-c2cf-4b69-84aa-da6d1df9dd68 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:57.156710 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 573/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:56 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:57.157023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-387eaae8-c2cf-4b69-84aa-da6d1df9dd68 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:57.164126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:57.165080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:57.175062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:57.175871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:57.176676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:57.177569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:57.178197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:57.179207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:57.269656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-387eaae8-c2cf-4b69-84aa-da6d1df9dd68 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 04:50:57.344994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-387eaae8-c2cf-4b69-84aa-da6d1df9dd68 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0/action" status: 202 len: 0 microversion: 2.1 time: 0.217368 Sep 01 04:50:57.348768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 520/1093] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:50:57 2022] POST /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:50:57.356187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:57.359206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:57.371443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:57.372523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:57.373135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:57.374036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:57.374730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:57.375353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:57.411197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:57.578774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:57.617527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:57.631030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:57.645026 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4351ac8-b47b-4e1d-b690-30326e35c951 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.487092 Sep 01 04:50:57.656591 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 574/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:57 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:57.751670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:57.774490 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-717c9cf6-2510-4b7b-9bf6-f6b16052037b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.423121 Sep 01 04:50:57.777667 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 521/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:57 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:58.146247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:58.147777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:58.164763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.166342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.167754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.168729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.170065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.171423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.183785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:58.187594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:58.201696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.202492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.203401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.205038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.205744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.206627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.544009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:58.561628 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d6d8346-967b-4930-aee1-237cce2823ed tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1471 microversion: 2.1 time: 0.417476 Sep 01 04:50:58.563975 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 575/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:58 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:58.607714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:58.626660 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07b7a281-ec7e-4f15-b388-f10ad4c14152 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1310 microversion: 2.1 time: 0.448442 Sep 01 04:50:58.638794 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 522/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:58 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1310 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:58.682681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:58.684491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:58.703208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d8d8aed9-0574-4e7d-b402-69dbabf5f888 req-5b1e08a5-ecce-4d95-aeda-a56537ca2c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7738b864-3cdf-4c60-b8cd-3cbfc92a81c9", "name": "network-vif-deleted", "tag": "1104478b-f5c0-4743-aae4-152e2a2dd154"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:50:58.743646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.748679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.749135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.750091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.768836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.769447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.773196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d8d8aed9-0574-4e7d-b402-69dbabf5f888 req-5b1e08a5-ecce-4d95-aeda-a56537ca2c11 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.776871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d8d8aed9-0574-4e7d-b402-69dbabf5f888 req-5b1e08a5-ecce-4d95-aeda-a56537ca2c11 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.779351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d8d8aed9-0574-4e7d-b402-69dbabf5f888 req-5b1e08a5-ecce-4d95-aeda-a56537ca2c11 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.846724 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d8d8aed9-0574-4e7d-b402-69dbabf5f888 req-5b1e08a5-ecce-4d95-aeda-a56537ca2c11 service nova] Creating event network-vif-deleted:1104478b-f5c0-4743-aae4-152e2a2dd154 for instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 on n-h1-820368-37 Sep 01 04:50:58.871789 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d8d8aed9-0574-4e7d-b402-69dbabf5f888 req-5b1e08a5-ecce-4d95-aeda-a56537ca2c11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176440 Sep 01 04:50:58.882829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 523/1098] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:50:58.909616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:58.910469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:58.945120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.948580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.949166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:58.950001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:58.956775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:58.957434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:59.021942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:50:59.146930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:59.170059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:59.172542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:59.177549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a5029eb-b4d7-4f34-a6bf-fb9977a68361 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.510127 Sep 01 04:50:59.179591 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 576/1099] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:50:58 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:50:59.353402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:59.390385 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eff00eee-3569-47da-bc86-9afc5080fd9b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.503402 Sep 01 04:50:59.391044 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 524/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:58 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:50:59.585408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:59.586298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:59.602353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:59.603693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:59.605209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:59.607827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:59.608937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:59.611120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:59.658448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:50:59.663029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:50:59.696439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:59.700450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:59.703175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:59.704123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:59.706735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:59.707591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:59.765319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:50:59.765938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:50:59.766370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:50:59.767057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lazy-loading 'fault' on Instance uuid 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:50:59.942263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:50:59.953632 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e20d0a83-3b11-4db3-9907-377a120f887f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 200 len: 1307 microversion: 2.1 time: 0.372555 Sep 01 04:50:59.954321 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 577/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:59 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:00.008150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:00.017638 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d57d77b-adaa-4200-a9ae-4575c8646384 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1494 microversion: 2.1 time: 0.364265 Sep 01 04:51:00.019420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 525/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:50:59 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:00.045807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:00.047134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:00.056933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.058349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.059035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.060107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.061109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.061965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.208592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:00.210660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:00.224140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.225159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.225837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.226832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.227548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.228214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.506273 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef6eb5aa-d329-41db-9d51-ed708bfcee8d tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1647 microversion: 2.1 time: 0.465817 Sep 01 04:51:00.514229 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 578/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:00 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1647 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:00.523064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:00.524394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:00.545366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.546030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.548080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.552469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.558370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.559238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.602694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:00.613582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:00.618536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:00.620314 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8788e746-e990-4042-8a44-dd2528af0c4f tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.418062 Sep 01 04:51:00.635633 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 526/1104] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:00 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:00.653174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:00.661318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:00.681239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.681972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.682642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.683641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.686490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.687477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.848650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:00.860131 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdd90972-1fe4-4f08-8112-951ec88d4b13 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.344072 Sep 01 04:51:00.860726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 579/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:00 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:00.939798 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3bf97e8-b1b9-44b6-a0f5-a3da6c4852b8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1647 microversion: 2.1 time: 0.302486 Sep 01 04:51:00.941542 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 527/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:00 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1647 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:00.962518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:00.966367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.967747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.968252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.969011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.969683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.973024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.979063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:00.980022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:00.995005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:00.995448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:00.998165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:00.999935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.000758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.001146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.026038 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 could not be found. Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 HTTP/1.1 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 could not be found. Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7738b864-3cdf-4c60-b8cd-3cbfc92a81c9'} Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 could not be found. Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 could not be found. Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:01.027669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 could not be found. Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance 7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ff608b8-4b31-4ba0-ab00-6f2b59c5115c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9" status: 404 len: 111 microversion: 2.1 time: 0.055508 Sep 01 04:51:01.032768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 528/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:00 2022] GET /compute/v2.1/servers/7738b864-3cdf-4c60-b8cd-3cbfc92a81c9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:01.041517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:01.042430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:01.059738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:01.066144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.067549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.067973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.068851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.072093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.072093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.074815 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a8fa72c-8b87-485b-a54a-43f241d36810 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.115890 Sep 01 04:51:01.079300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 580/1108] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:51:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:01.091880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:01.092419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:01.099028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.099533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.099967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.100679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.101412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.101837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.151874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:01.201567 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f491ee26-fd9c-460a-936f-c2cdac6a148f tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178/action" status: 202 len: 0 microversion: 2.1 time: 0.113656 Sep 01 04:51:01.207700 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 581/1109] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:51:01 2022] POST /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:01.214927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:01.216323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:01.226179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.227096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.227960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.229421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.230659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.231302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.277203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:01.376869 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7350e7cd-d055-4c4a-8383-81a8b5fb6494 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 204 len: 0 microversion: 2.1 time: 0.340997 Sep 01 04:51:01.381069 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 529/1110] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:01 2022] DELETE /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:01.391333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:01.393230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:01.406918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.407883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.408945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.423594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.424082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.424530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.526393 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79ac9212-9d0b-42bb-9357-02e0281a11c1 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1652 microversion: 2.1 time: 0.315486 Sep 01 04:51:01.529756 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 582/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:01 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1652 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:01.649520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:01.650316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:01.660405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.661201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.661970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.662871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.663591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.664197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.674938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:01.687573 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33d3ae6e-b1aa-4c18-a5d4-6bb1a41f32ff tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1472 microversion: 2.1 time: 0.304851 Sep 01 04:51:01.695220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 530/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:01 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:01.860873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:01.872517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:01.875512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:01.877215 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e347bd7-826a-402d-96b9-ff62a9cb125a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.233283 Sep 01 04:51:01.878384 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 583/1113] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:01 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:51:01.897879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:01.899070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:01.908312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.909451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.910056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:01.911491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:01.912468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:01.913050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:02.114007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:02.136135 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16b9f6d1-50a2-44d2-b51f-779de3817bb3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.258799 Sep 01 04:51:02.142954 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 531/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:01 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:02.184926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1966810165", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "df19449c-17b0-4df8-9477-4c629adf8a44"}, {"uuid": "015066ce-2e62-4dc9-8bc6-bce84e615185"}, {"uuid": "df19449c-17b0-4df8-9477-4c629adf8a44"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:02.252605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] validate_networks() for [('df19449c-17b0-4df8-9477-4c629adf8a44', None, None, None, None, None), ('015066ce-2e62-4dc9-8bc6-bce84e615185', None, None, None, None, None), ('df19449c-17b0-4df8-9477-4c629adf8a44', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:51:02.551215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:02.552413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:02.573753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:02.574615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:02.575511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:02.576706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:02.577380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:02.578384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:02.877527 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ab8c627-dbc4-44a0-93b1-c8c66e0f9ec5 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1632 microversion: 2.1 time: 0.331384 Sep 01 04:51:02.878239 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 532/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:02 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1632 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:02.886298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:02.886938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:02.902066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:02.903510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:02.904154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:02.905062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:02.906734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:02.908056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:03.192339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:03.204816 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c6a2ef0-7cca-4302-b8c6-49cdf2adc24f tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1472 microversion: 2.1 time: 0.325609 Sep 01 04:51:03.205835 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 533/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:02 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:03.210922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-37", "block_migration": true, "disk_over_commit": false}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:03.213277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:03.219704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:03.220330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:03.221377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:03.221714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:03.222267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:03.222792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:03.260033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lazy-loading 'flavor' on Instance uuid c5034886-1ed0-4985-988a-617e6bb57178 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:03.275762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Going to try to live migrate instance to n-h1-820368-37 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:51:03.507974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:51:03.508537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:51:03.508853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:51:03.509887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:51:03.510451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:51:03.542308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:03.545463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:03.547417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:03.549459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:03.550313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:03.552271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:03.584300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Getting quotas for project a9b08a156c194615b51ba116446334d1. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:51:03.598937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Getting quotas for user 1c0c2fb280fa41c4a65417e35b2e53c1 and project a9b08a156c194615b51ba116446334d1. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:51:03.646567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:51:03.650429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:51:03.767350 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6a15fec-dea2-48be-9f38-59c546f9482a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586032 Sep 01 04:51:03.771002 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 584/1117] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:51:03.785651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:03.788713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:03.824916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:03.827132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:03.827754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:03.828487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:03.832804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:03.832921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:04.480291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:04.490666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:04.494598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:04.496440 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1003a43-2325-40f7-b454-dacab68a3978 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.724070 Sep 01 04:51:04.502748 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 585/1118] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:03 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:04.510549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:04.512967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:04.528977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:04.529875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:04.530680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:04.533092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:04.533913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:04.538728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:04.834143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:04.843751 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0df7975-ff12-45e7-836d-d9adc799d8f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.339200 Sep 01 04:51:04.847441 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 586/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:04 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:04.858258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-974b7421-7119-4887-98d8-7c7ffc923f1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:04.859423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-974b7421-7119-4887-98d8-7c7ffc923f1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:04.972985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-974b7421-7119-4887-98d8-7c7ffc923f1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:04.981670 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-974b7421-7119-4887-98d8-7c7ffc923f1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1213 microversion: 2.1 time: 0.132499 Sep 01 04:51:04.998239 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 587/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:04 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:05.008915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:05.018298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:05.025570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:05.026177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:05.026750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:05.031988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:05.033945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:05.034940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:05.161574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:05.163957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:05.164425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:05.164892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lazy-loading 'fault' on Instance uuid 98c42042-270f-4a18-934a-eea8c16522c6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:05.266270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:05.290658 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-313d1266-f504-4e81-9a42-c25e3a069d9c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 200 len: 1306 microversion: 2.1 time: 0.287540 Sep 01 04:51:05.291435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 588/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:04 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 1306 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:05.344308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8f2c5279-4c88-4bbf-95b8-3a57bdd37182 req-e60390c2-68ee-4e87-b2d0-9885950e0886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c42042-270f-4a18-934a-eea8c16522c6", "name": "network-vif-deleted", "tag": "e52d6985-0139-404c-9a48-2be473f5440f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:05.385763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f2c5279-4c88-4bbf-95b8-3a57bdd37182 req-e60390c2-68ee-4e87-b2d0-9885950e0886 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:05.388411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f2c5279-4c88-4bbf-95b8-3a57bdd37182 req-e60390c2-68ee-4e87-b2d0-9885950e0886 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:05.390337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f2c5279-4c88-4bbf-95b8-3a57bdd37182 req-e60390c2-68ee-4e87-b2d0-9885950e0886 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:05.418116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8f2c5279-4c88-4bbf-95b8-3a57bdd37182 req-e60390c2-68ee-4e87-b2d0-9885950e0886 service nova] Creating event network-vif-deleted:e52d6985-0139-404c-9a48-2be473f5440f for instance 98c42042-270f-4a18-934a-eea8c16522c6 on n-h2-820368-37 Sep 01 04:51:05.431942 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8f2c5279-4c88-4bbf-95b8-3a57bdd37182 req-e60390c2-68ee-4e87-b2d0-9885950e0886 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121873 Sep 01 04:51:05.433056 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 589/1122] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:05.528372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:05.530078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:05.546580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:05.546580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:05.546580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:05.548130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:05.548771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:05.551459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:06.685387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:06.704684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:06.710931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:06.713152 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1944f7ca-1833-4232-b548-0d857b179d96 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 1.189911 Sep 01 04:51:06.716022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 590/1123] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:05 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:06.738110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:06.739249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:06.750152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:06.751657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:06.761216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:06.761216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:06.761216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:06.761216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.198793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:07.211473 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-557c92a7-79cb-4986-a2eb-9e6edf8743e3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.493801 Sep 01 04:51:07.212724 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 591/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:06 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:07.219847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:07.220815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:07.248441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.251189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.252426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.261690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.262782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.268614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.319694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-972dc797-94f9-4d27-8458-1640556b3359 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178/action" status: 202 len: 0 microversion: 2.1 time: 4.112768 Sep 01 04:51:07.320373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 534/1125] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:51:03 2022] POST /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178/action => generated 0 bytes in 4114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:07.352766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:07.357090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 98c42042-270f-4a18-934a-eea8c16522c6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:07.374803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:07.400062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.400580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.403594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.407534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.408030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.413919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a330130-9405-45e6-b4f9-a2446aca097a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1265 microversion: 2.1 time: 0.184399 Sep 01 04:51:07.416574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.418040 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 592/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:07 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:07.441834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:07.442462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:07.490193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.494213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.494714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.495573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.505216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.505704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.510193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance 98c42042-270f-4a18-934a-eea8c16522c6 could not be found. Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 HTTP/1.1 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 98c42042-270f-4a18-934a-eea8c16522c6 could not be found. Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '98c42042-270f-4a18-934a-eea8c16522c6'} Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c42042-270f-4a18-934a-eea8c16522c6 could not be found. Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c42042-270f-4a18-934a-eea8c16522c6 could not be found. Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:07.519770 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c42042-270f-4a18-934a-eea8c16522c6 could not be found. Sep 01 04:51:07.524180 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:07.526730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance 98c42042-270f-4a18-934a-eea8c16522c6 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:07.530349 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c64d51cf-eee1-401f-bb94-ddda6bf1e13d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6" status: 404 len: 111 microversion: 2.1 time: 0.208648 Sep 01 04:51:07.536952 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 535/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:07 2022] GET /compute/v2.1/servers/98c42042-270f-4a18-934a-eea8c16522c6 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:07.549988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:07.550870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:07.570286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.571826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.576996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.579025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.579974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.580685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.632053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:07.657658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:07.854344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:07.872360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37464433-a35c-45b6-9364-0a30eeee4ff8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.450778 Sep 01 04:51:07.873656 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 593/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:07 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:07.884502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:07.885703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:07.897662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.898874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.899585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.900752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.901618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.902813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.914631 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c625139-4649-4ff3-9c4a-a6131090f71c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 204 len: 0 microversion: 2.1 time: 0.371544 Sep 01 04:51:07.916741 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 536/1129] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:07 2022] DELETE /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:07.938025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:07.940386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:07.955275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.967746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.969100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:07.971575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:07.972924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:07.973826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.345348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:08.355490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:08.367177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:08.370990 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bac5bd32-51ed-48ed-b67e-1de4abd01b5e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.495586 Sep 01 04:51:08.375529 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 594/1130] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:07 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:08.376133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:08.380666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:08.381290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:08.396743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.397237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.397743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.398487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.398962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.399388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.402339 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54daab9b-12fb-4055-bf31-eda7cce41230 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1472 microversion: 2.1 time: 0.472926 Sep 01 04:51:08.419674 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 537/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:07 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:08.440521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:08.441609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:08.452101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.453516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.454201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.455443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.456321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.457079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.690399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:08.707689 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fe9466b-3b48-4a70-887f-bd0980050502 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1265 microversion: 2.1 time: 0.273501 Sep 01 04:51:08.719736 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 538/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:08 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:08.736932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "108aa069-d8cb-453d-b3ee-5fb4bda2480d"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:08.749311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:08.767647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.768118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.770700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.773712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.774635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.775415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.792675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:08.814631 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50b4a725-401c-4509-82e5-73610d1750d9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.437833 Sep 01 04:51:08.820344 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 595/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:08 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:08.917226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:08.917859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:08.927254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.927754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.928192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:08.928902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:08.929358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:08.930016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.126314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:09.150634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f376ebc-6c47-446e-b881-af85a6ab88a6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.245805 Sep 01 04:51:09.152279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 596/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:08 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:09.261402 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87a3a4f0-efbe-4a52-828f-189ec0197de6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "POST /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539425 Sep 01 04:51:09.262392 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 539/1135] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 04:51:08 2022] POST /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:09.402680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:09.403866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:09.411247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.411828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.412280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.415966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.416499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.416942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.426664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:09.427409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:09.445221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.445928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.447021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.447315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.447768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.448189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.762274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:09.772208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:09.773661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:09.774859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9326984a-2805-4e40-9a68-13cea974c739 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.377037 Sep 01 04:51:09.775710 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 597/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:09 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:09.780021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:09.781178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:09.799278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.800040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.800663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.801696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.802305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.802942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.824491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:09.833440 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4fe8e23-fea3-466b-b304-c5ec8e26bfd0 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1472 microversion: 2.1 time: 0.412627 Sep 01 04:51:09.847546 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 540/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:09 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1472 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:09.855649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:09.856516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:09.864284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.866356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.867020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.868106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:09.868676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:09.869194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:09.900476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:09.915411 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9014d469-82b1-41b1-8974-0a34208220b5 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1265 microversion: 2.1 time: 0.138604 Sep 01 04:51:09.917197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 598/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:09 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:10.039078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:10.070267 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b74253d-3e4b-432d-9f7b-1d2d21382b60 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.220837 Sep 01 04:51:10.071447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 541/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:09 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:10.176103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:10.176989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:10.183401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:10.183902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:10.184345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:10.185065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:10.185525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:10.186069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:10.709282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:10.737363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3be205c3-bfbe-4dad-b17e-d32a011fab5c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.563683 Sep 01 04:51:10.763952 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 599/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:10 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:10.800631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:10.807179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:10.834728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:10.835504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:10.836169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:10.869950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:10.877434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:10.878593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:10.879556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:10.880213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:10.924613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:10.925522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:10.926187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:10.927316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:10.928030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:10.928664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:11.880495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:11.892718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:11.894146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:11.895367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1ce8c04-cf63-4eb2-b3e1-1794f764ba54 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 1.101342 Sep 01 04:51:11.896113 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 542/1141] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:10 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:51:11.905244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:11.907777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:11.917199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:11.918118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:11.918756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:11.919695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:11.920381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:11.921065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:12.344065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:12.355968 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-001de60f-5a03-4a8c-a004-c0b4c1e340f1 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1271 microversion: 2.1 time: 0.458293 Sep 01 04:51:12.360561 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 543/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:11 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1271 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:12.368747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:12.369666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:12.377017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:12.377706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:12.378289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:12.379179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:12.379786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:12.380377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:12.681747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:12.697329 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-635c5f00-39b4-46d8-bf54-69fdc68b7220 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1472 microversion: 2.1 time: 1.839210 Sep 01 04:51:12.708030 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 600/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:10 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1472 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:12.720685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-133a7d60-3a85-4366-b470-4d81f7baabf2 req-26839b3c-d0ec-4cf7-87d8-a921d24a76bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90982816-19d1-448f-bd4a-7cda5aab3e2a", "name": "network-vif-unplugged", "status": "completed", "tag": "30294c27-aeaa-49f8-874e-b14aeb855c61"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:12.759225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-133a7d60-3a85-4366-b470-4d81f7baabf2 req-26839b3c-d0ec-4cf7-87d8-a921d24a76bd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:12.761270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-133a7d60-3a85-4366-b470-4d81f7baabf2 req-26839b3c-d0ec-4cf7-87d8-a921d24a76bd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:12.762956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-133a7d60-3a85-4366-b470-4d81f7baabf2 req-26839b3c-d0ec-4cf7-87d8-a921d24a76bd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:12.799404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:12.809061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-133a7d60-3a85-4366-b470-4d81f7baabf2 req-26839b3c-d0ec-4cf7-87d8-a921d24a76bd service nova] Creating event network-vif-unplugged:30294c27-aeaa-49f8-874e-b14aeb855c61 for instance 90982816-19d1-448f-bd4a-7cda5aab3e2a on n-h1-820368-37 Sep 01 04:51:12.826106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-133a7d60-3a85-4366-b470-4d81f7baabf2 req-26839b3c-d0ec-4cf7-87d8-a921d24a76bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116107 Sep 01 04:51:12.831030 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 601/1144] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:12.845059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:12.849315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:12.885429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:12.885429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:12.885429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:12.885429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:12.885429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:12.885429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.248085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:13.281413 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5c9d35a-a500-4098-a1c6-6b2011c7acf4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.912483 Sep 01 04:51:13.286390 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 544/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:12 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:13.316335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:13.325373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:13.387243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.392494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.397628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.399460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.401845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.403581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.524745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:13.541129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b75c270-25e7-4d3c-957b-bec72b4abebf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.708493 Sep 01 04:51:13.559458 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 602/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:12 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:13.577436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9ca3bbd7-c921-4baa-a750-3b75190519ad req-e6883fe5-7c9d-4fc5-80ac-938e8d28a2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5034886-1ed0-4985-988a-617e6bb57178", "name": "network-vif-unplugged", "status": "completed", "tag": "8207761b-ec9f-48b6-ab48-3831645f3314"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:13.587876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:13.611675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9ca3bbd7-c921-4baa-a750-3b75190519ad req-e6883fe5-7c9d-4fc5-80ac-938e8d28a2fe service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.612575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9ca3bbd7-c921-4baa-a750-3b75190519ad req-e6883fe5-7c9d-4fc5-80ac-938e8d28a2fe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.614237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9ca3bbd7-c921-4baa-a750-3b75190519ad req-e6883fe5-7c9d-4fc5-80ac-938e8d28a2fe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.640428 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9ca3bbd7-c921-4baa-a750-3b75190519ad req-e6883fe5-7c9d-4fc5-80ac-938e8d28a2fe service nova] Creating event network-vif-unplugged:8207761b-ec9f-48b6-ab48-3831645f3314 for instance c5034886-1ed0-4985-988a-617e6bb57178 on n-h2-820368-37 Sep 01 04:51:13.649814 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9ca3bbd7-c921-4baa-a750-3b75190519ad req-e6883fe5-7c9d-4fc5-80ac-938e8d28a2fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088861 Sep 01 04:51:13.651461 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 603/1147] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:13.662942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:13.672477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:13.684878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.685543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.690403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.695437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.696014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.696562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.825116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:13.837808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ca22dff-942e-4efc-b1ea-f989db2bb61f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1271 microversion: 2.1 time: 0.179412 Sep 01 04:51:13.838368 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 604/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:13 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:13.849970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:13.855825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:13.866459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.875862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.876329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.877088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.877556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.877988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.928538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:13.942382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:13.954255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:13.954255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:13.954255 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29c3cd92-ab3c-4875-bc96-ecd69b745adb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.663636 Sep 01 04:51:13.955337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 545/1149] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:13 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:13.959248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:13.959713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:13.960201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lazy-loading 'fault' on Instance uuid 5ab2aaef-db86-4580-8099-fa33d9244919 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:14.032013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:14.044531 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-336b545c-1538-4a4d-b39a-c7747235d606 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 200 len: 1306 microversion: 2.1 time: 0.198167 Sep 01 04:51:14.044864 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 605/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:13 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:14.309862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:14.311886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:14.325205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.325205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.325205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.325205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.325996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.325996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.570220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:14.571891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:14.580729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.581493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.582101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.582988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.583597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.584180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.664782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:14.676956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fe7fa20-191a-49af-a5c2-951c43e94eb6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.370836 Sep 01 04:51:14.678234 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 546/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:14 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:14.846742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:14.856186 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-422b6338-b50d-4780-b65d-df3b5b9bdd86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.291304 Sep 01 04:51:14.858002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:14.859610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:14.868103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.868590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.869022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.869808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.870151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.870572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.879340 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 606/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:14 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:14.891690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ab2aaef-db86-4580-8099-fa33d9244919", "name": "network-vif-deleted", "tag": "b62a06ba-4246-49bc-8430-ee36a9926b18"}, {"name": "network-changed", "server_uuid": "90982816-19d1-448f-bd4a-7cda5aab3e2a", "tag": "30294c27-aeaa-49f8-874e-b14aeb855c61"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:14.911630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.912602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.913606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.939186 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] Creating event network-vif-deleted:b62a06ba-4246-49bc-8430-ee36a9926b18 for instance 5ab2aaef-db86-4580-8099-fa33d9244919 on n-h2-820368-37 Sep 01 04:51:14.940718 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] Creating event network-changed:30294c27-aeaa-49f8-874e-b14aeb855c61 for instance 90982816-19d1-448f-bd4a-7cda5aab3e2a on n-h1-820368-37 Sep 01 04:51:14.953615 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e7520221-d44b-4577-93d1-8248538c0a8e req-7749a5a7-c318-4eb3-8c64-2fc9f816e4be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070036 Sep 01 04:51:14.954489 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 607/1153] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:51:14.982141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:14.982861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:14.990203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:14.992242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.992801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.993245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:14.993956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:14.994702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:14.995445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.160139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:15.179271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a85235b-88a9-4d3c-ad01-76cec762a2af tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1313 microversion: 2.1 time: 0.325454 Sep 01 04:51:15.180553 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 547/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:14 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:15.188842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:15.190286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 5ab2aaef-db86-4580-8099-fa33d9244919] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:15.197941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.198814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.199481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.200964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.201660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.202721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.232765 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance 5ab2aaef-db86-4580-8099-fa33d9244919 could not be found. Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 HTTP/1.1 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 5ab2aaef-db86-4580-8099-fa33d9244919 could not be found. Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '5ab2aaef-db86-4580-8099-fa33d9244919'} Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ab2aaef-db86-4580-8099-fa33d9244919 could not be found. Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ab2aaef-db86-4580-8099-fa33d9244919 could not be found. Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:15.239581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ab2aaef-db86-4580-8099-fa33d9244919 could not be found. Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance 5ab2aaef-db86-4580-8099-fa33d9244919 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:15.245074 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6815dfaf-4d4a-459f-963b-ab19fa52ef15 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919" status: 404 len: 111 microversion: 2.1 time: 0.059901 Sep 01 04:51:15.251291 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 548/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:15 2022] GET /compute/v2.1/servers/5ab2aaef-db86-4580-8099-fa33d9244919 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:15.260324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-818101703", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "20ad708b-c26b-40c9-ab42-3bb2aa34e0ff"}], "security_groups": [{"name": "tempest-securitygroup--1731972580"}], "key_name": "tempest-keypair-1663476022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "104b71f0-4cc5-4d5e-9273-6718ef855f67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:15.300117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:15.312311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:15.313766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:15.314979 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36e9fd25-550b-431d-9e36-7b55b7335b76 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.341193 Sep 01 04:51:15.317848 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 608/1156] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:14 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:15.325870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:15.326562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:15.333152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.333995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.334641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.336207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.336913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.337762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.378187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:15.449831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] validate_networks() for [('20ad708b-c26b-40c9-ab42-3bb2aa34e0ff', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:51:15.469330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:15.506908 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fb8caae-3633-40f6-969b-70d3ed05e8dd tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 204 len: 0 microversion: 2.1 time: 0.185610 Sep 01 04:51:15.508269 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 609/1157] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:15 2022] DELETE /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:15.519113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:15.520177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:15.528812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.529643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.531888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.532949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.533613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.534785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.573713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:15.702316 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a2957ce-00b0-4d8d-9e8b-809268d71b74 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 204 len: 0 microversion: 2.1 time: 0.186977 Sep 01 04:51:15.706506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 610/1158] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:15 2022] DELETE /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:15.713641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:15.714248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:15.722694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.723250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.723688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.724408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.724919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.725355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.756625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:15.848059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d49f928d-8cf3-4dd3-a689-7380a0d8676f tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "DELETE /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 204 len: 0 microversion: 2.1 time: 0.139524 Sep 01 04:51:15.849146 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 611/1159] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:15 2022] DELETE /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:15.855113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:15.856133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:15.864581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.865076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.865494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:15.866206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:15.866652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:15.867281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.263923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:16.279624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0394b3c-c3cf-4ae8-8e6a-b6374588f76c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.429007 Sep 01 04:51:16.280510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 612/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:15 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:16.301168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:16.302166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:16.309474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.309970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.310413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.311149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.311731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.312171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.463534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Getting quotas for project 5d249f0206964985b5f6ebd59e1e7269. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:51:16.468591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Getting quotas for user 1b306ffc96ba4bb4a7d631f19d43072b and project 5d249f0206964985b5f6ebd59e1e7269. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:51:16.483639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:51:16.483941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:51:16.484593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:51:16.485168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:51:16.485711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:51:16.493021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:16.494729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.495240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.495859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.496573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.496981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.497602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.501688 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-128eca61-42c1-4670-ad48-2394001fdbfc tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 200 len: 1475 microversion: 2.1 time: 0.205626 Sep 01 04:51:16.514908 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 613/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:16 2022] GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 1475 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:16.514908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-415d3798-509c-416f-9300-64153979eb86 req-7467a733-5f67-42b9-8409-47ce81ac0ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5034886-1ed0-4985-988a-617e6bb57178", "tag": "8207761b-ec9f-48b6-ab48-3831645f3314"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:16.515208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Getting quotas for project 5d249f0206964985b5f6ebd59e1e7269. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:51:16.517687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-415d3798-509c-416f-9300-64153979eb86 req-7467a733-5f67-42b9-8409-47ce81ac0ea2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.517975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-415d3798-509c-416f-9300-64153979eb86 req-7467a733-5f67-42b9-8409-47ce81ac0ea2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.518477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-415d3798-509c-416f-9300-64153979eb86 req-7467a733-5f67-42b9-8409-47ce81ac0ea2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.520298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Getting quotas for user 1b306ffc96ba4bb4a7d631f19d43072b and project 5d249f0206964985b5f6ebd59e1e7269. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:51:16.530429 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-415d3798-509c-416f-9300-64153979eb86 req-7467a733-5f67-42b9-8409-47ce81ac0ea2 service nova] Creating event network-changed:8207761b-ec9f-48b6-ab48-3831645f3314 for instance c5034886-1ed0-4985-988a-617e6bb57178 on n-h2-820368-37 Sep 01 04:51:16.536254 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-415d3798-509c-416f-9300-64153979eb86 req-7467a733-5f67-42b9-8409-47ce81ac0ea2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Sep 01 04:51:16.537204 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 614/1162] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:16.545642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:16.546635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:16.552885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.553453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.554064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.555126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.555839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.556505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.563270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:16.584375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:51:16.586702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='104b71f0-4cc5-4d5e-9273-6718ef855f67',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:51:16.714319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:16.724545 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98d720cb-b7fc-49df-9ccf-bfe421a50a7e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1713 microversion: 2.1 time: 0.183136 Sep 01 04:51:16.725328 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 615/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:16 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1713 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:16.729630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:16.730235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:16.736637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.737059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.737750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.738443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.738852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.739285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.752032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f00469fa-6ddc-4dac-9da3-291b34b072d6 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.499209 Sep 01 04:51:16.753004 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 549/1164] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:51:15 2022] POST /compute/v2.1/servers => generated 407 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:51:16.758330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:16.759158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:16.767997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.767997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.767997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.769079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:16.769903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:16.770659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:16.974512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:16.978809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:16.985332 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11590cc4-a3aa-4969-b40d-22ab9980ac7a tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1334 microversion: 2.1 time: 0.231019 Sep 01 04:51:16.986223 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 550/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:16 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1334 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:16.991929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:16.992735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:16.993989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1766cdbb-e836-457d-bdd1-94898aaeb2b8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.267813 Sep 01 04:51:17.000186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.000880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.001502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.002391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.003032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.003609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.009075 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 616/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:16 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:17.011465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:17.016051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c48d043e-e8ef-48ca-858c-58fbd0e31857 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:17.017719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c48d043e-e8ef-48ca-858c-58fbd0e31857 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:17.142137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c48d043e-e8ef-48ca-858c-58fbd0e31857 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:17.151248 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c48d043e-e8ef-48ca-858c-58fbd0e31857 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1121 microversion: 2.1 time: 0.139148 Sep 01 04:51:17.164581 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 617/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:17 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1121 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:17.308083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:17.308926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:17.316725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.321173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:17.330582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:17.331173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.331957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.332524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:17.332968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.333506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.333707 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-691d4acd-ff11-4bd7-b8a7-79ca4371fe43 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.346173 Sep 01 04:51:17.334055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.337508 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 551/1168] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:16 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:17.526219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:17.527593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:17.534986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.535480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.535972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.536801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.537249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.537669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.557749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:17.566737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-012bd4e6-8b4c-4b6a-a6a2-479291ec583a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.262971 Sep 01 04:51:17.580397 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 618/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:17 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:17.745834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:17.746479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:17.746622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:17.753660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.754051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.754481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.755181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:17.755619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:17.756063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:17.756614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d081b95-8c82-4120-a448-2c413cdab8ba tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 200 len: 1475 microversion: 2.1 time: 0.234753 Sep 01 04:51:17.757393 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 552/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:17 2022] GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 1475 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:18.007600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:18.008181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:18.016954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.017775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.018355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.019283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.019914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.020481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.201328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:18.212512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e34f42b-4ef0-44e4-b3a8-ceda8560836e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1713 microversion: 2.1 time: 0.470413 Sep 01 04:51:18.223422 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 619/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:17 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1713 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:18.231245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:18.231936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:18.238927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.239528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.240065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.240765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.241304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.241798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.616558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:18.625438 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6eff012a-639b-466d-8785-0580d008d0e2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.622444 Sep 01 04:51:18.638965 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 553/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:18 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:18.644458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:18.644973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:18.677457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.679313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.680973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.681735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.682866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.683799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.813921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:18.823761 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b53be52a-0480-4c06-b499-3ba6a46f74ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.597477 Sep 01 04:51:18.825646 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 620/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:18 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:18.831266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:18.832088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:18.839371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.840130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.840768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.841619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.842248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.844228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.930943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:18.940211 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-560f99de-6489-45de-b4b3-19b129a2e1c3 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1163 microversion: 2.1 time: 0.299539 Sep 01 04:51:18.940836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 554/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:18 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1163 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:18.945884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:18.946653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:18.953452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.954119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.954714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:18.955433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:18.955879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:18.956374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:19.792423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:19.811365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:19.814350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:19.815798 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e94be48b-f746-4f85-a4a2-db987e47e5c9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.988935 Sep 01 04:51:19.820032 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 621/1175] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:18 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:19.831291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:19.835613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:19.854637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:19.858017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:19.858550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:19.859585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:19.865614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:19.866092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:20.006416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:20.023358 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1a5e555-e02d-47f9-b260-9fc6a6849dda tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 1.081080 Sep 01 04:51:20.024891 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 555/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:18 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:20.032613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:20.033501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:20.042005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:20.042736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:20.043905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:20.044836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:20.045297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:20.046220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:20.154811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:20.167548 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a11940ff-44da-414b-9dd9-ca25090804a7 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 200 len: 1433 microversion: 2.1 time: 0.346102 Sep 01 04:51:20.181342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 622/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:19 2022] GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 1433 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:20.181342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-212aa46b-9cd6-4a10-8a4f-22a2a512a432 req-5f37a397-1927-448d-9015-55c9ffee26af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d0e8a1-2431-49af-8292-4f43d3c5876d", "name": "network-vif-deleted", "tag": "bb286f0f-d08d-4166-b089-02b82c4bbeb2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:20.189284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-212aa46b-9cd6-4a10-8a4f-22a2a512a432 req-5f37a397-1927-448d-9015-55c9ffee26af service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:20.189759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-212aa46b-9cd6-4a10-8a4f-22a2a512a432 req-5f37a397-1927-448d-9015-55c9ffee26af service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:20.190491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-212aa46b-9cd6-4a10-8a4f-22a2a512a432 req-5f37a397-1927-448d-9015-55c9ffee26af service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:20.205695 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-212aa46b-9cd6-4a10-8a4f-22a2a512a432 req-5f37a397-1927-448d-9015-55c9ffee26af service nova] Creating event network-vif-deleted:bb286f0f-d08d-4166-b089-02b82c4bbeb2 for instance e8d0e8a1-2431-49af-8292-4f43d3c5876d on n-h1-820368-37 Sep 01 04:51:20.220758 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-212aa46b-9cd6-4a10-8a4f-22a2a512a432 req-5f37a397-1927-448d-9015-55c9ffee26af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051062 Sep 01 04:51:20.221676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 623/1178] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:20.227436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:20.228126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:20.234733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:20.235255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:20.235691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:20.236391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:20.236844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:20.237265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:21.097228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:21.129347 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e44c0879-cab9-47ec-aca7-bbab30b68562 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1713 microversion: 2.1 time: 1.101556 Sep 01 04:51:21.132067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:21.132593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 556/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:20 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1713 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:21.141941 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c1f4375-c8c1-42d5-9927-08fc0a2e2905 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.918639 Sep 01 04:51:21.150214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:21.151110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:21.153590 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 624/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:20 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:21.162485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:21.163515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:21.165584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:21.170474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:21.171128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:21.172085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:21.173082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:21.175619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:21.176399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:21.176899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:21.177319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:21.178207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:21.178810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:21.179861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:22.051244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:22.060345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e396807-d081-4023-8074-a79a3f292da7 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1305 microversion: 2.1 time: 0.905518 Sep 01 04:51:22.074958 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 625/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:21 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1305 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:22.079903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:22.081242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8f8e91cb-8d29-4670-85c3-7e157a5b21ad req-73c5712d-6039-4d14-9d2a-909619669468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e5f1ec-18a2-448a-af16-c682e9b8383a", "name": "network-vif-deleted", "tag": "1c5038ed-f14c-405c-ad41-af3508fed97c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:22.092286 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d791bd9a-1ff8-476a-b291-3b92326837c7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1504 microversion: 2.1 time: 0.958022 Sep 01 04:51:22.093615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f8e91cb-8d29-4670-85c3-7e157a5b21ad req-73c5712d-6039-4d14-9d2a-909619669468 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:22.094355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f8e91cb-8d29-4670-85c3-7e157a5b21ad req-73c5712d-6039-4d14-9d2a-909619669468 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:22.095047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f8e91cb-8d29-4670-85c3-7e157a5b21ad req-73c5712d-6039-4d14-9d2a-909619669468 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:22.097510 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 557/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:21 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1504 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:22.112078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:22.112962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:22.122803 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8f8e91cb-8d29-4670-85c3-7e157a5b21ad req-73c5712d-6039-4d14-9d2a-909619669468 service nova] Creating event network-vif-deleted:1c5038ed-f14c-405c-ad41-af3508fed97c for instance 44e5f1ec-18a2-448a-af16-c682e9b8383a on n-h2-820368-37 Sep 01 04:51:22.125258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:22.125988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:22.127545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:22.128499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:22.129656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8f8e91cb-8d29-4670-85c3-7e157a5b21ad req-73c5712d-6039-4d14-9d2a-909619669468 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052830 Sep 01 04:51:22.130470 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 626/1183] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:22.131091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:22.131897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:22.138143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:22.139060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:22.156129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:22.156619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:22.157253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:22.157964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:22.158484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:22.159069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.224187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:23.227126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:23.236290 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a43e889e-4942-405e-9cca-8aeeede88582 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 1.103423 Sep 01 04:51:23.243218 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 627/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:22 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:23.244384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:23.247335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:23.252153 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f260e2fa-b54f-4316-9418-9334fabc94cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 1.151910 Sep 01 04:51:23.253677 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 558/1185] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:22 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:23.255421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:23.256036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 44e5f1ec-18a2-448a-af16-c682e9b8383a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:23.262949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:23.265779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.266380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.267592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:23.271536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.272298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.272774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.273203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.282369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.283111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.283765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.295044 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance 44e5f1ec-18a2-448a-af16-c682e9b8383a could not be found. Sep 01 04:51:23.300461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.301342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.303045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a HTTP/1.1 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 44e5f1ec-18a2-448a-af16-c682e9b8383a could not be found. Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '44e5f1ec-18a2-448a-af16-c682e9b8383a'} Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e5f1ec-18a2-448a-af16-c682e9b8383a could not be found. Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e5f1ec-18a2-448a-af16-c682e9b8383a could not be found. Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:23.316936 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e5f1ec-18a2-448a-af16-c682e9b8383a could not be found. Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance 44e5f1ec-18a2-448a-af16-c682e9b8383a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbe2934f-50b2-4c80-9e2d-4209a61ad30d tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a" status: 404 len: 111 microversion: 2.1 time: 0.073924 Sep 01 04:51:23.321950 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 628/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:23 2022] GET /compute/v2.1/servers/44e5f1ec-18a2-448a-af16-c682e9b8383a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:23.323472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:23.324280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:23.344927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.345675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.346290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.347215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.347827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.349038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.516841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:23.530799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62fb66f0-f99a-48a4-a999-188055216063 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1645 microversion: 2.1 time: 0.275151 Sep 01 04:51:23.543462 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 559/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:23 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1645 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:23.552135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4367fc71-9c62-4c7c-9a42-2d265ab5261b req-fb2748f9-f0b7-459a-9977-470512a48599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fd3cd6-8be4-4ed5-862e-6b613c179a4f", "tag": "fa8e93cc-a812-4ca2-9049-00fc0beaff56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:23.561131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:23.564702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4367fc71-9c62-4c7c-9a42-2d265ab5261b req-fb2748f9-f0b7-459a-9977-470512a48599 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.565576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4367fc71-9c62-4c7c-9a42-2d265ab5261b req-fb2748f9-f0b7-459a-9977-470512a48599 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.566005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4367fc71-9c62-4c7c-9a42-2d265ab5261b req-fb2748f9-f0b7-459a-9977-470512a48599 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.581216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4367fc71-9c62-4c7c-9a42-2d265ab5261b req-fb2748f9-f0b7-459a-9977-470512a48599 service nova] Creating event network-changed:fa8e93cc-a812-4ca2-9049-00fc0beaff56 for instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f on n-h1-820368-37 Sep 01 04:51:23.587502 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4367fc71-9c62-4c7c-9a42-2d265ab5261b req-fb2748f9-f0b7-459a-9977-470512a48599 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042494 Sep 01 04:51:23.588614 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 560/1188] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:23.595220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:23.596150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:23.603324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.604402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.604840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.605724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:23.606247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:23.607093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:23.945470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:23.970642 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f8e3bc2-7395-437e-90ec-5b4b694dccc7 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.650565 Sep 01 04:51:23.972077 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 629/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:23 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:23.994066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:23.994960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:24.028049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.029645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.030078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.031727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.032240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.032669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.032807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:24.043913 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33e53fee-2d11-4bc5-a143-bfa857a693bb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1305 microversion: 2.1 time: 0.453899 Sep 01 04:51:24.059294 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 561/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:23 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1305 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:24.065831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:24.066446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e8d0e8a1-2431-49af-8292-4f43d3c5876d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:24.086087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.089917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.090775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.091585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.092069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.092965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.121357 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance e8d0e8a1-2431-49af-8292-4f43d3c5876d could not be found. Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d HTTP/1.1 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e8d0e8a1-2431-49af-8292-4f43d3c5876d could not be found. Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e8d0e8a1-2431-49af-8292-4f43d3c5876d'} Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d0e8a1-2431-49af-8292-4f43d3c5876d could not be found. Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d0e8a1-2431-49af-8292-4f43d3c5876d could not be found. Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:24.123353 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d0e8a1-2431-49af-8292-4f43d3c5876d could not be found. Sep 01 04:51:24.128144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:24.129486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance e8d0e8a1-2431-49af-8292-4f43d3c5876d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:24.130594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fad75f8b-9591-4f07-be6f-74c8d5603c5a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d" status: 404 len: 111 microversion: 2.1 time: 0.070145 Sep 01 04:51:24.131916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 562/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:24 2022] GET /compute/v2.1/servers/e8d0e8a1-2431-49af-8292-4f43d3c5876d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:24.142314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-078ade2b-212e-4b58-b04b-d7f2cf6b0082 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:24.208310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-078ade2b-212e-4b58-b04b-d7f2cf6b0082 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/f7f96ce1-feb2-4706-9f46-385e1a8cb15b" status: 204 len: 0 microversion: 2.1 time: 0.072489 Sep 01 04:51:24.211503 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 563/1192] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 04:51:24 2022] DELETE /compute/v2.1/os-server-groups/f7f96ce1-feb2-4706-9f46-385e1a8cb15b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:24.221273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:24.221830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:24.229075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.230535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.231175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.232083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.232737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.233342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.341466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:24.477512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17489d8d-a911-4bfb-b884-cd2ebd551b7e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 204 len: 0 microversion: 2.1 time: 0.261284 Sep 01 04:51:24.479174 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 564/1193] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:24 2022] DELETE /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:24.490820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:24.492194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:24.505140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.506248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.507096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.508445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.509100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.509673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.885341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:24.903971 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ea79743-4f66-4ea7-a4a6-4432733ccba2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1479 microversion: 2.1 time: 0.930113 Sep 01 04:51:24.906733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 630/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:23 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1479 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:24.908678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:24.925143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:24.929736 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ce0db33-dd7c-46d5-9c03-0b9b29526a2a tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.448598 Sep 01 04:51:24.930536 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 565/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:24 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:24.931094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:24.946375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.946966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "tag": "63a3bd85-011c-4efd-b904-9d723910cdd2"}, {"server_uuid": "26874bdb-4cfa-4522-ac41-5370de3e8c8c", "name": "network-vif-deleted", "tag": "31f29742-91ff-49c1-b6a5-677ff0d64164"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:24.947388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.948090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.949035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.949702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.950336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:24.977170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:24.977722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:24.978168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.001542 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] Creating event network-changed:63a3bd85-011c-4efd-b904-9d723910cdd2 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:51:25.001542 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] Creating event network-vif-deleted:31f29742-91ff-49c1-b6a5-677ff0d64164 for instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c on n-h1-820368-37 Sep 01 04:51:25.010114 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e0a9efa9-9e7f-4827-a8f5-3fc85a842649 req-d5a3e968-fb62-4156-807f-b45e32938ffc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.078476 Sep 01 04:51:25.017437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 566/1196] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:25.018214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.019840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:25.026908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.027396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.027835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.028539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.028989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.029410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.068996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:25.154407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:25.195295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:25.209928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:25.211422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:25.212761 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1895ee21-0a41-4cd8-99f2-b46e0de435d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.302214 Sep 01 04:51:25.213326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 631/1197] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:24 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:25.225573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.226232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:25.233139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.233718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.234148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.235148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.235557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.235988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.240337 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cdaf9b23-0625-4d1e-a62c-88e7c276d9df tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 204 len: 0 microversion: 2.1 time: 0.226481 Sep 01 04:51:25.241496 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 567/1198] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:25 2022] DELETE /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:25.250644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59b276d9-c0a1-4e9c-98fb-7091d273d3bf tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '.version_select at 0x7fa75beb65e0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.259022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b276d9-c0a1-4e9c-98fb-7091d273d3bf tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.260159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b276d9-c0a1-4e9c-98fb-7091d273d3bf tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.261354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b276d9-c0a1-4e9c-98fb-7091d273d3bf tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.287431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.288020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.288610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.289252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lazy-loading 'fault' on Instance uuid 26874bdb-4cfa-4522-ac41-5370de3e8c8c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:25.311955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59b276d9-c0a1-4e9c-98fb-7091d273d3bf tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.068746 Sep 01 04:51:25.312837 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 568/1199] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:51:25 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:25.317723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.318670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:25.328174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.331478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.332083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.333629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.334148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.337014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.406269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:25.422238 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea7a46f1-9d71-43d1-80bd-dd6a42bcbfe9 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1353 microversion: 2.1 time: 0.203704 Sep 01 04:51:25.436530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 632/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:25 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:25.442031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.442864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:25.449918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.450666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.451306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.452242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.452918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.453496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.877991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:25.887150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57f09478-4bbc-40ef-98f1-4d63a00f5876 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.573142 Sep 01 04:51:25.888165 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 569/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:25 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:25.894156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.894911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:25.903785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.904657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.905299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.906175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.907032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.907612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.926380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:25.936662 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a8ce340-9f48-4221-87d4-d1069b6c7a06 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1305 microversion: 2.1 time: 0.498722 Sep 01 04:51:25.940251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 633/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:25 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1305 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:25.946133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:25.947082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:25.956597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.957323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.957935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.958783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:25.959411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:25.960119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:25.981216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:26.301319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:26.317592 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7c17a74-11e2-4cdd-9c78-14f75fa15400 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 200 len: 1473 microversion: 2.1 time: 0.426083 Sep 01 04:51:26.323001 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 570/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:25 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:26.331979 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac23243d-4dbb-453a-adf5-df08ac72bc33 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1632 microversion: 2.1 time: 0.390569 Sep 01 04:51:26.332899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 634/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:25 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1632 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:26.335501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:26.336480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:26.342776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:26.343435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:26.356628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.357366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.357666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.358173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.358379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.359859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.360322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.360687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.361333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.361456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.362009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.362679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.506502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:26.528038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:26.684871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:26.694548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:26.696269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:26.697666 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98779b68-4db1-4d21-ae47-cc300b178335 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.362491 Sep 01 04:51:26.711468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:26.712176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 635/1205] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:26 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:26.721433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a46d80d-b7c1-465c-97f6-3659ee23079f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Action: 'create', calling method: .version_select at 0x7fa75be625e0>, body: {"keypair": {"name": "tempest-keypair-1575979223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvOf+KJaZ6pn5lJhLU2fx4yTDWBSQIEnwnXp5LIcZL3Cf7yoVeQpkMa2INTvSpoCjONQOlM4DrHQXC/rWTgjQnj9f7O36U86I/u5n1th4LL1thRsbxRYYIcAlfRBfwxOg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:26.725420 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dad9ade-5798-432c-bb0e-4bb5689dbbc0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.403990 Sep 01 04:51:26.729830 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 571/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:26 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:26.739813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9a46d80d-b7c1-465c-97f6-3659ee23079f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:51:26.745000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9a46d80d-b7c1-465c-97f6-3659ee23079f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for user 6c067efaa01740ee9284a943d574f086 and project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:51:26.785872 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a46d80d-b7c1-465c-97f6-3659ee23079f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072204 Sep 01 04:51:26.787044 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 636/1207] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:51:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:26.811815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:26.812397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:26.869595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.870237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.870692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.882112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.882622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.883253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.912931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:26.913567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:26.926166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.927088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.928909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.929815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.930468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.931102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.990180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:26.990691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:26.991177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:26.991818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lazy-loading 'fault' on Instance uuid 26874bdb-4cfa-4522-ac41-5370de3e8c8c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:27.335645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d938ea24d3a4098bb7b932057afb841', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2827829d3ee04a6f8037be7c021a17f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:27.353312 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da86abb6-c67b-4f24-ac36-28ce7a7a848d tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 200 len: 1353 microversion: 2.1 time: 0.622258 Sep 01 04:51:27.367471 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 572/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:26 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 1353 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:27.373356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:27.374421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:27.382190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:27.382704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:27.383275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:27.384085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:27.384653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:27.385224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:27.872659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:27.887465 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-18c1c6f1-2f90-478a-ad98-2ff160c25a7f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.978472 Sep 01 04:51:27.893300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 637/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:26 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:27.936681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:27.955747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:27.975006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:27.975495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:27.975923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:27.976620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:27.977070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:27.977497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.023669 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3894ce9-e550-4a0d-a480-b327019f8b2f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093092 Sep 01 04:51:28.024676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 638/1210] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:51:27 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:28.029366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d5d787ae-a506-46f6-9a29-88d7ed26e002 req-c2d8dc62-9e13-4c47-8d8d-59dec65ad540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "tag": "68c49780-c70d-4f84-b9c7-39ed3b38d649"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:28.040070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5d787ae-a506-46f6-9a29-88d7ed26e002 req-c2d8dc62-9e13-4c47-8d8d-59dec65ad540 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.040547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5d787ae-a506-46f6-9a29-88d7ed26e002 req-c2d8dc62-9e13-4c47-8d8d-59dec65ad540 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.040959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5d787ae-a506-46f6-9a29-88d7ed26e002 req-c2d8dc62-9e13-4c47-8d8d-59dec65ad540 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.076773 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d5d787ae-a506-46f6-9a29-88d7ed26e002 req-c2d8dc62-9e13-4c47-8d8d-59dec65ad540 service nova] Creating event network-changed:68c49780-c70d-4f84-b9c7-39ed3b38d649 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:51:28.082786 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d5d787ae-a506-46f6-9a29-88d7ed26e002 req-c2d8dc62-9e13-4c47-8d8d-59dec65ad540 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056710 Sep 01 04:51:28.084185 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 639/1211] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:28.090988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:28.091932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:28.098504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.099106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.099480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.100378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.100827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.101242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.178821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:28.188826 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6c29ad7-a678-419a-aef9-7e6331be466d tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1305 microversion: 2.1 time: 0.820033 Sep 01 04:51:28.189541 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 573/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:27 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1305 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:28.195011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:28.195879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:28.203857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.204687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.205338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.206070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.206502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.207124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.723352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:28.733986 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef95ccc2-3608-43a8-a04c-b6fbd5082e57 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 200 len: 1473 microversion: 2.1 time: 0.647456 Sep 01 04:51:28.741780 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 640/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:28 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 1473 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:28.749407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:28.750339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:28.758349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.758974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.759634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.760397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.760914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.761399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.803295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:28.815348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:28.817638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:28.820471 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9bd7402-3baf-48d9-9ffc-30727fbd823e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.628213 Sep 01 04:51:28.838283 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 574/1214] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:28 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:28.855879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:28.856943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:28.865752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.867462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.868255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:28.870520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:28.871450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:28.872294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:29.029649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lazy-loading 'services' on Instance uuid df4b80bb-15cc-49d3-bc27-ad6a5f06884e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:29.208132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ffa6076-bf52-4e49-a9ee-f8e055ee708f tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments/108aa069-d8cb-453d-b3ee-5fb4bda2480d" status: 202 len: 0 microversion: 2.1 time: 0.368958 Sep 01 04:51:29.212335 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 575/1215] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 04:51:28 2022] DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments/108aa069-d8cb-453d-b3ee-5fb4bda2480d => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:29.218388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:29.219233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:29.230613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:29.231329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:29.232231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:29.232906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:29.233561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:29.233982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:29.259993 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c HTTP/1.1 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '26874bdb-4cfa-4522-ac41-5370de3e8c8c'} Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:29.265081 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:29.270139 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4684975-8170-43cc-9735-42cee2a86dac tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 404 len: 111 microversion: 2.1 time: 0.056246 Sep 01 04:51:29.272087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 576/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:29 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:29.277608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:29.278274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:29.301868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:29.302353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:29.303160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:29.304290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:29.304740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:29.306085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:29.364682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:29.379051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-555243b3-acac-4800-9c26-f51d05674af8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1496 microversion: 2.1 time: 0.635715 Sep 01 04:51:29.399971 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 641/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:28 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1496 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:29.406569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:29.407325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:29.414368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:29.415150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:29.415816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:29.416706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:29.417330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:29.417949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.186975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:30.194962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25b92698-a9c0-4d40-b195-596f79af551c tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 0.793633 Sep 01 04:51:30.195992 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 642/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:29 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:30.200906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:30.201708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:30.216238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.217007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.221320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.221320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.221320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.221320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.246782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:30.248524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 HTTP/1.1 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'b9fd1215-d488-4a50-986c-4a4006f1ff37'} Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:30.251260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.255880 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.257280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-218e50be-24cf-4fc1-8d71-2c3cba7fcdcb tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.983914 Sep 01 04:51:30.258135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:30.259187 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a10621b6-d8c5-4924-988d-569cf107862e tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 404 len: 111 microversion: 2.1 time: 0.062100 Sep 01 04:51:30.260214 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 643/1220] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:30 2022] DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:30.260368 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 577/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:29 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:30.265201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:30.266036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:30.271634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:30.273627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.274277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.274873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.275521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:30.276056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.276198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:30.276790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.277359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.294216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.294709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.295166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.299736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.300217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.300645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.324353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.325075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.325664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.326268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lazy-loading 'fault' on Instance uuid 3c60da80-bd80-4e4a-94b1-fe33392994f5 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:30.443635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:30.454291 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56c9dd2b-4dbf-4540-935c-f5b8318cacec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 200 len: 1308 microversion: 2.1 time: 0.192726 Sep 01 04:51:30.457609 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 644/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:30 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:30.466711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-597154209", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "59c92b9b-a4b3-4189-97d1-ab9f2663410e"}], "security_groups": [{"name": "tempest-securitygroup--1289084371"}], "key_name": "tempest-keypair-1575979223", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:30.767721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:30.790837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:30.792858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:30.794360 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-782c135a-813e-4a5b-a884-a249d4bb1223 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1814 microversion: 2.25 time: 0.531826 Sep 01 04:51:30.795978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 578/1222] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:30 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1814 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:30.811729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] validate_networks() for [('59c92b9b-a4b3-4189-97d1-ab9f2663410e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:51:30.814137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "tag": "ba3008f4-6a4d-4cbb-a293-83d1234b6f51"}, {"server_uuid": "3c60da80-bd80-4e4a-94b1-fe33392994f5", "name": "network-vif-deleted", "tag": "24a63565-8087-45ad-8826-15aafe9285c1"}, {"server_uuid": "41fe5a6c-9184-463d-89db-ec54804eb733", "name": "network-vif-deleted", "tag": "5c882909-c5ef-46f8-877b-055f7e5fcc2e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:30.830145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.831171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.831823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.873455 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Creating event network-changed:ba3008f4-6a4d-4cbb-a293-83d1234b6f51 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:51:30.875909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Creating event network-vif-deleted:24a63565-8087-45ad-8826-15aafe9285c1 for instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 on n-h1-820368-37 Sep 01 04:51:30.876962 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] Creating event network-vif-deleted:5c882909-c5ef-46f8-877b-055f7e5fcc2e for instance 41fe5a6c-9184-463d-89db-ec54804eb733 on n-h1-820368-37 Sep 01 04:51:30.891817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2e12e63e-a570-4e57-997c-fe88ae8ffb97 req-6d035a1d-c475-4a1a-899e-ded90a83a569 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.093266 Sep 01 04:51:30.893436 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 579/1223] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:30.906524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:30.906789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:30.919567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.920263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.920931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.922149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:30.922717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:30.923427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:30.963898 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 HTTP/1.1 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b9fd1215-d488-4a50-986c-4a4006f1ff37'} Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.966106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:30.970515 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:30.973494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:30.974948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a723d884-9fff-4369-aa24-eac7694614bf tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 404 len: 111 microversion: 2.1 time: 0.076164 Sep 01 04:51:30.976020 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 580/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:30 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:30.992849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:31.005601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:31.021438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.022654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.023324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.024345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.025281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.025965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.419090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:31.429701 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37657c3e-595e-44f1-b63b-d1d2e8952a6d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 200 len: 1473 microversion: 2.1 time: 0.444281 Sep 01 04:51:31.440901 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 581/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:30 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 1473 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:31.440901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccb7e414-b18c-46d1-a785-1746e8c3d938 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '.version_select at 0x7fa75bd6c160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:31.465927 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccb7e414-b18c-46d1-a785-1746e8c3d938 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768765177" status: 202 len: 0 microversion: 2.1 time: 0.034525 Sep 01 04:51:31.467091 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 582/1226] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 04:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768765177 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:31.477004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:31.477630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:31.484995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.485493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.485965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.486627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.487276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.487681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.792592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:51:31.793967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:51:31.794752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:51:31.795633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:51:31.796729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:51:31.810968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.812802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.814312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.815689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.816416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.817072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.849511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:51:31.856436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for user 6c067efaa01740ee9284a943d574f086 and project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:51:31.870478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:31.877212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:51:31.879340 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-401e4b55-32a2-4274-9d36-b8359ae90acb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 0.410596 Sep 01 04:51:31.879935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 583/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:31 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:31.881752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:51:31.886229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:31.886835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:31.894745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.895451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.895938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.896646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:31.897115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:31.897809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:31.973146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40020f75-7695-4751-9345-54c40b2c228e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.514187 Sep 01 04:51:31.980806 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 645/1228] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:51:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:51:31.988027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1788480725"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:31.993142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.006774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.008304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.009064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.012124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.013766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.014471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.227411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:32.235452 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-600207cf-36a4-4f3f-a505-1f783a561a1e tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.354505 Sep 01 04:51:32.236025 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 584/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:31 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:32.256218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.257003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 3c60da80-bd80-4e4a-94b1-fe33392994f5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.266562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.267828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.268417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.270024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.270636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.271262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.296230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 could not be found. Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 HTTP/1.1 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 could not be found. Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3c60da80-bd80-4e4a-94b1-fe33392994f5'} Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 could not be found. Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 could not be found. Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:32.298946 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 could not be found. Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance 3c60da80-bd80-4e4a-94b1-fe33392994f5 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:32.303468 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-335b6264-8f7e-4534-af8e-6ca691942d3c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5" status: 404 len: 111 microversion: 2.1 time: 0.049276 Sep 01 04:51:32.304501 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 585/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/servers/3c60da80-bd80-4e4a-94b1-fe33392994f5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:32.309451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.310188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.318693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.319254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.319765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.320454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.321704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.322125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.439606 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fae9d52-1d8e-4a07-9e86-b7601cd6d6f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0/action" status: 202 len: 0 microversion: 2.1 time: 0.450208 Sep 01 04:51:32.453086 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 646/1231] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:51:31 2022] POST /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:51:32.463878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fec5008e-03e7-43d1-bc89-34ad853b1cee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.464589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fec5008e-03e7-43d1-bc89-34ad853b1cee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.575663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:32.590004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:32.593163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:32.596712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6bb710dc-c368-409b-bc27-deb4815195e4 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1804 microversion: 2.25 time: 0.291221 Sep 01 04:51:32.610757 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 586/1232] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1804 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:32.627278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.630555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: 41fe5a6c-9184-463d-89db-ec54804eb733] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.637976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.638651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.639291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.643489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fec5008e-03e7-43d1-bc89-34ad853b1cee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:32.651204 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fec5008e-03e7-43d1-bc89-34ad853b1cee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1234 microversion: 2.1 time: 0.196621 Sep 01 04:51:32.651960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.652501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.652937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.655606 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 647/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1234 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:32.679212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1455ebb-02c4-4356-a73c-52a2d0c399f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bf3f790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.714662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance 41fe5a6c-9184-463d-89db-ec54804eb733 could not be found. Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 HTTP/1.1 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 41fe5a6c-9184-463d-89db-ec54804eb733 could not be found. Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '41fe5a6c-9184-463d-89db-ec54804eb733'} Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fe5a6c-9184-463d-89db-ec54804eb733 could not be found. Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fe5a6c-9184-463d-89db-ec54804eb733 could not be found. Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:32.739457 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fe5a6c-9184-463d-89db-ec54804eb733 could not be found. Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance 41fe5a6c-9184-463d-89db-ec54804eb733 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:32.745488 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bd9f6a5-a856-4bbf-bbcb-46662148287e tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733" status: 404 len: 111 microversion: 2.1 time: 0.123969 Sep 01 04:51:32.746985 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 587/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/servers/41fe5a6c-9184-463d-89db-ec54804eb733 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:32.749857 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1455ebb-02c4-4356-a73c-52a2d0c399f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.081197 Sep 01 04:51:32.750447 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 648/1235] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:32.755297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbccd994-7c0e-488d-a321-922fb46dcbe5 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '.version_select at 0x7fa75be421f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.757263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21e79887-10e7-4cf6-b6ed-bac587f533f4 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.759257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbccd994-7c0e-488d-a321-922fb46dcbe5 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.759945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbccd994-7c0e-488d-a321-922fb46dcbe5 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.760600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbccd994-7c0e-488d-a321-922fb46dcbe5 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.770864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbccd994-7c0e-488d-a321-922fb46dcbe5 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2380 microversion: 2.25 time: 0.019105 Sep 01 04:51:32.771853 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 649/1236] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/os-migrations => generated 2380 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:32.787492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1539368a-b79c-4cbd-8dc6-d18de8a8c555 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.795280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21e79887-10e7-4cf6-b6ed-bac587f533f4 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1262420842" status: 202 len: 0 microversion: 2.1 time: 0.047063 Sep 01 04:51:32.796615 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 588/1237] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:51:32 2022] DELETE /compute/v2.1/flavors/1262420842 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:32.806756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.808019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.819756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.820583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.821065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.822931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.823509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.826072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.832339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:32.849982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1539368a-b79c-4cbd-8dc6-d18de8a8c555 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/1c6aa3f2-600e-4852-8748-9e25b4070475" status: 204 len: 0 microversion: 2.1 time: 0.076900 Sep 01 04:51:32.850871 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 650/1238] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 04:51:32 2022] DELETE /compute/v2.1/os-server-groups/1c6aa3f2-600e-4852-8748-9e25b4070475 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:32.857853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84ea9b45-5dcb-42af-b01a-f4da0fca5603 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.881993 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84ea9b45-5dcb-42af-b01a-f4da0fca5603 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.029952 Sep 01 04:51:32.887026 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 651/1239] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:32.892601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:32.893093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:32.911431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.911968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.912402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.913336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:32.913943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:32.914653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:32.957881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:33.043699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:33.074145 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4013c335-0538-4606-9e21-f899fb5ac665 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 2424 microversion: 2.25 time: 0.275087 Sep 01 04:51:33.075524 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 589/1240] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:32 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 2424 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:33.080543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-363ea00b-5a60-40a6-9970-c8f007c395f6 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.119655 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-363ea00b-5a60-40a6-9970-c8f007c395f6 tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1608081223" status: 202 len: 0 microversion: 2.1 time: 0.042652 Sep 01 04:51:33.120623 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 590/1241] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:51:33 2022] DELETE /compute/v2.1/flavors/1608081223 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:33.128359 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3da8de3f-2b3e-4779-ae96-702fd7abfeec tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 204 len: 0 microversion: 2.1 time: 0.239921 Sep 01 04:51:33.132670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.133580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.134625 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 652/1242] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:32 2022] DELETE /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:33.141732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.142218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.142638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.143641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.143887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.145100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.145426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.145994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.154607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.156687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.157356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.158273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.158913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.160341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.346485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:33.354774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ad4d2ec-e5be-4398-874c-a3b1fa7e75bc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 0.228786 Sep 01 04:51:33.355503 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 591/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:33.357009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:33.360997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de9bee1e-9838-4bb4-b519-5b8b0e9e0c7c tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.380915 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de9bee1e-9838-4bb4-b519-5b8b0e9e0c7c tempest-ServersWithSpecificFlavorTestJSON-1880043389 tempest-ServersWithSpecificFlavorTestJSON-1880043389-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024041 Sep 01 04:51:33.381600 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 592/1244] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:33.381983 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb86c1a5-5c24-4f18-9a2f-2066cbf607af tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 2424 microversion: 2.25 time: 0.245162 Sep 01 04:51:33.382637 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 653/1245] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 2424 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:51:33.386813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.387480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.388029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.388300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.397388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.397870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.398293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.399130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.399791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.400443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.400897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.403403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.403403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.403403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.404219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.404799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.619724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:33.623476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:33.630044 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bfdf626-52c3-4f5a-a4f9-1584f2538008 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1472 microversion: 2.1 time: 0.246540 Sep 01 04:51:33.630987 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 593/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:33.632380 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c6b7d41-12d0-4e05-a29d-4eed27f6d137 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.248455 Sep 01 04:51:33.632955 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 654/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:33.637146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.637821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.638416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.638932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.646476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.647000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.647120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.647437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.647583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.648020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.648514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.648726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.648970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.649176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.649392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.649595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.664406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c HTTP/1.1 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '26874bdb-4cfa-4522-ac41-5370de3e8c8c'} Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:33.666062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d743846-bfed-4656-aefa-739fdbf60f96 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "DELETE /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 404 len: 111 microversion: 2.1 time: 0.035435 Sep 01 04:51:33.669994 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 594/1248] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:33 2022] DELETE /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:33.679308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.681218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: 26874bdb-4cfa-4522-ac41-5370de3e8c8c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.683178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:33.683326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:33.689523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.690005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.690569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.691318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.691779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.692168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.711800 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c HTTP/1.1 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '26874bdb-4cfa-4522-ac41-5370de3e8c8c'} Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.713935 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance 26874bdb-4cfa-4522-ac41-5370de3e8c8c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5934fc4-c6b3-4734-9829-6f353d252742 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c" status: 404 len: 111 microversion: 2.1 time: 0.041155 Sep 01 04:51:33.718850 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 595/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/26874bdb-4cfa-4522-ac41-5370de3e8c8c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:33.723368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.724369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.731513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.731984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.732416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.733362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.735085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.735518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.808518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:33.817085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c3c07f1-2796-4ee0-a177-778f320d9fa1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1238 microversion: 2.1 time: 0.099396 Sep 01 04:51:33.818057 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 596/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:33.822638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.823435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.825827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lazy-loading 'services' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:33.831356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.832046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.832654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.833524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.833972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.834391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.849698 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 HTTP/1.1 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b9fd1215-d488-4a50-986c-4a4006f1ff37'} Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:33.851267 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41abe34d-95d9-40cb-bc0e-a030b7623794 tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 404 len: 111 microversion: 2.1 time: 0.033519 Sep 01 04:51:33.855606 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 597/1251] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:33 2022] DELETE /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:33.857723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-debd5fee-0da2-4bcc-a573-2dfe38730ab7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bc99310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.907191 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-debd5fee-0da2-4bcc-a573-2dfe38730ab7 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.052902 Sep 01 04:51:33.908036 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 598/1252] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:33.913462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.914254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] [instance: b9fd1215-d488-4a50-986c-4a4006f1ff37] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.921124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.921637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.922063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.922770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.923296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.923723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.938320 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] HTTP exception thrown: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Request method failure captured: Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 HTTP/1.1 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlprNQK-wBmsTxh0EmsNJEP82_-ySE00iDs-sgyXKc-6_Y20XTfOv4wv70GBfDs3ndMXqdmerulJm6isOnAFJxSfss3yZ_m09OX5aI1SSEibK4DJTl3isSpm6AHFU2vXYPDkUnvRK8gNz8NZQHYngXMhmcxwMl8-j3JcoTs3YRwG78 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2827829d3ee04a6f8037be7c021a17f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 2827829d3ee04a6f8037be7c021a17f0 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5d938ea24d3a4098bb7b932057afb841 Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1683387505-project Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b9fd1215-d488-4a50-986c-4a4006f1ff37'} Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.940320 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] Returning 404 to user: Instance b9fd1215-d488-4a50-986c-4a4006f1ff37 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2f81abc-0e0a-44ad-b1e9-ef07e46bb4aa tempest-ServersWithSpecificFlavorTestJSON-1683387505 tempest-ServersWithSpecificFlavorTestJSON-1683387505-project] 10.222.0.26 "GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37" status: 404 len: 111 microversion: 2.1 time: 0.032597 Sep 01 04:51:33.945589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 599/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/b9fd1215-d488-4a50-986c-4a4006f1ff37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:33.959318 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88cf91de-10f7-4386-bfd4-e7e7202aa258 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments/364ec36f-36cd-4af3-a497-9eba98d2523b" status: 202 len: 0 microversion: 2.25 time: 0.325124 Sep 01 04:51:33.960186 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 655/1254] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Sep 1 04:51:33 2022] DELETE /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments/364ec36f-36cd-4af3-a497-9eba98d2523b => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:33.968806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:33.970993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:33.977365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.977850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.978282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:33.979004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:33.979452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:33.979872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:34.014213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6258a97a-87a1-4e60-83d6-abcc72849697 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049371 Sep 01 04:51:34.019042 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 600/1255] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:51:33 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:51:34.377217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:34.378227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:34.385288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:34.386040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:34.386646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:34.387538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:34.388148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:34.388726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:34.559959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:34.570021 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86884384-4665-4120-931f-88c56d18aabc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 0.198064 Sep 01 04:51:34.571699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 656/1256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:34 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:34.656216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:34.656832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:34.660242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:34.660866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:34.674732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:34.675271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:34.675704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:34.676411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:34.676861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:34.683057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:34.690076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:34.690638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:34.691115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:34.691865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:34.692316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:34.692918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.188675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:35.206372 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0bc59d7-afbb-47f5-a7f1-01c562f2dfee tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.553960 Sep 01 04:51:35.207070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:35.219145 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 657/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:34 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:35.226461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4affe35-e256-4b01-974d-e8eec77e281a tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1472 microversion: 2.1 time: 0.578844 Sep 01 04:51:35.226863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.227405 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 601/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:34 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:35.227882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:35.234040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.236716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.237549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.238293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.239234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.239839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.240486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.243354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:35.262512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.264206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.266861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.267933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.270431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.273313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.325162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4a9ef24-e893-4a19-83c5-8b68dbde796e tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095936 Sep 01 04:51:35.326506 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 602/1259] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:51:35 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:51:35.331875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c9bd38b-f322-4f33-a4e6-f66d665cd7f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcaa430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.431545 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c9bd38b-f322-4f33-a4e6-f66d665cd7f8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.103627 Sep 01 04:51:35.432664 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 603/1260] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:35 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:35.440643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:35.443205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.448783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:35.451123 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccf7caf6-612d-48b3-a8c7-a65647d89e83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1230 microversion: 2.1 time: 0.228519 Sep 01 04:51:35.452340 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 658/1261] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:35 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1230 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:35.461500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.463902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.466373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:35.467438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.468288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.469504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.473043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.474325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.481022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.481789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.482380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.485008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.485646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.495184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.559230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6578985-06d5-4f42-9192-eb76fa0dd9f3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122371 Sep 01 04:51:35.560240 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 604/1262] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:51:35 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:51:35.584656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bd5cbb3-2f08-4608-870e-8b39f84ca7b3 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130901 Sep 01 04:51:35.592017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.592623 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 659/1263] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:51:35 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:51:35.592974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:35.618848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.622693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.624465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.630081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.630727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.635284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.716295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:35.717055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:35.736846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.737582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.738191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.739112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:35.739742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:35.740327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:35.815942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:36.046612 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8f4519e-0c1c-4ec7-acfb-471f89c7b129 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 204 len: 0 microversion: 2.1 time: 0.333945 Sep 01 04:51:36.054696 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 660/1264] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:35 2022] DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:51:36.072699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:36.073731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:36.083120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:36.091469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:36.091947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:36.092419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:36.093408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:36.094251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:36.094251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:36.100799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00a4793f-65e7-4896-8168-56ff0c3c4126 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 0.511910 Sep 01 04:51:36.118139 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 605/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:35 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:36.229324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:36.229324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:36.241806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:36.242910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:36.243541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:36.247173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:36.248266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:36.248944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.372384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:37.388115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-928f86df-7c7a-43b4-9741-adc0a86e1f1c tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1681 microversion: 2.1 time: 1.330764 Sep 01 04:51:37.417649 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 661/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:36 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1681 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:37.431669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:37.434784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:37.464702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.467391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.469125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.474356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.475648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.479311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.592687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.593722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.594415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.597175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lazy-loading 'fault' on Instance uuid e2eda1a9-f765-416e-843a-a16925ec4c08 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:51:37.747573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:37.757706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2a7c5e7b394b9b9b44aef2156c7515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a917f0bb781a42879a605ffca90e436d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:37.773749 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f794081e-4301-4b50-807b-3023d225e8a0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 1.548817 Sep 01 04:51:37.776505 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46663417-b8d0-453e-af3b-c1d33b0855b2 tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 200 len: 1306 microversion: 2.1 time: 0.357503 Sep 01 04:51:37.777509 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 606/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:36 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:37.779765 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 662/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:37 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 1306 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:37.785585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21c19dd9-da33-4908-8794-109d1f768f8c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bc41160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:37.789523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:37.799203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:37.808212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.810949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.811701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.820125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.820730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.821245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.852691 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21c19dd9-da33-4908-8794-109d1f768f8c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.073319 Sep 01 04:51:37.859111 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 607/1269] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:37 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:37.864287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:37.878813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:37.892053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.892617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.893114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.893879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:37.894396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:37.894875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:37.962541 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8f5e224-1227-4a49-9460-f66e6d800b7c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.101976 Sep 01 04:51:37.976833 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 608/1270] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:51:37 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:51:37.984610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:37.985562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:38.010052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:38.023071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:38.024212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:38.025248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:38.026423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:38.027162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:38.050560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:38.061572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89014df8-325b-46d0-876f-340c10c2f009 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1292 microversion: 2.1 time: 0.280146 Sep 01 04:51:38.071856 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 663/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:37 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1292 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:38.159943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0fd71d8c-b9af-4ed6-a5a9-dfae64d352f8 req-ba94b0fb-f8f9-4998-bba2-5ee7953a6c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2eda1a9-f765-416e-843a-a16925ec4c08", "name": "network-vif-deleted", "tag": "0342e640-737e-4ade-ad77-9f3f869c631b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:38.183135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0fd71d8c-b9af-4ed6-a5a9-dfae64d352f8 req-ba94b0fb-f8f9-4998-bba2-5ee7953a6c79 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:38.183619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0fd71d8c-b9af-4ed6-a5a9-dfae64d352f8 req-ba94b0fb-f8f9-4998-bba2-5ee7953a6c79 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:38.184057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0fd71d8c-b9af-4ed6-a5a9-dfae64d352f8 req-ba94b0fb-f8f9-4998-bba2-5ee7953a6c79 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:38.198987 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0fd71d8c-b9af-4ed6-a5a9-dfae64d352f8 req-ba94b0fb-f8f9-4998-bba2-5ee7953a6c79 service nova] Creating event network-vif-deleted:0342e640-737e-4ade-ad77-9f3f869c631b for instance e2eda1a9-f765-416e-843a-a16925ec4c08 on n-h1-820368-37 Sep 01 04:51:38.204857 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0fd71d8c-b9af-4ed6-a5a9-dfae64d352f8 req-ba94b0fb-f8f9-4998-bba2-5ee7953a6c79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131203 Sep 01 04:51:38.205840 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 664/1272] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:38.410762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:38.412271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:38.431977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:38.432666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:38.433283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:38.434161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:38.434817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:38.435254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.188261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:39.209807 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccb5e13d-3484-4021-b57d-52352ca8d576 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1681 microversion: 2.1 time: 0.803538 Sep 01 04:51:39.213031 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 665/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:38 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1681 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:39.221957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:39.223111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:39.232120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.234000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.234848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.236223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.238309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.239166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.272399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:39.292955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc06c8f1-f9e5-46af-8aa0-11d153bb3711 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 1.314621 Sep 01 04:51:39.294036 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 609/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:37 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:39.317502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:39.318481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] [instance: e2eda1a9-f765-416e-843a-a16925ec4c08] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:39.338294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.340670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.341854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.343746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.344382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.345047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.385885 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] HTTP exception thrown: Instance e2eda1a9-f765-416e-843a-a16925ec4c08 could not be found. Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Request method failure captured: Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 HTTP/1.1 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlucmz_TAPqsMQ6GfyegxaGPRK7OWB5MuyOl4jZfcKpbbUt2OO_8Oiq07fTSqcS2EkRF-XY52icFN0AV4sZlus1lSD-mzsdv_p14GWANicfIOYya7RXZecjDLJZNYLZPqe8brVjJja8_QeRr6ba5kt0vbIA2eWUUBsdUEtXXBrTKHQ Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a917f0bb781a42879a605ffca90e436d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a917f0bb781a42879a605ffca90e436d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a917f0bb781a42879a605ffca90e436d Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-858954035 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: be2a7c5e7b394b9b9b44aef2156c7515 Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersOnMultiNodesTest-858954035-project Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e2eda1a9-f765-416e-843a-a16925ec4c08 could not be found. Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e2eda1a9-f765-416e-843a-a16925ec4c08'} Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2eda1a9-f765-416e-843a-a16925ec4c08 could not be found. Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2eda1a9-f765-416e-843a-a16925ec4c08 could not be found. Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:39.387912 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2eda1a9-f765-416e-843a-a16925ec4c08 could not be found. Sep 01 04:51:39.394108 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:39.396992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] Returning 404 to user: Instance e2eda1a9-f765-416e-843a-a16925ec4c08 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:39.399026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb743fea-8db0-45a5-b268-884ba3d27c7c tempest-ServersOnMultiNodesTest-858954035 tempest-ServersOnMultiNodesTest-858954035-project] 10.222.0.26 "GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08" status: 404 len: 111 microversion: 2.1 time: 0.100603 Sep 01 04:51:39.400122 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 610/1275] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:39 2022] GET /compute/v2.1/servers/e2eda1a9-f765-416e-843a-a16925ec4c08 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:39.423740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db32383b-f439-468c-84d5-efef6dce54d0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75beb10d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:39.514077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db32383b-f439-468c-84d5-efef6dce54d0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.112525 Sep 01 04:51:39.515409 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 611/1276] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:39 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:39.523462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3108a73e-cc17-4513-a70e-2e2ac7cdd1e8 req-082c3967-4913-4b22-9437-a515999509a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-plugged", "status": "completed", "tag": "63a3bd85-011c-4efd-b904-9d723910cdd2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:39.539662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3108a73e-cc17-4513-a70e-2e2ac7cdd1e8 req-082c3967-4913-4b22-9437-a515999509a0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.542249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3108a73e-cc17-4513-a70e-2e2ac7cdd1e8 req-082c3967-4913-4b22-9437-a515999509a0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.543016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3108a73e-cc17-4513-a70e-2e2ac7cdd1e8 req-082c3967-4913-4b22-9437-a515999509a0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.576082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3108a73e-cc17-4513-a70e-2e2ac7cdd1e8 req-082c3967-4913-4b22-9437-a515999509a0 service nova] Creating event network-vif-plugged:63a3bd85-011c-4efd-b904-9d723910cdd2 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:51:39.583507 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3108a73e-cc17-4513-a70e-2e2ac7cdd1e8 req-082c3967-4913-4b22-9437-a515999509a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066368 Sep 01 04:51:39.585611 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 612/1277] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:39.592033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:39.595936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:39.610684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.611331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.611887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.612706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.613455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.613956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.654401 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fc601b5-faa5-4753-bf4d-c7994bcc627d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067366 Sep 01 04:51:39.655947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 613/1278] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:51:39 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:51:39.662262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:39.663312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:39.670779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.671858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.673094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.674418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:39.675069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:39.675697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:39.827749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:39.839433 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9644ee07-a68a-4327-a567-7c0b25018c69 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.622910 Sep 01 04:51:39.853090 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 666/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:39 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:39.901463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:39.915735 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2073940e-706b-4a39-9be8-ccf8667db8c8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1292 microversion: 2.1 time: 0.258288 Sep 01 04:51:39.916977 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 614/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:39 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1292 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:40.234292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:40.235504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:40.242470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.243222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.243455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.245963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.246798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.247441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.318368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:40.320724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:40.330283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.331042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.331680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.333626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.334719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.335433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.375417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:40.524426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:40.556105 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9f2c02b-ff4c-4ef3-94c1-cfec567a8f20 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1613 microversion: 2.1 time: 0.326720 Sep 01 04:51:40.566693 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 667/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:40 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1613 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:40.580631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53b12f5b-44e7-4630-bc1f-ef9ff9744b2e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd99280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:40.650192 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53b12f5b-44e7-4630-bc1f-ef9ff9744b2e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.082107 Sep 01 04:51:40.653913 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 668/1282] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:40 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:40.678773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:40.682308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:40.708649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.712524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.713245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.715447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.716973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.719203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.776946 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d957317-5440-4847-bce1-7019b235d707 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112407 Sep 01 04:51:40.778720 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 669/1283] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:51:40 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 04:51:40.866570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:40.870975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:40.892443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.895585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.903905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:40.904835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:40.909020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:40.919511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:41.647901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:41.673110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-837e1c24-3742-4ebb-aee3-f4a42297f7ac tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 1.362992 Sep 01 04:51:41.689222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 615/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:40 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:41.699476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:41.700086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:41.716697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:41.720160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:41.720658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:41.721394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:41.725507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:41.725985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:41.756797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:41.761199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:41.769270 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2771c00-dace-4422-bd25-8d7eac78c081 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.907696 Sep 01 04:51:41.769878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 670/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:40 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:41.782805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:41.783481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:41.810150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:41.810944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:41.811624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:41.813415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:41.817684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:41.818124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:41.861583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:41.980927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f10e75ab3564762b0fcc3f712f62cd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55b43bf6a8240428ac269fbe2d10db3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:42.003880 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b537fd47-0ae7-4cca-83ce-d28512fa790b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 200 len: 1613 microversion: 2.1 time: 0.232933 Sep 01 04:51:42.004478 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 671/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:41 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 1613 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:42.020011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c95f04d0-7e49-4090-86b6-5733535c09b3 req-44c874bf-bee0-4d05-9ee2-a9f00392171f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fd3cd6-8be4-4ed5-862e-6b613c179a4f", "name": "network-vif-plugged", "status": "completed", "tag": "fa8e93cc-a812-4ca2-9049-00fc0beaff56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:42.049822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c95f04d0-7e49-4090-86b6-5733535c09b3 req-44c874bf-bee0-4d05-9ee2-a9f00392171f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.051390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c95f04d0-7e49-4090-86b6-5733535c09b3 req-44c874bf-bee0-4d05-9ee2-a9f00392171f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.052157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c95f04d0-7e49-4090-86b6-5733535c09b3 req-44c874bf-bee0-4d05-9ee2-a9f00392171f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.101523 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c95f04d0-7e49-4090-86b6-5733535c09b3 req-44c874bf-bee0-4d05-9ee2-a9f00392171f service nova] Creating event network-vif-plugged:fa8e93cc-a812-4ca2-9049-00fc0beaff56 for instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f on n-h1-820368-37 Sep 01 04:51:42.107593 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c95f04d0-7e49-4090-86b6-5733535c09b3 req-44c874bf-bee0-4d05-9ee2-a9f00392171f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101720 Sep 01 04:51:42.109664 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 672/1287] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:42.138929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-940e7900-46fd-49ad-85ff-6bd822b2faeb tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd68b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:42.227944 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-940e7900-46fd-49ad-85ff-6bd822b2faeb tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.116838 Sep 01 04:51:42.229795 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 673/1288] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:42 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:42.235274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:42.249392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:42.278302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.278707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.302606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.304768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.306347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.309283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.420065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a59a3fcc-5d0f-4b18-989d-e1f527d4debb tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.189089 Sep 01 04:51:42.424879 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 674/1289] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 04:51:42 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a/os-volume_attachments => generated 25 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:42.464999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e198c173-8982-4a2a-b043-cba389063b03 req-46ebb62a-a96c-4dad-9573-dfb5d2e9da43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4b80bb-15cc-49d3-bc27-ad6a5f06884e", "name": "network-vif-deleted", "tag": "73b4e919-25ce-4ea5-8eb1-05a49bc73fd1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:42.488720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e198c173-8982-4a2a-b043-cba389063b03 req-46ebb62a-a96c-4dad-9573-dfb5d2e9da43 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.490004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e198c173-8982-4a2a-b043-cba389063b03 req-46ebb62a-a96c-4dad-9573-dfb5d2e9da43 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.490716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e198c173-8982-4a2a-b043-cba389063b03 req-46ebb62a-a96c-4dad-9573-dfb5d2e9da43 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.520046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e198c173-8982-4a2a-b043-cba389063b03 req-46ebb62a-a96c-4dad-9573-dfb5d2e9da43 service nova] Creating event network-vif-deleted:73b4e919-25ce-4ea5-8eb1-05a49bc73fd1 for instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e on n-h1-820368-37 Sep 01 04:51:42.526796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e198c173-8982-4a2a-b043-cba389063b03 req-46ebb62a-a96c-4dad-9573-dfb5d2e9da43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088056 Sep 01 04:51:42.528289 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 675/1290] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:42.548076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:42.583730 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ad6e896-9b32-45f8-8889-12cd17b8fc48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.893163 Sep 01 04:51:42.605610 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 616/1291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:41 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:42.696708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:42.697554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:42.699639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:42.724377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.724904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.727514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.732115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.732613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.733119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.791004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:42.792498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:42.840767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.845037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.845751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:42.853954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:42.854694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:42.855190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:43.750169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:43.758636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4baa781f-9ac8-426c-be64-f299346817fe tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.971847 Sep 01 04:51:43.775225 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 617/1292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:42 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:43.781544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:43.782535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:43.791619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:43.792773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:43.793455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:43.794418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:43.795149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:43.795950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:43.812357 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] HTTP exception thrown: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Request method failure captured: Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e HTTP/1.1 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDm0DVvb4u8CUg1gIJpJLSMs_Zx4VU6SHBS5YOu8Sbqv2ifkRs6PqaP_RvHftqOj-AwffjiLkrvWvflXbx8adXWi24Jh384h7Q4FGp7vW31G6rx2uD7Y2C8LMPAevdjExfn9nG82ieoFcYuZx9WOm3LgkITNd7-TC_v9fC_9Eb7rj7Q Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c55b43bf6a8240428ac269fbe2d10db3 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c55b43bf6a8240428ac269fbe2d10db3 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachSCSIVolumeTestJSON-1818894042-project Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5f10e75ab3564762b0fcc3f712f62cd7 Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1818894042-project Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'df4b80bb-15cc-49d3-bc27-ad6a5f06884e'} Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:43.814443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:51:43.818595 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:51:43.821105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Returning 404 to user: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:43.822185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2997ac86-1b82-4c8b-a4b9-0b8fb78256af tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 404 len: 111 microversion: 2.1 time: 0.045508 Sep 01 04:51:43.823620 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 618/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:43 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:43.834460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f14436c2-ad62-48f5-9729-7634f8d34341 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcbc1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:43.874409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:43.884133 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96e2a80c-6844-4e02-8b1f-9f3d803ed8e2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1293 microversion: 2.1 time: 1.193782 Sep 01 04:51:43.895773 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 676/1294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:42 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1293 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:43.937277 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f14436c2-ad62-48f5-9729-7634f8d34341 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1412 microversion: 2.1 time: 0.112163 Sep 01 04:51:43.943173 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 619/1295] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:43 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:43.948115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:43.951869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:43.987146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:43.987858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:43.988482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:43.990408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:43.993360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:43.994045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:44.246427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-767c46d9-f8dc-46df-baad-8df495a6fa73 tempest-TenantUsagesNegativeTestJSON-233402155 tempest-TenantUsagesNegativeTestJSON-233402155-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-31T04%3A51%3A43.590970&end=2022-09-02T04%3A51%3A43.590970" status: 404 len: 112 microversion: - time: 0.349249 Sep 01 04:51:44.247086 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 677/1296] 10.222.0.26 () {58 vars in 1316 bytes} [Thu Sep 1 04:51:43 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-31T04%3A51%3A43.590970&end=2022-09-02T04%3A51%3A43.590970 => generated 112 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 04:51:44.254307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b66bcb56-5e63-47af-bc93-28a569464b69 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '.version_select at 0x7fa75bd688b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:44.323145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:44.347283 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b66bcb56-5e63-47af-bc93-28a569464b69 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017395731" status: 202 len: 0 microversion: 2.1 time: 0.098840 Sep 01 04:51:44.348571 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 678/1297] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:51:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017395731 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:51:44.366003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-241ef57a-b605-4adb-8032-b7e87b341122 tempest-TenantUsagesNegativeTestJSON-233402155 tempest-TenantUsagesNegativeTestJSON-233402155-project-admin] Calling method '.version_select at 0x7fa75bd18ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:44.379496 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-241ef57a-b605-4adb-8032-b7e87b341122 tempest-TenantUsagesNegativeTestJSON-233402155 tempest-TenantUsagesNegativeTestJSON-233402155-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-241ef57a-b605-4adb-8032-b7e87b341122 tempest-TenantUsagesNegativeTestJSON-233402155 tempest-TenantUsagesNegativeTestJSON-233402155-project-admin] Request method failure captured: Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-simple-tenant-usage/d09a08a2f19c4751bf3df9dc38e4c410?start=2022-09-02T04%3A51%3A43.590970&end=2022-08-31T04%3A51%3A43.590970 HTTP/1.1 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDpfzPo5a6tXVR--F3icnYb_-IwbkPSXUnG7t7-ds7jUe1gWe0rsCIxXOwiEJb5XroioONdisKatYLNH6Hib8E2O9PMykHb1Gw1m8noJ374_pYdi23kkcuNSPqMTgBOspU6g2vAwhA1f5RopQqoA-C42HUZOAH_CiK9hMug8-o3AeW4 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e6865adf21f54bc1bf7a7fd6fa97f0d8 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-233402155 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e6865adf21f54bc1bf7a7fd6fa97f0d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e6865adf21f54bc1bf7a7fd6fa97f0d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e6865adf21f54bc1bf7a7fd6fa97f0d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e6865adf21f54bc1bf7a7fd6fa97f0d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-233402155 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e6865adf21f54bc1bf7a7fd6fa97f0d8 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-233402155 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TenantUsagesNegativeTestJSON-233402155-project-admin Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 783d88aa73b84ceea46a42b3b2e92079 Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-233402155-project-admin Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid start time. The start time cannot occur after the end time. Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'd09a08a2f19c4751bf3df9dc38e4c410'} Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 01 04:51:44.388081 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:44.396763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-241ef57a-b605-4adb-8032-b7e87b341122 tempest-TenantUsagesNegativeTestJSON-233402155 tempest-TenantUsagesNegativeTestJSON-233402155-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:44.397862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-241ef57a-b605-4adb-8032-b7e87b341122 tempest-TenantUsagesNegativeTestJSON-233402155 tempest-TenantUsagesNegativeTestJSON-233402155-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/d09a08a2f19c4751bf3df9dc38e4c410?start=2022-09-02T04%3A51%3A43.590970&end=2022-08-31T04%3A51%3A43.590970" status: 400 len: 111 microversion: 2.1 time: 0.042596 Sep 01 04:51:44.404421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 679/1298] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Sep 1 04:51:44 2022] GET /compute/v2.1/os-simple-tenant-usage/d09a08a2f19c4751bf3df9dc38e4c410?start=2022-09-02T04%3A51%3A43.590970&end=2022-08-31T04%3A51%3A43.590970 => generated 111 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:51:44.583981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0288cdd-7818-44cd-9ace-5c983e63d7b8 tempest-TenantUsagesNegativeTestJSON-1361563033 tempest-TenantUsagesNegativeTestJSON-1361563033-project] Calling method '.version_select at 0x7fa75bd7e160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:44.589212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0288cdd-7818-44cd-9ace-5c983e63d7b8 tempest-TenantUsagesNegativeTestJSON-1361563033 tempest-TenantUsagesNegativeTestJSON-1361563033-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd4aad95de39c4aedbf39f2b450103a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd09a08a2f19c4751bf3df9dc38e4c410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0288cdd-7818-44cd-9ace-5c983e63d7b8 tempest-TenantUsagesNegativeTestJSON-1361563033 tempest-TenantUsagesNegativeTestJSON-1361563033-project] Request method failure captured: Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-31T04%3A51%3A43.590970&end=2022-09-02T04%3A51%3A43.590970&detailed=1 HTTP/1.1 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDpen3tZzJOUy7D4YUXMvoGMKLOIXFvs_VmrXXoB8ctcJHMNaH2Na-UNL3DIRrsqCwrNM8AL7jUHOG3uyzNDNKm92lne_tKkf3Qp9GiVXOMWBXmnC6FWOFxpBJcyTBqFDsUx8d_z5B239WgZKIf53vCde7FhRe_f0-fTIeVr6EMI5Jg Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d09a08a2f19c4751bf3df9dc38e4c410 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1361563033 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d09a08a2f19c4751bf3df9dc38e4c410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d09a08a2f19c4751bf3df9dc38e4c410"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d09a08a2f19c4751bf3df9dc38e4c410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d09a08a2f19c4751bf3df9dc38e4c410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1361563033 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d09a08a2f19c4751bf3df9dc38e4c410 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1361563033 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TenantUsagesNegativeTestJSON-1361563033-project Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d4aad95de39c4aedbf39f2b450103a06 Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1361563033-project Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: action_args: {} Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:51:44.594195 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 01 04:51:44.598264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:51:44.603774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0288cdd-7818-44cd-9ace-5c983e63d7b8 tempest-TenantUsagesNegativeTestJSON-1361563033 tempest-TenantUsagesNegativeTestJSON-1361563033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:51:44.604774 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0288cdd-7818-44cd-9ace-5c983e63d7b8 tempest-TenantUsagesNegativeTestJSON-1361563033 tempest-TenantUsagesNegativeTestJSON-1361563033-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-31T04%3A51%3A43.590970&end=2022-09-02T04%3A51%3A43.590970&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.193305 Sep 01 04:51:44.605472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 680/1299] 10.222.0.26 () {58 vars in 1335 bytes} [Thu Sep 1 04:51:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-31T04%3A51%3A43.590970&end=2022-09-02T04%3A51%3A43.590970&detailed=1 => generated 123 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:51:44.695292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:44.721662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f208ee32-1e84-45e2-b31f-ac62e8b9ab7a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.777170 Sep 01 04:51:44.727259 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 620/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:43 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:44.787959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:44.789325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:44.804257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:44.814636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:44.822899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:44.823950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:44.828851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:44.831306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:44.912642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:44.913367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:44.928775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:44.938766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:44.942080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:44.944616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:44.945160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:44.951541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:45.697963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:45.724319 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbd416eb-3cec-4c4e-8830-285f757970d2 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.940879 Sep 01 04:51:45.729087 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 681/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:44 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:45.742313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e011fea7-446a-4a5d-9408-009acae31ed9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd44af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:46.146234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:46.177160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39c91988-49e7-4b3a-9070-149def185ce4 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1483 microversion: 2.1 time: 1.259274 Sep 01 04:51:46.203120 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 621/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:44 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1483 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:46.211998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9d381bbb-0f89-411a-8bd4-357927da6dd7 req-37966481-6b6e-4b75-b2d3-f7c5abf080c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-plugged", "status": "completed", "tag": "68c49780-c70d-4f84-b9c7-39ed3b38d649"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:46.225759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9d381bbb-0f89-411a-8bd4-357927da6dd7 req-37966481-6b6e-4b75-b2d3-f7c5abf080c0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:46.226707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9d381bbb-0f89-411a-8bd4-357927da6dd7 req-37966481-6b6e-4b75-b2d3-f7c5abf080c0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:46.227364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9d381bbb-0f89-411a-8bd4-357927da6dd7 req-37966481-6b6e-4b75-b2d3-f7c5abf080c0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:46.241502 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9d381bbb-0f89-411a-8bd4-357927da6dd7 req-37966481-6b6e-4b75-b2d3-f7c5abf080c0 service nova] Creating event network-vif-plugged:68c49780-c70d-4f84-b9c7-39ed3b38d649 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:51:46.248153 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9d381bbb-0f89-411a-8bd4-357927da6dd7 req-37966481-6b6e-4b75-b2d3-f7c5abf080c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042316 Sep 01 04:51:46.249507 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 622/1303] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:46.255237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:46.256344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:46.263917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:46.264778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:46.265465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:46.266401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:46.267101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:46.267814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:46.723174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:46.732847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67355d3d-f959-4da0-8f7e-6c63785a3f41 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.481824 Sep 01 04:51:46.735716 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 623/1304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:46 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:46.751953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:46.753600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:46.773564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:46.785471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:46.787463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:46.788943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:46.790579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:46.792194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:47.116958 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2637852c-a4d6-4302-ad11-e891f53fa4fc tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.379305 Sep 01 04:51:47.117903 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 624/1305] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:51:46 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f/os-interface => generated 284 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:47.125544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-05622cc6-1762-4268-82b7-89a0873faa63 req-61f0559d-2b44-4141-a1c2-1b7d58724e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b21455b-3a86-47bf-a77f-098f46a1e18e", "tag": "505d6c37-58cb-45c9-a9d6-0f8252a15906"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:47.166603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-05622cc6-1762-4268-82b7-89a0873faa63 req-61f0559d-2b44-4141-a1c2-1b7d58724e6f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:47.168792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-05622cc6-1762-4268-82b7-89a0873faa63 req-61f0559d-2b44-4141-a1c2-1b7d58724e6f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:47.169583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-05622cc6-1762-4268-82b7-89a0873faa63 req-61f0559d-2b44-4141-a1c2-1b7d58724e6f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:47.217285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-05622cc6-1762-4268-82b7-89a0873faa63 req-61f0559d-2b44-4141-a1c2-1b7d58724e6f service nova] Creating event network-changed:505d6c37-58cb-45c9-a9d6-0f8252a15906 for instance 0b21455b-3a86-47bf-a77f-098f46a1e18e on n-h2-820368-37 Sep 01 04:51:47.227860 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-05622cc6-1762-4268-82b7-89a0873faa63 req-61f0559d-2b44-4141-a1c2-1b7d58724e6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108427 Sep 01 04:51:47.229901 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 625/1306] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:47.250945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:47.254579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:47.269809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:47.270608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:47.271444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:47.273110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:47.273781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:47.274404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:48.048624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:48.060506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b87d7a8-74d7-44b5-bfa0-bc4cc20b2adf tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.827613 Sep 01 04:51:48.067606 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 626/1307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:47 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:48.080248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:48.080873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:48.093348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:48.093849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:48.094284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:48.098730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:48.100508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:48.101219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:49.364762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:49.380409 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fef7bee2-594f-4bf5-8e02-1d1e79daef90 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 1.309022 Sep 01 04:51:49.382917 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 627/1308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:48 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:49.393084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-plugged", "status": "completed", "tag": "ba3008f4-6a4d-4cbb-a293-83d1234b6f51"}, {"server_uuid": "259cb86c-0712-4582-847a-96d54ed7c4f0", "name": "network-vif-plugged", "status": "completed", "tag": "f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:49.426191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:49.426685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:49.429611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:49.466868 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] Creating event network-vif-plugged:ba3008f4-6a4d-4cbb-a293-83d1234b6f51 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:51:49.473056 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] Creating event network-vif-plugged:f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c for instance 259cb86c-0712-4582-847a-96d54ed7c4f0 on n-h2-820368-37 Sep 01 04:51:49.487407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c4790f70-962a-4395-a6a0-9cb3bbd96686 req-8dfc4e68-28c4-4cb5-bb95-2f86b451731e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099784 Sep 01 04:51:49.488586 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 628/1309] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:49.501463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:49.502678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:49.531264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:49.533188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:49.536552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:49.540271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:49.541043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:49.542811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:49.890202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:49.902847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-221c3bf4-590f-49bf-8e3c-c1d16e86ea0b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.408264 Sep 01 04:51:49.908751 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 629/1310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:49 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:50.284292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:50.285746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:50.299211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:50.300658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:50.301607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:50.302548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:50.303477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:50.304458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:50.641110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:50.652355 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3e83e68-de2b-481d-9cd0-e8ec8ddf7c41 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1483 microversion: 2.1 time: 0.376040 Sep 01 04:51:50.653528 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 630/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:50 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1483 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:50.674331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2fc2b45a-b054-4c7e-be71-4304511bfc5c req-402cbf23-4dbe-4ab1-ba43-44772c118389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fd3cd6-8be4-4ed5-862e-6b613c179a4f", "tag": "fa8e93cc-a812-4ca2-9049-00fc0beaff56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:50.692985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2fc2b45a-b054-4c7e-be71-4304511bfc5c req-402cbf23-4dbe-4ab1-ba43-44772c118389 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:50.693738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2fc2b45a-b054-4c7e-be71-4304511bfc5c req-402cbf23-4dbe-4ab1-ba43-44772c118389 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:50.694577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2fc2b45a-b054-4c7e-be71-4304511bfc5c req-402cbf23-4dbe-4ab1-ba43-44772c118389 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:50.708945 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2fc2b45a-b054-4c7e-be71-4304511bfc5c req-402cbf23-4dbe-4ab1-ba43-44772c118389 service nova] Creating event network-changed:fa8e93cc-a812-4ca2-9049-00fc0beaff56 for instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f on n-h1-820368-37 Sep 01 04:51:50.715506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2fc2b45a-b054-4c7e-be71-4304511bfc5c req-402cbf23-4dbe-4ab1-ba43-44772c118389 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060565 Sep 01 04:51:50.720838 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 631/1312] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:50.728530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:50.730522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:50.739099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:50.739820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:50.740404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:50.741316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:50.741943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:50.742511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:51.098215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:51.113232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e34fc5a-80d7-490e-8ad9-c9e60fefe8f0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.390847 Sep 01 04:51:51.114200 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 632/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:50 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:51.704779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9444c002-3bd5-40b7-b5dd-0fdffafbeb80 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:51.726209 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9444c002-3bd5-40b7-b5dd-0fdffafbeb80 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.610589 Sep 01 04:51:51.727614 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 633/1314] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:51.748907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:51.751374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:51.758720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:51.759521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:51.760125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:51.763287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:51.764197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:51.764848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:52.439325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:52.449778 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1329ff57-63d5-48cf-acc3-5a8cbef05131 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.720701 Sep 01 04:51:52.451055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 634/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:51 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:52.456706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b44378ea-d6e6-48e1-b091-3861e40eb1f6 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:52.522140 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b44378ea-d6e6-48e1-b091-3861e40eb1f6 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.065406 Sep 01 04:51:52.522762 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 635/1316] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:51:52 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:52.535436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:52.536367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:52.553474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:52.554273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:52.554990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:52.556174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:52.556954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:52.557121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:52.882458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:52.890703 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b06c1282-22ea-47ca-9b02-aef2706cce57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.366542 Sep 01 04:51:52.891327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 636/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:52 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:52.899452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60a57a24-d7f3-4033-9519-f07a1e62f67a tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:52.907895 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60a57a24-d7f3-4033-9519-f07a1e62f67a tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015535 Sep 01 04:51:52.908616 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 637/1318] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.060514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75bc99c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.062345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.063069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.063727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.084202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.085076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.085776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.099460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.100446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.101094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.111249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecac6098-eb1b-4cdb-98a8-d95b7703291c tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.201342 Sep 01 04:51:53.112325 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 638/1319] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.117457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abafbfdb-5afc-4a3c-a24a-a209fa3af051 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.129140 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abafbfdb-5afc-4a3c-a24a-a209fa3af051 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015647 Sep 01 04:51:53.130087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 639/1320] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.135437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75bdf7c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.138009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.138741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.139955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.158065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.158545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.159078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.179277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.180684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.182073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.185684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:53.190796 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69a64d8e-0e63-4c9a-ae97-b9f9376ad3ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.059298 Sep 01 04:51:53.191853 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 640/1321] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:53.197723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4355b284-a46a-43f0-9cef-380888d17d4d tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.225830 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4355b284-a46a-43f0-9cef-380888d17d4d tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032663 Sep 01 04:51:53.240435 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 641/1322] 10.222.0.26 () {58 vars in 1165 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:53.251689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75be59430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.254733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.260040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.260885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.275745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.276570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.277233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.289473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.290200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.290788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.298238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9f6ebff-27fe-490c-99d1-eeff4e79c776 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.054109 Sep 01 04:51:53.299437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 642/1323] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.304543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f0cc09f-e775-4428-ba9e-d437b3c13774 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.313576 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f0cc09f-e775-4428-ba9e-d437b3c13774 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012758 Sep 01 04:51:53.314562 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 643/1324] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.325968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75be1ad30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.327848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.328332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.328760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.351045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.352006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.352452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.360894 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cd726b5-1916-45bc-a2d7-8adedf131f6f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.038671 Sep 01 04:51:53.361905 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 644/1325] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.366417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c7567e9-12cb-4383-b631-4df99668a97d tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.399633 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c7567e9-12cb-4383-b631-4df99668a97d tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.036605 Sep 01 04:51:53.400204 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 645/1326] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:53.410230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e9cd538-ff23-41d9-96fb-f0dea6a5673f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75bd66550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.414606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9cd538-ff23-41d9-96fb-f0dea6a5673f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.415122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9cd538-ff23-41d9-96fb-f0dea6a5673f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.416987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9cd538-ff23-41d9-96fb-f0dea6a5673f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.445334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e9cd538-ff23-41d9-96fb-f0dea6a5673f tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 264 microversion: 2.1 time: 0.041290 Sep 01 04:51:53.446403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 646/1327] 10.222.0.26 () {58 vars in 1179 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 264 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.451126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03b495cd-dc53-4f32-922a-3993c55f69d8 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.464989 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03b495cd-dc53-4f32-922a-3993c55f69d8 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017321 Sep 01 04:51:53.466039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 647/1328] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.470531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75be59280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.472711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.473238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.473779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.492500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:53.496477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.496477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.496477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.508954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.509399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.509901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.517252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-601a6bd6-2ec6-4e92-b6c7-28f85e2f715b tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.050038 Sep 01 04:51:53.518036 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 648/1329] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.527534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.528091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:53.537122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.537715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.538242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.539028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.540039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.540538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.843870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:53.853133 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d317b86-70a5-4792-a541-923d26c92588 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1355 microversion: 2.1 time: 0.333983 Sep 01 04:51:53.854862 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 649/1330] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1355 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:53.873735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d727dd62-1991-437b-81b7-e301ce54b093 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.890359 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d727dd62-1991-437b-81b7-e301ce54b093 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021246 Sep 01 04:51:53.895386 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 650/1331] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.901082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75bcbb820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:53.904789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.904789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.904789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.924846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:53.925478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:53.925915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:53.933840 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbaded94-5bd9-4c8d-9dab-cdd6fbcbe493 tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.037226 Sep 01 04:51:53.934752 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 651/1332] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:53.943800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-242a1b2e-3291-4a98-a12b-1e10e41acf34 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.009742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-242a1b2e-3291-4a98-a12b-1e10e41acf34 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.073091 Sep 01 04:51:54.010643 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 652/1333] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 1 04:51:53 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:54.015415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.016025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:54.023328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.023328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.023590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.024154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.024608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.025025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.216616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:54.226824 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35d9ad1b-467d-4ebf-adc9-40ab2abccc83 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.214997 Sep 01 04:51:54.228292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 653/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:54.237363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75bcaab80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.241050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.242107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.243743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.266908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.267812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.268438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.291720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51fbfca4-e5ca-4fe5-ab80-5579739c86ec tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.061367 Sep 01 04:51:54.293177 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 654/1335] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:54.300395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff3cdf4d-622a-4b86-a106-65df8899bcb4 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.312874 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff3cdf4d-622a-4b86-a106-65df8899bcb4 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016807 Sep 01 04:51:54.314427 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 655/1336] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:54.321262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Calling method '.version_select at 0x7fa75bdf7c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.327057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.328713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.329362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.358456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.358860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.359352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.374982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.375443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.376174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.392697 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e51d5932-f08d-4705-8203-041b06a93b0a tempest-HypervisorAdminTestJSON-655649678 tempest-HypervisorAdminTestJSON-655649678-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.076781 Sep 01 04:51:54.393315 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 656/1337] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:54.399853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d179a2c-b16e-4bc2-a19c-97b21fdd5e80 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.421959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d179a2c-b16e-4bc2-a19c-97b21fdd5e80 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.027407 Sep 01 04:51:54.423000 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 657/1338] 10.222.0.26 () {58 vars in 1144 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:54.438068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc868bf4-acdf-4de6-ad23-21f58239c7d3 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.453742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc868bf4-acdf-4de6-ad23-21f58239c7d3 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020191 Sep 01 04:51:54.454348 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 658/1339] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:51:54.467490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-322ceec5-617e-4a27-adfc-5dc03788c76c tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.486952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-322ceec5-617e-4a27-adfc-5dc03788c76c tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.024544 Sep 01 04:51:54.487930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 659/1340] 10.222.0.26 () {58 vars in 1148 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:54.501687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-786a5636-0080-4e18-8aee-04a771cf606a tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.515805 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-786a5636-0080-4e18-8aee-04a771cf606a tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018278 Sep 01 04:51:54.516797 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 660/1341] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:54.532605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82217888-4396-4581-8e21-4a328ff80884 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.542873 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82217888-4396-4581-8e21-4a328ff80884 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018232 Sep 01 04:51:54.543827 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 661/1342] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:54.559783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a15c08e5-5bfb-4cf6-9eb6-3d93a3c5ccda tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.585817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a15c08e5-5bfb-4cf6-9eb6-3d93a3c5ccda tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.032102 Sep 01 04:51:54.586961 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 662/1343] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:54.604411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90fa4bd9-0160-4e75-a004-07a74198255e tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.632975 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90fa4bd9-0160-4e75-a004-07a74198255e tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035465 Sep 01 04:51:54.633566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 663/1344] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:54.652253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a195f55-07f9-42f2-bfb0-375509986581 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.663752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a195f55-07f9-42f2-bfb0-375509986581 tempest-FlavorsV2TestJSON-781772862 tempest-FlavorsV2TestJSON-781772862-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016541 Sep 01 04:51:54.664756 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 664/1345] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:54.794154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:54.889397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:54.891527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:54.913224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.913754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.914185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:54.914918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:54.915370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:54.915788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.214802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:55.226649 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2303b0ef-06b1-4ada-8458-119765e734f4 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1803 microversion: 2.1 time: 0.352263 Sep 01 04:51:55.227811 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 665/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:54 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1803 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:55.250501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:55.251488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:55.266059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:55.268831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:55.269493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.271687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:55.272481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:55.273116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.331941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01a49c7e-e5c4-43da-a0dd-2b50396aa1c0 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e/ips" status: 200 len: 216 microversion: 2.1 time: 0.087993 Sep 01 04:51:55.343838 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 666/1347] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 04:51:55 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e/ips => generated 216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:51:55.360823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:55.360823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:55.375307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:55.376335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:55.376778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.377488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:55.377940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:55.378777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.723933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:55.815854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:55.835212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa1bbd63-2475-445e-819d-26e7324c56ee tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.490464 Sep 01 04:51:55.852451 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 667/1348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:55 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:55.864904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:55.865542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:55.881549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:55.883378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:55.884467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.885880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:55.886353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:55.886783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:55.918988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:51:56.187437 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3456362d-9a44-483c-9a21-438fb328c8a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 204 len: 0 microversion: 2.1 time: 0.331197 Sep 01 04:51:56.189634 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 668/1349] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:51:55 2022] DELETE /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:51:56.577293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c83da1a2-7c69-42ce-9010-cf817abf5f5e req-803e9e69-4a7b-4d11-b2b3-4a6e4f40423f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b21455b-3a86-47bf-a77f-098f46a1e18e", "name": "network-vif-plugged", "status": "completed", "tag": "505d6c37-58cb-45c9-a9d6-0f8252a15906"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:51:56.596976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c83da1a2-7c69-42ce-9010-cf817abf5f5e req-803e9e69-4a7b-4d11-b2b3-4a6e4f40423f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:56.596976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c83da1a2-7c69-42ce-9010-cf817abf5f5e req-803e9e69-4a7b-4d11-b2b3-4a6e4f40423f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:56.596976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c83da1a2-7c69-42ce-9010-cf817abf5f5e req-803e9e69-4a7b-4d11-b2b3-4a6e4f40423f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:56.611768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c83da1a2-7c69-42ce-9010-cf817abf5f5e req-803e9e69-4a7b-4d11-b2b3-4a6e4f40423f service nova] Creating event network-vif-plugged:505d6c37-58cb-45c9-a9d6-0f8252a15906 for instance 0b21455b-3a86-47bf-a77f-098f46a1e18e on n-h2-820368-37 Sep 01 04:51:56.618031 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c83da1a2-7c69-42ce-9010-cf817abf5f5e req-803e9e69-4a7b-4d11-b2b3-4a6e4f40423f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425674 Sep 01 04:51:56.619354 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 669/1350] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:51:56.627333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:56.628229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:56.636880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:56.637702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:56.638347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:56.639671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:56.640384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:56.641013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:56.854254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:56.869889 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce2c00d1-b0fe-4d12-b9b5-fe158b039097 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1809 microversion: 2.1 time: 0.249017 Sep 01 04:51:56.870397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 670/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:56 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:56.880304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:56.887031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:56.896509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:56.897147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:56.897620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:56.898656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:56.899206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:56.899843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:57.079147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:57.088400 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6de6ba9d-9e57-4579-92a7-a1f4ccc91ae6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.216809 Sep 01 04:51:57.089565 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 671/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:56 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:57.896082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:57.897054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:57.908644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:57.910339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:57.911032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:57.913178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:57.914708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:57.917061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:58.434350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:58.445150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58ecf1e4-55c1-43ae-95e8-a3d42b6b52c9 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1809 microversion: 2.1 time: 0.555211 Sep 01 04:51:58.460280 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 672/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:57 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1809 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:51:58.465881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:58.466981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:58.475552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:58.476433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:58.477100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:58.478144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:58.478848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:58.479600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:58.509206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:51:59.007131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:51:59.023359 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cf3155c-ad63-4c5e-a6a2-16f8935d8b98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1360 microversion: 2.1 time: 0.561381 Sep 01 04:51:59.038864 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 673/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:58 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1360 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:51:59.468806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:51:59.469549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:51:59.489637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:59.495532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:59.496211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:51:59.498188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:51:59.502495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:51:59.503693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:00.575817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:00.603607 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b9c245f-f55f-4662-a789-9ad4f29ad327 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1788 microversion: 2.1 time: 1.130786 Sep 01 04:52:00.604350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 674/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:51:59 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1788 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:00.627520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2dd6f746-9015-4656-abb2-ad0adc52afef req-0ffd0963-146a-49b9-bfca-326391c1dc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-deleted", "tag": "63a3bd85-011c-4efd-b904-9d723910cdd2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:00.662468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2dd6f746-9015-4656-abb2-ad0adc52afef req-0ffd0963-146a-49b9-bfca-326391c1dc2f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:00.665392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2dd6f746-9015-4656-abb2-ad0adc52afef req-0ffd0963-146a-49b9-bfca-326391c1dc2f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:00.665990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2dd6f746-9015-4656-abb2-ad0adc52afef req-0ffd0963-146a-49b9-bfca-326391c1dc2f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:00.722924 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2dd6f746-9015-4656-abb2-ad0adc52afef req-0ffd0963-146a-49b9-bfca-326391c1dc2f service nova] Creating event network-vif-deleted:63a3bd85-011c-4efd-b904-9d723910cdd2 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:52:00.745931 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2dd6f746-9015-4656-abb2-ad0adc52afef req-0ffd0963-146a-49b9-bfca-326391c1dc2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135769 Sep 01 04:52:00.748968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 675/1356] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:00.766429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:00.771400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:00.789067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:00.791531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:00.798178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:00.799222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:00.799988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:00.800592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:01.546801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:01.557138 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75133041-8b47-41ae-9143-eb8ec5afff92 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1543 microversion: 2.1 time: 0.805417 Sep 01 04:52:01.574915 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 676/1357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:00 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1543 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:02.053520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Calling method '.version_select at 0x7fa75bbf0280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:02.060110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.061338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.062996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.094820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.095791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.096502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.133380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.138279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.141900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.169989 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-303ea678-4085-4365-86cf-db524bcd6643 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.591624 Sep 01 04:52:02.172886 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 677/1358] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 04:52:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:52:02.196646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:02.198373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:02.243665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.245145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.245635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.246397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.246856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.247752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.579774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d18f3a8-dc1c-46f6-9da4-d718f56ecd57 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.384968 Sep 01 04:52:02.579774 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 678/1359] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:52:02 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-interface => generated 284 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:02.579774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:02.579774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:02.611781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.613270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.613838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.617598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.618176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.618603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.718080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:02.718607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:02.719840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:02.722086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lazy-loading 'fault' on Instance uuid fed11711-4ce9-4844-809b-1b7744c93b6e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:52:02.951255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:02.979736 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02ab1025-f4fa-46cf-8583-b333a5d0cf6b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 200 len: 1303 microversion: 2.1 time: 0.415074 Sep 01 04:52:02.982856 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 679/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:02 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 1303 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:02.990551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fe26fec1-18ca-4937-882d-4c29e2ec5344 req-054eea63-efec-4e6e-8f91-eefbf4be1a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-unplugged", "status": "completed", "tag": "ba3008f4-6a4d-4cbb-a293-83d1234b6f51"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:03.005753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fe26fec1-18ca-4937-882d-4c29e2ec5344 req-054eea63-efec-4e6e-8f91-eefbf4be1a1b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:03.006823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fe26fec1-18ca-4937-882d-4c29e2ec5344 req-054eea63-efec-4e6e-8f91-eefbf4be1a1b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:03.007487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fe26fec1-18ca-4937-882d-4c29e2ec5344 req-054eea63-efec-4e6e-8f91-eefbf4be1a1b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:03.022051 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fe26fec1-18ca-4937-882d-4c29e2ec5344 req-054eea63-efec-4e6e-8f91-eefbf4be1a1b service nova] Creating event network-vif-unplugged:ba3008f4-6a4d-4cbb-a293-83d1234b6f51 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:52:03.028532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fe26fec1-18ca-4937-882d-4c29e2ec5344 req-054eea63-efec-4e6e-8f91-eefbf4be1a1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043349 Sep 01 04:52:03.029595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 680/1361] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:03.037909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Calling method '.version_select at 0x7fa75bbf0820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:03.043091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:03.043827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:03.044270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:03.060839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:03.062340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:03.062340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:03.072829 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35334b61-984f-4f58-8fc1-2dab53222fa9 tempest-HypervisorAdminV228Test-1322592092 tempest-HypervisorAdminV228Test-1322592092-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.041111 Sep 01 04:52:03.086123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 681/1362] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 04:52:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:52:03.297967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-deleted", "tag": "68c49780-c70d-4f84-b9c7-39ed3b38d649"}, {"server_uuid": "fed11711-4ce9-4844-809b-1b7744c93b6e", "name": "network-vif-deleted", "tag": "ba3008f4-6a4d-4cbb-a293-83d1234b6f51"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:03.339034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:03.339515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:03.339995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:03.366395 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] Creating event network-vif-deleted:68c49780-c70d-4f84-b9c7-39ed3b38d649 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:52:03.368663 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] Creating event network-vif-deleted:ba3008f4-6a4d-4cbb-a293-83d1234b6f51 for instance fed11711-4ce9-4844-809b-1b7744c93b6e on n-h2-820368-37 Sep 01 04:52:03.386803 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1e7a0c38-6e25-44bf-9ca7-d48765699a61 req-e47d2237-8f0e-4552-8181-9c13df182093 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096089 Sep 01 04:52:03.388144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 682/1363] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:04.006490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:04.007734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:04.028319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:04.031904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:04.034097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:04.035441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:04.038009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:04.041064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:04.101410 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] HTTP exception thrown: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Request method failure captured: Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e HTTP/1.1 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDozn53jmtn_HGSry5zjXjHTKXsImN_j9WyyPygTXyX6lGl3nRjr_7KYnDFX3ck-2LoOhUpYWb4qoH0VYA2flE2blsjAKqMijX1E6eIEFbtdV0XzSnujyOEGZr2MrXfNRW2JNK_3H4Vu2SqcdtARiwUygemTPglMkm4qV0BlMS8aBB0 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9b08a156c194615b51ba116446334d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9b08a156c194615b51ba116446334d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestMultiNic-1067702955 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 1c0c2fb280fa41c4a65417e35b2e53c1 Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'fed11711-4ce9-4844-809b-1b7744c93b6e'} Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:04.105697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:04.111514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Returning 404 to user: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:04.112194 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e3f6c64-8e74-4ace-b6d4-ff6a4e7bf480 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 404 len: 111 microversion: 2.1 time: 0.108934 Sep 01 04:52:04.113941 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 683/1364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:03 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:05.264128 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e011fea7-446a-4a5d-9408-009acae31ed9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1421 microversion: 2.1 time: 19.533601 Sep 01 04:52:05.278526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60bb997a-3209-4553-a9f1-a4c0e8c9a291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcaa940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:05.283240 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 682/1365] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:51:45 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1421 bytes in 19543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:05.376545 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60bb997a-3209-4553-a9f1-a4c0e8c9a291 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 200 len: 1421 microversion: 2.1 time: 0.102081 Sep 01 04:52:05.377394 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 684/1366] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:05 2022] GET /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:05.392254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f38c0fee-fc98-4689-b27a-fff766962dc5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75be91790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:05.881874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-660bffb8-bde6-4ca2-97b2-de4f2a6f2ebc req-d290ef13-43ef-439a-9a6f-1553b51f64cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b21455b-3a86-47bf-a77f-098f46a1e18e", "tag": "505d6c37-58cb-45c9-a9d6-0f8252a15906"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:05.902393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-660bffb8-bde6-4ca2-97b2-de4f2a6f2ebc req-d290ef13-43ef-439a-9a6f-1553b51f64cf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:05.905753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-660bffb8-bde6-4ca2-97b2-de4f2a6f2ebc req-d290ef13-43ef-439a-9a6f-1553b51f64cf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:05.907423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-660bffb8-bde6-4ca2-97b2-de4f2a6f2ebc req-d290ef13-43ef-439a-9a6f-1553b51f64cf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:05.941102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-660bffb8-bde6-4ca2-97b2-de4f2a6f2ebc req-d290ef13-43ef-439a-9a6f-1553b51f64cf service nova] Creating event network-changed:505d6c37-58cb-45c9-a9d6-0f8252a15906 for instance 0b21455b-3a86-47bf-a77f-098f46a1e18e on n-h2-820368-37 Sep 01 04:52:05.956608 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-660bffb8-bde6-4ca2-97b2-de4f2a6f2ebc req-d290ef13-43ef-439a-9a6f-1553b51f64cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077183 Sep 01 04:52:05.961209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 685/1367] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:52:06.189774 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f38c0fee-fc98-4689-b27a-fff766962dc5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 204 len: 0 microversion: 2.1 time: 0.802159 Sep 01 04:52:06.190961 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 683/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:05 2022] DELETE /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:52:06.201731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:06.203072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:06.212931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:06.215475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:06.216146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:06.218795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:06.219463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:06.235978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:06.316615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:52:06.496901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a80bae4d-0a14-4623-a3c2-139ca82365f6 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 204 len: 0 microversion: 2.1 time: 0.300098 Sep 01 04:52:06.499590 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 686/1369] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:52:06 2022] DELETE /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:52:06.718296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1425361578", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d85331bd-fb06-4841-92d7-0758031f2664"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:06.824127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] validate_networks() for [('d85331bd-fb06-4841-92d7-0758031f2664', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:52:08.936632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:52:08.937229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:52:08.937915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:52:08.938328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:52:08.938740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:52:08.969225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:08.969763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:08.970210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:08.971058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:08.971513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:08.971930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:09.071353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:52:09.094524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for user fcfdd4deb06b413d9585d204bd614e06 and project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:52:09.136109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:52:09.144044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:52:09.235707 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5f1d5ec-acf8-4bd9-8e4f-2871cf6aada8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525365 Sep 01 04:52:09.242772 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 684/1370] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:52:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:52:09.249200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a10fb0e-b742-47ee-a53a-308cb1ad05f4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:09.250128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a10fb0e-b742-47ee-a53a-308cb1ad05f4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:09.322647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:09.645212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a10fb0e-b742-47ee-a53a-308cb1ad05f4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:09.682370 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a10fb0e-b742-47ee-a53a-308cb1ad05f4 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1208 microversion: 2.1 time: 0.437885 Sep 01 04:52:09.700614 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 687/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:09 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1208 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:10.599368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c94483e-d929-4fd6-852c-f695762f6508 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Action: 'create', calling method: .version_select at 0x7fa75bd993a0>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:10.711751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:10.712441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:10.762504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:10.763242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:10.763695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:10.764693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:10.765150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:10.765582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:11.403127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:11.420735 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fd93d8a-cca3-4c61-8861-f4150f72147b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1260 microversion: 2.1 time: 0.707349 Sep 01 04:52:11.423875 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 688/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:10 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1260 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:11.443895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6868591a-4f72-4df6-b037-fe0f73b94783 req-6b6f98a7-c06c-4efe-bbfb-66d8e9573619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259cb86c-0712-4582-847a-96d54ed7c4f0", "name": "network-vif-unplugged", "status": "completed", "tag": "f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:11.472881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6868591a-4f72-4df6-b037-fe0f73b94783 req-6b6f98a7-c06c-4efe-bbfb-66d8e9573619 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:11.474752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6868591a-4f72-4df6-b037-fe0f73b94783 req-6b6f98a7-c06c-4efe-bbfb-66d8e9573619 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:11.477208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6868591a-4f72-4df6-b037-fe0f73b94783 req-6b6f98a7-c06c-4efe-bbfb-66d8e9573619 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:11.507879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6868591a-4f72-4df6-b037-fe0f73b94783 req-6b6f98a7-c06c-4efe-bbfb-66d8e9573619 service nova] Creating event network-vif-unplugged:f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c for instance 259cb86c-0712-4582-847a-96d54ed7c4f0 on n-h2-820368-37 Sep 01 04:52:11.526957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6868591a-4f72-4df6-b037-fe0f73b94783 req-6b6f98a7-c06c-4efe-bbfb-66d8e9573619 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098461 Sep 01 04:52:11.530927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 689/1373] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:12.448144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:12.450848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:12.489828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:12.491038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:12.494872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:12.496511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:12.497668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:12.499347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:12.730135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:12.743678 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35b39113-8138-42fb-87df-fc3fc60d4a8f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1266 microversion: 2.1 time: 0.301220 Sep 01 04:52:12.757303 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 690/1374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:12 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:13.765829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:13.767470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:13.781942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:13.784334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:13.785250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:13.791002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:13.791674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:13.792574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:13.972593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:13.986335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35ca45f7-468e-4160-a95b-293b0d35d5f9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1266 microversion: 2.1 time: 0.224723 Sep 01 04:52:14.015599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 691/1375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:13 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:14.361659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6860752-02f7-4511-b856-3e916ed7dd9c tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Calling method '.version_select at 0x7fa75bb50940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.363635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6860752-02f7-4511-b856-3e916ed7dd9c tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'af7cc34190604eb3b7839991fec7a680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99a853179a40b6a94339b67ba27160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6860752-02f7-4511-b856-3e916ed7dd9c tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Request method failure captured: Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp8UYaMYCOClSxZ6K_Cmfo6u__wEM523YK43G3ERJYSM-8OZinqiCwiYChn0BK-VXhRTxhruILoebogQl6AbO-GyW74soMRg5asaOd__XwJEHhR28FlwvV4jEzkduX5vGo9BQXRYOKf2XAPDzpQRHLoL20KSqcDrkBFcIdN18WQznY Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be99a853179a40b6a94339b67ba27160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be99a853179a40b6a94339b67ba27160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: af7cc34190604eb3b7839991fec7a680 Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 01 04:52:14.365839 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 01 04:52:14.371581 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.373494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6860752-02f7-4511-b856-3e916ed7dd9c tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.374662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6860752-02f7-4511-b856-3e916ed7dd9c tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.374330 Sep 01 04:52:14.387899 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 692/1376] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 1 04:52:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 388 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:14.393463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0a3ef084-b46c-463a-a4ee-e6fa314a71ef req-a1899a90-af57-4287-81f6-09711c06d2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259cb86c-0712-4582-847a-96d54ed7c4f0", "name": "network-vif-deleted", "tag": "f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:14.428266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a3ef084-b46c-463a-a4ee-e6fa314a71ef req-a1899a90-af57-4287-81f6-09711c06d2cb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.429060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a3ef084-b46c-463a-a4ee-e6fa314a71ef req-a1899a90-af57-4287-81f6-09711c06d2cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.429662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a3ef084-b46c-463a-a4ee-e6fa314a71ef req-a1899a90-af57-4287-81f6-09711c06d2cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.448358 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0a3ef084-b46c-463a-a4ee-e6fa314a71ef req-a1899a90-af57-4287-81f6-09711c06d2cb service nova] Creating event network-vif-deleted:f8cbbdc9-4312-45f1-a0b0-6a80a73ec85c for instance 259cb86c-0712-4582-847a-96d54ed7c4f0 on n-h2-820368-37 Sep 01 04:52:14.455965 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0a3ef084-b46c-463a-a4ee-e6fa314a71ef req-a1899a90-af57-4287-81f6-09711c06d2cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066263 Sep 01 04:52:14.457094 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 693/1377] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:14.462551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.463398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:14.470440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.471156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.471748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.473652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.473652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.473652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.488261 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] HTTP exception thrown: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Request method failure captured: Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e HTTP/1.1 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDm0DVvb4u8CUg1gIJpJLSMs_Zx4VU6SHBS5YOu8Sbqv2ifkRs6PqaP_RvHftqOj-AwffjiLkrvWvflXbx8adXWi24Jh384h7Q4FGp7vW31G6rx2uD7Y2C8LMPAevdjExfn9nG82ieoFcYuZx9WOm3LgkITNd7-TC_v9fC_9Eb7rj7Q Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c55b43bf6a8240428ac269fbe2d10db3 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c55b43bf6a8240428ac269fbe2d10db3 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachSCSIVolumeTestJSON-1818894042-project Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5f10e75ab3564762b0fcc3f712f62cd7 Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1818894042-project Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'df4b80bb-15cc-49d3-bc27-ad6a5f06884e'} Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:52:14.490212 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.494564 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.507457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Returning 404 to user: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.516110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af0ec7ef-2757-47da-b967-3d21c6fa5ee6 tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 404 len: 111 microversion: 2.1 time: 0.057604 Sep 01 04:52:14.517263 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 694/1378] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:52:14 2022] DELETE /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:14.523980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69bec672-f0b9-4a40-a0c3-3a401272d0fb tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Calling method '.version_select at 0x7fa75bb50b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.526709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69bec672-f0b9-4a40-a0c3-3a401272d0fb tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'af7cc34190604eb3b7839991fec7a680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99a853179a40b6a94339b67ba27160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69bec672-f0b9-4a40-a0c3-3a401272d0fb tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Request method failure captured: Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp8UYaMYCOClSxZ6K_Cmfo6u__wEM523YK43G3ERJYSM-8OZinqiCwiYChn0BK-VXhRTxhruILoebogQl6AbO-GyW74soMRg5asaOd__XwJEHhR28FlwvV4jEzkduX5vGo9BQXRYOKf2XAPDzpQRHLoL20KSqcDrkBFcIdN18WQznY Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be99a853179a40b6a94339b67ba27160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be99a853179a40b6a94339b67ba27160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: af7cc34190604eb3b7839991fec7a680 Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 01 04:52:14.532299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 01 04:52:14.537451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.541199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69bec672-f0b9-4a40-a0c3-3a401272d0fb tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.542237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69bec672-f0b9-4a40-a0c3-3a401272d0fb tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.023883 Sep 01 04:52:14.542978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 695/1379] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:14.552064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.564921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] [instance: df4b80bb-15cc-49d3-bc27-ad6a5f06884e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:14.586048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.586681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.587255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.588109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.588658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.589183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.612805 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] HTTP exception thrown: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Request method failure captured: Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e HTTP/1.1 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDm0DVvb4u8CUg1gIJpJLSMs_Zx4VU6SHBS5YOu8Sbqv2ifkRs6PqaP_RvHftqOj-AwffjiLkrvWvflXbx8adXWi24Jh384h7Q4FGp7vW31G6rx2uD7Y2C8LMPAevdjExfn9nG82ieoFcYuZx9WOm3LgkITNd7-TC_v9fC_9Eb7rj7Q Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c55b43bf6a8240428ac269fbe2d10db3 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c55b43bf6a8240428ac269fbe2d10db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c55b43bf6a8240428ac269fbe2d10db3 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1818894042 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachSCSIVolumeTestJSON-1818894042-project Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 5f10e75ab3564762b0fcc3f712f62cd7 Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1818894042-project Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'df4b80bb-15cc-49d3-bc27-ad6a5f06884e'} Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.614971 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. Sep 01 04:52:14.619882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.621185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] Returning 404 to user: Instance df4b80bb-15cc-49d3-bc27-ad6a5f06884e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.622223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02cdfa05-0160-4d91-9785-9aa2bfbade3b tempest-AttachSCSIVolumeTestJSON-1818894042 tempest-AttachSCSIVolumeTestJSON-1818894042-project] 10.222.0.26 "GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e" status: 404 len: 111 microversion: 2.1 time: 0.073927 Sep 01 04:52:14.624154 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 696/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/servers/df4b80bb-15cc-49d3-bc27-ad6a5f06884e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:14.631872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf78bd60-9b21-4677-a4d2-978260c5c129 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Calling method '.version_select at 0x7fa75bb50700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.636196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf78bd60-9b21-4677-a4d2-978260c5c129 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'af7cc34190604eb3b7839991fec7a680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99a853179a40b6a94339b67ba27160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf78bd60-9b21-4677-a4d2-978260c5c129 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Request method failure captured: Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp8UYaMYCOClSxZ6K_Cmfo6u__wEM523YK43G3ERJYSM-8OZinqiCwiYChn0BK-VXhRTxhruILoebogQl6AbO-GyW74soMRg5asaOd__XwJEHhR28FlwvV4jEzkduX5vGo9BQXRYOKf2XAPDzpQRHLoL20KSqcDrkBFcIdN18WQznY Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be99a853179a40b6a94339b67ba27160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be99a853179a40b6a94339b67ba27160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: af7cc34190604eb3b7839991fec7a680 Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.638715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.643760 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.643760 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.643760 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:52:14.643760 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:52:14.643760 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 01 04:52:14.643760 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.647341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf78bd60-9b21-4677-a4d2-978260c5c129 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.648959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf78bd60-9b21-4677-a4d2-978260c5c129 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.023544 Sep 01 04:52:14.654397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 697/1381] 10.222.0.26 () {58 vars in 1179 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:14.814133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Calling method '.version_select at 0x7fa75bbbb670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.816073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.816674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.817271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.849634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.852984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.853502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.885928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:14.889190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:14.891223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:14.920055 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3111197-95e1-4ed4-b655-d8291c33392c tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.263820 Sep 01 04:52:14.921387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 698/1382] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:14.932499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ef06252-4716-463e-9df2-83f72d5ab177 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Calling method '.version_select at 0x7fa75bebf0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.934501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ef06252-4716-463e-9df2-83f72d5ab177 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'af7cc34190604eb3b7839991fec7a680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99a853179a40b6a94339b67ba27160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ef06252-4716-463e-9df2-83f72d5ab177 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Request method failure captured: Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp8UYaMYCOClSxZ6K_Cmfo6u__wEM523YK43G3ERJYSM-8OZinqiCwiYChn0BK-VXhRTxhruILoebogQl6AbO-GyW74soMRg5asaOd__XwJEHhR28FlwvV4jEzkduX5vGo9BQXRYOKf2XAPDzpQRHLoL20KSqcDrkBFcIdN18WQznY Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be99a853179a40b6a94339b67ba27160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be99a853179a40b6a94339b67ba27160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: af7cc34190604eb3b7839991fec7a680 Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '1'} Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.939091 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.943234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.943234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.943234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:52:14.943234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:52:14.943234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 01 04:52:14.943234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.946613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ef06252-4716-463e-9df2-83f72d5ab177 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.947964 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ef06252-4716-463e-9df2-83f72d5ab177 tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019876 Sep 01 04:52:14.949161 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 699/1383] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:14.964147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8cc93f8-5a40-4169-9f0e-df7db28a74e0 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Calling method '.version_select at 0x7fa75bb50940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:14.966349 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a8cc93f8-5a40-4169-9f0e-df7db28a74e0 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] HTTP exception thrown: Hypervisor with ID '8e63483c-5028-410a-851f-1a35ea191bcf' could not be found. Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8cc93f8-5a40-4169-9f0e-df7db28a74e0 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Request method failure captured: Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/8e63483c-5028-410a-851f-1a35ea191bcf/uptime HTTP/1.1 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp9HQWIC8poVxeovXkAlGjVId8b6XoVbj4ykG4I5glbaMHLJokJt8x3h5DDDJiDRf8EBQZOm0wWwvktMOquiWUCYc2ToQl5uOZIZZ2J62IXjh0LaBLqdRi6esgCQDKRFdepKT2f9E9Arv7D_RunAEEyy9uZkTCh-9WCNS7HTYASAjc Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 40e5b89beb224eb488d07950b8a4b81d Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-455203195 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-455203195 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 40e5b89beb224eb488d07950b8a4b81d Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-455203195 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 78fb7301293d4a79bb50f54ed4191725 Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: exception: Hypervisor with ID '8e63483c-5028-410a-851f-1a35ea191bcf' could not be found. Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '8e63483c-5028-410a-851f-1a35ea191bcf'} Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8e63483c-5028-410a-851f-1a35ea191bcf' Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:14.984245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8e63483c-5028-410a-851f-1a35ea191bcf' could not be found. Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8e63483c-5028-410a-851f-1a35ea191bcf' could not be found. Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8cc93f8-5a40-4169-9f0e-df7db28a74e0 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Returning 404 to user: Hypervisor with ID '8e63483c-5028-410a-851f-1a35ea191bcf' could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8cc93f8-5a40-4169-9f0e-df7db28a74e0 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/8e63483c-5028-410a-851f-1a35ea191bcf/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029628 Sep 01 04:52:14.993889 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 700/1384] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/os-hypervisors/8e63483c-5028-410a-851f-1a35ea191bcf/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:15.001379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Calling method '.version_select at 0x7fa75bcbcaf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:15.003524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:15.004131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:15.006605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:15.038584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:15.039124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:15.039557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:15.059060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:15.059552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:15.059997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:15.063653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:15.069930 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-448f95f7-369d-4e3e-a617-f4c2dfa225f3 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.075857 Sep 01 04:52:15.070820 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 701/1385] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:52:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:15.081281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:15.082166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:15.091210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:15.092057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:15.092698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:15.093754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:15.094486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:15.095177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:15.859960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:15.872311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2f66b5f-b497-4d03-9128-f1a47bc1d8ba tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1308 microversion: 2.1 time: 0.799862 Sep 01 04:52:15.874869 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 702/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:15 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:15.887822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcb6ab97-c6b2-4a9f-b146-d2ff830de05b tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Calling method '.version_select at 0x7fa75bebf0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:15.893670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fcb6ab97-c6b2-4a9f-b146-d2ff830de05b tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'af7cc34190604eb3b7839991fec7a680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be99a853179a40b6a94339b67ba27160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcb6ab97-c6b2-4a9f-b146-d2ff830de05b tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Request method failure captured: Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp8UYaMYCOClSxZ6K_Cmfo6u__wEM523YK43G3ERJYSM-8OZinqiCwiYChn0BK-VXhRTxhruILoebogQl6AbO-GyW74soMRg5asaOd__XwJEHhR28FlwvV4jEzkduX5vGo9BQXRYOKf2XAPDzpQRHLoL20KSqcDrkBFcIdN18WQznY Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/be99a853179a40b6a94339b67ba27160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_be99a853179a40b6a94339b67ba27160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/be99a853179a40b6a94339b67ba27160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: be99a853179a40b6a94339b67ba27160 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-504161819 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: af7cc34190604eb3b7839991fec7a680 Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-504161819-project Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '1'} Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 01 04:52:15.897733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 01 04:52:15.904965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.907774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcb6ab97-c6b2-4a9f-b146-d2ff830de05b tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:15.912488 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fcb6ab97-c6b2-4a9f-b146-d2ff830de05b tempest-HypervisorAdminNegativeTestJSON-504161819 tempest-HypervisorAdminNegativeTestJSON-504161819-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.034854 Sep 01 04:52:15.913308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 703/1387] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:52:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:15.938372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d233784-9e71-41e1-9692-96c060632ba1 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Calling method '.version_select at 0x7fa75bc70280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:15.945584 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5d233784-9e71-41e1-9692-96c060632ba1 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] HTTP exception thrown: Hypervisor with ID '22d79f5a-0a01-4db5-a4f4-e06796578df4' could not be found. Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d233784-9e71-41e1-9692-96c060632ba1 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Request method failure captured: Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-hypervisors/22d79f5a-0a01-4db5-a4f4-e06796578df4 HTTP/1.1 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp9HQWIC8poVxeovXkAlGjVId8b6XoVbj4ykG4I5glbaMHLJokJt8x3h5DDDJiDRf8EBQZOm0wWwvktMOquiWUCYc2ToQl5uOZIZZ2J62IXjh0LaBLqdRi6esgCQDKRFdepKT2f9E9Arv7D_RunAEEyy9uZkTCh-9WCNS7HTYASAjc Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 40e5b89beb224eb488d07950b8a4b81d Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-455203195 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/40e5b89beb224eb488d07950b8a4b81d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-455203195 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 40e5b89beb224eb488d07950b8a4b81d Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-455203195 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 78fb7301293d4a79bb50f54ed4191725 Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: exception: Hypervisor with ID '22d79f5a-0a01-4db5-a4f4-e06796578df4' could not be found. Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '22d79f5a-0a01-4db5-a4f4-e06796578df4'} Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '22d79f5a-0a01-4db5-a4f4-e06796578df4' Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:15.950032 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '22d79f5a-0a01-4db5-a4f4-e06796578df4' could not be found. Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '22d79f5a-0a01-4db5-a4f4-e06796578df4' could not be found. Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d233784-9e71-41e1-9692-96c060632ba1 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] Returning 404 to user: Hypervisor with ID '22d79f5a-0a01-4db5-a4f4-e06796578df4' could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:15.955708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d233784-9e71-41e1-9692-96c060632ba1 tempest-HypervisorAdminNegativeTestJSON-455203195 tempest-HypervisorAdminNegativeTestJSON-455203195-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/22d79f5a-0a01-4db5-a4f4-e06796578df4" status: 404 len: 123 microversion: 2.1 time: 0.034313 Sep 01 04:52:15.957194 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 704/1388] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 04:52:15 2022] GET /compute/v2.1/os-hypervisors/22d79f5a-0a01-4db5-a4f4-e06796578df4 => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:16.018801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1005350606", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "249799ae-d888-4e51-b7e2-7c9ac6dab9a9"}, {"uuid": "be79761b-bee3-4164-82eb-0bc7a65c5f77"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:16.046061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c94483e-d929-4fd6-852c-f695762f6508 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.733463 Sep 01 04:52:16.047248 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 685/1389] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 04:52:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:52:16.059407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4886fbc7-ad1a-4da1-b1b3-d77bd9dc9f0b tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Calling method '.version_select at 0x7fa75bcc2f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:16.162666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] validate_networks() for [('249799ae-d888-4e51-b7e2-7c9ac6dab9a9', None, None, None, None, None), ('be79761b-bee3-4164-82eb-0bc7a65c5f77', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:52:18.335739 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4886fbc7-ad1a-4da1-b1b3-d77bd9dc9f0b tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/ee41a9aa-bcc6-4f93-840a-0763b7e90b33" status: 200 len: 142 microversion: 2.1 time: 2.280262 Sep 01 04:52:18.349787 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 686/1390] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:52:16 2022] GET /compute/v2.1/os-floating-ips/ee41a9aa-bcc6-4f93-840a-0763b7e90b33 => generated 142 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:52:18.364345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:18.366186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:18.412156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:18.415083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:18.420191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:18.430974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:18.433965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:18.434425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:18.925542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:18.947064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec1890ea-492b-4a28-9bc9-c7e58cd566cf tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1308 microversion: 2.1 time: 0.595242 Sep 01 04:52:18.951964 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 687/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:18 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1308 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:18.977019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eacb2ea3-2594-474c-803a-a94b007d3792 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Calling method '.version_select at 0x7fa75bcc2b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:19.045788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:19.121096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:19.674640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:20.161371 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eacb2ea3-2594-474c-803a-a94b007d3792 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.203336 Sep 01 04:52:20.162584 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 688/1392] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 04:52:18 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:20.175040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a1bfe2ae-0de6-49d7-a4d4-d6033cc05493 req-a7543224-3ec8-4e3e-b64c-f1c1bfd7ceae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42d112d-4c29-4c33-81b5-e1a1c223d95d", "tag": "d436f69c-c3c5-4e3b-8dfd-2089edfba365"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:20.202590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1bfe2ae-0de6-49d7-a4d4-d6033cc05493 req-a7543224-3ec8-4e3e-b64c-f1c1bfd7ceae service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:20.204240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1bfe2ae-0de6-49d7-a4d4-d6033cc05493 req-a7543224-3ec8-4e3e-b64c-f1c1bfd7ceae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:20.206303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1bfe2ae-0de6-49d7-a4d4-d6033cc05493 req-a7543224-3ec8-4e3e-b64c-f1c1bfd7ceae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:20.231142 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a1bfe2ae-0de6-49d7-a4d4-d6033cc05493 req-a7543224-3ec8-4e3e-b64c-f1c1bfd7ceae service nova] Creating event network-changed:d436f69c-c3c5-4e3b-8dfd-2089edfba365 for instance e42d112d-4c29-4c33-81b5-e1a1c223d95d on n-h1-820368-37 Sep 01 04:52:20.245376 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a1bfe2ae-0de6-49d7-a4d4-d6033cc05493 req-a7543224-3ec8-4e3e-b64c-f1c1bfd7ceae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077481 Sep 01 04:52:20.246657 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 689/1393] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:20.260077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:20.262097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:20.277838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:20.278458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:20.279125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:20.284608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:20.287446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:20.288012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:20.585679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:52:20.586144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:52:20.586845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:52:20.587314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:52:20.587721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:52:20.602157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:20.602937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:20.603909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:20.605278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:20.606463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:20.608002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:20.641775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Getting quotas for project a9b08a156c194615b51ba116446334d1. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:52:20.652367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Getting quotas for user 1c0c2fb280fa41c4a65417e35b2e53c1 and project a9b08a156c194615b51ba116446334d1. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:52:20.673126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:52:20.682081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:52:20.761206 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed948986-b1b2-4c90-a9c4-143236b296b8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.749762 Sep 01 04:52:20.768609 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 705/1394] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:52:20.774666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2e929dc-a0f5-4e5b-bf80-b5159a498b8e tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Calling method '.version_select at 0x7fa75bc70040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:20.785108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:20.799588 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7785c2e3-5117-40cc-aa12-9cc0898e2a95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1308 microversion: 2.1 time: 0.551215 Sep 01 04:52:20.811208 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 690/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:20 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1308 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:20.821992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1038215979", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "541b0280-9b86-4b41-9f61-cdb1f531e297"}], "block_device_mapping_v2": [{"uuid": "a186ac2e-4d2c-46fd-8e26-4215fe123164", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:20.908441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] validate_networks() for [('541b0280-9b86-4b41-9f61-cdb1f531e297', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:52:23.417643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:52:23.418827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:52:23.419491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:52:23.419971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:52:23.420422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:52:23.443379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:23.444171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:23.444769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:23.445654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:23.446263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:23.446929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:23.486013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:52:23.499506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Getting quotas for user ce4ece60266c4a9692b03d795cea8462 and project c74dd6c8acf14c5883658f846d1b34c7. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:52:23.604018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:52:23.607453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a186ac2e-4d2c-46fd-8e26-4215fe123164',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:52:23.705791 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2e929dc-a0f5-4e5b-bf80-b5159a498b8e tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/ee41a9aa-bcc6-4f93-840a-0763b7e90b33" status: 202 len: 0 microversion: 2.1 time: 2.935734 Sep 01 04:52:23.706566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 706/1396] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:52:20 2022] DELETE /compute/v2.1/os-floating-ips/ee41a9aa-bcc6-4f93-840a-0763b7e90b33 => generated 0 bytes in 2937 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:52:23.717819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:23.718865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:23.736938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:23.737873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:23.738534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:23.741241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:23.742022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:23.742737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:23.863291 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9b42537-a128-4c1a-a41b-28940096ba4d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.046748 Sep 01 04:52:23.871114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 691/1397] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3055 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:52:23.876654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:23.887361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:23.898385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:23.899167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:23.900150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:23.902300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:23.903204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:23.903952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:24.148065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:24.163480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ec43156-016b-426c-a0cb-ab4596b84c2d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1271 microversion: 2.1 time: 0.451343 Sep 01 04:52:24.166564 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 707/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:23 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1271 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:24.179695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29da2feb-b683-4d89-a4c4-406b04f6a3e1 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Action: 'create', calling method: .version_select at 0x7fa75bd6c550>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:24.427222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:24.442005 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e60cf89-88c5-4f43-ae5c-84abbaf90964 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1308 microversion: 2.1 time: 0.573500 Sep 01 04:52:24.451874 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 692/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:23 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:24.463575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f26fe20-e2c7-40c1-a6b1-e237ad0ca20e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:24.467293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f26fe20-e2c7-40c1-a6b1-e237ad0ca20e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:24.656165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f26fe20-e2c7-40c1-a6b1-e237ad0ca20e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:24.674276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f26fe20-e2c7-40c1-a6b1-e237ad0ca20e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:24.678344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f26fe20-e2c7-40c1-a6b1-e237ad0ca20e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:24.679530 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f26fe20-e2c7-40c1-a6b1-e237ad0ca20e tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1104 microversion: 2.25 time: 0.226068 Sep 01 04:52:24.680097 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 693/1400] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:24 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1104 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:24.841371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52c35321-c35d-424d-9ce2-0e27e36984f7 tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] Calling method '.version_select at 0x7fa75bcce5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:24.856450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52c35321-c35d-424d-9ce2-0e27e36984f7 tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.175138 Sep 01 04:52:24.857757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 694/1401] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 04:52:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:24.871297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09a38bed-5a10-4d9b-8949-ef969274764d tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] Action: 'update', calling method: .version_select at 0x7fa75bcce700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:25.280748 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09a38bed-5a10-4d9b-8949-ef969274764d tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.414497 Sep 01 04:52:25.288832 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 695/1402] 10.222.0.26 () {60 vars in 1206 bytes} [Thu Sep 1 04:52:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:52:25.297010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:25.297010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:25.305006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:25.305643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:25.306159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:25.307173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:25.307426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:25.310098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:25.411402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:25.420208 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e92d2286-fc76-4672-81a9-d05ae910e389 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1271 microversion: 2.1 time: 0.129833 Sep 01 04:52:25.421479 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 696/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:25 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:25.437981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8109e147-2866-404a-afdb-af6b01f5c974 tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] Calling method '.version_select at 0x7fa75bd680d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:25.468311 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8109e147-2866-404a-afdb-af6b01f5c974 tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.045105 Sep 01 04:52:25.471684 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 697/1404] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 04:52:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:25.483148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-47b55b66-9759-41bc-8b04-a031df234232 req-f4ef1922-3869-4e5a-9b33-be059fbd7dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d112d-4c29-4c33-81b5-e1a1c223d95d", "name": "network-vif-plugged", "status": "completed", "tag": "d436f69c-c3c5-4e3b-8dfd-2089edfba365"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:25.516977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47b55b66-9759-41bc-8b04-a031df234232 req-f4ef1922-3869-4e5a-9b33-be059fbd7dc9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:25.518409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47b55b66-9759-41bc-8b04-a031df234232 req-f4ef1922-3869-4e5a-9b33-be059fbd7dc9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:25.519818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47b55b66-9759-41bc-8b04-a031df234232 req-f4ef1922-3869-4e5a-9b33-be059fbd7dc9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:25.548073 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-47b55b66-9759-41bc-8b04-a031df234232 req-f4ef1922-3869-4e5a-9b33-be059fbd7dc9 service nova] Creating event network-vif-plugged:d436f69c-c3c5-4e3b-8dfd-2089edfba365 for instance e42d112d-4c29-4c33-81b5-e1a1c223d95d on n-h1-820368-37 Sep 01 04:52:25.556248 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-47b55b66-9759-41bc-8b04-a031df234232 req-f4ef1922-3869-4e5a-9b33-be059fbd7dc9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078152 Sep 01 04:52:25.557425 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 698/1405] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:25.563468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:25.564173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:25.572940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=13,nova_api:UPDATE=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:25.575906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:25.576637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:25.578445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:25.579315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:25.580615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:25.581064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:26.003480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:26.011628 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56609356-34ee-4260-9e0b-05623cf7fc82 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1308 microversion: 2.1 time: 0.452992 Sep 01 04:52:26.025612 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 699/1406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:25 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:26.031027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ee98331-bda0-4d78-9ffa-d6f0112d09fc tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] Action: 'update', calling method: .version_select at 0x7fa75bcce940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:26.241917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ee98331-bda0-4d78-9ffa-d6f0112d09fc tempest-QuotaClassesAdminTestJSON-1566570969 tempest-QuotaClassesAdminTestJSON-1566570969-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.215015 Sep 01 04:52:26.250934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 700/1407] 10.222.0.26 () {60 vars in 1206 bytes} [Thu Sep 1 04:52:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:26.273857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:26.275570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:26.299083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:26.310680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:26.310680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:26.317476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:26.319008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:26.320617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:27.191789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:27.217855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:27.221963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:27.227349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88f18664-fdfe-4a2d-b150-8c7e974c6539 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1251 microversion: 2.25 time: 0.981003 Sep 01 04:52:27.229452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 701/1408] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:26 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1251 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:27.244237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:27.245578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:27.269635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:27.270163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:27.272679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:27.274165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:27.276983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:27.277479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:27.750382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:27.769639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78e03395-9fd1-4769-87e5-8472c6371ad6 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1313 microversion: 2.1 time: 0.531363 Sep 01 04:52:27.785512 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 702/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:27 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:27.802196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:27.803247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:27.820979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:27.821252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:27.821936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:27.825838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:27.826989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:27.827831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:28.491476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:28.502801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86f9ca4d-d996-4487-a24a-b1e9113e11f3 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1488 microversion: 2.1 time: 0.711561 Sep 01 04:52:28.503424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 703/1410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:27 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1488 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:28.530546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:28.531990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:28.542366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:28.543145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:28.543778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:28.544972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:28.545634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:28.546232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:28.707714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:28.734266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:28.735759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:28.737197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41ec83a6-49d9-49e1-8fc6-7173aa92352a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1251 microversion: 2.25 time: 0.231251 Sep 01 04:52:28.738257 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 704/1411] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:28 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1251 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:28.744421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:28.745155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:28.754317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:28.755053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:28.755686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:28.756941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:28.757568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:28.758342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:28.789887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lazy-loading 'flavor' on Instance uuid e42d112d-4c29-4c33-81b5-e1a1c223d95d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:52:28.975571 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32a72d90-1b60-4667-81b4-1ce5b5e9aad5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d/action" status: 202 len: 0 microversion: 2.1 time: 0.235557 Sep 01 04:52:28.979565 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 705/1412] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:52:28 2022] POST /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:52:28.990025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:28.991029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:29.010668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.013486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.014090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.015205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.015680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.016109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.742095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:29.758967 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98b34eb4-5063-4906-b04a-94c01ff4391d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1313 microversion: 2.1 time: 0.778764 Sep 01 04:52:29.759873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 706/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:28 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:29.775464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:29.776645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:29.787652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.790557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.792637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.794226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.795914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.797226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.840451 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29da2feb-b683-4d89-a4c4-406b04f6a3e1 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.672204 Sep 01 04:52:29.850146 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 708/1414] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 04:52:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:29.860918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:29.868222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:29.869932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Searching by: {'deleted': False, 'project_id': '5d249f0206964985b5f6ebd59e1e7269'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:52:29.878555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.879372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.880356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.881651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.882898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.883445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.918782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:52:29.954674 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-636ba96e-e250-474c-88c9-c556df441edb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.103108 Sep 01 04:52:29.955600 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 709/1415] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:52:29 2022] GET /compute/v2.1/servers => generated 343 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:29.961967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:29.963259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:29.971768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.972749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.973405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:29.974337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:29.975033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:29.975674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:30.417339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:30.427431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d3ceeef-81ce-4b89-98c8-c4d1ca85f65d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 200 len: 1479 microversion: 2.1 time: 0.666221 Sep 01 04:52:30.439470 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 707/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:29 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 1479 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:30.444813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f42ad7b-1959-43a7-a0c2-1a6c9e63325b tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Calling method '.version_select at 0x7fa75bcc7310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:30.585886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:30.597640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:30.599246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:30.600825 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67acabf8-fefe-43c6-90c3-ef8d842d61e5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1293 microversion: 2.25 time: 0.643642 Sep 01 04:52:30.601574 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 710/1417] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:29 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1293 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:30.622629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:30.631535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:30.632761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Searching by: {'deleted': False, 'project_id': '5d249f0206964985b5f6ebd59e1e7269'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:52:30.640235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:30.640854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:30.641313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:30.643130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:30.643725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:30.645432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:30.691261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:30.778451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:52:30.983293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:30.994487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:30.996186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:30.997035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:31.808521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a66bff64-3699-4b0f-8b84-6c0395a6fa78 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.190875 Sep 01 04:52:31.811133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 711/1418] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:52:30 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:31.818088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1300554067"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:31.820806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:31.828459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:31.829206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:31.829795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:31.832808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:31.834039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:31.834855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:32.102739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be02fd7c-0e4d-4b5d-90a7-91423c048078 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d/action" status: 202 len: 0 microversion: 2.1 time: 0.290055 Sep 01 04:52:32.104442 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 712/1419] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:52:31 2022] POST /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:52:32.125463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:32.126147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:32.133211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:32.134018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:32.134518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:32.135208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:32.135799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:32.136355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:32.572905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:32.582200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b2ff54a-7866-42d1-a685-ac801dcb3433 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 0.461318 Sep 01 04:52:32.582786 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 713/1420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:32 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:32.833479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f278117f-3688-4a94-a6ca-fbc5b4e9684f tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] 10.222.0.26 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.249403 Sep 01 04:52:32.841307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 714/1421] 10.222.0.26 () {58 vars in 1128 bytes} [Thu Sep 1 04:52:32 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 04:52:32.846115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:32.847553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:32.855791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:32.857670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:32.858642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:32.859711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:32.860880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:32.861829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:32.873805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f42ad7b-1959-43a7-a0c2-1a6c9e63325b tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84" status: 202 len: 0 microversion: 2.1 time: 2.431435 Sep 01 04:52:32.875145 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 708/1422] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:52:30 2022] DELETE /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84 => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:52:32.886172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a0ab8dc-d3b1-484a-986b-6622f265360b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:32.902147 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a0ab8dc-d3b1-484a-986b-6622f265360b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020964 Sep 01 04:52:32.904192 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 709/1423] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:32.990666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-843736969", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:33.091866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:52:33.451553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:33.460346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:33.462050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:33.463194 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82783991-2cdd-4d46-94c3-46c7dc72a1c8 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1293 microversion: 2.25 time: 0.623158 Sep 01 04:52:33.463767 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 715/1424] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:32 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1293 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:33.464664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:33.472846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81e6ccb4-5c44-4214-8afd-f131c4afe10f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bbec670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:33.529276 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81e6ccb4-5c44-4214-8afd-f131c4afe10f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.064473 Sep 01 04:52:33.530500 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 716/1425] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:33 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:33.535287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9b2c655c-bff6-4724-90a3-1f84554ccac8 req-e415abf3-c318-4634-a8f6-5074fa2792e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5943be74-63b0-4bf2-9b9f-c9a37ff00ec1", "tag": "ff13fb50-fd09-4168-93e1-118e18ff8dde"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:33.545353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b2c655c-bff6-4724-90a3-1f84554ccac8 req-e415abf3-c318-4634-a8f6-5074fa2792e0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.546182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b2c655c-bff6-4724-90a3-1f84554ccac8 req-e415abf3-c318-4634-a8f6-5074fa2792e0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.546611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b2c655c-bff6-4724-90a3-1f84554ccac8 req-e415abf3-c318-4634-a8f6-5074fa2792e0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.557737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9b2c655c-bff6-4724-90a3-1f84554ccac8 req-e415abf3-c318-4634-a8f6-5074fa2792e0 service nova] Creating event network-changed:ff13fb50-fd09-4168-93e1-118e18ff8dde for instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 on n-h1-820368-37 Sep 01 04:52:33.563011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9b2c655c-bff6-4724-90a3-1f84554ccac8 req-e415abf3-c318-4634-a8f6-5074fa2792e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031191 Sep 01 04:52:33.563928 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 717/1426] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:33.569256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73011dac-b414-40ce-bc6b-7a295fd269d4 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Calling method '.version_select at 0x7fa75bb509d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:33.613063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:52:33.613500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:52:33.614196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:52:33.614603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:52:33.615179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:52:33.624384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.624872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.625321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.626019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.626464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.626879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.644427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Getting quotas for project f54577a158c74f57819ef92429fbda99. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:52:33.649878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Getting quotas for user 9db030290d94441abeba1f5c11690005 and project f54577a158c74f57819ef92429fbda99. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:52:33.653461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-73011dac-b414-40ce-bc6b-7a295fd269d4 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] HTTP exception thrown: Image not found. Sep 01 04:52:33.664255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:52:33.666633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73011dac-b414-40ce-bc6b-7a295fd269d4 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Request method failure captured: Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDqOs1A_LJHhppCVs877dHhAJfViowfIplYfPSjPxUKLzAmv7yqZtAbpczpFVeBXpObOMmSGW5vJsf2aW29Y9ULmpIc02wXZDcCt3uBI5bSZ5snP9lpO16tJ8J89KkQSTiIVYaMBqpbmG3fDn6r1ciCP5m-h4YBJfSMP-U9vSqM-6sA Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 351dabdca4614632b27481c21309d5e9 Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '-1'} Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.693534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73011dac-b414-40ce-bc6b-7a295fd269d4 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73011dac-b414-40ce-bc6b-7a295fd269d4 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] 10.222.0.26 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.131366 Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 718/1427] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Sep 1 04:52:33 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:52:33.706055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6be4be7-c32a-484e-8b83-c5a2a1422c30 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Calling method '.version_select at 0x7fa75ba441f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:33.722247 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36786708-2eaa-4431-8ed0-3716ab6c0820 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816413 Sep 01 04:52:33.724434 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 710/1428] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:52:33.728012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:33.728601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:33.735381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.736170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.736618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.737558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.738090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.738741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.771463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:52:33.786859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-d6be4be7-c32a-484e-8b83-c5a2a1422c30 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1af273b3-d875-4e9a-9318-4fe41d8ddb84 could not be found", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:52:33.787834 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d6be4be7-c32a-484e-8b83-c5a2a1422c30 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] HTTP exception thrown: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:33.788133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6be4be7-c32a-484e-8b83-c5a2a1422c30 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Request method failure captured: Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84 HTTP/1.1 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp6fA8c2omP3G3I---wlPuDLoNEcqmt0we6JQcGJnU0Pdxw5enal0QPajKCaQybdfNlUW5XKzpsDun8e1e1XuH9w9PWC1aRKmLvJFiwzXipDsPSjc8y93H62JjskCB-vDGULwLiR0m0DvVNqWsKFa_QNR2kZU-CSUN_a4HzHT98H6I Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: e77a702fc78047328aaacb906e8880b8 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsTestJSON-988986224 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e77a702fc78047328aaacb906e8880b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e77a702fc78047328aaacb906e8880b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e77a702fc78047328aaacb906e8880b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e77a702fc78047328aaacb906e8880b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsTestJSON-988986224 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: e77a702fc78047328aaacb906e8880b8 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsTestJSON-988986224 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsTestJSON-988986224-project Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f71c37faf35e4867836d7efeb111eaf9 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsTestJSON-988986224-project Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: exception: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '1af273b3-d875-4e9a-9318-4fe41d8ddb84'} Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1af273b3-d875-4e9a-9318-4fe41d8ddb84 could not be found Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b62399e-f049-4b80-8802-9d552a672e70'] Sep 01 04:52:33.805662 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84. Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.810719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6be4be7-c32a-484e-8b83-c5a2a1422c30 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Returning 404 to user: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:33.815649 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6be4be7-c32a-484e-8b83-c5a2a1422c30 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84" status: 404 len: 111 microversion: 2.1 time: 0.113592 Sep 01 04:52:33.815649 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 719/1429] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 04:52:33 2022] GET /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:33.825112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:33.827912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:33.839954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.840552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.841020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.841903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:33.842641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:33.843095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:33.879694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-615ff81f-014d-4de4-9915-8c847f89a8c2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "DELETE /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 204 len: 0 microversion: 2.1 time: 0.154774 Sep 01 04:52:33.882151 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 711/1430] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:52:33 2022] DELETE /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:52:33.890575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b825acb-1fb0-425e-bbe1-10f5bca6c683 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Calling method '.version_select at 0x7fa75bd4a940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:33.921968 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9b825acb-1fb0-425e-bbe1-10f5bca6c683 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] HTTP exception thrown: Image not found. Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b825acb-1fb0-425e-bbe1-10f5bca6c683 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Request method failure captured: Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/ecdadcce-512f-4003-8cf4-097450568ecj HTTP/1.1 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqOs1A_LJHhppCVs877dHhAJfViowfIplYfPSjPxUKLzAmv7yqZtAbpczpFVeBXpObOMmSGW5vJsf2aW29Y9ULmpIc02wXZDcCt3uBI5bSZ5snP9lpO16tJ8J89KkQSTiIVYaMBqpbmG3fDn6r1ciCP5m-h4YBJfSMP-U9vSqM-6sA Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 351dabdca4614632b27481c21309d5e9 Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ecdadcce-512f-4003-8cf4-097450568ecj'} Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ecdadcce-512f-4003-8cf4-097450568ecj to delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ecdadcce-512f-4003-8cf4-097450568ecj could not be found. Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.926004 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b825acb-1fb0-425e-bbe1-10f5bca6c683 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b825acb-1fb0-425e-bbe1-10f5bca6c683 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] 10.222.0.26 "DELETE /compute/v2.1/images/ecdadcce-512f-4003-8cf4-097450568ecj" status: 404 len: 62 microversion: 2.1 time: 0.044103 Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 712/1431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:33 2022] DELETE /compute/v2.1/images/ecdadcce-512f-4003-8cf4-097450568ecj => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:52:33.936932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-305509404", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:34.016681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:52:34.141730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:34.151146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cdcc2ae-6220-4d57-91aa-22eb8d2e5fdd tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 0.334422 Sep 01 04:52:34.152035 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 720/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:33 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:34.170039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d829e556-710d-46d2-bd76-0588bc89da62 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Calling method '.version_select at 0x7fa75bbec310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-d829e556-710d-46d2-bd76-0588bc89da62 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1af273b3-d875-4e9a-9318-4fe41d8ddb84 could not be found", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d829e556-710d-46d2-bd76-0588bc89da62 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] HTTP exception thrown: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d829e556-710d-46d2-bd76-0588bc89da62 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Request method failure captured: Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84 HTTP/1.1 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDp6fA8c2omP3G3I---wlPuDLoNEcqmt0we6JQcGJnU0Pdxw5enal0QPajKCaQybdfNlUW5XKzpsDun8e1e1XuH9w9PWC1aRKmLvJFiwzXipDsPSjc8y93H62JjskCB-vDGULwLiR0m0DvVNqWsKFa_QNR2kZU-CSUN_a4HzHT98H6I Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: e77a702fc78047328aaacb906e8880b8 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsTestJSON-988986224 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e77a702fc78047328aaacb906e8880b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e77a702fc78047328aaacb906e8880b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e77a702fc78047328aaacb906e8880b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e77a702fc78047328aaacb906e8880b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsTestJSON-988986224 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: e77a702fc78047328aaacb906e8880b8 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsTestJSON-988986224 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsTestJSON-988986224-project Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f71c37faf35e4867836d7efeb111eaf9 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsTestJSON-988986224-project Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: exception: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '1af273b3-d875-4e9a-9318-4fe41d8ddb84'} Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:52:34.245080 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1af273b3-d875-4e9a-9318-4fe41d8ddb84 could not be found Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2bf9eee-1222-4997-afee-9131158cf7a0'] Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84. Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d829e556-710d-46d2-bd76-0588bc89da62 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] Returning 404 to user: Floating IP not found for ID 1af273b3-d875-4e9a-9318-4fe41d8ddb84 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d829e556-710d-46d2-bd76-0588bc89da62 tempest-FloatingIPsTestJSON-988986224 tempest-FloatingIPsTestJSON-988986224-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84" status: 404 len: 111 microversion: 2.1 time: 0.089788 Sep 01 04:52:34.249463 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 721/1433] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:52:34 2022] DELETE /compute/v2.1/os-floating-ips/1af273b3-d875-4e9a-9318-4fe41d8ddb84 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:34.258501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.259151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:34.270512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:34.271233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:34.271853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:34.275302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:34.276210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:34.276809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:34.568201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:52:34.568914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:52:34.570062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:52:34.570646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:52:34.571762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:52:34.587828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:34.588940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:34.589903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:34.591075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:34.592902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:34.593784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:34.653859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Getting quotas for project f54577a158c74f57819ef92429fbda99. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:52:34.666316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Getting quotas for user 9db030290d94441abeba1f5c11690005 and project f54577a158c74f57819ef92429fbda99. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:52:34.686143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:52:34.691409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:52:34.706273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:34.719809 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba8c9ed8-0f1f-4a63-b504-83418718e3c5 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1608 microversion: 2.1 time: 0.462910 Sep 01 04:52:34.720813 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 722/1434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:34 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1608 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:34.734180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-760ead06-d55a-4f32-95fc-a30e28a06382 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Calling method '.version_select at 0x7fa75b9a78b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.763933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-760ead06-d55a-4f32-95fc-a30e28a06382 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] HTTP exception thrown: Image not found. Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-760ead06-d55a-4f32-95fc-a30e28a06382 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Request method failure captured: Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/c3a68219-ce47-4439-b5c2-b89468ef18b61 HTTP/1.1 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDqOs1A_LJHhppCVs877dHhAJfViowfIplYfPSjPxUKLzAmv7yqZtAbpczpFVeBXpObOMmSGW5vJsf2aW29Y9ULmpIc02wXZDcCt3uBI5bSZ5snP9lpO16tJ8J89KkQSTiIVYaMBqpbmG3fDn6r1ciCP5m-h4YBJfSMP-U9vSqM-6sA Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 351dabdca4614632b27481c21309d5e9 Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'c3a68219-ce47-4439-b5c2-b89468ef18b61'} Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c3a68219-ce47-4439-b5c2-b89468ef18b61 to delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3a68219-ce47-4439-b5c2-b89468ef18b61 could not be found. Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.766266 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:52:34.770504 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.776974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-760ead06-d55a-4f32-95fc-a30e28a06382 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:34.777827 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-760ead06-d55a-4f32-95fc-a30e28a06382 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] 10.222.0.26 "DELETE /compute/v2.1/images/c3a68219-ce47-4439-b5c2-b89468ef18b61" status: 404 len: 62 microversion: 2.1 time: 0.055856 Sep 01 04:52:34.782642 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 723/1435] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:52:34 2022] DELETE /compute/v2.1/images/c3a68219-ce47-4439-b5c2-b89468ef18b61 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:52:34.792515 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbd04f37-4c5e-4850-ae42-ae59e1826ebb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862314 Sep 01 04:52:34.794305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.796046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:34.798126 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 713/1436] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:52:34.807181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fd1a9d3-8ca1-4748-ae0d-c5c5fc5e03d5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcc2d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.819747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:34.820681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:34.821303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:34.822953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:34.828281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:34.833289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:34.908268 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fd1a9d3-8ca1-4748-ae0d-c5c5fc5e03d5 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.106717 Sep 01 04:52:34.915989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 714/1437] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:34 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:34.920687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-361d7517-4dc9-46f3-8c8a-fd4ce3f65ba7 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Calling method '.version_select at 0x7fa75bc479d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.960119 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-361d7517-4dc9-46f3-8c8a-fd4ce3f65ba7 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] HTTP exception thrown: Image not found. Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-361d7517-4dc9-46f3-8c8a-fd4ce3f65ba7 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Request method failure captured: Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/tempest-invalid-316039417 HTTP/1.1 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqOs1A_LJHhppCVs877dHhAJfViowfIplYfPSjPxUKLzAmv7yqZtAbpczpFVeBXpObOMmSGW5vJsf2aW29Y9ULmpIc02wXZDcCt3uBI5bSZ5snP9lpO16tJ8J89KkQSTiIVYaMBqpbmG3fDn6r1ciCP5m-h4YBJfSMP-U9vSqM-6sA Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 351dabdca4614632b27481c21309d5e9 Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'tempest-invalid-316039417'} Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-316039417 to delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-316039417 could not be found. Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.962024 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-361d7517-4dc9-46f3-8c8a-fd4ce3f65ba7 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-361d7517-4dc9-46f3-8c8a-fd4ce3f65ba7 tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] 10.222.0.26 "DELETE /compute/v2.1/images/tempest-invalid-316039417" status: 404 len: 62 microversion: 2.1 time: 0.053486 Sep 01 04:52:34.967048 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 715/1438] 10.222.0.26 () {58 vars in 1203 bytes} [Thu Sep 1 04:52:34 2022] DELETE /compute/v2.1/images/tempest-invalid-316039417 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:52:34.974746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05f2d037-1dc0-4e1b-9b25-6a720a3eb8fb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:34.978415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05f2d037-1dc0-4e1b-9b25-6a720a3eb8fb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:35.198401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05f2d037-1dc0-4e1b-9b25-6a720a3eb8fb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:35.217745 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05f2d037-1dc0-4e1b-9b25-6a720a3eb8fb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1213 microversion: 2.1 time: 0.250063 Sep 01 04:52:35.228108 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 716/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:34 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1213 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:35.230631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca0eed47-9383-478b-8558-4888cef9311a tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Calling method '.version_select at 0x7fa75bc7b040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:35.266693 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ca0eed47-9383-478b-8558-4888cef9311a tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] HTTP exception thrown: Image not found. Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca0eed47-9383-478b-8558-4888cef9311a tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Request method failure captured: Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/79e032c7-1a01-4566-821f-d37a2e36b4e4 HTTP/1.1 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqOs1A_LJHhppCVs877dHhAJfViowfIplYfPSjPxUKLzAmv7yqZtAbpczpFVeBXpObOMmSGW5vJsf2aW29Y9ULmpIc02wXZDcCt3uBI5bSZ5snP9lpO16tJ8J89KkQSTiIVYaMBqpbmG3fDn6r1ciCP5m-h4YBJfSMP-U9vSqM-6sA Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/143096ea6f5d4a15baa6da1d5a2bcd3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 143096ea6f5d4a15baa6da1d5a2bcd3a Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-82188042 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 351dabdca4614632b27481c21309d5e9 Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-82188042-project Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '79e032c7-1a01-4566-821f-d37a2e36b4e4'} Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 79e032c7-1a01-4566-821f-d37a2e36b4e4 to delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 79e032c7-1a01-4566-821f-d37a2e36b4e4 could not be found. Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:35.274035 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca0eed47-9383-478b-8558-4888cef9311a tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:35.278339 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca0eed47-9383-478b-8558-4888cef9311a tempest-ImagesDeleteNegativeTestJSON-82188042 tempest-ImagesDeleteNegativeTestJSON-82188042-project] 10.222.0.26 "DELETE /compute/v2.1/images/79e032c7-1a01-4566-821f-d37a2e36b4e4" status: 404 len: 62 microversion: 2.1 time: 0.055133 Sep 01 04:52:35.288410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 717/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:35 2022] DELETE /compute/v2.1/images/79e032c7-1a01-4566-821f-d37a2e36b4e4 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:52:35.294657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:35.297430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:35.318486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:35.319237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:35.320369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:35.321970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:35.322632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:35.323277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:36.337832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:36.354124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:36.367513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:36.369179 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b93fb71-cc57-493a-92b6-79dc4364ae1b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1281 microversion: 2.25 time: 1.580617 Sep 01 04:52:36.371430 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 724/1441] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:34 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1281 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:36.392808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4b1ad65d-b74e-4cab-86d8-61727690444a req-b9c54f5c-7918-4cbc-b7f4-93a38eadd653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d112d-4c29-4c33-81b5-e1a1c223d95d", "name": "network-vif-plugged", "status": "completed", "tag": "d436f69c-c3c5-4e3b-8dfd-2089edfba365"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:36.420910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b1ad65d-b74e-4cab-86d8-61727690444a req-b9c54f5c-7918-4cbc-b7f4-93a38eadd653 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:36.421065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b1ad65d-b74e-4cab-86d8-61727690444a req-b9c54f5c-7918-4cbc-b7f4-93a38eadd653 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:36.421455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b1ad65d-b74e-4cab-86d8-61727690444a req-b9c54f5c-7918-4cbc-b7f4-93a38eadd653 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:36.456728 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4b1ad65d-b74e-4cab-86d8-61727690444a req-b9c54f5c-7918-4cbc-b7f4-93a38eadd653 service nova] Creating event network-vif-plugged:d436f69c-c3c5-4e3b-8dfd-2089edfba365 for instance e42d112d-4c29-4c33-81b5-e1a1c223d95d on n-h1-820368-37 Sep 01 04:52:36.461944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4b1ad65d-b74e-4cab-86d8-61727690444a req-b9c54f5c-7918-4cbc-b7f4-93a38eadd653 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089053 Sep 01 04:52:36.462557 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 725/1442] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:36.467780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:36.468491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:36.482012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:36.487344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:36.487809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:36.488569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:36.489042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:36.489469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:36.925096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:36.952903 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58072e89-d20f-42bb-a807-65ec0212393d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.666895 Sep 01 04:52:36.954118 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 718/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:35 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:36.963946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc8b32c8-6d3f-4a90-8f6d-1d3e3ef72c62 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bc475e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:37.051044 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc8b32c8-6d3f-4a90-8f6d-1d3e3ef72c62 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.093992 Sep 01 04:52:37.052157 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 719/1444] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:36 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:37.065186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879949bf-a2ab-40d8-b151-cdefadb6b7c2", "tag": "dbc3efe1-bf2f-4583-98e6-f0539646605d"}, {"name": "network-changed", "server_uuid": "879949bf-a2ab-40d8-b151-cdefadb6b7c2", "tag": "e6412782-87af-4eb9-80c5-037e1fa79bc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:37.083114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.084092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.085071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:37.116401 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] Creating event network-changed:dbc3efe1-bf2f-4583-98e6-f0539646605d for instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 on n-h2-820368-37 Sep 01 04:52:37.118325 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] Creating event network-changed:e6412782-87af-4eb9-80c5-037e1fa79bc3 for instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 on n-h2-820368-37 Sep 01 04:52:37.128156 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-26dcc8b0-54c6-4eb3-bc47-272c0f1eff7a req-5e43d7ff-8edc-41a0-b618-a03f3fa360cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073591 Sep 01 04:52:37.130110 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 720/1445] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:37.139001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:37.140592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:37.153703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.154930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.156120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:37.157479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.158613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.159331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:37.493532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:37.508240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-356bfcaf-2a17-431d-8f50-b0f93222504b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1271 microversion: 2.1 time: 0.375839 Sep 01 04:52:37.515967 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 721/1446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:37 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1271 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:37.549309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:37.550200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:37.557231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.558008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.558616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:37.559544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.560166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.560843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:37.569953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:37.582744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c273b797-77d9-4140-b85c-2eabe36352eb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1608 microversion: 2.1 time: 1.118850 Sep 01 04:52:37.595675 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 726/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:36 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1608 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:37.974119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:37.974925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:37.987467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.987970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.988402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:37.991929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:37.992416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:37.992858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:39.033049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:39.036059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:39.065392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2174485c-b30c-4e6d-a7a9-cb419dbde6e3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.090721 Sep 01 04:52:39.069746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 727/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:37 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:39.073961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:39.093544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-026d7cbd-db79-468d-a3ba-9e84611a3436 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75b9a7160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:39.094174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:39.095672 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7c5f3f3-7eda-4e36-95c8-19fc5d3d82d5 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1281 microversion: 2.25 time: 1.560872 Sep 01 04:52:39.099066 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 722/1449] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:37 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1281 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:39.126029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:39.126646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:39.140632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:39.141498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:39.141961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:39.142845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:39.143338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:39.143770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:39.177900 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-026d7cbd-db79-468d-a3ba-9e84611a3436 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.105393 Sep 01 04:52:39.178798 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 728/1450] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:39 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:39.189271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:39.189895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:39.206140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:39.206637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:39.207103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:39.207820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:39.208274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:39.208701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:39.230878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:39.317332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:39.325216 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba05e855-38b5-4da5-a2f2-75601b8624c5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1271 microversion: 2.1 time: 0.224314 Sep 01 04:52:39.325818 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 723/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:39 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:39.423577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:39.437709 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da4e1edb-c7e2-4dce-9680-5268791ee789 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1540 microversion: 2.1 time: 0.257675 Sep 01 04:52:39.439031 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 729/1452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:39 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1540 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:39.676336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3a4ee3df-e3ad-4e06-b32f-ceb09efa7bc5 req-a048943e-c5ce-44bc-8f4f-9203ba601cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fd3cd6-8be4-4ed5-862e-6b613c179a4f", "name": "network-vif-deleted", "tag": "fa8e93cc-a812-4ca2-9049-00fc0beaff56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:39.698431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3a4ee3df-e3ad-4e06-b32f-ceb09efa7bc5 req-a048943e-c5ce-44bc-8f4f-9203ba601cdf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:39.704676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3a4ee3df-e3ad-4e06-b32f-ceb09efa7bc5 req-a048943e-c5ce-44bc-8f4f-9203ba601cdf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:39.705303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3a4ee3df-e3ad-4e06-b32f-ceb09efa7bc5 req-a048943e-c5ce-44bc-8f4f-9203ba601cdf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:39.734427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3a4ee3df-e3ad-4e06-b32f-ceb09efa7bc5 req-a048943e-c5ce-44bc-8f4f-9203ba601cdf service nova] Creating event network-vif-deleted:fa8e93cc-a812-4ca2-9049-00fc0beaff56 for instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f on n-h1-820368-37 Sep 01 04:52:39.746945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3a4ee3df-e3ad-4e06-b32f-ceb09efa7bc5 req-a048943e-c5ce-44bc-8f4f-9203ba601cdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075889 Sep 01 04:52:39.756813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 724/1453] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:40.096997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:40.098060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:40.103106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:40.125783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:40.126481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:40.128789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=13,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:40.131926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:40.133761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:40.143627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:40.147229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:40.147717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:40.148153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:40.154051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:40.155060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:40.155715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:40.156451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:40.156911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:40.157345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:40.693020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:40.967850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:41.413028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:41.425522 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ded1daf5-4952-40a7-a70f-475d9b20df17 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.336596 Sep 01 04:52:41.426516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 730/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:40 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:41.437668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2a5aaaf-d760-45f2-89b6-38773b53a7db tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bbbb8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:41.513428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2a5aaaf-d760-45f2-89b6-38773b53a7db tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.084864 Sep 01 04:52:41.514309 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 731/1455] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:41 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:41.536044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:41.536932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:41.552942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:41.553812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:41.554385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:41.555143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:41.555800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:41.556455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:41.579367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:41.600443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:41.610600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:41.618931 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71a533e7-e7e1-43d4-987c-11d48d4fe8dc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1281 microversion: 2.25 time: 1.497136 Sep 01 04:52:41.644260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 725/1456] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:40 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1281 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:52:41.676656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:41.687885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:41.694491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:41.695022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:41.695519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:41.696264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:41.696725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:41.697153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:42.269021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:42.281769 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92762271-23b1-4183-a0b4-1afdfd03cbd2 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1252 microversion: 2.1 time: 0.636192 Sep 01 04:52:42.288123 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 726/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:41 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1252 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:42.452058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:42.453056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:42.474271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:42.475098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:42.477293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:42.480207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:42.481126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:42.483482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:43.171372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:43.184396 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14a0156e-0369-4b81-a640-9594fbc00c8d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 1.661499 Sep 01 04:52:43.185882 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 732/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:41 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:43.202092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e469c66-35cc-42a3-9979-8bf1d17c85ca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bbf7430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:43.281817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e469c66-35cc-42a3-9979-8bf1d17c85ca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.094395 Sep 01 04:52:43.285891 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 733/1459] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:43 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:43.297444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:43.298422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:43.327555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:43.336737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:43.337588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:43.338534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:43.347565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:43.355716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:43.689415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:43.712788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e85ead4-2815-4736-a66d-3726d997d77b tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.265331 Sep 01 04:52:43.716139 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 727/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:42 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:43.735058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:43.736423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:43.751712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:43.756042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:43.758234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:43.761503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:43.762976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:43.767323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:44.361700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:44.377099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:44.380812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:44.384329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d0a420e-0fd6-4a61-a002-fe73c0ced422 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1281 microversion: 2.25 time: 1.096709 Sep 01 04:52:44.401197 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 734/1461] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:43 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1281 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:44.404788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:44.420949 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ee7e977-b9f7-4484-842c-585d7877a96b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1252 microversion: 2.1 time: 0.702740 Sep 01 04:52:44.421692 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 728/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:43 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1252 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:44.431636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:44.440773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:44.462991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:44.469696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:44.470395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:44.471719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:44.479489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:44.480091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:44.638317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:44.856382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d25f9e96-0da4-430f-ac9e-e2113a70af18 req-e7f24c44-76c6-47c3-bb12-69df345a295e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3ae373-b7f4-4601-88dd-03677d4c4277", "tag": "634ec57c-6cc7-4904-a960-fc82804f80de"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:44.883043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d25f9e96-0da4-430f-ac9e-e2113a70af18 req-e7f24c44-76c6-47c3-bb12-69df345a295e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:44.896729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d25f9e96-0da4-430f-ac9e-e2113a70af18 req-e7f24c44-76c6-47c3-bb12-69df345a295e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:44.897504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d25f9e96-0da4-430f-ac9e-e2113a70af18 req-e7f24c44-76c6-47c3-bb12-69df345a295e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:44.956212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d25f9e96-0da4-430f-ac9e-e2113a70af18 req-e7f24c44-76c6-47c3-bb12-69df345a295e service nova] Creating event network-changed:634ec57c-6cc7-4904-a960-fc82804f80de for instance cf3ae373-b7f4-4601-88dd-03677d4c4277 on n-h1-820368-37 Sep 01 04:52:44.969158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d25f9e96-0da4-430f-ac9e-e2113a70af18 req-e7f24c44-76c6-47c3-bb12-69df345a295e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.566246 Sep 01 04:52:44.974168 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 735/1463] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:44.986248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58ac7249-344f-4d49-bad0-33644f4fa824 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75b943040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:45.076548 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58ac7249-344f-4d49-bad0-33644f4fa824 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.100098 Sep 01 04:52:45.077619 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 736/1464] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:44 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:45.087553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:45.093177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:45.105995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:45.106993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:45.110292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:45.111312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:45.117066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:45.117742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:45.162402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:45.178722 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a79a76b-83fb-46bb-935d-2cfe77c53cf9 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 0.755860 Sep 01 04:52:45.191473 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 729/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:44 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:45.410276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:45.411351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:45.414563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=51,nova_cell0:UPDATE=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:45.427239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:45.436694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:45.437347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:45.438263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:45.441371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:45.444481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:46.896962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:46.911777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:46.921697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:46.923139 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7dace0fa-7fa8-4c6b-9998-fd7080530c62 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1281 microversion: 2.25 time: 1.518314 Sep 01 04:52:46.926967 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 730/1466] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:45 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1281 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:46.943837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:46.944919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:46.951933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:46.953944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:46.954566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:46.957109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:46.957612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:46.957931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:46.958371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:46.977215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13f7b1e3-eedf-4a2d-8c11-9d5d4adf4824 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.898428 Sep 01 04:52:46.978307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 737/1467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:45 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:46.983360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-02fd8889-a416-4ad3-ae41-3dba32787b93 req-13ca8585-7e4b-4ddf-a69d-006d01565dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5943be74-63b0-4bf2-9b9f-c9a37ff00ec1", "name": "network-vif-plugged", "status": "completed", "tag": "ff13fb50-fd09-4168-93e1-118e18ff8dde"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:47.010528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02fd8889-a416-4ad3-ae41-3dba32787b93 req-13ca8585-7e4b-4ddf-a69d-006d01565dbb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:47.013570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02fd8889-a416-4ad3-ae41-3dba32787b93 req-13ca8585-7e4b-4ddf-a69d-006d01565dbb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:47.016123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02fd8889-a416-4ad3-ae41-3dba32787b93 req-13ca8585-7e4b-4ddf-a69d-006d01565dbb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:47.055853 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-02fd8889-a416-4ad3-ae41-3dba32787b93 req-13ca8585-7e4b-4ddf-a69d-006d01565dbb service nova] Creating event network-vif-plugged:ff13fb50-fd09-4168-93e1-118e18ff8dde for instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 on n-h1-820368-37 Sep 01 04:52:47.079782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-02fd8889-a416-4ad3-ae41-3dba32787b93 req-13ca8585-7e4b-4ddf-a69d-006d01565dbb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095050 Sep 01 04:52:47.096002 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 738/1468] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:47.140124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43110c34-2bfb-4393-8964-4266d1167aeb tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75ba8fb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:47.297496 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43110c34-2bfb-4393-8964-4266d1167aeb tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.195518 Sep 01 04:52:47.298296 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 739/1469] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:47 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:47.315961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:47.318866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:47.333491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:47.342866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:47.346826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:47.347929 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-290ac9d3-916b-4070-aee9-cb67a7015566 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1252 microversion: 2.1 time: 0.419749 Sep 01 04:52:47.348531 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 731/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:46 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1252 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:47.349739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:47.352230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:47.353031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:47.354074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:47.385325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5a6aaec0-e15b-48f4-b8b5-ada1295b51a0 req-079b544e-f91f-4abd-9546-ff4aed1a3192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:47.410541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a6aaec0-e15b-48f4-b8b5-ada1295b51a0 req-079b544e-f91f-4abd-9546-ff4aed1a3192 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:47.411070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a6aaec0-e15b-48f4-b8b5-ada1295b51a0 req-079b544e-f91f-4abd-9546-ff4aed1a3192 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:47.411487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a6aaec0-e15b-48f4-b8b5-ada1295b51a0 req-079b544e-f91f-4abd-9546-ff4aed1a3192 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:47.437639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5a6aaec0-e15b-48f4-b8b5-ada1295b51a0 req-079b544e-f91f-4abd-9546-ff4aed1a3192 service nova] Creating event network-changed:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:52:47.456580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5a6aaec0-e15b-48f4-b8b5-ada1295b51a0 req-079b544e-f91f-4abd-9546-ff4aed1a3192 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088516 Sep 01 04:52:47.457948 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 732/1471] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:47.952439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:47.953995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:47.969085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:47.970197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:47.970984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:47.975543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:47.976530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:47.977239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:48.781281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:48.791247 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-742210e1-e7da-4888-b628-33c256e0785c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 1.489031 Sep 01 04:52:48.808987 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 740/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:47 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:48.818227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:48.818666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:48.830566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:48.839445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:48.841007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:48.842576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68f3da7d-983b-4a19-8692-7cbb19fa5b0c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1281 microversion: 2.25 time: 0.896816 Sep 01 04:52:48.866613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:48.867130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:48.867556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:48.868287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:48.868733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:48.869151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:48.876342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 733/1473] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:47 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1281 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:48.889639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9cb34d34-392b-4a16-b165-aca34fb63a35 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcb28b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:49.050596 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9cb34d34-392b-4a16-b165-aca34fb63a35 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.173008 Sep 01 04:52:49.051296 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 734/1474] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:48 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:49.063072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:49.063685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:49.098314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:49.104023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:49.108695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:49.112347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:49.116635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:49.118570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:49.356747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:49.372078 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a568e63c-361a-4cd7-957a-9f96db061aeb tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1252 microversion: 2.1 time: 0.319747 Sep 01 04:52:49.375673 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 735/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:49 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1252 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:49.502299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b6a8ed7f-6e6f-4feb-ac7a-66460822738c req-500f93d9-d14b-4dca-a1d9-cb6c8cca3bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879949bf-a2ab-40d8-b151-cdefadb6b7c2", "name": "network-vif-plugged", "status": "completed", "tag": "dbc3efe1-bf2f-4583-98e6-f0539646605d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:49.521803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b6a8ed7f-6e6f-4feb-ac7a-66460822738c req-500f93d9-d14b-4dca-a1d9-cb6c8cca3bae service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:49.522591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b6a8ed7f-6e6f-4feb-ac7a-66460822738c req-500f93d9-d14b-4dca-a1d9-cb6c8cca3bae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:49.523250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b6a8ed7f-6e6f-4feb-ac7a-66460822738c req-500f93d9-d14b-4dca-a1d9-cb6c8cca3bae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:49.538011 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b6a8ed7f-6e6f-4feb-ac7a-66460822738c req-500f93d9-d14b-4dca-a1d9-cb6c8cca3bae service nova] Creating event network-vif-plugged:dbc3efe1-bf2f-4583-98e6-f0539646605d for instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 on n-h2-820368-37 Sep 01 04:52:49.544565 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b6a8ed7f-6e6f-4feb-ac7a-66460822738c req-500f93d9-d14b-4dca-a1d9-cb6c8cca3bae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048121 Sep 01 04:52:49.546813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 736/1476] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:49.820305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:49.821680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:49.835769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:49.838569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:49.839242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:49.840814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:49.845948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:49.846848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:49.930750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:52:50.330759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:50.352319 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c56aafd0-ed61-4f5e-aff2-4017d641ee76 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.550549 Sep 01 04:52:50.353774 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 741/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:48 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:50.364321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:50.371203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:50.395630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:50.397917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:50.398433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:50.400553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:50.403560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:50.404327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:50.818280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:50.841129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f898f56-8931-4da7-bbed-3728114dde98 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 1.027712 Sep 01 04:52:50.842953 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 737/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:49 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:50.852096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef73b17b-f289-4f0a-a726-0a4890cf34a2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd998b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:50.980000 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef73b17b-f289-4f0a-a726-0a4890cf34a2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.116216 Sep 01 04:52:50.982013 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 738/1479] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:50 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:51.014876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:51.015546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:51.040579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:51.049421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:51.049968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:51.050727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:51.054446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:51.055015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:51.158274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:51.173928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:51.179529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:51.192927 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac0a0e0a-aa0a-406e-9566-2b25b68fd586 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1478 microversion: 2.25 time: 0.834261 Sep 01 04:52:51.193570 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 742/1480] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:50 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1478 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:51.219471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:51.220231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:51.222719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:51.226531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lazy-loading 'fault' on Instance uuid 20fd3cd6-8be4-4ed5-862e-6b613c179a4f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:52:51.386303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b306ffc96ba4bb4a7d631f19d43072b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d249f0206964985b5f6ebd59e1e7269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:51.405353 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20b9a8db-3f24-4514-9266-5e975c00a27b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 200 len: 1257 microversion: 2.1 time: 0.419620 Sep 01 04:52:51.410522 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 739/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:50 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 1257 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:51.440763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:51.443555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:51.489091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:51.491294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:51.493464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:51.498622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:51.502526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:51.505738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:51.934647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:51.934647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:51.987965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:51.990785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:51.991925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:52.026202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:52.028468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:52.031685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:52.822552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:52.834322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a73aa5ed-d827-4d64-bd80-795929251b54 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.420659 Sep 01 04:52:52.839202 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 740/1482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:51 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:52.849797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4dd84646-f623-4016-b978-49e4afeb87cf req-8d8efab7-6583-4e0b-97ff-c4f15a4b5023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879949bf-a2ab-40d8-b151-cdefadb6b7c2", "name": "network-vif-plugged", "status": "completed", "tag": "e6412782-87af-4eb9-80c5-037e1fa79bc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:52.880585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:52:52.884041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4dd84646-f623-4016-b978-49e4afeb87cf req-8d8efab7-6583-4e0b-97ff-c4f15a4b5023 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:52.892599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4dd84646-f623-4016-b978-49e4afeb87cf req-8d8efab7-6583-4e0b-97ff-c4f15a4b5023 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:52.893667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4dd84646-f623-4016-b978-49e4afeb87cf req-8d8efab7-6583-4e0b-97ff-c4f15a4b5023 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:52.932117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4dd84646-f623-4016-b978-49e4afeb87cf req-8d8efab7-6583-4e0b-97ff-c4f15a4b5023 service nova] Creating event network-vif-plugged:e6412782-87af-4eb9-80c5-037e1fa79bc3 for instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 on n-h2-820368-37 Sep 01 04:52:52.934690 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b075a456-a46f-49fc-805a-799592a6697e tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1973 microversion: 2.25 time: 1.719112 Sep 01 04:52:52.940644 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 743/1483] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:51 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1973 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:52.955843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:52.956545 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4dd84646-f623-4016-b978-49e4afeb87cf req-8d8efab7-6583-4e0b-97ff-c4f15a4b5023 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113147 Sep 01 04:52:52.957920 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 741/1484] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:52.963021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:52.978486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7ed248a-6c84-4249-9729-c5ef6727e8ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcb24c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:52.982392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:52.992650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:52.994142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:52.996103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:52.998690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:52.999510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:53.124002 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7ed248a-6c84-4249-9729-c5ef6727e8ad tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.161517 Sep 01 04:52:53.125547 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 742/1485] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:52 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:53.149220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:53.154315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] [instance: 20fd3cd6-8be4-4ed5-862e-6b613c179a4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:53.176166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:53.176672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:53.177117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:53.183412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:53.184251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:53.184891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:53.220239 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] HTTP exception thrown: Instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f could not be found. Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Request method failure captured: Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f HTTP/1.1 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDogyrAS4mmZRr9TTyhI_HLJND7hvGMy5ga6qmJgxIdxFIAN-qyF_QKMyxLntyfesQkqYhBmKX8OHekXnIMUOWBTgUE0id40mhbFO0uq2fwbZff2BkYjPJDI_N9G0BLpuC1uW6VN2FfOiK8aa7y3jjG5LgvJOggbSqHlF6EBjJunlUY Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5d249f0206964985b5f6ebd59e1e7269 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestBootFromVolume-234883765 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5d249f0206964985b5f6ebd59e1e7269"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5d249f0206964985b5f6ebd59e1e7269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5d249f0206964985b5f6ebd59e1e7269"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5d249f0206964985b5f6ebd59e1e7269"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestBootFromVolume-234883765 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5d249f0206964985b5f6ebd59e1e7269 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestBootFromVolume-234883765 Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestBootFromVolume-234883765-project Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 1b306ffc96ba4bb4a7d631f19d43072b Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestBootFromVolume-234883765-project Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f could not be found. Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '20fd3cd6-8be4-4ed5-862e-6b613c179a4f'} Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f could not be found. Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f could not be found. Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:52:53.222328 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f could not be found. Sep 01 04:52:53.227926 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:52:53.231874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Returning 404 to user: Instance 20fd3cd6-8be4-4ed5-862e-6b613c179a4f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:52:53.236180 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a2e8acb-2cac-4e71-9b05-db898ab9399b tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f" status: 404 len: 111 microversion: 2.1 time: 0.109566 Sep 01 04:52:53.237376 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 743/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:53 2022] GET /compute/v2.1/servers/20fd3cd6-8be4-4ed5-862e-6b613c179a4f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:52:53.245534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:53.250088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:53.265182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:53.265697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:53.266135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:53.266865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:53.282755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:53.283483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:53.892768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:53.907941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4542ac7-c89e-45d8-b7b0-cfe58d39f4aa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 0.965748 Sep 01 04:52:53.926028 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 744/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:52 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:53.948570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:52:53.959677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8030405-2c02-4021-9bb4-9cccb01afc11 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] Calling method '.version_select at 0x7fa75bbbbdc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:54.010805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebad4d34-ffa7-4558-89db-8a838866a3e9 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1973 microversion: 2.25 time: 0.772033 Sep 01 04:52:54.033176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 744/1488] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:53 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1973 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:52:54.042743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:54.042743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:54.053660 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8030405-2c02-4021-9bb4-9cccb01afc11 tempest-ServersTestBootFromVolume-234883765 tempest-ServersTestBootFromVolume-234883765-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663476022" status: 202 len: 0 microversion: 2.1 time: 0.124198 Sep 01 04:52:54.054363 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 745/1489] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:52:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663476022 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:52:54.064511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:54.073576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:54.077415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:54.077912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:54.078317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:54.078772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:54.080977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:54.081459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:54.081895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:54.084387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:54.085212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:54.085683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:54.086109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:54.199478 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ddd2e4e-e36d-4923-8ac0-29b42f660213 tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.140641 Sep 01 04:52:54.208902 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 746/1490] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Sep 1 04:52:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:52:54.226983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eab45891-2c4f-4c3e-bad1-e73eb020ae98 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bc62e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:54.328518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eab45891-2c4f-4c3e-bad1-e73eb020ae98 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.118262 Sep 01 04:52:54.329118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 747/1491] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:54 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:54.343239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-37", "block_migration": "auto"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:54.348122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:54.368949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:54.369466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:54.372422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:54.375127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:54.378464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:54.381659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:54.479433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'flavor' on Instance uuid 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:52:54.503287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Going to try to live migrate instance to n-h2-820368-37 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:52:55.206688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:55.225324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f31c7fa3-8304-4f8b-a1b6-b69868cbb7cc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1334 microversion: 2.1 time: 1.200441 Sep 01 04:52:55.226682 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 745/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:54 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1334 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:55.238451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:55.240152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:55.253636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:55.256721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:55.259430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:55.260731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:55.261447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:55.265108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:55.671317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:55.679979 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9683e305-a13e-49e0-9cb9-77b35d75a39f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 0.451923 Sep 01 04:52:55.687302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 746/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:55 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:55.707295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-683a85cb-a16c-4d19-922c-a703cdef6c51 req-680f6acd-4001-4466-8e58-fb3897fcdf04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3ae373-b7f4-4601-88dd-03677d4c4277", "name": "network-vif-plugged", "status": "completed", "tag": "634ec57c-6cc7-4904-a960-fc82804f80de"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:55.733851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-683a85cb-a16c-4d19-922c-a703cdef6c51 req-680f6acd-4001-4466-8e58-fb3897fcdf04 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:55.740475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-683a85cb-a16c-4d19-922c-a703cdef6c51 req-680f6acd-4001-4466-8e58-fb3897fcdf04 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:55.741316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-683a85cb-a16c-4d19-922c-a703cdef6c51 req-680f6acd-4001-4466-8e58-fb3897fcdf04 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:55.761652 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-683a85cb-a16c-4d19-922c-a703cdef6c51 req-680f6acd-4001-4466-8e58-fb3897fcdf04 service nova] Creating event network-vif-plugged:634ec57c-6cc7-4904-a960-fc82804f80de for instance cf3ae373-b7f4-4601-88dd-03677d4c4277 on n-h1-820368-37 Sep 01 04:52:55.771100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-683a85cb-a16c-4d19-922c-a703cdef6c51 req-680f6acd-4001-4466-8e58-fb3897fcdf04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080720 Sep 01 04:52:55.773781 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 747/1494] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:55.816307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96aa09f4-8f0b-4cb8-93da-ecb6c445297b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd7e280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:55.989651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96aa09f4-8f0b-4cb8-93da-ecb6c445297b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.214404 Sep 01 04:52:55.991900 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 748/1495] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:55 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:56.247738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:56.249448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:56.270163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:56.271739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:56.272216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:56.272987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:56.277327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:56.278180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:56.690715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:56.701888 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbe04427-183e-4d77-85de-80cd79026c1d tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1670 microversion: 2.1 time: 0.455376 Sep 01 04:52:56.705925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 749/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:56 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1670 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:52:56.719621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:56.727071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:56.753798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:56.754294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:56.757456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:56.758557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:56.760277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:56.760929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:57.087306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:57.096810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-011aece6-1f0f-4311-ba71-45d3c2c8ca64 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1313 microversion: 2.1 time: 0.389017 Sep 01 04:52:57.098452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 750/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:56 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:57.105492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:57.111684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:57.124935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:57.133526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:57.135531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:57.136507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:57.141043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:57.141660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:57.184642 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e78c397-d26c-4d41-b2e6-98bc90ee3561 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2/ips" status: 200 len: 180 microversion: 2.1 time: 0.084131 Sep 01 04:52:57.186685 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 751/1498] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 04:52:57 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2/ips => generated 180 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:57.194292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23b66553-1a04-4346-a601-7635b901b1df tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd68ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:57.267577 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23b66553-1a04-4346-a601-7635b901b1df tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.079418 Sep 01 04:52:57.268670 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 752/1499] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:57 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:57.279521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:57.280033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:57.297852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:57.307576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:57.308361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:57.309168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:57.309654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:57.310595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:57.433291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:52:57.665953 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c35a512d-a5eb-429f-98bd-62eb970309f8 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "DELETE /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 204 len: 0 microversion: 2.1 time: 0.395972 Sep 01 04:52:57.666773 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 753/1500] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:52:57 2022] DELETE /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:52:57.680912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:57.681339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:57.696145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:57.696547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:57.696975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:57.697677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:57.698124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:57.698542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:58.068206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:58.085830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33f9c40d-17cd-41cd-a815-d7675b635b8f tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1676 microversion: 2.1 time: 0.403655 Sep 01 04:52:58.100991 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 754/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:57 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1676 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:58.120154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:58.121049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:58.132935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:58.135933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:58.136478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:58.137229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:58.137682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:58.140364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:58.682740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:58.715046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-648da9e7-4220-491e-823a-c4d377a168cc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1462 microversion: 2.1 time: 0.600237 Sep 01 04:52:58.716019 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 755/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:58 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1462 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:58.723053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fcf508d-f538-4244-9ecd-2370d66f728e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd7eaf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:58.809682 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fcf508d-f538-4244-9ecd-2370d66f728e tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.090224 Sep 01 04:52:58.826612 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 756/1503] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:52:58 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:58.838575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:58.839685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:58.859364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:58.860094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:58.860688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:58.861566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:58.862662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:58.863305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:59.683601 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c638fa9-48f6-4bce-84b0-670c19d6126d tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1/action" status: 202 len: 0 microversion: 2.25 time: 5.353216 Sep 01 04:52:59.685511 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 748/1504] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 04:52:54 2022] POST /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1/action => generated 0 bytes in 5356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:52:59.691658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:59.692568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:59.711624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:59.712647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:59.713349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:59.714904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:59.717782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:59.719946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:59.756842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:52:59.776352 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3e618d4-cc67-472b-931c-f2ef67636dc7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1313 microversion: 2.1 time: 0.943982 Sep 01 04:52:59.788015 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 757/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:58 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1313 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:52:59.793212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f237f054-a5d6-43f6-84c4-9d3b463a4eb4 req-a77a4c11-6406-43b1-8537-7e82caae4db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "name": "network-vif-plugged", "status": "completed", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:52:59.836399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f237f054-a5d6-43f6-84c4-9d3b463a4eb4 req-a77a4c11-6406-43b1-8537-7e82caae4db3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:59.838093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f237f054-a5d6-43f6-84c4-9d3b463a4eb4 req-a77a4c11-6406-43b1-8537-7e82caae4db3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:59.838713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f237f054-a5d6-43f6-84c4-9d3b463a4eb4 req-a77a4c11-6406-43b1-8537-7e82caae4db3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:59.872562 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f237f054-a5d6-43f6-84c4-9d3b463a4eb4 req-a77a4c11-6406-43b1-8537-7e82caae4db3 service nova] Creating event network-vif-plugged:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:52:59.880877 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f237f054-a5d6-43f6-84c4-9d3b463a4eb4 req-a77a4c11-6406-43b1-8537-7e82caae4db3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091254 Sep 01 04:52:59.916341 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 758/1506] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:52:59.932940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:52:59.934874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:52:59.960150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:59.961025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:59.984126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:52:59.985382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:52:59.986039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:52:59.989049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:01.075729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:01.080874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:01.081850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:01.096152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:01.098064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:01.104409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb0dabe1-e76e-40ab-a06c-cd0cc3d4345a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 1.179575 Sep 01 04:53:01.105279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 759/1507] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:52:59 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:01.121363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4da30837-ae4f-430f-8d2e-75b144dc033f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd998b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:01.122090 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6436187-6a02-44bd-8b97-81738dd3c336 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1676 microversion: 2.1 time: 1.434857 Sep 01 04:53:01.123378 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 749/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:52:59 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1676 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:01.132642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:01.136077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:01.162934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:01.174578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:01.177256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:01.178410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:01.178915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:01.179446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:01.221494 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4da30837-ae4f-430f-8d2e-75b144dc033f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1438 microversion: 2.1 time: 0.111214 Sep 01 04:53:01.230119 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 760/1509] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:53:01 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:01.737540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:01.754348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8582a99f-4cca-4a50-97be-2ef719b931f7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1313 microversion: 2.1 time: 0.629788 Sep 01 04:53:01.755013 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 750/1510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:01 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:01.845421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1056029007", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "69e5544e-9033-464c-9a3d-38ff2a1272c2"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:02.023923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] validate_networks() for [('69e5544e-9033-464c-9a3d-38ff2a1272c2', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:53:02.152924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-950d9866-2194-4f98-a637-14f42cb6a631 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75b961790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-89206559", "description": "tempest-description-1614628341"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:03.791324 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-950d9866-2194-4f98-a637-14f42cb6a631 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.706472 Sep 01 04:53:03.801426 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 751/1511] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:02 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:03.807902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:03.808513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:03.829280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:03.830015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:03.830667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:03.831913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:03.841466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:03.842623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:03.871417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:04.136382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:04.162778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:53:04.163373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:53:04.163701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:53:04.164105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:53:04.164515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:53:04.180832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.181315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.182125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:04.183486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.184479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.185192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:04.217712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Getting quotas for project 61f9dee0603e4800be75797947f403b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:53:04.225554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Getting quotas for user ffc188d31a6843e89254e2886baf0a0b and project 61f9dee0603e4800be75797947f403b9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:53:04.251690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:53:04.254811 n-d-820368-37 devstack@n-api.service[128863]: WARNING nova.utils [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1056029007 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-105602900 Sep 01 04:53:04.255854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:53:04.324952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:04.330501 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9922da9-00a5-494e-833e-9f1c0fac52a3 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.565400 Sep 01 04:53:04.331380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 761/1512] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:53:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:53:04.336518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:04.337554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:04.341180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:04.345032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:04.347128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df31fa78-f726-44b8-8367-57c2ab4aabb2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.543373 Sep 01 04:53:04.348532 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 752/1513] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:03 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:04.356271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.357378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.358144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:04.361746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.362564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.365225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92a7cbdf-302c-458e-ac2b-15616181036c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bbec310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:04.375173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:04.483172 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92a7cbdf-302c-458e-ac2b-15616181036c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1447 microversion: 2.1 time: 0.130712 Sep 01 04:53:04.483956 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 753/1514] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:53:04 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:04.498132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-90a6ebc7-2952-4c3d-a7fe-eb4a7dc43276 req-0663a6df-6cfd-43cc-9674-da2d5ecfcfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879949bf-a2ab-40d8-b151-cdefadb6b7c2", "name": "network-vif-deleted", "tag": "e6412782-87af-4eb9-80c5-037e1fa79bc3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:04.531813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-90a6ebc7-2952-4c3d-a7fe-eb4a7dc43276 req-0663a6df-6cfd-43cc-9674-da2d5ecfcfac service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.532529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-90a6ebc7-2952-4c3d-a7fe-eb4a7dc43276 req-0663a6df-6cfd-43cc-9674-da2d5ecfcfac service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.535934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-90a6ebc7-2952-4c3d-a7fe-eb4a7dc43276 req-0663a6df-6cfd-43cc-9674-da2d5ecfcfac service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:04.567372 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-90a6ebc7-2952-4c3d-a7fe-eb4a7dc43276 req-0663a6df-6cfd-43cc-9674-da2d5ecfcfac service nova] Creating event network-vif-deleted:e6412782-87af-4eb9-80c5-037e1fa79bc3 for instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 on n-h2-820368-37 Sep 01 04:53:04.574966 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-90a6ebc7-2952-4c3d-a7fe-eb4a7dc43276 req-0663a6df-6cfd-43cc-9674-da2d5ecfcfac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086058 Sep 01 04:53:04.577145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 754/1515] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:04.589074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:04.590226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:04.599974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.603189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.603891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:04.605040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:04.606487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:04.606974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:05.237773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:05.250682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e966717-bb85-4e18-b62a-ef79871674dc tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1461 microversion: 2.1 time: 0.670693 Sep 01 04:53:05.254382 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 755/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:04 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1461 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:05.265454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c2fb280fa41c4a65417e35b2e53c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b08a156c194615b51ba116446334d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:05.273020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-208de738-eaa3-499c-ae3d-edd5796272f1 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bcbc430>, body: {"security_group_rule": {"parent_group_id": "09c1f5d9-0204-427e-8e07-08b433ca10fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:05.283622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c00704c-8977-443f-99d2-53129881b545 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 200 len: 1655 microversion: 2.1 time: 0.951032 Sep 01 04:53:05.296240 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 762/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:04 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 1655 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:05.315310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44442610-ee4d-4e11-9980-245ec397a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:05.315991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44442610-ee4d-4e11-9980-245ec397a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:05.414950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44442610-ee4d-4e11-9980-245ec397a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:05.427922 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44442610-ee4d-4e11-9980-245ec397a3c4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1232 microversion: 2.1 time: 0.122404 Sep 01 04:53:05.428881 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 763/1518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:05 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1232 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:05.433601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a734ff8e-76e4-4516-a7ab-abe49a93e748 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd99b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:05.527233 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a734ff8e-76e4-4516-a7ab-abe49a93e748 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 200 len: 1447 microversion: 2.1 time: 0.097181 Sep 01 04:53:05.527901 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 764/1519] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:53:05 2022] GET /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:05.534793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:05.536109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:05.545318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:05.546319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:05.547074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:05.548129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:05.548830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:05.549621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:06.013463 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-208de738-eaa3-499c-ae3d-edd5796272f1 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.757796 Sep 01 04:53:06.014556 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 756/1520] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:53:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:06.032210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1589741414", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0c6ec29e-34ea-4c49-935d-463a602a9d4c"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:06.033786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:06.055254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:06.057503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:06.063051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f4df65a-2f17-4dc0-9a27-027477b74cf9 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.531023 Sep 01 04:53:06.079900 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 765/1521] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:05 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:06.099214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aaaec770-f191-48b9-8ef1-5c00233fad24 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd0b790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:06.139293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:53:06.706186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:53:06.707565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:53:06.708758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:53:06.709433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:53:06.709914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:53:06.723003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:06.723608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:06.724067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:06.725579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:06.726073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:06.726507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:06.749976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Getting quotas for project f54577a158c74f57819ef92429fbda99. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:53:06.756854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Getting quotas for user 9db030290d94441abeba1f5c11690005 and project f54577a158c74f57819ef92429fbda99. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:53:06.774411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:53:06.777157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:53:06.881410 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb287b73-a8c8-4555-9325-18c40e56ea72 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862570 Sep 01 04:53:06.884015 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 757/1522] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:53:06.902683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-461b32d8-6b08-4fdc-a8a6-ef128e8fe4fe tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bc41820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-790884677", "description": "tempest-description-978878935"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:07.446127 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aaaec770-f191-48b9-8ef1-5c00233fad24 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 204 len: 0 microversion: 2.1 time: 1.362531 Sep 01 04:53:07.448146 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 766/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:06 2022] DELETE /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 0 bytes in 1366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:53:07.457286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:07.458804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:07.468998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.472312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.473269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.474421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.475096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.475524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.513122 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] HTTP exception thrown: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Request method failure captured: Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 HTTP/1.1 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDozn53jmtn_HGSry5zjXjHTKXsImN_j9WyyPygTXyX6lGl3nRjr_7KYnDFX3ck-2LoOhUpYWb4qoH0VYA2flE2blsjAKqMijX1E6eIEFbtdV0XzSnujyOEGZr2MrXfNRW2JNK_3H4Vu2SqcdtARiwUygemTPglMkm4qV0BlMS8aBB0 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9b08a156c194615b51ba116446334d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9b08a156c194615b51ba116446334d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 1c0c2fb280fa41c4a65417e35b2e53c1 Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '879949bf-a2ab-40d8-b151-cdefadb6b7c2'} Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:07.519317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:07.526327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Returning 404 to user: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:07.529583 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e82a0670-e5f5-450c-8abe-ce86709675dc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 404 len: 111 microversion: 2.1 time: 0.079390 Sep 01 04:53:07.530899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 767/1524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:07 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:07.536788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:07.539623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:07.549719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.551159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.551659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.552687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.554368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.555610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.788097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:07.801791 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afffe6df-0f41-4c0f-a512-34b9e8a75a7f tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1290 microversion: 2.1 time: 0.269493 Sep 01 04:53:07.803178 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 768/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:07 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1290 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:07.808800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ad1541dd-c064-4ccc-ac4c-9d2c961d0826 req-cdc6bfa9-cedb-406c-9ca1-5709aba7f107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879949bf-a2ab-40d8-b151-cdefadb6b7c2", "name": "network-vif-deleted", "tag": "dbc3efe1-bf2f-4583-98e6-f0539646605d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:07.838631 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-461b32d8-6b08-4fdc-a8a6-ef128e8fe4fe tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.950939 Sep 01 04:53:07.849028 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 758/1526] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:06 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:07.854803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:07.857839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:07.868368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ad1541dd-c064-4ccc-ac4c-9d2c961d0826 req-cdc6bfa9-cedb-406c-9ca1-5709aba7f107 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.871387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ad1541dd-c064-4ccc-ac4c-9d2c961d0826 req-cdc6bfa9-cedb-406c-9ca1-5709aba7f107 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.876260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ad1541dd-c064-4ccc-ac4c-9d2c961d0826 req-cdc6bfa9-cedb-406c-9ca1-5709aba7f107 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.885911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.887943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.888781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.892585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:07.893457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:07.911152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:07.930715 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ad1541dd-c064-4ccc-ac4c-9d2c961d0826 req-cdc6bfa9-cedb-406c-9ca1-5709aba7f107 service nova] Creating event network-vif-deleted:dbc3efe1-bf2f-4583-98e6-f0539646605d for instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 on n-h2-820368-37 Sep 01 04:53:07.949101 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ad1541dd-c064-4ccc-ac4c-9d2c961d0826 req-cdc6bfa9-cedb-406c-9ca1-5709aba7f107 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140651 Sep 01 04:53:07.949795 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 769/1527] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:07.977129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:07.978807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:07.997343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:08.004865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:08.006289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:08.007941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:08.017062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:08.018592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:08.068757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:08.083047 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9cafaeb-db3b-4ebc-b613-1753c9a03364 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1218 microversion: 2.1 time: 0.232403 Sep 01 04:53:08.090723 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 759/1528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:07 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:08.099205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:08.112330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:08.130451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:08.133613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:08.134580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:08.135597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:08.136295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:08.137047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:08.271372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:53:08.421444 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b053e86a-3002-4beb-b8cf-32295f4e6103 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 204 len: 0 microversion: 2.1 time: 0.328600 Sep 01 04:53:08.422382 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 760/1529] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:08 2022] DELETE /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:53:08.427965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-82e4e4ff-0551-427e-83fd-fcef43c5a2db req-668594d5-5b66-401e-93b7-24fe9b9b696a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d112d-4c29-4c33-81b5-e1a1c223d95d", "name": "network-vif-unplugged", "status": "completed", "tag": "d436f69c-c3c5-4e3b-8dfd-2089edfba365"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:08.450992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-82e4e4ff-0551-427e-83fd-fcef43c5a2db req-668594d5-5b66-401e-93b7-24fe9b9b696a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:08.459537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-82e4e4ff-0551-427e-83fd-fcef43c5a2db req-668594d5-5b66-401e-93b7-24fe9b9b696a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:08.460212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-82e4e4ff-0551-427e-83fd-fcef43c5a2db req-668594d5-5b66-401e-93b7-24fe9b9b696a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:08.499101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-82e4e4ff-0551-427e-83fd-fcef43c5a2db req-668594d5-5b66-401e-93b7-24fe9b9b696a service nova] Creating event network-vif-unplugged:d436f69c-c3c5-4e3b-8dfd-2089edfba365 for instance e42d112d-4c29-4c33-81b5-e1a1c223d95d on n-h1-820368-37 Sep 01 04:53:08.505777 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-82e4e4ff-0551-427e-83fd-fcef43c5a2db req-668594d5-5b66-401e-93b7-24fe9b9b696a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081728 Sep 01 04:53:08.506824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 761/1530] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:08.525946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-542d1d65-900a-4c8a-a0cd-1947b1aa3ff5 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75b961670>, body: {"security_group_rule": {"parent_group_id": "1b6f3832-2075-461a-a156-91871f892ba7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:09.144461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:09.157904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:09.159431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:09.161003 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9d1af6b-dd00-42ae-b457-000363d1d72d tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 1.204721 Sep 01 04:53:09.165471 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 770/1531] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:07 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:09.175513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-979929585", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d85331bd-fb06-4841-92d7-0758031f2664"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:09.310551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] validate_networks() for [('d85331bd-fb06-4841-92d7-0758031f2664', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:53:10.470794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-542d1d65-900a-4c8a-a0cd-1947b1aa3ff5 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.962393 Sep 01 04:53:10.472148 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 762/1532] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:53:08 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:10.477216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:10.478254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:10.493750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:10.498628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:10.499419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:10.500034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:10.500954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:10.502465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:10.503134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:10.711724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:10.722682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93563d47-e565-4468-b22b-19cade02fbc5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1290 microversion: 2.1 time: 0.249232 Sep 01 04:53:10.724078 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 763/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:10 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1290 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:10.739441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:10.740477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:10.750439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:10.751232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:10.752317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:10.753296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:10.753930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:10.754549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:10.896953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:10.905704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a43e020-2b92-4adb-855a-a69b4708be5d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1272 microversion: 2.1 time: 0.180295 Sep 01 04:53:10.919381 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 764/1534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:10 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:10.925129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:10.926055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:10.932225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:10.932999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:10.933633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:10.934545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:10.935364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:10.936063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:11.274208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:53:11.275463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:53:11.276767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:53:11.277396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:53:11.280431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:53:11.283438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:11.325486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:11.326709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:11.327391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:11.328515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:11.329426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:11.330087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:11.354535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:53:11.361360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Getting quotas for user fcfdd4deb06b413d9585d204bd614e06 and project b8dc46fa344b42ee9597ecfe34672366. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:53:11.379425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:53:11.408004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:53:11.501408 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-090e533a-5c58-46fe-a02f-e7428285b65b tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.334783 Sep 01 04:53:11.502194 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 771/1535] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:53:11.508241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c75a745-f3dd-4494-ab18-3ec37d768578 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bd68ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-402934034", "description": "tempest-description-561213581"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:12.226386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:12.236976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:12.252880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:12.254648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-520b46dd-0049-4107-91ee-52a030b003e7 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 1.333777 Sep 01 04:53:12.255438 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 765/1536] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:10 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:12.274788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-195e52b1-0ebf-4bc6-b991-bed4bc4b150c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:12.275620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-195e52b1-0ebf-4bc6-b991-bed4bc4b150c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:12.315400 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c75a745-f3dd-4494-ab18-3ec37d768578 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.811033 Sep 01 04:53:12.316692 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 772/1537] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:11 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:12.322452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:12.323757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:12.338596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:12.342045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:12.342872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:12.345622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:12.349049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:12.355150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:12.431586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-195e52b1-0ebf-4bc6-b991-bed4bc4b150c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:12.440596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-195e52b1-0ebf-4bc6-b991-bed4bc4b150c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1207 microversion: 2.1 time: 0.183712 Sep 01 04:53:12.453602 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 766/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:12 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1207 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:12.465923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:12.471928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:12.484062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:12.484565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:12.487107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:12.487905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:12.488385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:12.488825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:13.348216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:13.362995 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7b40eea-b979-40d8-a906-ff045de8e124 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.907378 Sep 01 04:53:13.364303 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 767/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:12 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:13.370523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f4a0976-60af-4658-8786-7c52278f74f5 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bb8c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-884736614", "description": "tempest-description-167791993"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:13.492720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:13.543820 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c1450ba-fef1-4c9e-9be1-174fe1f1aa05 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 1.222827 Sep 01 04:53:13.561283 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 773/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:12 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:13.568397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-91b002cc-e126-4603-a4fc-8e07259a4579 req-6a20b9df-823c-42a1-900a-230550e4d6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d112d-4c29-4c33-81b5-e1a1c223d95d", "name": "network-vif-deleted", "tag": "d436f69c-c3c5-4e3b-8dfd-2089edfba365"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:13.584769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-91b002cc-e126-4603-a4fc-8e07259a4579 req-6a20b9df-823c-42a1-900a-230550e4d6f3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:13.588121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-91b002cc-e126-4603-a4fc-8e07259a4579 req-6a20b9df-823c-42a1-900a-230550e4d6f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:13.589163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-91b002cc-e126-4603-a4fc-8e07259a4579 req-6a20b9df-823c-42a1-900a-230550e4d6f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:13.606349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-91b002cc-e126-4603-a4fc-8e07259a4579 req-6a20b9df-823c-42a1-900a-230550e4d6f3 service nova] Creating event network-vif-deleted:d436f69c-c3c5-4e3b-8dfd-2089edfba365 for instance e42d112d-4c29-4c33-81b5-e1a1c223d95d on n-h1-820368-37 Sep 01 04:53:13.613263 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-91b002cc-e126-4603-a4fc-8e07259a4579 req-6a20b9df-823c-42a1-900a-230550e4d6f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050564 Sep 01 04:53:13.614367 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 774/1541] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:13.624197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:13.625732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:13.635025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:13.635947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:13.636628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:13.637588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:13.638451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:13.639101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:13.657230 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] HTTP exception thrown: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Request method failure captured: Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 HTTP/1.1 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDozn53jmtn_HGSry5zjXjHTKXsImN_j9WyyPygTXyX6lGl3nRjr_7KYnDFX3ck-2LoOhUpYWb4qoH0VYA2flE2blsjAKqMijX1E6eIEFbtdV0XzSnujyOEGZr2MrXfNRW2JNK_3H4Vu2SqcdtARiwUygemTPglMkm4qV0BlMS8aBB0 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9b08a156c194615b51ba116446334d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9b08a156c194615b51ba116446334d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 1c0c2fb280fa41c4a65417e35b2e53c1 Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '879949bf-a2ab-40d8-b151-cdefadb6b7c2'} Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:13.659638 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:13.666549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Returning 404 to user: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:13.668115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cb6b7dc-1ec7-4981-ad29-6cf7afab38bc tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "DELETE /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 404 len: 111 microversion: 2.1 time: 0.045995 Sep 01 04:53:13.669413 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 775/1542] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:13 2022] DELETE /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:13.674833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:13.675803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:13.683332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:13.684048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:13.684669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:13.687100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:13.687756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:13.688840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.253204 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f4a0976-60af-4658-8786-7c52278f74f5 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.886462 Sep 01 04:53:14.254964 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 768/1543] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:14.268445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:14.269682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:14.281790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:14.282717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:14.283266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.284130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:14.286772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:14.287624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.411529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:14.425008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:14.432775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:14.434221 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5335a572-0ebc-4d63-9cb7-1a8e707db510 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.763643 Sep 01 04:53:14.435377 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 776/1544] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:13 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:14.446645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:14.447560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: 879949bf-a2ab-40d8-b151-cdefadb6b7c2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:14.459808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:14.460302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:14.460732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.465976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:14.466876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:14.467534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.493032 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] HTTP exception thrown: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Request method failure captured: Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 HTTP/1.1 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDozn53jmtn_HGSry5zjXjHTKXsImN_j9WyyPygTXyX6lGl3nRjr_7KYnDFX3ck-2LoOhUpYWb4qoH0VYA2flE2blsjAKqMijX1E6eIEFbtdV0XzSnujyOEGZr2MrXfNRW2JNK_3H4Vu2SqcdtARiwUygemTPglMkm4qV0BlMS8aBB0 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9b08a156c194615b51ba116446334d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9b08a156c194615b51ba116446334d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 1c0c2fb280fa41c4a65417e35b2e53c1 Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '879949bf-a2ab-40d8-b151-cdefadb6b7c2'} Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:14.495003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Returning 404 to user: Instance 879949bf-a2ab-40d8-b151-cdefadb6b7c2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-162219aa-572d-48d7-bb21-4daba46232ad tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2" status: 404 len: 111 microversion: 2.1 time: 0.059638 Sep 01 04:53:14.501445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 777/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:14 2022] GET /compute/v2.1/servers/879949bf-a2ab-40d8-b151-cdefadb6b7c2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:14.506299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:14.506921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:14.514058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:14.514557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:14.515031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.516007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:14.516461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:14.517086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:14.530698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:14.547480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd6d359e-922b-4ff8-940c-ca1e60ff2f8d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1267 microversion: 2.1 time: 0.290939 Sep 01 04:53:14.548082 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 769/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:14 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:14.561663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4018e193-e31b-43e1-9de7-9f145ec8ff42 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75b9433a0>, body: {"security_group_rule": {"parent_group_id": "ebca26f2-331b-416f-8a59-3cd2a4130b33", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e48e4adb-3209-4b55-b083-4bd441dbe9b1"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:15.487102 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d2fc457-d709-4aa8-8ea3-5ab95d16dbe8 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1814 microversion: 2.1 time: 0.985053 Sep 01 04:53:15.489348 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 778/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:14 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1814 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:15.495377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:15.497096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:15.506261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:15.506754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:15.507237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:15.508060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:15.508544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:15.509108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:15.912432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:15.924581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c14c4036-2e75-4ff6-94b6-608bbdaf2432 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.433543 Sep 01 04:53:15.926181 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 779/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:15 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:15.932658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:15.933551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:15.954408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:15.955330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:15.956088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:15.957290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:15.958987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:15.959626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:15.984379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] HTTP exception thrown: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Request method failure captured: Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e HTTP/1.1 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDozn53jmtn_HGSry5zjXjHTKXsImN_j9WyyPygTXyX6lGl3nRjr_7KYnDFX3ck-2LoOhUpYWb4qoH0VYA2flE2blsjAKqMijX1E6eIEFbtdV0XzSnujyOEGZr2MrXfNRW2JNK_3H4Vu2SqcdtARiwUygemTPglMkm4qV0BlMS8aBB0 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9b08a156c194615b51ba116446334d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9b08a156c194615b51ba116446334d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 1c0c2fb280fa41c4a65417e35b2e53c1 Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'fed11711-4ce9-4844-809b-1b7744c93b6e'} Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:15.987472 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:15.996142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:16.000351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Returning 404 to user: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:16.003451 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf8a1760-b8f9-43d7-9537-f5325f658189 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 404 len: 111 microversion: 2.1 time: 0.074147 Sep 01 04:53:16.009517 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 780/1549] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:15 2022] DELETE /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:16.025003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:16.025996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:16.038590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.039552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.040407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.041466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.043219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.043910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.143134 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4018e193-e31b-43e1-9de7-9f145ec8ff42 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.590812 Sep 01 04:53:16.145579 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 770/1550] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:53:14 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:16.158650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:16.159824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:16.172568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.173809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.174970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.178293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.178930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.179827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.580524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:16.595149 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23c7278d-8151-4aa4-bc90-5998897c1edc tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 0.583340 Sep 01 04:53:16.615525 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 781/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:16 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:16.628298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:16.632977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.634283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.637281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.638447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.639296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.639759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:16.640218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.657465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:16.659255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:16.663336 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ebd0dc9-16ff-436c-a1a1-45a36a53ae46 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.513370 Sep 01 04:53:16.666297 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 771/1552] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:16 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:16.679700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1eba7e19-2ed6-4c25-a086-742599e280b9 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.060071 Sep 01 04:53:16.680002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:16.680540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:16.681664 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 782/1553] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:53:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:16.687933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e6fa8977-52c6-4149-a521-2aa7317814e4 req-d23797a1-9c38-4214-88ac-7ab96f058d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab707524-dfad-44d7-af09-26f0fca9ce83", "tag": "9f3a7a5f-0938-4510-95c4-a826732b173a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:16.704604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e6fa8977-52c6-4149-a521-2aa7317814e4 req-d23797a1-9c38-4214-88ac-7ab96f058d48 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.705532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e6fa8977-52c6-4149-a521-2aa7317814e4 req-d23797a1-9c38-4214-88ac-7ab96f058d48 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.706442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e6fa8977-52c6-4149-a521-2aa7317814e4 req-d23797a1-9c38-4214-88ac-7ab96f058d48 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.715222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.715720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.716484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.720511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.720997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.722795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.728145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e6fa8977-52c6-4149-a521-2aa7317814e4 req-d23797a1-9c38-4214-88ac-7ab96f058d48 service nova] Creating event network-changed:9f3a7a5f-0938-4510-95c4-a826732b173a for instance ab707524-dfad-44d7-af09-26f0fca9ce83 on n-h1-820368-37 Sep 01 04:53:16.734834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:16.737749 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e6fa8977-52c6-4149-a521-2aa7317814e4 req-d23797a1-9c38-4214-88ac-7ab96f058d48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054214 Sep 01 04:53:16.741160 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 783/1554] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:16.756914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-48bce6d1-3db4-4f9a-8c7b-6c019e3943f2 req-63369df3-8082-4c64-8336-28dc284f4160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ffff1f-649c-4947-b75d-171df891356d", "tag": "d4b994bf-9e4f-44a9-9e00-d474655b45a1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:16.771476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-48bce6d1-3db4-4f9a-8c7b-6c019e3943f2 req-63369df3-8082-4c64-8336-28dc284f4160 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.773847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-48bce6d1-3db4-4f9a-8c7b-6c019e3943f2 req-63369df3-8082-4c64-8336-28dc284f4160 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.774981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-48bce6d1-3db4-4f9a-8c7b-6c019e3943f2 req-63369df3-8082-4c64-8336-28dc284f4160 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.788244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-48bce6d1-3db4-4f9a-8c7b-6c019e3943f2 req-63369df3-8082-4c64-8336-28dc284f4160 service nova] Creating event network-changed:d4b994bf-9e4f-44a9-9e00-d474655b45a1 for instance a9ffff1f-649c-4947-b75d-171df891356d on n-h2-820368-37 Sep 01 04:53:16.793651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-48bce6d1-3db4-4f9a-8c7b-6c019e3943f2 req-63369df3-8082-4c64-8336-28dc284f4160 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042123 Sep 01 04:53:16.794425 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 784/1555] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:16.800005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:16.801075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] [instance: fed11711-4ce9-4844-809b-1b7744c93b6e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:16.809472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.810318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.811001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.813326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:16.815425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:16.815425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:16.832432 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] HTTP exception thrown: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Request method failure captured: Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e HTTP/1.1 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDozn53jmtn_HGSry5zjXjHTKXsImN_j9WyyPygTXyX6lGl3nRjr_7KYnDFX3ck-2LoOhUpYWb4qoH0VYA2flE2blsjAKqMijX1E6eIEFbtdV0XzSnujyOEGZr2MrXfNRW2JNK_3H4Vu2SqcdtARiwUygemTPglMkm4qV0BlMS8aBB0 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9b08a156c194615b51ba116446334d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9b08a156c194615b51ba116446334d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9b08a156c194615b51ba116446334d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a9b08a156c194615b51ba116446334d1 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-1067702955 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 1c0c2fb280fa41c4a65417e35b2e53c1 Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-1067702955-project Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'fed11711-4ce9-4844-809b-1b7744c93b6e'} Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:16.834535 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. Sep 01 04:53:16.842245 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:16.844767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] Returning 404 to user: Instance fed11711-4ce9-4844-809b-1b7744c93b6e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:16.845889 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e69e416-fd39-4fc8-8f79-4680cfc227a3 tempest-ServersTestMultiNic-1067702955 tempest-ServersTestMultiNic-1067702955-project] 10.222.0.26 "GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e" status: 404 len: 111 microversion: 2.1 time: 0.050212 Sep 01 04:53:16.846684 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 785/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:16 2022] GET /compute/v2.1/servers/fed11711-4ce9-4844-809b-1b7744c93b6e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:16.854257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ca66640-dd8b-455b-96c8-53187dce7dac tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bc32ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1805099079", "description": "tempest-description-2012467487"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:17.399502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:17.416026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14b34a29-8102-49f1-9902-a41601705639 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1307 microversion: 2.1 time: 0.747895 Sep 01 04:53:17.433005 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 772/1557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:16 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1307 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:17.438373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:17.445494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:17.470275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:17.471154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:17.471706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:17.472664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:17.474008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:17.474800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:17.779812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ca66640-dd8b-455b-96c8-53187dce7dac tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.930668 Sep 01 04:53:17.782060 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 786/1558] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:16 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:17.788643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:17.790638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:17.799929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:17.800793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:17.801835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:17.804637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:17.805751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:17.806571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:17.861182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:17.874336 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fecf20a-3e5e-4dc7-b783-d8d7c9407e29 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.440004 Sep 01 04:53:17.875344 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 773/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:17 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:17.888662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:17.889285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:17.906118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:17.906939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:17.907545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:17.909524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:17.910732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:17.911344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:18.309280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:18.332554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:18.336849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:18.339752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccb43d02-b2ec-4a3a-9fc5-6703b4b25486 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.463425 Sep 01 04:53:18.344466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:18.353284 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bde0e8b-ee36-451d-a2b7-a855dbce7a81 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 0.569315 Sep 01 04:53:18.354249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 774/1560] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:17 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:18.365124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 787/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:17 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:18.379636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bed21d0-0d9f-403f-ae4a-7e258f3e9e0c tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bc411f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1942155464", "description": "tempest-description-198187455"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:18.439496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:18.440637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:18.459958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:18.460714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:18.461387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:18.462438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:18.463201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:18.463947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.126834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:19.136157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43740b5d-0809-4049-b6fa-fb179b2cf4dc tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1307 microversion: 2.1 time: 0.701056 Sep 01 04:53:19.150339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 788/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:18 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1307 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:19.155990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:19.156846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:19.164671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.165373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.165841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.166502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.167160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.167581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.296353 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bed21d0-0d9f-403f-ae4a-7e258f3e9e0c tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.939275 Sep 01 04:53:19.317952 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 775/1563] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:19.343304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5baa128c-29a2-4844-bc0a-2dceded655fc req-880ad136-1dbf-486a-ba54-e907ea24ea5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9817b3f-a4c3-415b-80d2-223a97d07d36", "tag": "1f7f1217-76b5-4c96-b44a-1789c165fa1d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:19.370420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5baa128c-29a2-4844-bc0a-2dceded655fc req-880ad136-1dbf-486a-ba54-e907ea24ea5a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.371080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5baa128c-29a2-4844-bc0a-2dceded655fc req-880ad136-1dbf-486a-ba54-e907ea24ea5a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.371723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5baa128c-29a2-4844-bc0a-2dceded655fc req-880ad136-1dbf-486a-ba54-e907ea24ea5a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.396043 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5baa128c-29a2-4844-bc0a-2dceded655fc req-880ad136-1dbf-486a-ba54-e907ea24ea5a service nova] Creating event network-changed:1f7f1217-76b5-4c96-b44a-1789c165fa1d for instance e9817b3f-a4c3-415b-80d2-223a97d07d36 on n-h2-820368-37 Sep 01 04:53:19.411667 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5baa128c-29a2-4844-bc0a-2dceded655fc req-880ad136-1dbf-486a-ba54-e907ea24ea5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090048 Sep 01 04:53:19.415012 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 776/1564] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:19.426313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6658c296-c42f-43ea-952c-02547fa703ee tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bb500d0>, body: {"security_group_rule": {"parent_group_id": "c85c1e89-faa1-4b7e-a10d-d506c05daa01", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "dae4ac82-a325-4909-859d-3b2b57a5a0b6"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:19.505911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:19.518524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a854225-d7be-49bb-a1bb-629c0225090c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.366685 Sep 01 04:53:19.520654 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 789/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:19 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:19.526450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:19.527554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:19.536705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.537694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.538360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.539683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.541207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.542149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.590113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:19.862585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:19.879546 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6da8835b-a03b-4050-829e-e21ed1df4565 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 0.357266 Sep 01 04:53:19.897178 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 790/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:19 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:19.905557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:19.906852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:19.916464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.918116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.918818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:19.920769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:19.921542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:19.922192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:20.431062 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6658c296-c42f-43ea-952c-02547fa703ee tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.012320 Sep 01 04:53:20.431818 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 777/1567] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:53:19 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:20.443315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "577ce66e-98b0-4d7b-921c-c013cab4b8e2", "device": "/dev/xvdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:20.446237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:20.454026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:20.459503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:20.461865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:20.466565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:20.467595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:20.468196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:20.468742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:20.470008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:20.472112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:20.475135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e25384c-2dea-40e5-a77e-45025d3f1f35 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.576277 Sep 01 04:53:20.475726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 791/1568] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:19 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:20.494167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:20.494825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:20.513341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:20.514460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:20.514927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:20.515898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:20.516529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:20.517126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:20.829765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:20.849421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50566d3b-2e09-4a56-aafb-51f12ac3aca0 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1307 microversion: 2.1 time: 0.372168 Sep 01 04:53:20.850595 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 792/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:20 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:20.860338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac3bd3e6-6c72-4174-bd07-40ee7a39811b tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bc47dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:21.371616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:21.551866 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac3bd3e6-6c72-4174-bd07-40ee7a39811b tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dae4ac82-a325-4909-859d-3b2b57a5a0b6" status: 202 len: 0 microversion: 2.1 time: 0.699032 Sep 01 04:53:21.553310 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 793/1570] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:20 2022] DELETE /compute/v2.1/os-security-groups/dae4ac82-a325-4909-859d-3b2b57a5a0b6 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:21.560601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:21.561751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:21.574984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:21.576192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:21.577547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:21.578776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:21.579820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:21.580589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:21.851600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:21.864681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da5edf47-3a83-4690-bffc-7abd45a4b2ec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.309824 Sep 01 04:53:21.866251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 794/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:21 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:21.877444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:21.879116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:21.892101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:21.892600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:21.893038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:21.893752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:21.894430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:21.895237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:22.143897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:22.157362 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97c2da69-26c0-4828-97d9-299be53cab82 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 0.289605 Sep 01 04:53:22.158940 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 795/1572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:21 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:22.163123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:22.163829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:22.180704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:22.181216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:22.181706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:22.182453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:22.183472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:22.183887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:22.425518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:22.434697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:22.436289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:22.437737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12a6e482-54b7-4715-b280-1906d50dca50 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.278746 Sep 01 04:53:22.438302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 796/1573] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:22 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:22.452930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5dba6a95-462f-4aaa-b89d-6e106c9c3ba2 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bcbf3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:22.459797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:22.570083 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5dba6a95-462f-4aaa-b89d-6e106c9c3ba2 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/c85c1e89-faa1-4b7e-a10d-d506c05daa01" status: 200 len: 248 microversion: 2.1 time: 0.130287 Sep 01 04:53:22.580676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 797/1574] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:53:22 2022] GET /compute/v2.1/os-security-groups/c85c1e89-faa1-4b7e-a10d-d506c05daa01 => generated 248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:22.804308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88df9582-bed2-4951-8af3-c77710d4218d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Action: 'create', calling method: .version_select at 0x7fa75bcbfe50>, body: {"keypair": {"name": "tempest-keypair-2018250195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXLmjp/RHIDTcd7QKNHN+4Iouk8fmfL4/gL9l6tYlVvS8ToP/TJb6Yy0Y+QHCykDMc5njdWw4waZW10+0+AwszORNWt62bywZorcrHYXfl8e4k9y0rTD2c/deEvMO0uVw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:22.828053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-88df9582-bed2-4951-8af3-c77710d4218d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Getting quotas for project aaafcc3055b24c4ca9be6effa2fbeb3f. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:53:22.835326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-88df9582-bed2-4951-8af3-c77710d4218d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Getting quotas for user 4e4095ea5213430c879aa801822dac27 and project aaafcc3055b24c4ca9be6effa2fbeb3f. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:53:22.877084 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88df9582-bed2-4951-8af3-c77710d4218d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.294101 Sep 01 04:53:22.878147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 798/1575] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:53:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:22.884686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:22.886323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:22.893401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:22.894237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:22.894754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:22.895752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:22.896518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:22.897128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:23.163524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:23.176866 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-851a4333-96c5-47ff-8224-bf01b74b45a1 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1307 microversion: 2.1 time: 0.297370 Sep 01 04:53:23.177819 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 799/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:22 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:23.182861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6629ccf-f554-4f8a-8d39-8ab2c482e931 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bc47d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-831489658", "description": "tempest-description-26404631"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:23.230383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:23.489888 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed1ae498-752b-43ed-907b-cec521f270b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "POST /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.056629 Sep 01 04:53:23.509778 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 778/1577] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 04:53:20 2022] POST /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 194 bytes in 3077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:23.525250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:23.526383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:23.552617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:23.555976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:23.556755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:23.559682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:23.561821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:23.563211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:23.886270 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6629ccf-f554-4f8a-8d39-8ab2c482e931 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.706461 Sep 01 04:53:23.895333 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 800/1578] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:53:23 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:23.902074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:23.904468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:23.919666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:23.925465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:23.926029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:23.926799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:23.927480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:23.928110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:24.780984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:24.802558 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a88a972b-ce22-4cfc-95d2-7ca92d971c8e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 1.289255 Sep 01 04:53:24.805975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 779/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:23 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:24.822024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:24.825742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:24.853961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:24.856512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:24.859433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:24.868916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:24.870298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:24.875602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:25.123051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:25.138799 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b36f5ea1-4c0e-4e91-8532-3bfae5d599b4 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 1.246337 Sep 01 04:53:25.140815 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 801/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:23 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:25.161871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d1b1ec06-d473-4944-b41b-f4146d330919 req-cda99ee9-ff24-4476-90e2-d26ea4b4764c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab707524-dfad-44d7-af09-26f0fca9ce83", "name": "network-vif-plugged", "status": "completed", "tag": "9f3a7a5f-0938-4510-95c4-a826732b173a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:25.194361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1b1ec06-d473-4944-b41b-f4146d330919 req-cda99ee9-ff24-4476-90e2-d26ea4b4764c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:25.195745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1b1ec06-d473-4944-b41b-f4146d330919 req-cda99ee9-ff24-4476-90e2-d26ea4b4764c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:25.197255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1b1ec06-d473-4944-b41b-f4146d330919 req-cda99ee9-ff24-4476-90e2-d26ea4b4764c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:25.234350 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d1b1ec06-d473-4944-b41b-f4146d330919 req-cda99ee9-ff24-4476-90e2-d26ea4b4764c service nova] Creating event network-vif-plugged:9f3a7a5f-0938-4510-95c4-a826732b173a for instance ab707524-dfad-44d7-af09-26f0fca9ce83 on n-h1-820368-37 Sep 01 04:53:25.250964 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d1b1ec06-d473-4944-b41b-f4146d330919 req-cda99ee9-ff24-4476-90e2-d26ea4b4764c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107835 Sep 01 04:53:25.252803 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 802/1581] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:25.267278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8674a949-c0ac-4daa-ad75-e1565f840282 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bc474c0>, body: {"security_group_rule": {"parent_group_id": "be569742-cc2a-49c9-9120-9dea9498fac4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:25.867234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:25.889269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:25.896419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:25.899616 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cced90a-ccad-40cb-9806-918753b18c0b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 1.090441 Sep 01 04:53:25.905403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 780/1582] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:24 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:25.915657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:25.916689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:25.930097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:25.930997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:25.931932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:25.932967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:25.933685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:25.934482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:26.654253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:26.749134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:26.762986 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f85ac8d-3942-4a94-80d6-5fc06fd850e2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1307 microversion: 2.1 time: 0.855770 Sep 01 04:53:26.764937 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 781/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:25 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1307 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:26.770175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:26.771757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:26.790063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:26.791013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:26.792477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:26.795290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:26.796091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:26.796940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:26.841515 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8674a949-c0ac-4daa-ad75-e1565f840282 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.587065 Sep 01 04:53:26.848396 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 803/1584] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:53:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:26.848396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:26.848992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:26.860997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:26.861494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:26.861936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:26.862660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:26.883389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:26.884058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:27.613709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:27.626934 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3f35bfa-b0e0-4ddb-9c8d-e43412c40a77 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.860600 Sep 01 04:53:27.635227 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 782/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:26 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:27.662578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4d97d55c-5f42-4968-b092-ab16f89b7ab1 req-80028f5b-7f25-493c-b258-63597123cb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5943be74-63b0-4bf2-9b9f-c9a37ff00ec1", "name": "network-vif-unplugged", "status": "completed", "tag": "ff13fb50-fd09-4168-93e1-118e18ff8dde"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:27.702271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4d97d55c-5f42-4968-b092-ab16f89b7ab1 req-80028f5b-7f25-493c-b258-63597123cb43 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:27.702913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4d97d55c-5f42-4968-b092-ab16f89b7ab1 req-80028f5b-7f25-493c-b258-63597123cb43 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:27.705900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4d97d55c-5f42-4968-b092-ab16f89b7ab1 req-80028f5b-7f25-493c-b258-63597123cb43 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:27.743599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4d97d55c-5f42-4968-b092-ab16f89b7ab1 req-80028f5b-7f25-493c-b258-63597123cb43 service nova] Creating event network-vif-unplugged:ff13fb50-fd09-4168-93e1-118e18ff8dde for instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 on n-h1-820368-37 Sep 01 04:53:27.757840 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4d97d55c-5f42-4968-b092-ab16f89b7ab1 req-80028f5b-7f25-493c-b258-63597123cb43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119362 Sep 01 04:53:27.758481 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 783/1586] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:27.770494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:27.772721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fc4bb03-043c-4e50-a43d-bdd66e037a07 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Action: 'create', calling method: .version_select at 0x7fa75bd66670>, body: {"security_group_rule": {"parent_group_id": "be569742-cc2a-49c9-9120-9dea9498fac4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:27.796747 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cab599e1-ddbf-49f0-9279-a0676c0e2a08 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 0.950669 Sep 01 04:53:27.800684 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 804/1587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:26 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:27.811566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:27.813752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:27.844889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:27.848197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:27.851287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:27.857154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:27.858494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:27.860542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:28.144631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:28.170641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:28.176426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:28.178598 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-893f3a45-fd81-47d7-a385-b3b41d73cf0a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.375546 Sep 01 04:53:28.183037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 805/1588] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:27 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:28.197867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "1cd3af36-1c86-4ef1-aa23-47487cd76fb1"}], "security_groups": [{"name": "tempest-securitygroup--297587977"}], "key_name": "tempest-keypair-2018250195", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:28.257550 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fc4bb03-043c-4e50-a43d-bdd66e037a07 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.497579 Sep 01 04:53:28.266174 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 784/1589] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:53:27 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:28.272900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:28.274872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:28.304679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:28.305379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:28.307399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:28.308538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:28.310722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:28.311497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:28.409006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] validate_networks() for [('1cd3af36-1c86-4ef1-aa23-47487cd76fb1', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:53:28.553804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:28.566928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-286f16ae-ce8e-43f6-abcb-410d3257fe42 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1487 microversion: 2.1 time: 0.299297 Sep 01 04:53:28.576981 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 785/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:28 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1487 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:28.590803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b8185cb2-c03b-416d-8163-36c77a3c373c req-8c7f4af4-25f4-4b7f-85ab-c8003229f4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ffff1f-649c-4947-b75d-171df891356d", "name": "network-vif-plugged", "status": "completed", "tag": "d4b994bf-9e4f-44a9-9e00-d474655b45a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:28.603811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8185cb2-c03b-416d-8163-36c77a3c373c req-8c7f4af4-25f4-4b7f-85ab-c8003229f4d2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:28.604597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8185cb2-c03b-416d-8163-36c77a3c373c req-8c7f4af4-25f4-4b7f-85ab-c8003229f4d2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:28.605194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b8185cb2-c03b-416d-8163-36c77a3c373c req-8c7f4af4-25f4-4b7f-85ab-c8003229f4d2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:28.621700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b8185cb2-c03b-416d-8163-36c77a3c373c req-8c7f4af4-25f4-4b7f-85ab-c8003229f4d2 service nova] Creating event network-vif-plugged:d4b994bf-9e4f-44a9-9e00-d474655b45a1 for instance a9ffff1f-649c-4947-b75d-171df891356d on n-h2-820368-37 Sep 01 04:53:28.635830 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b8185cb2-c03b-416d-8163-36c77a3c373c req-8c7f4af4-25f4-4b7f-85ab-c8003229f4d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057068 Sep 01 04:53:28.641165 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 786/1591] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:28.647909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5f3c2d1-f05b-44c4-82d0-652d2c9dd2d6 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bbecca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:28.774180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5f3c2d1-f05b-44c4-82d0-652d2c9dd2d6 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/be569742-cc2a-49c9-9120-9dea9498fac4" status: 200 len: 662 microversion: 2.1 time: 0.128505 Sep 01 04:53:28.774806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 787/1592] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:53:28 2022] GET /compute/v2.1/os-security-groups/be569742-cc2a-49c9-9120-9dea9498fac4 => generated 662 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:28.780172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2048270740"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:28.783006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:28.790983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:28.791817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:28.792441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:28.793428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:28.793929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:28.794748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.112660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:53:29.113276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:53:29.113532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:53:29.113936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:53:29.114340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:53:29.128698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.131529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.132276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.133078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.133534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.133965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.169412 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f32d3052-19f6-4d8e-a678-98eec1b67280 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "POST /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83/action" status: 202 len: 0 microversion: 2.1 time: 0.390882 Sep 01 04:53:29.172025 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 788/1593] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:28 2022] POST /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:53:29.179978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:29.181629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:29.189759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Getting quotas for project aaafcc3055b24c4ca9be6effa2fbeb3f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:53:29.195234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.195958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Getting quotas for user 4e4095ea5213430c879aa801822dac27 and project aaafcc3055b24c4ca9be6effa2fbeb3f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:53:29.196369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.197825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.220715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.221990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.223584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.225304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:53:29.234101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:53:29.396799 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-029ede28-189a-4fdc-9a1c-f48ba51d51b2 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.207108 Sep 01 04:53:29.396799 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 806/1594] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:53:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:53:29.412809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01350546-f276-44fb-836e-4aa5cfef0e76 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bc32280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:29.466133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:29.476878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15e3e7ad-19cd-4dde-bf80-82d3f72d3a2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.301674 Sep 01 04:53:29.482559 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 789/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:29 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:29.494047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:29.498299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:29.511883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.514948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.516876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.518311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.524089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.525356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.873791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:29.888051 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95593aae-2c22-4628-bb2a-fafa1bbb1753 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1332 microversion: 2.1 time: 0.403593 Sep 01 04:53:29.889275 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 790/1596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:29 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1332 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:29.907893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d2bcbc3-272d-477c-a613-3f24911347cb tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75b94f3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:29.918858 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01350546-f276-44fb-836e-4aa5cfef0e76 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/35c558cf-7b0a-46ed-b1fb-1f9c846c0f07" status: 202 len: 0 microversion: 2.1 time: 0.519196 Sep 01 04:53:29.920323 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 807/1597] 10.222.0.26 () {58 vars in 1287 bytes} [Thu Sep 1 04:53:29 2022] DELETE /compute/v2.1/os-security-group-rules/35c558cf-7b0a-46ed-b1fb-1f9c846c0f07 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:29.926491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:29.927383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:29.941309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:29.942783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.943331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.944592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.945033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:29.945827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:29.946455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:29.990253 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d2bcbc3-272d-477c-a613-3f24911347cb tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d" status: 200 len: 1412 microversion: 2.1 time: 0.098619 Sep 01 04:53:29.991877 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 791/1598] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:53:29 2022] GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:30.045398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a78014c-98d3-4d23-a29b-4ef7c250cb00 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.046192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a78014c-98d3-4d23-a29b-4ef7c250cb00 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:30.213477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a78014c-98d3-4d23-a29b-4ef7c250cb00 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:30.231724 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a78014c-98d3-4d23-a29b-4ef7c250cb00 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1226 microversion: 2.1 time: 0.212069 Sep 01 04:53:30.233772 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 792/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:29 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:30.260383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6c6c52f5-b048-4e9f-b29e-91cfadd74305 req-f4c86d74-eeff-4817-9b9a-1dadf20854a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5943be74-63b0-4bf2-9b9f-c9a37ff00ec1", "tag": "ff13fb50-fd09-4168-93e1-118e18ff8dde"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:30.282257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c6c52f5-b048-4e9f-b29e-91cfadd74305 req-f4c86d74-eeff-4817-9b9a-1dadf20854a5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:30.282997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c6c52f5-b048-4e9f-b29e-91cfadd74305 req-f4c86d74-eeff-4817-9b9a-1dadf20854a5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:30.283583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6c6c52f5-b048-4e9f-b29e-91cfadd74305 req-f4c86d74-eeff-4817-9b9a-1dadf20854a5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:30.283809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:30.298860 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6c6c52f5-b048-4e9f-b29e-91cfadd74305 req-f4c86d74-eeff-4817-9b9a-1dadf20854a5 service nova] Creating event network-changed:ff13fb50-fd09-4168-93e1-118e18ff8dde for instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 on n-h1-820368-37 Sep 01 04:53:30.304597 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6c6c52f5-b048-4e9f-b29e-91cfadd74305 req-f4c86d74-eeff-4817-9b9a-1dadf20854a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054977 Sep 01 04:53:30.305607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:30.308788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:30.310952 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-caf94bfa-861d-42ac-a00b-924ccfab3e8c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.388508 Sep 01 04:53:30.313878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 808/1600] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:29 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:30.314933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 793/1601] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:30.330191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-402794a3-09d2-41cf-83cc-988d9e3c2091 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bc47820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.332596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b05c7acb-5144-46f4-ab40-f087eef26cfa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcbc820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.399412 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b05c7acb-5144-46f4-ab40-f087eef26cfa tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d" status: 200 len: 1412 microversion: 2.1 time: 0.080265 Sep 01 04:53:30.401911 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 794/1602] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:53:30 2022] GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:30.416850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1fcd17f-ab71-449d-9c1f-94b26f332b77 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bd6f280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.638676 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1fcd17f-ab71-449d-9c1f-94b26f332b77 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d" status: 204 len: 0 microversion: 2.1 time: 0.225844 Sep 01 04:53:30.643480 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 795/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:30 2022] DELETE /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:53:30.648622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.649374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:30.667860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:30.668644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:30.669308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:30.670763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:30.675201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:30.675873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:30.681787 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-402794a3-09d2-41cf-83cc-988d9e3c2091 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/be569742-cc2a-49c9-9120-9dea9498fac4" status: 202 len: 0 microversion: 2.1 time: 0.361292 Sep 01 04:53:30.682477 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 809/1604] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:30 2022] DELETE /compute/v2.1/os-security-groups/be569742-cc2a-49c9-9120-9dea9498fac4 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:30.690389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35b8b3e0-1833-4a7f-aabb-7900b169adca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bc21b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.738556 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-35b8b3e0-1833-4a7f-aabb-7900b169adca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Image not found. Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35b8b3e0-1833-4a7f-aabb-7900b169adca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d HTTP/1.1 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'cccd0442-ee29-4765-8ab3-1f4bab86d87d'} Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cccd0442-ee29-4765-8ab3-1f4bab86d87d Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:53:30.740720 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cccd0442-ee29-4765-8ab3-1f4bab86d87d could not be found. Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35b8b3e0-1833-4a7f-aabb-7900b169adca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35b8b3e0-1833-4a7f-aabb-7900b169adca tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d" status: 404 len: 62 microversion: 2.1 time: 0.058637 Sep 01 04:53:30.745378 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 810/1605] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:53:30 2022] GET /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:53:30.760494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3003bd05-74bd-4495-b36c-fc5960ba346d req-3d7fbe94-0e3c-4ae7-9c38-6cb89db79875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9817b3f-a4c3-415b-80d2-223a97d07d36", "name": "network-vif-plugged", "status": "completed", "tag": "1f7f1217-76b5-4c96-b44a-1789c165fa1d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:30.775551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3003bd05-74bd-4495-b36c-fc5960ba346d req-3d7fbe94-0e3c-4ae7-9c38-6cb89db79875 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:30.776040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3003bd05-74bd-4495-b36c-fc5960ba346d req-3d7fbe94-0e3c-4ae7-9c38-6cb89db79875 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:30.776472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3003bd05-74bd-4495-b36c-fc5960ba346d req-3d7fbe94-0e3c-4ae7-9c38-6cb89db79875 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:30.804885 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3003bd05-74bd-4495-b36c-fc5960ba346d req-3d7fbe94-0e3c-4ae7-9c38-6cb89db79875 service nova] Creating event network-vif-plugged:1f7f1217-76b5-4c96-b44a-1789c165fa1d for instance e9817b3f-a4c3-415b-80d2-223a97d07d36 on n-h2-820368-37 Sep 01 04:53:30.828554 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3003bd05-74bd-4495-b36c-fc5960ba346d req-3d7fbe94-0e3c-4ae7-9c38-6cb89db79875 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084553 Sep 01 04:53:30.829524 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 811/1606] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:30.840089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bc32c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.922429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:53:30.923085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Neutron security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:53:30.923620 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] HTTP exception thrown: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.923620 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Request method failure captured: Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/dae4ac82-a325-4909-859d-3b2b57a5a0b6 HTTP/1.1 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqtXirzt9m5dLW0HH3L5tBjzZIX1Zif0voc0whg8uKK3-0vKperLV1vSsc7ySKNnqvzzCVk2CNYUcUhghMUE4JDAUCQU4fSQ4twq1A5M5ilHVHAate7p_0wVVmsbFhKbgbiaP3QTN5IKPtAlV40H9_SQYlgKeZXB7u-_j5PGcXbFO8 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b01523473d58487aa6f6b5448ec99a27 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1011244964 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01523473d58487aa6f6b5448ec99a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b01523473d58487aa6f6b5448ec99a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b01523473d58487aa6f6b5448ec99a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b01523473d58487aa6f6b5448ec99a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1011244964 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b01523473d58487aa6f6b5448ec99a27 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1011244964 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesTestJSON-1011244964-project Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c34026b993e946c586d8d275ac36b1d8 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1011244964-project Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'dae4ac82-a325-4909-859d-3b2b57a5a0b6'} Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:53:30.938550 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Returning 404 to user: Security group dae4ac82-a325-4909-859d-3b2b57a5a0b6 does not exist Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-b016ee2e-f25e-42ce-a632-4bc871d1792b'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:30.943244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3cbcd6a-3c25-4fa2-b726-d382cf40c3ae tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dae4ac82-a325-4909-859d-3b2b57a5a0b6" status: 404 len: 194 microversion: 2.1 time: 0.110638 Sep 01 04:53:30.955878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 812/1607] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:30 2022] DELETE /compute/v2.1/os-security-groups/dae4ac82-a325-4909-859d-3b2b57a5a0b6 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:30.973084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:30.978197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:31.010434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.028290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.031110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.035019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.036016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.038184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.085028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:31.103891 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71c7ad9d-f82c-48d3-90c4-c0ec7269c8e1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1314 microversion: 2.1 time: 0.459049 Sep 01 04:53:31.104766 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 796/1608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:30 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:31.126318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:31.130198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:31.174977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.183694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.184468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.185388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.188064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.189126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.542747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:31.553218 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df36295f-93ab-491c-9170-c683e8ec8f2c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1505 microversion: 2.1 time: 0.596023 Sep 01 04:53:31.554278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 813/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:30 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:31.569302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abe7c00b-b43b-45c9-b65b-c008b2ab646c tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa764138b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:31.785989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:31.796085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-347e82bb-13ca-40d1-9376-092aa7ddccaa tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1536 microversion: 2.1 time: 0.686946 Sep 01 04:53:31.797110 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 797/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:31 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1536 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:31.807264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:31.808605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:31.833381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.836791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.838413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.839747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.844024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.844752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.949662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:31.961612 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27940a36-b180-4828-8c1e-8189bba5d77f tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1278 microversion: 2.1 time: 0.162494 Sep 01 04:53:31.974925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 798/1611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:31 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:31.974925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:31.974925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:31.982651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.983230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.983672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:31.984393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:31.984856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:31.985282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:32.088895 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abe7c00b-b43b-45c9-b65b-c008b2ab646c tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c85c1e89-faa1-4b7e-a10d-d506c05daa01" status: 202 len: 0 microversion: 2.1 time: 0.531015 Sep 01 04:53:32.090733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 814/1612] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:31 2022] DELETE /compute/v2.1/os-security-groups/c85c1e89-faa1-4b7e-a10d-d506c05daa01 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:32.098619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c6e6251-b1b1-4f5a-94b9-99f68b867fa2 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'create', calling method: .version_select at 0x7fa75bc21ca0>, body: {"pool": "de99b901-9137-483d-84f6-8a5416d6d696"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:32.787134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:32.800894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:32.803243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:32.807852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc7471f4-75c5-4692-aafd-cef45f54fbec tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.839629 Sep 01 04:53:32.809473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 799/1613] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:31 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:32.816226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce32d544-4e2e-4cc1-8e0c-3486233e6f91 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75be1adc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:34.589596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce32d544-4e2e-4cc1-8e0c-3486233e6f91 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e48e4adb-3209-4b55-b083-4bd441dbe9b1" status: 202 len: 0 microversion: 2.1 time: 1.777781 Sep 01 04:53:34.590607 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 800/1614] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:32 2022] DELETE /compute/v2.1/os-security-groups/e48e4adb-3209-4b55-b083-4bd441dbe9b1 => generated 0 bytes in 1779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:34.596113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:34.596995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:34.619807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:34.620667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:34.621320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:34.622670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:34.623570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:34.624223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:34.933686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:34.947312 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83a67f8e-09c7-4f49-8b04-0a892415a331 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1463 microversion: 2.1 time: 0.354200 Sep 01 04:53:34.947933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 801/1615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:34 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:34.957775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:34.960732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:34.974775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:34.975272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:34.980058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:34.983599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:34.984237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:34.984686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:35.095149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:35.650022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcfdd4deb06b413d9585d204bd614e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8dc46fa344b42ee9597ecfe34672366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:35.665609 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c45d705-6deb-4df3-a1c2-ef9f05095065 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 200 len: 1487 microversion: 2.1 time: 0.716483 Sep 01 04:53:35.667706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 802/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:34 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 1487 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:35.679554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:35.687870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:35.695280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:35.696195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:35.696811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:35.697750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:35.698348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:35.698970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:36.185344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:36.195088 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-135d99cd-f405-48ce-a259-cca77da6dbb7 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1351 microversion: 2.1 time: 0.525726 Sep 01 04:53:36.203845 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 803/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:35 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1351 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:36.219770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:36.220826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:36.228324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:36.233567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:36.234257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:36.235286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:36.235975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:36.239923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:36.510259 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c6e6251-b1b1-4f5a-94b9-99f68b867fa2 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.417944 Sep 01 04:53:36.512635 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 815/1618] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 04:53:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:36.518185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09dba524-8cb9-4862-8778-d46e3d908ac3 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bc25ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:36.611760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:36.622321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:36.635718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:36.637252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e7ae257-f0f2-481b-bad7-9973055c3a30 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1488 microversion: 2.25 time: 0.431361 Sep 01 04:53:36.651568 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 804/1619] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:36 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1488 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:36.981689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:36.988444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'deleted': False, 'project_id': '6d18a2fbd5544bfa93601a5b131ed461'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:36.995878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:36.996662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:36.997571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:36.998516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.001367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.002026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.102657 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ad1a3b9-727f-4187-a649-4233cc6e7198 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.449686 Sep 01 04:53:37.103215 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 805/1620] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:53:36 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:53:37.129572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:37.130536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:37.139039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.139873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.144587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.145880 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09dba524-8cb9-4862-8778-d46e3d908ac3 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ebca26f2-331b-416f-8a59-3cd2a4130b33" status: 202 len: 0 microversion: 2.1 time: 0.631896 Sep 01 04:53:37.149594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.150404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.152320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.155169 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 816/1621] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:36 2022] DELETE /compute/v2.1/os-security-groups/ebca26f2-331b-416f-8a59-3cd2a4130b33 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:37.171362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dfae9a42-7579-4ca0-9716-7394e2a14838 req-c3ade788-3da2-4e70-95de-09786b7a005b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab707524-dfad-44d7-af09-26f0fca9ce83", "name": "network-vif-plugged", "status": "completed", "tag": "9f3a7a5f-0938-4510-95c4-a826732b173a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:37.184229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dfae9a42-7579-4ca0-9716-7394e2a14838 req-c3ade788-3da2-4e70-95de-09786b7a005b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.184889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dfae9a42-7579-4ca0-9716-7394e2a14838 req-c3ade788-3da2-4e70-95de-09786b7a005b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.185322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dfae9a42-7579-4ca0-9716-7394e2a14838 req-c3ade788-3da2-4e70-95de-09786b7a005b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.202777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:53:37.209959 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dfae9a42-7579-4ca0-9716-7394e2a14838 req-c3ade788-3da2-4e70-95de-09786b7a005b service nova] Creating event network-vif-plugged:9f3a7a5f-0938-4510-95c4-a826732b173a for instance ab707524-dfad-44d7-af09-26f0fca9ce83 on n-h1-820368-37 Sep 01 04:53:37.228755 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dfae9a42-7579-4ca0-9716-7394e2a14838 req-c3ade788-3da2-4e70-95de-09786b7a005b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060736 Sep 01 04:53:37.236224 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 817/1622] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:37.249245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'action', calling method: .version_select at 0x7fa761a4ec10>, body: {"addFloatingIp": {"address": "172.25.9.190"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:37.254633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:37.263784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.264833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.265470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.266453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.267122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.267740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.315274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:53:37.315701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquired lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:53:37.370062 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbcef904-ba42-4904-a3c4-5a8d4cf0ee4f tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 204 len: 0 microversion: 2.1 time: 0.249966 Sep 01 04:53:37.370929 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 806/1623] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:37 2022] DELETE /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:53:37.380350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:37.388069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'deleted': False} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:37.394292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.395102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.395866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.396822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.397466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.398135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:37.529696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:53:37.646123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:37.646720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:37.647218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:39.159479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:39.212697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:39.644460 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1c07bef-b3f3-4583-87e6-68c7b2e32df8 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21451 microversion: 2.1 time: 2.272267 Sep 01 04:53:39.645061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 807/1624] 10.222.0.26 () {58 vars in 1171 bytes} [Thu Sep 1 04:53:37 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21451 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:53:39.650669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19ecdeb8-e7a0-4c01-aaeb-930ca4f13950 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bba2940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:41.059326 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19ecdeb8-e7a0-4c01-aaeb-930ca4f13950 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1b6f3832-2075-461a-a156-91871f892ba7" status: 202 len: 0 microversion: 2.1 time: 1.412915 Sep 01 04:53:41.061243 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 808/1625] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:39 2022] DELETE /compute/v2.1/os-security-groups/1b6f3832-2075-461a-a156-91871f892ba7 => generated 0 bytes in 1415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:41.066600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:41.067613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:41.069998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:41.086018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:41.086813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:41.087318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:41.087993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:41.088446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:41.088870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:41.548979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:41.572381 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bb717a5-d44d-489c-ae8d-d3ddf372c500 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1351 microversion: 2.1 time: 0.509734 Sep 01 04:53:41.574387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 809/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:41 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1351 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:41.599557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-808f11c3-1339-4110-894c-b0e6cb88746b req-0204865d-2699-4a4d-a024-5174c530d211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513b9001-2495-4749-bf46-15acf99d948a", "tag": "17d561fb-d413-419b-8808-72b59db5261d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:41.633681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-808f11c3-1339-4110-894c-b0e6cb88746b req-0204865d-2699-4a4d-a024-5174c530d211 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:41.635719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-808f11c3-1339-4110-894c-b0e6cb88746b req-0204865d-2699-4a4d-a024-5174c530d211 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:41.637681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-808f11c3-1339-4110-894c-b0e6cb88746b req-0204865d-2699-4a4d-a024-5174c530d211 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:41.664880 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-808f11c3-1339-4110-894c-b0e6cb88746b req-0204865d-2699-4a4d-a024-5174c530d211 service nova] Creating event network-changed:17d561fb-d413-419b-8808-72b59db5261d for instance 513b9001-2495-4749-bf46-15acf99d948a on n-h1-820368-37 Sep 01 04:53:41.684409 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-808f11c3-1339-4110-894c-b0e6cb88746b req-0204865d-2699-4a4d-a024-5174c530d211 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105437 Sep 01 04:53:41.686047 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 810/1627] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:41.693525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-641495b8-1b13-44d7-ac8c-e470d7091067 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75b94fa60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:41.754824 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-641495b8-1b13-44d7-ac8c-e470d7091067 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Image not found. Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-641495b8-1b13-44d7-ac8c-e470d7091067 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d HTTP/1.1 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'cccd0442-ee29-4765-8ab3-1f4bab86d87d'} Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cccd0442-ee29-4765-8ab3-1f4bab86d87d to delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cccd0442-ee29-4765-8ab3-1f4bab86d87d could not be found. Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.757016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:41.762819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-641495b8-1b13-44d7-ac8c-e470d7091067 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:41.764826 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-641495b8-1b13-44d7-ac8c-e470d7091067 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d" status: 404 len: 62 microversion: 2.1 time: 0.074531 Sep 01 04:53:41.766118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 811/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:41 2022] DELETE /compute/v2.1/images/cccd0442-ee29-4765-8ab3-1f4bab86d87d => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:53:41.778369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:41.779344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:41.790859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:41.803670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:41.804286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:41.805459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:41.806074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:41.806651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:41.987798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:53:42.482383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:42.504544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:42.506257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:42.514904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71ecffd7-652e-4113-bced-eb68ceccc821 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1478 microversion: 2.25 time: 0.748055 Sep 01 04:53:42.518527 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 812/1629] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:41 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1478 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:42.542262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:42.554385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'deleted': False, 'project_id': '6d18a2fbd5544bfa93601a5b131ed461'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:42.562508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:42.563359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:42.564690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:42.565656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:42.566286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:42.567008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:42.614000 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fa4da27-7127-4363-b98f-ec77a33bbdf2 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?tenant_id=f54577a158c74f57819ef92429fbda99" status: 200 len: 15 microversion: 2.1 time: 0.093856 Sep 01 04:53:42.614936 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 813/1630] 10.222.0.26 () {58 vars in 1231 bytes} [Thu Sep 1 04:53:42 2022] GET /compute/v2.1/servers/detail?tenant_id=f54577a158c74f57819ef92429fbda99 => generated 15 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:53:42.632719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:42.633338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:42.642577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:42.647540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:42.648186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:42.649231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:42.650368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:42.653728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:43.044714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e99dff9-b8e5-42f7-a137-8d53d886f3de tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1860 microversion: 2.1 time: 0.420952 Sep 01 04:53:43.063686 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 814/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:42 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1860 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:43.072632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-03a2a7bf-b250-42d5-bdab-51962cc8b47f req-42b1f38b-5b00-4627-b22c-10129619aed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab707524-dfad-44d7-af09-26f0fca9ce83", "name": "network-vif-deleted", "tag": "9f3a7a5f-0938-4510-95c4-a826732b173a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:43.083546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-03a2a7bf-b250-42d5-bdab-51962cc8b47f req-42b1f38b-5b00-4627-b22c-10129619aed5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:43.084665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-03a2a7bf-b250-42d5-bdab-51962cc8b47f req-42b1f38b-5b00-4627-b22c-10129619aed5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:43.085124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-03a2a7bf-b250-42d5-bdab-51962cc8b47f req-42b1f38b-5b00-4627-b22c-10129619aed5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:43.104588 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-03a2a7bf-b250-42d5-bdab-51962cc8b47f req-42b1f38b-5b00-4627-b22c-10129619aed5 service nova] Creating event network-vif-deleted:9f3a7a5f-0938-4510-95c4-a826732b173a for instance ab707524-dfad-44d7-af09-26f0fca9ce83 on n-h1-820368-37 Sep 01 04:53:43.118688 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-03a2a7bf-b250-42d5-bdab-51962cc8b47f req-42b1f38b-5b00-4627-b22c-10129619aed5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050608 Sep 01 04:53:43.120652 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 815/1632] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:43.135428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05af571e-eb3f-473d-a8ad-00b7ac10cfa4 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] Calling method '.version_select at 0x7fa75bde4e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:43.979665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Updating instance_info_cache with network_info: [{"id": "d4b994bf-9e4f-44a9-9e00-d474655b45a1", "address": "fa:16:3e:56:87:35", "network": {"id": "69e5544e-9033-464c-9a3d-38ff2a1272c2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-805029320-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61f9dee0603e4800be75797947f403b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd4b994bf-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:53:43.994459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Releasing lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:53:43.995651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28bf531f-f372-43f0-a760-6d2c4529524b tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action" status: 202 len: 0 microversion: 2.1 time: 6.753449 Sep 01 04:53:44.000457 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 818/1633] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:37 2022] POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action => generated 0 bytes in 6759 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:53:44.006773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:44.007366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:44.017817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.019039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.019587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.020322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.020776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.021201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.037879 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 HTTP/1.1 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab707524-dfad-44d7-af09-26f0fca9ce83'} Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:44.039596 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccd755f8-45d1-45df-835a-aad22235e648 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 404 len: 111 microversion: 2.1 time: 0.039195 Sep 01 04:53:44.045991 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 819/1634] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:44 2022] DELETE /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:44.050645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-927811e2-b196-404d-aa37-b4509bd6938a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '.version_select at 0x7fa75bc214c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:44.054532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-927811e2-b196-404d-aa37-b4509bd6938a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.055052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-927811e2-b196-404d-aa37-b4509bd6938a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.055492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-927811e2-b196-404d-aa37-b4509bd6938a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.066735 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-927811e2-b196-404d-aa37-b4509bd6938a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2560 microversion: 2.25 time: 0.020038 Sep 01 04:53:44.067541 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 820/1635] 10.222.0.26 () {60 vars in 1184 bytes} [Thu Sep 1 04:53:44 2022] GET /compute/v2.1/os-migrations => generated 2560 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:44.084492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:44.085712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:44.099150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.101177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.101964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.103924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.105027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.105729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.121512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05af571e-eb3f-473d-a8ad-00b7ac10cfa4 tempest-SecurityGroupRulesTestJSON-1011244964 tempest-SecurityGroupRulesTestJSON-1011244964-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/09c1f5d9-0204-427e-8e07-08b433ca10fe" status: 202 len: 0 microversion: 2.1 time: 0.998401 Sep 01 04:53:44.123423 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 816/1636] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:53:43 2022] DELETE /compute/v2.1/os-security-groups/09c1f5d9-0204-427e-8e07-08b433ca10fe => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:44.132568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:44.141670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'tenant_id': 'f54577a158c74f57819ef92429fbda99', 'deleted': False} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:44.148868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.149361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.149956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.150689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.151188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.151611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.191695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:53:44.249452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.250449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.251246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.402701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:44.412833 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-764ccd0c-c13a-4f58-9a73-4ac1bf434100 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1351 microversion: 2.1 time: 0.335476 Sep 01 04:53:44.433636 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 821/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:44 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1351 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:44.443248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-37", "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:44.446163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:44.466790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.467284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.467713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.472063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.472953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.473583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.524358 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68e25364-24f9-4c8a-9d93-779116671d65 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f54577a158c74f57819ef92429fbda99" status: 200 len: 4828 microversion: 2.1 time: 0.399242 Sep 01 04:53:44.540049 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 817/1638] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 04:53:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f54577a158c74f57819ef92429fbda99 => generated 4828 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:44.540049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-17d64487-6626-4c26-8347-b1446c4efc2b req-059fc9ea-d1fc-4dc3-85fe-fc7d300461de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ffff1f-649c-4947-b75d-171df891356d", "tag": "d4b994bf-9e4f-44a9-9e00-d474655b45a1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:44.540267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:44.545142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lazy-loading 'flavor' on Instance uuid 0b21455b-3a86-47bf-a77f-098f46a1e18e {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:53:44.550389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-17d64487-6626-4c26-8347-b1446c4efc2b req-059fc9ea-d1fc-4dc3-85fe-fc7d300461de service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:44.550871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-17d64487-6626-4c26-8347-b1446c4efc2b req-059fc9ea-d1fc-4dc3-85fe-fc7d300461de service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:44.551326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-17d64487-6626-4c26-8347-b1446c4efc2b req-059fc9ea-d1fc-4dc3-85fe-fc7d300461de service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:44.585232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Going to try to live migrate instance to n-h1-820368-37 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:53:44.587960 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-17d64487-6626-4c26-8347-b1446c4efc2b req-059fc9ea-d1fc-4dc3-85fe-fc7d300461de service nova] Creating event network-changed:d4b994bf-9e4f-44a9-9e00-d474655b45a1 for instance a9ffff1f-649c-4947-b75d-171df891356d on n-h2-820368-37 Sep 01 04:53:44.604949 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-17d64487-6626-4c26-8347-b1446c4efc2b req-059fc9ea-d1fc-4dc3-85fe-fc7d300461de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078269 Sep 01 04:53:44.606025 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 818/1639] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:44.611788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7666523-42ad-4bf3-bae7-de9586309d5a tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'create', calling method: .version_select at 0x7fa75bde4ca0>, body: {"pool": "de99b901-9137-483d-84f6-8a5416d6d696"} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:47.094040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e8e81c5-343f-4855-9f44-aa5269e9cd1a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/action" status: 202 len: 0 microversion: 2.1 time: 2.658488 Sep 01 04:53:47.095212 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 822/1640] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:44 2022] POST /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/action => generated 0 bytes in 2661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:47.101275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:47.102784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: ab707524-dfad-44d7-af09-26f0fca9ce83] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:47.124614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.127494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.128084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.129107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.130954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.132325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.195667 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 HTTP/1.1 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab707524-dfad-44d7-af09-26f0fca9ce83'} Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:47.200258 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance ab707524-dfad-44d7-af09-26f0fca9ce83 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49da1fba-c601-4c33-80ff-20fe7dd240f2 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83" status: 404 len: 111 microversion: 2.1 time: 0.108734 Sep 01 04:53:47.206037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 823/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:47 2022] GET /compute/v2.1/servers/ab707524-dfad-44d7-af09-26f0fca9ce83 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:47.219269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:47.219924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:47.238316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.238814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.239278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.239991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.240445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.240872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.547222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] Lazy-loading 'services' on Instance uuid 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:53:47.577150 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c322b18-38c1-4d3c-8ca0-40cf4e3f0b9a tempest-LiveAutoBlockMigrationV225Test-533103464 tempest-LiveAutoBlockMigrationV225Test-533103464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1973 microversion: 2.25 time: 0.370101 Sep 01 04:53:47.580995 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 824/1642] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:47 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1973 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:47.593749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:47.606360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'tenant_id': '6d18a2fbd5544bfa93601a5b131ed461', 'deleted': False} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:47.623515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.630618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.631336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.632316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.632960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.633583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.836258 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3fd33f31-8c5b-48e2-913b-7805233dcee5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d18a2fbd5544bfa93601a5b131ed461" status: 200 len: 15 microversion: 2.1 time: 0.250909 Sep 01 04:53:47.836854 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 825/1643] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 04:53:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d18a2fbd5544bfa93601a5b131ed461 => generated 15 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:53:47.871612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:47.873143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:47.891051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.891555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.891994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:47.892716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:47.893171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:47.893596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.190290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:48.207961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7149176d-e792-4f3a-af3e-f0d17f4776bc tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1351 microversion: 2.1 time: 0.340223 Sep 01 04:53:48.210157 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 826/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:47 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1351 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:48.232738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b29e32f4-d7eb-4a86-b5e4-4aa23d333ab2 req-ac5358f3-6e6d-45b7-9b7d-bc05204e2a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513b9001-2495-4749-bf46-15acf99d948a", "name": "network-vif-plugged", "status": "completed", "tag": "17d561fb-d413-419b-8808-72b59db5261d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:48.281541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b29e32f4-d7eb-4a86-b5e4-4aa23d333ab2 req-ac5358f3-6e6d-45b7-9b7d-bc05204e2a3c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.283564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b29e32f4-d7eb-4a86-b5e4-4aa23d333ab2 req-ac5358f3-6e6d-45b7-9b7d-bc05204e2a3c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.286474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b29e32f4-d7eb-4a86-b5e4-4aa23d333ab2 req-ac5358f3-6e6d-45b7-9b7d-bc05204e2a3c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.323790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b29e32f4-d7eb-4a86-b5e4-4aa23d333ab2 req-ac5358f3-6e6d-45b7-9b7d-bc05204e2a3c service nova] Creating event network-vif-plugged:17d561fb-d413-419b-8808-72b59db5261d for instance 513b9001-2495-4749-bf46-15acf99d948a on n-h1-820368-37 Sep 01 04:53:48.333197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b29e32f4-d7eb-4a86-b5e4-4aa23d333ab2 req-ac5358f3-6e6d-45b7-9b7d-bc05204e2a3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120766 Sep 01 04:53:48.334534 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 827/1645] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:48.343517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:48.344645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:48.352291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.353120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.353859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.354860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.355583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.357012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.604028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7666523-42ad-4bf3-bae7-de9586309d5a tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.996814 Sep 01 04:53:48.612252 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 819/1646] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 04:53:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:48.617241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b71550d6-17e5-42e7-bf31-89f1872eaa91 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bcaa0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:48.649216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b71550d6-17e5-42e7-bf31-89f1872eaa91 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Image not found. Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b71550d6-17e5-42e7-bf31-89f1872eaa91 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 HTTP/1.1 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '05e15767-0b91-465a-9867-8c693da77c46'} Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 05e15767-0b91-465a-9867-8c693da77c46 to delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05e15767-0b91-465a-9867-8c693da77c46 could not be found. Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.652749 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:53:48.658168 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:48.663426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b71550d6-17e5-42e7-bf31-89f1872eaa91 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:48.664692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b71550d6-17e5-42e7-bf31-89f1872eaa91 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46" status: 404 len: 62 microversion: 2.1 time: 0.051389 Sep 01 04:53:48.665435 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 820/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:48 2022] DELETE /compute/v2.1/images/05e15767-0b91-465a-9867-8c693da77c46 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:53:48.676711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:48.677414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:48.685550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.686612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.687323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.688280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.688970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.689620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.762691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:48.764540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:53:48.777317 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d532d209-3289-440c-b101-23e79f8d60ed tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.440814 Sep 01 04:53:48.781217 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 828/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:48 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:48.796960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf69c1b4-e5f5-430c-9916-1f5143490ade tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:48.810609 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf69c1b4-e5f5-430c-9916-1f5143490ade tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.022301 Sep 01 04:53:48.811374 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 829/1649] 10.222.0.26 () {58 vars in 1189 bytes} [Thu Sep 1 04:53:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:53:48.827761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.29"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:48.838551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:48.857024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.857953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.859529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.862034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:48.863327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:48.865398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:48.915461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:53:48.916162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquired lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:53:49.068366 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3540f0af-2924-4866-99a4-f9c603e0dc56 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 204 len: 0 microversion: 2.25 time: 0.397267 Sep 01 04:53:49.072395 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 821/1650] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:53:48 2022] DELETE /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:53:49.078680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:49.079606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:49.089679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.091523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.092205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.106266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.108114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.108562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.133391 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d HTTP/1.1 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e42d112d-4c29-4c33-81b5-e1a1c223d95d'} Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:49.135390 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bb7bb17-a10c-478e-8725-c3e62cb1564c tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 404 len: 111 microversion: 2.1 time: 0.063986 Sep 01 04:53:49.143753 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 822/1651] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:49 2022] DELETE /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:49.146944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:49.155692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:49.170595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.173247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.175443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.176313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.176632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.177052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.195154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:49.421658 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-baef73c5-0b7b-4280-b9fe-1a195c08680d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.279870 Sep 01 04:53:49.425798 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 823/1652] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:49 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:49.438344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:49.443127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:49.454025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.454501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.455224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.455951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.456391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.456833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.727391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:49.738956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:49.745637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:49.747285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e73b4df-b571-4c1b-bae3-f8bf477bb39c tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1484 microversion: 2.25 time: 0.320100 Sep 01 04:53:49.749685 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 824/1653] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:49 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1484 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:49.759731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696.", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:53:49.760911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Releasing lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:53:49.761631 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.761631 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Request method failure captured: Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action HTTP/1.1 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 45 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqt52FGYjVzNHbnasB-LrIAZa9qHd0ta27NsirEYuqMQvLx9DubBh5MdRmUQttjyc_ib_9p4z-QgGl1m1JC6XxqaecfJzMqPwazlX21Yr3yprUo02TeHwpSt-SUBW4_7TqSk1HF16fwg1AQ-z-ZTUCn9Q6CoOUV9okbhJrv1OhQL1Y Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61f9dee0603e4800be75797947f403b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61f9dee0603e4800be75797947f403b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ffc188d31a6843e89254e2886baf0a0b Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: {"addFloatingIp": {"address": "172.25.9.29"}} Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a9ffff1f-649c-4947-b75d-171df891356d', 'body': {'addFloatingIp': {'address': '172.25.9.29'}}} Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:53:49.764465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] Sep 01 04:53:49.769557 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.777807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Returning 400 to user: Cannot associate floating IP 172.25.9.29 (65925195-6d7d-476c-9950-a6ab2bb0fa43) with port d4b994bf-9e4f-44a9-9e00-d474655b45a1 using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network de99b901-9137-483d-84f6-8a5416d6d696. Sep 01 04:53:49.777807 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-384ba321-adf4-45c3-9be4-8a28e450afae'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:49.777807 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-754cc83f-62c4-4676-ae5e-3c28e6fc3365 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action" status: 400 len: 381 microversion: 2.1 time: 0.958387 Sep 01 04:53:49.777807 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 830/1654] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:48 2022] POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action => generated 381 bytes in 959 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:53:49.780540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:49.784342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: e42d112d-4c29-4c33-81b5-e1a1c223d95d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:49.792106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:49.793745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:49.803032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.806504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.807788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.809412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.810384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.811068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.811680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.812460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.813647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.815870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.816585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.818696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.847393 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d HTTP/1.1 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e42d112d-4c29-4c33-81b5-e1a1c223d95d'} Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.853443 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:49.858960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:49.858960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:49.858960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:49.858960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:49.858960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. Sep 01 04:53:49.858960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:49.862269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance e42d112d-4c29-4c33-81b5-e1a1c223d95d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:49.863450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b890f0a5-6ae6-44f3-9c32-e6c5f102db73 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d" status: 404 len: 111 microversion: 2.1 time: 0.112599 Sep 01 04:53:49.865040 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 825/1655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:49 2022] GET /compute/v2.1/servers/e42d112d-4c29-4c33-81b5-e1a1c223d95d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:49.875388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:49.892825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:49.894239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'f54577a158c74f57819ef92429fbda99'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:49.916612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.919978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.920664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:49.921663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:49.930280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:49.931050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:50.167566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:53:50.186267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:50.198878 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c1df076-7cda-4bfd-82db-157dcba0ff7e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1351 microversion: 2.1 time: 0.421095 Sep 01 04:53:50.199868 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 831/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:49 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1351 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:50.207535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2b75e98-cd20-4228-a83d-970dec018fee tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '.version_select at 0x7fa75bcbf040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:50.303578 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6e3f76d-ae78-4e56-8442-35e7d0129e10 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.437243 Sep 01 04:53:50.304717 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 826/1657] 10.222.0.26 () {58 vars in 1150 bytes} [Thu Sep 1 04:53:49 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:50.315841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:50.316558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:50.324742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:50.325945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:50.327492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:50.328436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:50.329068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:50.329725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:51.010824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:51.036697 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-131241eb-ed9a-49d8-897d-d161afd9cbce tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.730295 Sep 01 04:53:51.062226 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 827/1658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:50 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:51.070851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fe7c4ec-af2e-494d-b722-b375f3a1207d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bdae4c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:51.127752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0fe7c4ec-af2e-494d-b722-b375f3a1207d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Image not found. Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fe7c4ec-af2e-494d-b722-b375f3a1207d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 HTTP/1.1 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'add21bed-554c-4039-a924-a08ad3ed39c5'} Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image add21bed-554c-4039-a924-a08ad3ed39c5 to delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image add21bed-554c-4039-a924-a08ad3ed39c5 could not be found. Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.133483 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fe7c4ec-af2e-494d-b722-b375f3a1207d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:51.139989 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fe7c4ec-af2e-494d-b722-b375f3a1207d tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5" status: 404 len: 62 microversion: 2.1 time: 0.073188 Sep 01 04:53:51.145249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 828/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:51 2022] DELETE /compute/v2.1/images/add21bed-554c-4039-a924-a08ad3ed39c5 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:53:51.154003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:51.177426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:51.209575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:51.211638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:51.212847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:51.220373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:51.221315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:51.222003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:51.447287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff75d826-e42a-4986-a7a7-026ee6a8fa15 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.298832 Sep 01 04:53:51.448243 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 829/1660] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:51 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:51.466016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:51.467928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:51.484481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:51.485448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:51.486221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:51.492156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:51.493273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:51.494150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:51.935889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:51.946454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:51.955219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:51.956889 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f285164-4f8a-4622-9623-94fff5a968cf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1484 microversion: 2.25 time: 0.507425 Sep 01 04:53:51.964790 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 830/1661] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:51 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1484 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:51.983369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:51.983885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:52.046350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:52.047097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:52.047437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:52.047980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:52.060351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:52.060916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:52.092747 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 HTTP/1.1 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '259cb86c-0712-4582-847a-96d54ed7c4f0'} Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:52.102577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:52.108201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:52.110187 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-146a36ed-584b-4de0-a1fe-5d77b84c2c95 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 404 len: 111 microversion: 2.1 time: 0.144070 Sep 01 04:53:52.116067 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 831/1662] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:51 2022] DELETE /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:52.129790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:52.132009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:52.139666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:52.140402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:52.140992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:52.143142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:52.143142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:52.143142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:52.443541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:52.454623 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64596dff-3c1e-41bf-84ae-8f0cc3905f9e tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1540 microversion: 2.1 time: 0.336924 Sep 01 04:53:52.458196 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 832/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:52 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1540 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:52.485836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:52.497360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:52.512060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:52.515030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:52.516168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:52.517155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:52.517852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:52.521086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:52.964255 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2b75e98-cd20-4228-a83d-970dec018fee tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/65925195-6d7d-476c-9950-a6ab2bb0fa43" status: 202 len: 0 microversion: 2.1 time: 2.762821 Sep 01 04:53:52.965585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 832/1664] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:53:50 2022] DELETE /compute/v2.1/os-floating-ips/65925195-6d7d-476c-9950-a6ab2bb0fa43 => generated 0 bytes in 2765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:52.970927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:52.971838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:52.995904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.009989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.017438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.026285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.027806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.028499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.029669 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f874ed4-71a0-4d8c-89ac-952c677d22f5 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1614 microversion: 2.1 time: 0.567901 Sep 01 04:53:53.030260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 833/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:52 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1614 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:53.035944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:53.037854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 259cb86c-0712-4582-847a-96d54ed7c4f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:53.047147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.048420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.048869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.049606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.050062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.050486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.073160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 HTTP/1.1 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '259cb86c-0712-4582-847a-96d54ed7c4f0'} Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:53.074721 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance 259cb86c-0712-4582-847a-96d54ed7c4f0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f849804d-585a-45c7-aa10-83dd3dcdbeb8 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0" status: 404 len: 111 microversion: 2.1 time: 0.046398 Sep 01 04:53:53.081847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 834/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:53 2022] GET /compute/v2.1/servers/259cb86c-0712-4582-847a-96d54ed7c4f0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:53.084665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4a0e42a4-64d3-48a6-b952-088f1323f257 req-a9adc041-8c94-4bc8-9249-8944fc0680ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5943be74-63b0-4bf2-9b9f-c9a37ff00ec1", "name": "network-vif-deleted", "tag": "ff13fb50-fd09-4168-93e1-118e18ff8dde"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:53.110829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a0e42a4-64d3-48a6-b952-088f1323f257 req-a9adc041-8c94-4bc8-9249-8944fc0680ad service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.111334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a0e42a4-64d3-48a6-b952-088f1323f257 req-a9adc041-8c94-4bc8-9249-8944fc0680ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.111769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a0e42a4-64d3-48a6-b952-088f1323f257 req-a9adc041-8c94-4bc8-9249-8944fc0680ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.130171 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4a0e42a4-64d3-48a6-b952-088f1323f257 req-a9adc041-8c94-4bc8-9249-8944fc0680ad service nova] Creating event network-vif-deleted:ff13fb50-fd09-4168-93e1-118e18ff8dde for instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 on n-h2-820368-37 Sep 01 04:53:53.138064 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4a0e42a4-64d3-48a6-b952-088f1323f257 req-a9adc041-8c94-4bc8-9249-8944fc0680ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057417 Sep 01 04:53:53.139991 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 835/1667] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:53.155506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:53.156292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:53.168393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.169541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.170108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.170875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.172456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.172933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.345013 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3c29bc3-9eb0-4352-a46d-8cc424b57082 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199818 Sep 01 04:53:53.346467 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 836/1668] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:53:53 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:53.353303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.190"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:53.375132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:53.397781 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3ae208b-211d-490f-9229-c18d3a30850c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.430654 Sep 01 04:53:53.411003 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 833/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:52 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:53.411003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:53.411003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:53.428727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.429230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.429672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.430392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.430854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.431310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.543798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:53.563005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:53.565582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:53.567956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2826f7fb-4b2f-461c-aba9-cad381f55e75 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1266 microversion: 2.25 time: 0.167976 Sep 01 04:53:53.591202 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 834/1670] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:53 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:53.597448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:53.598657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:53.612302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.613213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.613891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.615135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.615822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.616463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.638768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:53.647879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.648713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.649809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:53.650853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:53.651861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:53.653790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:54.239560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:54.271922 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a94ec50-1f7e-41a8-94f8-34a49bdcb323 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1614 microversion: 2.1 time: 0.678789 Sep 01 04:53:54.272487 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 835/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:53 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1614 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:54.284017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13fd6ff0-893c-4b3c-b54c-f62e1c594624 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '.version_select at 0x7fa75bc21940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:54.335079 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-13fd6ff0-893c-4b3c-b54c-f62e1c594624 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Image not found. Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13fd6ff0-893c-4b3c-b54c-f62e1c594624 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 HTTP/1.1 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'd6531d9d-7077-4d52-8f8c-bc0cf0e25139'} Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d6531d9d-7077-4d52-8f8c-bc0cf0e25139 to delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6531d9d-7077-4d52-8f8c-bc0cf0e25139 could not be found. Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.337366 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:53:54.342348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.345635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13fd6ff0-893c-4b3c-b54c-f62e1c594624 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:54.346924 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13fd6ff0-893c-4b3c-b54c-f62e1c594624 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139" status: 404 len: 62 microversion: 2.1 time: 0.073585 Sep 01 04:53:54.351121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 836/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:54 2022] DELETE /compute/v2.1/images/d6531d9d-7077-4d52-8f8c-bc0cf0e25139 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:53:54.357991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:54.367041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'host': 'n-h2-820368-37', 'deleted': False} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:54.373600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:54.374464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:54.375295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:54.376562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:54.377383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:54.378077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:54.389136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:53:54.390201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquired lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:53:54.496699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:53:54.570982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d38f88d-78f9-4a5e-b3de-bfca561bd115 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=n-h2-820368-37&all_tenants=1" status: 200 len: 2672 microversion: 2.1 time: 0.218158 Sep 01 04:53:54.571768 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 837/1673] 10.222.0.26 () {58 vars in 1192 bytes} [Thu Sep 1 04:53:54 2022] GET /compute/v2.1/servers?host=n-h2-820368-37&all_tenants=1 => generated 2672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:54.594031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:54.594934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:54.612929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:54.614048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:54.615365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:54.617237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:54.618802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:54.619871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:54.698095 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 HTTP/1.1 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '55c6db0a-5d7e-4421-898b-2b390a63fac6'} Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:54.700836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:54.708477 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:54.711701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:54.713242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a13e6e8-ebcd-4ce9-a89b-2b95cbca5fe9 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 404 len: 111 microversion: 2.1 time: 0.140019 Sep 01 04:53:54.714592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 838/1674] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:53:54 2022] DELETE /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:54.721742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:54.722641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:54.729557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:54.730284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:54.731806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:54.735577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:54.736713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:54.737323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.319594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:55.336646 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-901c4006-f9be-44d2-a24d-57dfffdd9d48 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.620465 Sep 01 04:53:55.337503 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 839/1675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:54 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:55.345433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:55.360771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:53:55.380952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.383513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.386563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.387989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.390215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.390835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.427351 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a00e0145-346c-469f-b4c3-a439d4133e58 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.085565 Sep 01 04:53:55.428256 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 840/1676] 10.222.0.26 () {58 vars in 1196 bytes} [Thu Sep 1 04:53:55 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:53:55.441984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:55.443221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:55.450467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.451280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.452187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.453191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.454114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.454788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.589414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:55.608101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:55.612540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:55.615616 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-015ec5cc-f974-40fb-8656-fde2dad77cc3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1266 microversion: 2.25 time: 0.178479 Sep 01 04:53:55.636507 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 841/1677] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:55 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:55.647535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:55.651673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] [instance: 55c6db0a-5d7e-4421-898b-2b390a63fac6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:55.670671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.671735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.672311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.673332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.673854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.674332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.704241 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] HTTP exception thrown: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Request method failure captured: Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 HTTP/1.1 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDnVynWYHbpgtm76BRv9-1QnML4ht3FQuFA1qns1G80U0s7Em8LeHYsA-qCDKdbmf_pECHLYY7zaNUISvG04iasByNptJb1CGrD-waOdjp0FT6Un1F0yY3Wfh2x_6egSf1WyKt3CTddfQ14z98sOSTrvlFoBvo4d3mjnOybGLlJPYLM Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b8dc46fa344b42ee9597ecfe34672366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-966318740 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b8dc46fa344b42ee9597ecfe34672366 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-966318740 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fcfdd4deb06b413d9585d204bd614e06 Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-966318740-project Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '55c6db0a-5d7e-4421-898b-2b390a63fac6'} Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:55.709764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] Returning 404 to user: Instance 55c6db0a-5d7e-4421-898b-2b390a63fac6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb92c38f-30bb-41fe-8e28-182f3aeb3128 tempest-ImagesTestJSON-966318740 tempest-ImagesTestJSON-966318740-project] 10.222.0.26 "GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6" status: 404 len: 111 microversion: 2.1 time: 0.074935 Sep 01 04:53:55.714966 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 842/1678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:55 2022] GET /compute/v2.1/servers/55c6db0a-5d7e-4421-898b-2b390a63fac6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:53:55.729452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b87fcf48-9074-4241-9cc9-c98b6fe32171 req-64e3ac4d-bf1a-4367-aada-e002b135491e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513b9001-2495-4749-bf46-15acf99d948a", "tag": "17d561fb-d413-419b-8808-72b59db5261d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:55.751941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b87fcf48-9074-4241-9cc9-c98b6fe32171 req-64e3ac4d-bf1a-4367-aada-e002b135491e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.752718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b87fcf48-9074-4241-9cc9-c98b6fe32171 req-64e3ac4d-bf1a-4367-aada-e002b135491e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.753309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b87fcf48-9074-4241-9cc9-c98b6fe32171 req-64e3ac4d-bf1a-4367-aada-e002b135491e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.765045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:53:55.786576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b87fcf48-9074-4241-9cc9-c98b6fe32171 req-64e3ac4d-bf1a-4367-aada-e002b135491e service nova] Creating event network-changed:17d561fb-d413-419b-8808-72b59db5261d for instance 513b9001-2495-4749-bf46-15acf99d948a on n-h1-820368-37 Sep 01 04:53:55.792485 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b87fcf48-9074-4241-9cc9-c98b6fe32171 req-64e3ac4d-bf1a-4367-aada-e002b135491e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072030 Sep 01 04:53:55.793816 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 843/1679] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:55.799485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:55.806941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:55.838386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.838919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.839372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.840118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:55.840847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:55.841369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:55.881636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:56.016070 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f8ba872-05f4-4960-be69-4e269d101a6a tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.220712 Sep 01 04:53:56.020163 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 844/1680] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:55 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:53:56.025279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e847e741-d72b-4d8a-9f0c-8d866924f7ec req-2ab04e70-e5f2-4fce-ba07-eb2c5523eac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ffff1f-649c-4947-b75d-171df891356d", "tag": "d4b994bf-9e4f-44a9-9e00-d474655b45a1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:56.043211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e847e741-d72b-4d8a-9f0c-8d866924f7ec req-2ab04e70-e5f2-4fce-ba07-eb2c5523eac7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.043587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e847e741-d72b-4d8a-9f0c-8d866924f7ec req-2ab04e70-e5f2-4fce-ba07-eb2c5523eac7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.043956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e847e741-d72b-4d8a-9f0c-8d866924f7ec req-2ab04e70-e5f2-4fce-ba07-eb2c5523eac7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:56.072301 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e847e741-d72b-4d8a-9f0c-8d866924f7ec req-2ab04e70-e5f2-4fce-ba07-eb2c5523eac7 service nova] Creating event network-changed:d4b994bf-9e4f-44a9-9e00-d474655b45a1 for instance a9ffff1f-649c-4947-b75d-171df891356d on n-h2-820368-37 Sep 01 04:53:56.080236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e847e741-d72b-4d8a-9f0c-8d866924f7ec req-2ab04e70-e5f2-4fce-ba07-eb2c5523eac7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058627 Sep 01 04:53:56.091210 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 845/1681] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:53:56.097454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:53:56.099625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:56.114860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.115417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.115850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:56.116561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.123300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.123871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:56.281289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:53:56.282955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:53:56.283607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:53:56.287579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:53:56.288219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:53:56.442036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:56.463888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.464396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.464835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:56.473278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.475758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.482790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:56.554212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7782056-72b1-45eb-b825-cc3a8c5353c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 1065 microversion: 2.1 time: 0.461667 Sep 01 04:53:56.561460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 846/1682] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:56 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 1065 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 04:53:56.582597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:56.583472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:56.598467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.605003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.609416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:56.611061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:56.614537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:56.615262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:57.469162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:57.490862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4299b0f0-c4cf-4f25-aa00-06405e884c31 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.922369 Sep 01 04:53:57.491877 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 847/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:56 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:57.501578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:57.503039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:57.511079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:57.511754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:57.512518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:57.513957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:57.514596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:57.515494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:58.461624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Updating instance_info_cache with network_info: [{"id": "d4b994bf-9e4f-44a9-9e00-d474655b45a1", "address": "fa:16:3e:56:87:35", "network": {"id": "69e5544e-9033-464c-9a3d-38ff2a1272c2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-805029320-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "61f9dee0603e4800be75797947f403b9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd4b994bf-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:53:58.495682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Releasing lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:53:58.496895 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd47b5cc-3557-41bd-9beb-7f79392275d8 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action" status: 202 len: 0 microversion: 2.1 time: 5.148554 Sep 01 04:53:58.498745 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 837/1684] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:53:53 2022] POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action => generated 0 bytes in 5151 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:53:58.506825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:58.512870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:58.535010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:58.536707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:58.537275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:58.538560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:58.540235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:58.542217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:58.775147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:58.826824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:58.836171 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0230cf02-7ac4-4286-b74a-6bcd2a47a904 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 1.329946 Sep 01 04:53:58.836847 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 848/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:57 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:58.843882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:58.845496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:58.856620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0962f2c2-36ee-4e11-bbd5-88fe160f0384 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1266 microversion: 2.25 time: 0.354729 Sep 01 04:53:58.857329 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 838/1686] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:53:58 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:53:58.865406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec7322f2-94ef-4fea-b788-abe975c9d805 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '.version_select at 0x7fa75bc21e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:58.880714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:58.887853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:58.902396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:58.907457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:58.908192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:58.909158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:58.911006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:58.915571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:59.401122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:53:59.406873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:53:59.416978 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67954ccc-cf4c-40af-9923-e4fac7d1fa98 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.558292 Sep 01 04:53:59.418878 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 839/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:58 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:53:59.862677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:53:59.863908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:53:59.883051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:59.884723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:59.886334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:53:59.888618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:53:59.890029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:53:59.891566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.060671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:00.206858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:00.228362 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aab1278a-5fe0-425b-8814-4fbd97acd60e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 0.373176 Sep 01 04:54:00.228979 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 840/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:53:59 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:00.234510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:00.235262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:00.251622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:00.252424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:00.253057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.254068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:00.254726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:00.255350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.445496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:00.460046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:00.469457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:00.472122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27e8ea59-37f6-4b11-b6a2-704ed02d918a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1266 microversion: 2.25 time: 0.241783 Sep 01 04:54:00.491988 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 841/1689] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:00 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:00.501291 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec7322f2-94ef-4fea-b788-abe975c9d805 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/320aa31b-fb2f-4624-b138-034d9e97891e" status: 202 len: 0 microversion: 2.1 time: 1.663318 Sep 01 04:54:00.501978 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 849/1690] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:53:58 2022] DELETE /compute/v2.1/os-floating-ips/320aa31b-fb2f-4624-b138-034d9e97891e => generated 0 bytes in 1665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:00.504011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:00.504972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:00.511842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3affb68c-e9d3-4a03-bed6-f32640282c49 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3affb68c-e9d3-4a03-bed6-f32640282c49 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Request method failure captured: Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action HTTP/1.1 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 34 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqt52FGYjVzNHbnasB-LrIAZa9qHd0ta27NsirEYuqMQvLx9DubBh5MdRmUQttjyc_ib_9p4z-QgGl1m1JC6XxqaecfJzMqPwazlX21Yr3yprUo02TeHwpSt-SUBW4_7TqSk1HF16fwg1AQ-z-ZTUCn9Q6CoOUV9okbhJrv1OhQL1Y Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61f9dee0603e4800be75797947f403b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61f9dee0603e4800be75797947f403b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ffc188d31a6843e89254e2886baf0a0b Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: {"addFloatingIp": {"address": ""}} Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a9ffff1f-649c-4947-b75d-171df891356d', 'body': {'addFloatingIp': {'address': ''}}} Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '' Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:54:00.516822 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 01 04:54:00.521442 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.525925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3affb68c-e9d3-4a03-bed6-f32640282c49 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:00.526904 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3affb68c-e9d3-4a03-bed6-f32640282c49 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action" status: 400 len: 142 microversion: 2.1 time: 0.019521 Sep 01 04:54:00.533136 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 850/1691] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:54:00 2022] POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:00.537797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:00.542681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:00.543991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:00.544825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.545815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:00.546714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:00.547474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.554170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:00.563951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=70 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:00.579049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:00.579943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:00.580600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.581535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:00.582442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:00.583145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:00.661432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:54:00.661960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquired lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:54:00.892284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:00.906068 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d973798e-0074-451e-a4fb-3aadd323c2dc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.410859 Sep 01 04:54:00.911956 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 842/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:00 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:00.915497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Releasing lock "refresh_cache-a9ffff1f-649c-4947-b75d-171df891356d" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:54:00.916199 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] HTTP exception thrown: floating IP not found Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Request method failure captured: Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action HTTP/1.1 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 41 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqt52FGYjVzNHbnasB-LrIAZa9qHd0ta27NsirEYuqMQvLx9DubBh5MdRmUQttjyc_ib_9p4z-QgGl1m1JC6XxqaecfJzMqPwazlX21Yr3yprUo02TeHwpSt-SUBW4_7TqSk1HF16fwg1AQ-z-ZTUCn9Q6CoOUV9okbhJrv1OhQL1Y Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61f9dee0603e4800be75797947f403b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61f9dee0603e4800be75797947f403b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ffc188d31a6843e89254e2886baf0a0b Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: exception: floating IP not found Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a9ffff1f-649c-4947-b75d-171df891356d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 01 04:54:00.917877 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Returning 404 to user: floating IP not found {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:00.922815 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bbc2b60-21b2-4ff2-a167-2f6f5de4ec32 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action" status: 404 len: 67 microversion: 2.1 time: 0.383190 Sep 01 04:54:00.924909 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 851/1693] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:54:00 2022] POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action => generated 67 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:54:00.934047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-428570ad-3d54-4c2b-b4f6-2cdef42ee4a5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:00.994092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-428570ad-3d54-4c2b-b4f6-2cdef42ee4a5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-428570ad-3d54-4c2b-b4f6-2cdef42ee4a5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Request method failure captured: Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action HTTP/1.1 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 44 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDqt52FGYjVzNHbnasB-LrIAZa9qHd0ta27NsirEYuqMQvLx9DubBh5MdRmUQttjyc_ib_9p4z-QgGl1m1JC6XxqaecfJzMqPwazlX21Yr3yprUo02TeHwpSt-SUBW4_7TqSk1HF16fwg1AQ-z-ZTUCn9Q6CoOUV9okbhJrv1OhQL1Y Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61f9dee0603e4800be75797947f403b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61f9dee0603e4800be75797947f403b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ffc188d31a6843e89254e2886baf0a0b Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: exception: Floating IP not found for address 0.0.0.0. Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a9ffff1f-649c-4947-b75d-171df891356d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 01 04:54:00.995831 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-428570ad-3d54-4c2b-b4f6-2cdef42ee4a5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-428570ad-3d54-4c2b-b4f6-2cdef42ee4a5 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action" status: 404 len: 88 microversion: 2.1 time: 0.071240 Sep 01 04:54:01.008480 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 843/1694] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:54:00 2022] POST /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d/action => generated 88 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:54:01.010609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:01.020059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:01.027481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.028462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.028888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.039054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.039760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.040208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.104334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:54:01.253432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:01.260125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:01.277008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.278361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.290312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.293747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.296682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.299145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.323647 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92edfe7e-bf7f-4872-9383-f7cc23bd9b40 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 204 len: 0 microversion: 2.1 time: 0.319694 Sep 01 04:54:01.325447 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 852/1695] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:54:01 2022] DELETE /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:01.342272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:01.348490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:01.376349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.376826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.378152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.387926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.392012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.392547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.700790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:01.717180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd25ac96-8945-4979-99f6-6854d49bf3c7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 0.471377 Sep 01 04:54:01.717762 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 844/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:01 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:01.722839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:01.724356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:01.731489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.732199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.732819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.733717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.734295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.734879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.921069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:01.932689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:01.941571 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4ec445d-12ac-4029-84d2-c4a1f7b903ab tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1542 microversion: 2.1 time: 0.610373 Sep 01 04:54:01.954782 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 853/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:01 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1542 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:01.955009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:01.955150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:01.955150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:01.955314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:01.959415 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55a100e8-c414-4ad5-b4a8-af5308996c58 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 200 len: 1266 microversion: 2.25 time: 0.240392 Sep 01 04:54:01.973965 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 845/1698] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:01 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:01.976791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.977958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.978874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:01.979866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:01.980545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:01.981295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:02.281294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:02.301136 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc442307-a8c0-4659-8038-7832c154ddc3 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.351567 Sep 01 04:54:02.304129 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 854/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:01 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:02.737689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:02.738386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:02.750679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:02.751490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:02.752329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:02.753365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:02.754162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:02.754856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:02.962473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:02.963143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:02.977335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:02.977934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:02.978460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:02.979125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:02.979621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:02.988092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:03.408315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:03.423193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5e58962-718d-4f2c-9db5-de94aa759ca5 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 0.689303 Sep 01 04:54:03.446796 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 846/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:02 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:03.452899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:03.453520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:03.460339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:03.460842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:03.461281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:03.462027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:03.462695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:03.464518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:03.480681 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] HTTP exception thrown: Instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 could not be found. Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Request method failure captured: Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 HTTP/1.1 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDlAfvPBQ76lM0yew2K9xtim5Q9GI74X3jEwHlmJo-VVqx_hvWebVMCiRl62xoFE9rSWfDK2U183hBg6LfIXOoH5HpZ1lOtieDfvteVwaaDNkNf3V_rTNi95rfzP3To7MNf-O532ShWWYrw8cM_bwRpgK6E9cGcFsngNjb7yirscYKU Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.25 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ce4ece60266c4a9692b03d795cea8462 Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 could not be found. Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '5943be74-63b0-4bf2-9b9f-c9a37ff00ec1'} Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 could not be found. Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 could not be found. Sep 01 04:54:03.482789 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 could not be found. Sep 01 04:54:03.488129 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:03.490141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Returning 404 to user: Instance 5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:03.491549 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8a7f55c-24c0-421d-9aff-f27622d531d3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1" status: 404 len: 111 microversion: 2.25 time: 0.043223 Sep 01 04:54:03.493202 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 847/1701] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:03 2022] GET /compute/v2.1/servers/5943be74-63b0-4bf2-9b9f-c9a37ff00ec1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:03.517044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:03.519409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:03.534361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:03.535509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:03.536134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:03.537302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:03.537959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:03.538563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:04.133681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:04.143432 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cfd70c4-ea4f-4b63-94be-377f8dee9e7d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1542 microversion: 2.1 time: 1.185503 Sep 01 04:54:04.166369 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 855/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:02 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1542 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:04.445711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:04.446338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:04.463199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:04.464596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:04.467851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:04.468613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:04.469087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:04.469515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:04.552358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:04.571868 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1081397a-c9e4-4c8f-8ca1-3ef6f684ddf4 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 1.077297 Sep 01 04:54:04.581917 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 848/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:03 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:05.174350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:05.175273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:05.195910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:05.196546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:05.199676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:05.201339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:05.204440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:05.205232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:05.309341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:05.326723 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d14dd644-e86f-46e5-ad4f-7d4707ca0316 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 0.885229 Sep 01 04:54:05.331256 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 856/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:04 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:05.362716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d1ef859e-6ec3-43af-917c-44c3037c276a req-6a0fb567-245e-46ca-b5b0-6624f06be5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ffff1f-649c-4947-b75d-171df891356d", "name": "network-vif-deleted", "tag": "d4b994bf-9e4f-44a9-9e00-d474655b45a1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:05.390941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1ef859e-6ec3-43af-917c-44c3037c276a req-6a0fb567-245e-46ca-b5b0-6624f06be5e5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:05.391758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1ef859e-6ec3-43af-917c-44c3037c276a req-6a0fb567-245e-46ca-b5b0-6624f06be5e5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:05.392388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1ef859e-6ec3-43af-917c-44c3037c276a req-6a0fb567-245e-46ca-b5b0-6624f06be5e5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:05.409856 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d1ef859e-6ec3-43af-917c-44c3037c276a req-6a0fb567-245e-46ca-b5b0-6624f06be5e5 service nova] Creating event network-vif-deleted:d4b994bf-9e4f-44a9-9e00-d474655b45a1 for instance a9ffff1f-649c-4947-b75d-171df891356d on n-h2-820368-37 Sep 01 04:54:05.437493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:05.439550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:05.444256 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d1ef859e-6ec3-43af-917c-44c3037c276a req-6a0fb567-245e-46ca-b5b0-6624f06be5e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080822 Sep 01 04:54:05.447680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 857/1705] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:05.452738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1b87a13-7264-4858-a04a-97f017f6af96 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1500 microversion: 2.1 time: 0.282443 Sep 01 04:54:05.460537 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 849/1706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:05 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1500 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:05.609935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:05.614979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:05.632246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:05.633681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:05.636747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:05.638502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:05.639854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:05.642125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:06.347819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:06.348952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:06.372544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:06.394121 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d27ad5c-8721-431a-ace4-af8bd5cb860d tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.792608 Sep 01 04:54:06.398936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:06.403491 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 858/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:05 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:06.404639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:06.406548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:06.408920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:06.419462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:06.420245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:06.483918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:06.484545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:06.496996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:06.497536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:06.497981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:06.511892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:06.512948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:06.515060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:06.607364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:06.667652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:06.668853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:06.670718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:06.671516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lazy-loading 'fault' on Instance uuid a9ffff1f-649c-4947-b75d-171df891356d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:54:06.804409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffc188d31a6843e89254e2886baf0a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f9dee0603e4800be75797947f403b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:06.813705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84d5bb09-16ba-4e43-ba0e-0643429ef95d tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 200 len: 1322 microversion: 2.1 time: 0.334095 Sep 01 04:54:06.818746 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 859/1708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:06 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:06.995250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:07.023336 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fcc12c3b-dbe2-4f25-b714-f8974ed85b5c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 0.667639 Sep 01 04:54:07.024484 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 850/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:06 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:07.426047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:07.426619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:07.436669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:07.437163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:07.437594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:07.438298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:07.438747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:07.439195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:07.762530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:07.775996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4a77f8b-44bb-432e-b785-f48d3cfb4462 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.353873 Sep 01 04:54:07.777346 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 860/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:07 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:07.839490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:07.842131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] [instance: a9ffff1f-649c-4947-b75d-171df891356d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:07.857290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:07.857838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:07.858334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:07.859086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:07.859538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:07.863526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:07.895578 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] HTTP exception thrown: Instance a9ffff1f-649c-4947-b75d-171df891356d could not be found. Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Request method failure captured: Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d HTTP/1.1 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDqt52FGYjVzNHbnasB-LrIAZa9qHd0ta27NsirEYuqMQvLx9DubBh5MdRmUQttjyc_ib_9p4z-QgGl1m1JC6XxqaecfJzMqPwazlX21Yr3yprUo02TeHwpSt-SUBW4_7TqSk1HF16fwg1AQ-z-ZTUCn9Q6CoOUV9okbhJrv1OhQL1Y Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/61f9dee0603e4800be75797947f403b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_61f9dee0603e4800be75797947f403b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/61f9dee0603e4800be75797947f403b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 61f9dee0603e4800be75797947f403b9 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105 Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ffc188d31a6843e89254e2886baf0a0b Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a9ffff1f-649c-4947-b75d-171df891356d could not be found. Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a9ffff1f-649c-4947-b75d-171df891356d'} Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ffff1f-649c-4947-b75d-171df891356d could not be found. Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ffff1f-649c-4947-b75d-171df891356d could not be found. Sep 01 04:54:07.897137 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ffff1f-649c-4947-b75d-171df891356d could not be found. Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] Returning 404 to user: Instance a9ffff1f-649c-4947-b75d-171df891356d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1548b1d9-2a4f-4e07-8e6f-393d6ed9f034 tempest-FloatingIPsAssociationNegativeTestJSON-813164105 tempest-FloatingIPsAssociationNegativeTestJSON-813164105-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d" status: 404 len: 111 microversion: 2.1 time: 0.064356 Sep 01 04:54:07.903061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 851/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:07 2022] GET /compute/v2.1/servers/a9ffff1f-649c-4947-b75d-171df891356d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:54:08.058734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:08.059683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:08.070033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:08.075047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:08.075766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:08.077978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:08.079605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:08.080244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:08.758520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:08.767727 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8610814-fbe8-4645-8553-57aa6b9dccfa tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1469 microversion: 2.1 time: 0.719360 Sep 01 04:54:08.773339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 861/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:08 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1469 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:08.800289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:08.800950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:08.820282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:08.829508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:08.830258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:08.834465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:08.835197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:08.835826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:08.865023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-996633831", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:08.966216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:54:09.462356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:09.475338 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f396f20-8329-46c1-8172-2ae98f24bd08 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.679198 Sep 01 04:54:09.477267 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 862/1713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:08 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:09.628440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:54:09.629278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:54:09.629934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:54:09.630553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:54:09.631170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:54:09.650547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:09.652893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:09.653521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:09.654309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:09.660848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:09.661618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:09.736830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Getting quotas for project 657aec8cb7944e229be7f018c48faf26. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:09.751391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Getting quotas for user aa3671675b3e42b0bf27cac10347b02a and project 657aec8cb7944e229be7f018c48faf26. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:09.790613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:09.791290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:09.804749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:09.804996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:54:09.809623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:54:09.810513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:09.812337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:09.814864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:09.817202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:09.821105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:09.901219 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a14f4456-0bf3-432d-aee2-ef0dd4ebdc0d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.463930 Sep 01 04:54:09.902914 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 852/1714] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:54:10.068321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e7766ab-2f32-4bb2-8016-a6b35f220ad3 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bdf71f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-38412109", "description": "tempest-description-1574616337"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:10.300776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:10.316162 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-297175fb-4d8c-406e-a715-bb09839f1137 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1475 microversion: 2.1 time: 0.529948 Sep 01 04:54:10.321726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 863/1715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:09 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1475 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:10.365602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce2afe6c-8d1b-47b2-abf9-b74d691b1745 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:10.366227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce2afe6c-8d1b-47b2-abf9-b74d691b1745 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:10.653361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce2afe6c-8d1b-47b2-abf9-b74d691b1745 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:10.691000 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce2afe6c-8d1b-47b2-abf9-b74d691b1745 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1216 microversion: 2.1 time: 0.346935 Sep 01 04:54:10.692181 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 864/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:10 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1216 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:10.693508 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e7766ab-2f32-4bb2-8016-a6b35f220ad3 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.789304 Sep 01 04:54:10.694319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 853/1717] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:54:09 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:10.697329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:10.697952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:10.707800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62d6e105-c223-436f-8262-222a223e1734 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75beb18b0>, body: {"security_group_rule": {"parent_group_id": "f6b7a289-b1b5-439c-845f-d3e170019e18", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:10.726137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:10.726644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:10.727115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:10.727837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:10.728293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:10.728717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:11.204552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:11.221863 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-701cb78b-4c49-47c5-8caf-85a275b59185 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.528387 Sep 01 04:54:11.243307 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 865/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:10 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:11.349224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:11.350364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:11.363195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:11.367873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:11.369328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:11.370423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:11.372356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:11.373119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:11.562144 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62d6e105-c223-436f-8262-222a223e1734 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.858127 Sep 01 04:54:11.563706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 854/1719] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:11.576235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13c71be4-a2e7-4899-951f-cffc0fc4c69d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bdaec10>, body: {"security_group_rule": {"parent_group_id": "f6b7a289-b1b5-439c-845f-d3e170019e18", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:11.809653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:11.821762 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e812b58-d3b0-4c94-89e6-66165390b83a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1475 microversion: 2.1 time: 0.476506 Sep 01 04:54:11.839445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 866/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:11 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:11.853615 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-13c71be4-a2e7-4899-951f-cffc0fc4c69d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: This rule already exists in group f6b7a289-b1b5-439c-845f-d3e170019e18 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13c71be4-a2e7-4899-951f-cffc0fc4c69d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 138 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "f6b7a289-b1b5-439c-845f-d3e170019e18", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: exception: This rule already exists in group f6b7a289-b1b5-439c-845f-d3e170019e18 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f6b7a289-b1b5-439c-845f-d3e170019e18', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f6b7a289-b1b5-439c-845f-d3e170019e18 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f6b7a289-b1b5-439c-845f-d3e170019e18 Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:11.855852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f6b7a289-b1b5-439c-845f-d3e170019e18 Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13c71be4-a2e7-4899-951f-cffc0fc4c69d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 400 to user: This rule already exists in group f6b7a289-b1b5-439c-845f-d3e170019e18 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13c71be4-a2e7-4899-951f-cffc0fc4c69d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.286278 Sep 01 04:54:11.861906 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 855/1721] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:11 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:54:11.868918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:11.870218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffe1ffd3-9346-405d-9499-8233da4a8067 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa75beb6550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:11.873859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:11.891507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:11.891915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:11.892346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:11.893067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:11.908668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:11.909253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:12.037805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:12.048731 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f66e5c98-358e-41b7-afc8-cbd4d2be681c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1268 microversion: 2.1 time: 0.204219 Sep 01 04:54:12.054737 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 867/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:11 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:12.208941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffe1ffd3-9346-405d-9499-8233da4a8067 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/5ea0fa45-69c1-4072-b4dd-88d1c384da8b" status: 202 len: 0 microversion: 2.1 time: 0.346565 Sep 01 04:54:12.209842 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 856/1723] 10.222.0.26 () {58 vars in 1287 bytes} [Thu Sep 1 04:54:11 2022] DELETE /compute/v2.1/os-security-group-rules/5ea0fa45-69c1-4072-b4dd-88d1c384da8b => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:54:12.220168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbbc0acf-30ce-45fe-b2be-22681b415fba tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bcce430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1980191932", "description": "tempest-description-1270921682"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:12.258143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:12.258621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:12.268356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:12.269954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:12.273102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:12.273837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:12.292936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:12.295596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:12.296258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:12.961490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:12.977720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3689208b-7a31-48fb-acb7-223d065ac55f tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.723900 Sep 01 04:54:12.992244 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 857/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:12 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:13.004127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:13.005059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:13.021980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.037737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.039145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.050589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.051296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.052390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.122300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:54:13.335600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2957ab64-e7b7-4420-a6ff-d9c849c8bfaf tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 204 len: 0 microversion: 2.25 time: 0.341616 Sep 01 04:54:13.340469 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 858/1725] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:54:12 2022] DELETE /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:54:13.378161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:13.382332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:13.398985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.399804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.407085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbbc0acf-30ce-45fe-b2be-22681b415fba tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.191087 Sep 01 04:54:13.409945 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 868/1726] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:54:12 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:13.429615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:13.431310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:13.433009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.435645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.436567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.437888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.453104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.455759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.456865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.461167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.462530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.464007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.614480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:13.631715 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84cc5170-a156-4095-935a-53f655027299 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1268 microversion: 2.1 time: 0.218839 Sep 01 04:54:13.633393 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 869/1727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:13 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:13.654543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:13.660376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:13.691554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.695709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.698600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:13.701475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:13.706697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:13.707954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:14.291520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:14.350125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:14.361340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:14.368582 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dddc58ba-ebfe-44ff-bd21-e7bae9cbb326 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1732 microversion: 2.25 time: 0.727030 Sep 01 04:54:14.369668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 870/1728] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:13 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1732 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:14.375864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:14.394528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bbfe1df-84cd-4ce8-bbcb-625c3b28a45d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bcbf940>, body: {"security_group_rule": {"parent_group_id": "0eb4073f-e7bb-45f9-a5cf-5cb679a2cddb", "ip_protocol": "tcp", "from_port": 1459383395, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:14.395654 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-baf0f436-ac90-4a77-b729-a0781d5c1806 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1475 microversion: 2.1 time: 1.045193 Sep 01 04:54:14.409338 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 859/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:13 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1475 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:14.420646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-19606f7e-0651-4cb8-9baf-b41466f1c4e2 req-8c857c57-4877-4cde-a91e-9796fda37c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "name": "network-vif-unplugged", "status": "completed", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:14.465956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-19606f7e-0651-4cb8-9baf-b41466f1c4e2 req-8c857c57-4877-4cde-a91e-9796fda37c1b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:14.485998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-19606f7e-0651-4cb8-9baf-b41466f1c4e2 req-8c857c57-4877-4cde-a91e-9796fda37c1b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:14.488010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-19606f7e-0651-4cb8-9baf-b41466f1c4e2 req-8c857c57-4877-4cde-a91e-9796fda37c1b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:14.536698 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-19606f7e-0651-4cb8-9baf-b41466f1c4e2 req-8c857c57-4877-4cde-a91e-9796fda37c1b service nova] Creating event network-vif-unplugged:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:54:14.551089 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-19606f7e-0651-4cb8-9baf-b41466f1c4e2 req-8c857c57-4877-4cde-a91e-9796fda37c1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152378 Sep 01 04:54:14.552294 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 860/1730] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:14.559791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:14.560930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:14.568718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:14.569669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:14.578749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:14.579607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:14.580188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:14.582405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:15.412596 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9bbfe1df-84cd-4ce8-bbcb-625c3b28a45d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Invalid port range 1459383395:22. Former value cannot be greater than the later Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bbfe1df-84cd-4ce8-bbcb-625c3b28a45d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 146 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "0eb4073f-e7bb-45f9-a5cf-5cb679a2cddb", "ip_protocol": "tcp", "from_port": 1459383395, "to_port": 22}} Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid port range 1459383395:22. Former value cannot be greater than the later Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0eb4073f-e7bb-45f9-a5cf-5cb679a2cddb', 'ip_protocol': 'tcp', 'from_port': 1459383395, 'to_port': 22}}} Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1459383395:22. Former value cannot be greater than the later Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1459383395:22. Former value cannot be greater than the later Sep 01 04:54:15.416525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1459383395:22. Former value cannot be greater than the later Sep 01 04:54:15.421241 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:15.425113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bbfe1df-84cd-4ce8-bbcb-625c3b28a45d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 400 to user: Invalid port range 1459383395:22. Former value cannot be greater than the later {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:15.427717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9bbfe1df-84cd-4ce8-bbcb-625c3b28a45d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 1.055821 Sep 01 04:54:15.433516 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 871/1731] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:14 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 1063 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:15.451909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:15.453154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:15.478373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:15.483087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:15.484843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:15.488727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:15.491801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:15.492568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:15.641918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:15.651779 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d850ce7-bf29-4bdb-b293-1863ce409469 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 1.097728 Sep 01 04:54:15.657206 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 861/1732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:14 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:15.676054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-61d443bd-f0f6-4805-a659-83334c7c0aa0 req-4b288dac-b10d-4ded-be3f-06cd882ac37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b21455b-3a86-47bf-a77f-098f46a1e18e", "name": "network-vif-unplugged", "status": "completed", "tag": "505d6c37-58cb-45c9-a9d6-0f8252a15906"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:15.727309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61d443bd-f0f6-4805-a659-83334c7c0aa0 req-4b288dac-b10d-4ded-be3f-06cd882ac37f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:15.728088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61d443bd-f0f6-4805-a659-83334c7c0aa0 req-4b288dac-b10d-4ded-be3f-06cd882ac37f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:15.732065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61d443bd-f0f6-4805-a659-83334c7c0aa0 req-4b288dac-b10d-4ded-be3f-06cd882ac37f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:15.762739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-61d443bd-f0f6-4805-a659-83334c7c0aa0 req-4b288dac-b10d-4ded-be3f-06cd882ac37f service nova] Creating event network-vif-unplugged:505d6c37-58cb-45c9-a9d6-0f8252a15906 for instance 0b21455b-3a86-47bf-a77f-098f46a1e18e on n-h2-820368-37 Sep 01 04:54:15.777495 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-61d443bd-f0f6-4805-a659-83334c7c0aa0 req-4b288dac-b10d-4ded-be3f-06cd882ac37f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116872 Sep 01 04:54:15.778478 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 862/1733] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:15.784147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:15.790458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:15.808510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:15.809334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:15.810121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:15.812904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:15.813570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:15.814259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:15.869062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:17.473082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:17.494163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:17.503925 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30a0363a-8a5c-4e14-b489-254e3f1cd28d tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1316 microversion: 2.1 time: 2.063889 Sep 01 04:54:17.505607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:17.507794 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 872/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:15 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1316 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:17.509459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:17.515410 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4edde076-d05f-49a2-a5dc-12d225b15253 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1732 microversion: 2.25 time: 1.731001 Sep 01 04:54:17.517054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 863/1735] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:15 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1732 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:17.520289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:17.522687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:17.524950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b151f3fe-698b-41d3-a6f8-73c031f11d4a tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75beb1820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1869041390", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:17.533416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b151f3fe-698b-41d3-a6f8-73c031f11d4a tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Security group id should be uuid Sep 01 04:54:17.538234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b151f3fe-698b-41d3-a6f8-73c031f11d4a tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 131 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1869041390", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group id should be uuid Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1869041390', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:17.539465 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:17.544554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 01 04:54:17.544554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:17.546450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:17.548257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b151f3fe-698b-41d3-a6f8-73c031f11d4a tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 400 to user: Security group id should be uuid {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:17.549762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:17.557246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:17.559378 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b151f3fe-698b-41d3-a6f8-73c031f11d4a tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.040744 Sep 01 04:54:17.560075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:17.566233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 864/1736] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:17 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:54:17.566474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:17.581885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:17.585680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:17.614693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:17.615131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:17.615560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:17.616277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:17.616715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:17.618137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:18.027540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:18.039675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c6bf6f1-18e4-4fb1-97f8-107ab2fd3195 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1475 microversion: 2.1 time: 0.530014 Sep 01 04:54:18.046592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 873/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:17 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1475 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:18.054034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-50fa5fc4-ea40-42db-adb7-db0e214f2337 req-a339b02d-5ebe-45b9-b058-1450f0d6f54d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:18.074600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-50fa5fc4-ea40-42db-adb7-db0e214f2337 req-a339b02d-5ebe-45b9-b058-1450f0d6f54d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:18.075494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-50fa5fc4-ea40-42db-adb7-db0e214f2337 req-a339b02d-5ebe-45b9-b058-1450f0d6f54d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:18.076175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-50fa5fc4-ea40-42db-adb7-db0e214f2337 req-a339b02d-5ebe-45b9-b058-1450f0d6f54d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:18.105678 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-50fa5fc4-ea40-42db-adb7-db0e214f2337 req-a339b02d-5ebe-45b9-b058-1450f0d6f54d service nova] Creating event network-changed:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:54:18.128800 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-50fa5fc4-ea40-42db-adb7-db0e214f2337 req-a339b02d-5ebe-45b9-b058-1450f0d6f54d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080267 Sep 01 04:54:18.129994 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 874/1738] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:18.140455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e59aafe9-913f-4861-b5f5-1965af8d2433 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bc46820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-265334791", "description": "tempest-description-1265192924"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:18.274407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:18.302737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ffbf266f-3a11-4829-8424-eaf8c881dc9a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.741037 Sep 01 04:54:18.303963 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 865/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:17 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:18.313369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4850b512-6f77-4bef-8ea6-f64ae1684a42 req-6d3db585-cb3e-44bf-80ff-91ad4816b096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b21455b-3a86-47bf-a77f-098f46a1e18e", "tag": "505d6c37-58cb-45c9-a9d6-0f8252a15906"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:18.350023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4850b512-6f77-4bef-8ea6-f64ae1684a42 req-6d3db585-cb3e-44bf-80ff-91ad4816b096 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:18.350535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4850b512-6f77-4bef-8ea6-f64ae1684a42 req-6d3db585-cb3e-44bf-80ff-91ad4816b096 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:18.350995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4850b512-6f77-4bef-8ea6-f64ae1684a42 req-6d3db585-cb3e-44bf-80ff-91ad4816b096 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:18.393190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4850b512-6f77-4bef-8ea6-f64ae1684a42 req-6d3db585-cb3e-44bf-80ff-91ad4816b096 service nova] Creating event network-changed:505d6c37-58cb-45c9-a9d6-0f8252a15906 for instance 0b21455b-3a86-47bf-a77f-098f46a1e18e on n-h2-820368-37 Sep 01 04:54:18.408880 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4850b512-6f77-4bef-8ea6-f64ae1684a42 req-6d3db585-cb3e-44bf-80ff-91ad4816b096 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102131 Sep 01 04:54:18.410418 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 866/1740] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:18.530039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:18.530754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:18.546493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:18.547013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:18.547450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:18.548186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:18.548633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:18.549248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:18.865667 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e59aafe9-913f-4861-b5f5-1965af8d2433 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.734081 Sep 01 04:54:18.866345 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 875/1741] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:54:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:18.872653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:18.873657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:18.882449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:18.883350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:18.883966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:18.884880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:18.885504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:18.886151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:19.161241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:19.182994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:19.189761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:19.193334 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c47d63d5-cab0-46e2-beea-581cafb0ad9b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1664 microversion: 2.25 time: 0.325556 Sep 01 04:54:19.196050 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 876/1742] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:18 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1664 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:19.226918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-687f6970-49dd-42db-85f9-31d9966a7576 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bd0bee0>, body: {"security_group_rule": {"parent_group_id": "fb7fcc6d-f1cc-41f4-b738-d2da7ef521b9", "ip_protocol": "tempest-999-646440678", "from_port": 22, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:19.271425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:19.292986 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da505b8c-eea4-4ced-8ea8-7598a49c1b38 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1316 microversion: 2.1 time: 0.765756 Sep 01 04:54:19.308599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 867/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:18 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1316 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:19.316426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:19.317430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:19.325180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:19.325948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:19.326583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:19.327506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:19.328120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:19.329130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:19.472177 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-687f6970-49dd-42db-85f9-31d9966a7576 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Invalid IP protocol tempest-999-646440678. Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-687f6970-49dd-42db-85f9-31d9966a7576 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 156 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "fb7fcc6d-f1cc-41f4-b738-d2da7ef521b9", "ip_protocol": "tempest-999-646440678", "from_port": 22, "to_port": 22}} Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid IP protocol tempest-999-646440678. Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fb7fcc6d-f1cc-41f4-b738-d2da7ef521b9', 'ip_protocol': 'tempest-999-646440678', 'from_port': 22, 'to_port': 22}}} Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-646440678. Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-646440678. Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:19.474190 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-646440678. Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-687f6970-49dd-42db-85f9-31d9966a7576 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 400 to user: Invalid IP protocol tempest-999-646440678. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:19.479330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-687f6970-49dd-42db-85f9-31d9966a7576 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.278362 Sep 01 04:54:19.482617 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 877/1744] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:19 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:54:19.487921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-43527f91-2e5b-4288-a490-fd81f9612c66 req-794fa43a-b172-4c0e-bd3f-21c84280c8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "name": "network-vif-plugged", "status": "completed", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:19.502424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-43527f91-2e5b-4288-a490-fd81f9612c66 req-794fa43a-b172-4c0e-bd3f-21c84280c8eb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:19.503276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-43527f91-2e5b-4288-a490-fd81f9612c66 req-794fa43a-b172-4c0e-bd3f-21c84280c8eb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:19.503952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-43527f91-2e5b-4288-a490-fd81f9612c66 req-794fa43a-b172-4c0e-bd3f-21c84280c8eb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:19.519226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-43527f91-2e5b-4288-a490-fd81f9612c66 req-794fa43a-b172-4c0e-bd3f-21c84280c8eb service nova] Creating event network-vif-plugged:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:54:19.529782 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-43527f91-2e5b-4288-a490-fd81f9612c66 req-794fa43a-b172-4c0e-bd3f-21c84280c8eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045450 Sep 01 04:54:19.531171 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 878/1745] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:19.539695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:19.540828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:19.554144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:19.558586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:19.560304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:19.563101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:19.566164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:19.568147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:19.698112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:19.779344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:19.782134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:19.796195 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ab51ca8-c174-4c3c-9f27-271e92a11a45 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1475 microversion: 2.1 time: 0.485787 Sep 01 04:54:19.801801 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 868/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:19 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:19.820500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fabb4334-c33c-44af-aa89-56e9d05a7d01 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75be43940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-180100969", "description": "tempest-description-1250697427"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:20.112495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:20.126451 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9048febe-7946-4918-bced-1db6cf473a45 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.593668 Sep 01 04:54:20.127399 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 879/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:19 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:20.229411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:20.230087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:20.247157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.247690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.248127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.249089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.249714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.250307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.571170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:20.585395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:20.591354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:20.592976 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ca803d3-ff31-4801-b957-08137f2f532a tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1664 microversion: 2.25 time: 0.370269 Sep 01 04:54:20.593797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 880/1748] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:20 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1664 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:54:20.606735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:20.607564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:20.629384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.630035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.630474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.631422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.632048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.632643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.675054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:20.836006 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fabb4334-c33c-44af-aa89-56e9d05a7d01 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.032348 Sep 01 04:54:20.849225 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 869/1749] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:54:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:20.865673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-33b30610-0928-4cf2-a644-c069d42d29dc req-10c001a4-1f69-4a88-a199-b58bcf9bbcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90982816-19d1-448f-bd4a-7cda5aab3e2a", "name": "network-vif-deleted", "tag": "30294c27-aeaa-49f8-874e-b14aeb855c61"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:20.904315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-33b30610-0928-4cf2-a644-c069d42d29dc req-10c001a4-1f69-4a88-a199-b58bcf9bbcd3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.904838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-33b30610-0928-4cf2-a644-c069d42d29dc req-10c001a4-1f69-4a88-a199-b58bcf9bbcd3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.905274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-33b30610-0928-4cf2-a644-c069d42d29dc req-10c001a4-1f69-4a88-a199-b58bcf9bbcd3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.915151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:20.925093 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23724a72-9219-4faa-abf6-c368000a4432 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1316 microversion: 2.1 time: 0.329186 Sep 01 04:54:20.927072 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 881/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:20 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:20.932396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:20.933486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:20.940354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.941231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.941921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.942863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:20.943671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:20.945417 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-33b30610-0928-4cf2-a644-c069d42d29dc req-10c001a4-1f69-4a88-a199-b58bcf9bbcd3 service nova] Creating event network-vif-deleted:30294c27-aeaa-49f8-874e-b14aeb855c61 for instance 90982816-19d1-448f-bd4a-7cda5aab3e2a on n-h2-820368-37 Sep 01 04:54:20.946143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:20.952826 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-33b30610-0928-4cf2-a644-c069d42d29dc req-10c001a4-1f69-4a88-a199-b58bcf9bbcd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102160 Sep 01 04:54:20.953760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:20.955684 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 870/1751] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:20.962378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb2d0302-ea31-45e5-a1eb-2cbc4a576133 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bd873a0>, body: {"security_group_rule": {"parent_group_id": "468232f8-3696-472f-ac92-b8a49351cf4e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:21.075490 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-eb2d0302-ea31-45e5-a1eb-2cbc4a576133 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb2d0302-ea31-45e5-a1eb-2cbc4a576133 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 138 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "468232f8-3696-472f-ac92-b8a49351cf4e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': '468232f8-3696-472f-ac92-b8a49351cf4e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 01 04:54:21.077236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb2d0302-ea31-45e5-a1eb-2cbc4a576133 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb2d0302-ea31-45e5-a1eb-2cbc4a576133 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.121691 Sep 01 04:54:21.084851 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 871/1752] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:20 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:21.093302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fbf68b8-8e74-4a61-841c-2942b6b817a0 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75be43160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-633065536", "description": "tempest-description-1482744010"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:21.203905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:21.217003 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3f10f3b-b622-4b70-ab7b-6bf3cd568aef tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1475 microversion: 2.1 time: 0.288365 Sep 01 04:54:21.219836 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 882/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:20 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1475 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:21.225094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:21.225752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:21.244686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.245500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.247928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.248949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.251052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.251683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.523279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fbf68b8-8e74-4a61-841c-2942b6b817a0 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.436305 Sep 01 04:54:21.523279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 872/1754] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:54:21 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:21.556949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:21.569039 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00699157-1c82-47ea-ba5a-98df5aefd157 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.347774 Sep 01 04:54:21.579609 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 883/1755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:21 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:21.588746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56d2a439-cf5a-4440-829e-9328ebb5c21d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75bcce430>, body: {"security_group_rule": {"parent_group_id": "eca06d08-ee52-48b1-9c83-1d886b47a5a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 233438235}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:21.649700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-56d2a439-cf5a-4440-829e-9328ebb5c21d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Invalid port range 22:233438235. Valid TCP ports should be between 1-65535 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56d2a439-cf5a-4440-829e-9328ebb5c21d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 145 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "eca06d08-ee52-48b1-9c83-1d886b47a5a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 233438235}} Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid port range 22:233438235. Valid TCP ports should be between 1-65535 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'eca06d08-ee52-48b1-9c83-1d886b47a5a8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 233438235}}} Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:233438235. Valid TCP ports should be between 1-65535 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:233438235. Valid TCP ports should be between 1-65535 Sep 01 04:54:21.651912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:233438235. Valid TCP ports should be between 1-65535 Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56d2a439-cf5a-4440-829e-9328ebb5c21d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 400 to user: Invalid port range 22:233438235. Valid TCP ports should be between 1-65535 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56d2a439-cf5a-4440-829e-9328ebb5c21d tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.072673 Sep 01 04:54:21.662247 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 884/1756] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:21 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:21.663130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:21.663244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:21.681411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.684394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.685089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.685865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.686346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.686779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.734407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.735128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.736141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.737095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lazy-loading 'fault' on Instance uuid 90982816-19d1-448f-bd4a-7cda5aab3e2a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:54:21.757889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c531bff4-2558-43f9-9739-5b9be6eb3752 tempest-ListImageFiltersNegativeTestJSON-769852657 tempest-ListImageFiltersNegativeTestJSON-769852657-project] Calling method '.version_select at 0x7fa75bf15820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:21.781753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c531bff4-2558-43f9-9739-5b9be6eb3752 tempest-ListImageFiltersNegativeTestJSON-769852657 tempest-ListImageFiltersNegativeTestJSON-769852657-project] HTTP exception thrown: Image not found. Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c531bff4-2558-43f9-9739-5b9be6eb3752 tempest-ListImageFiltersNegativeTestJSON-769852657 tempest-ListImageFiltersNegativeTestJSON-769852657-project] Request method failure captured: Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/images/d04fbc13-7228-43c2-a58c-3fd191015749 HTTP/1.1 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDr9NDkyjICRk2eNaYcPJ0jnmzOdSxfUqJDKrDwDqYIH7tgdcv0HtTSrc88c8Mpf1VXTTtZhyMBn0Tje0cPHiI2hMpsU9IGmL2XVdEXoaiGg-vE5y9wW8zbc6pu4UCuvyM0bA8W5dgl3BsMd5QiYEszMEO9Kn7hSdYMcNSztSSQ3TEM Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d6c1a949bb0c426ea1129821096cb9c9 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-769852657 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d6c1a949bb0c426ea1129821096cb9c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d6c1a949bb0c426ea1129821096cb9c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d6c1a949bb0c426ea1129821096cb9c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d6c1a949bb0c426ea1129821096cb9c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-769852657 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d6c1a949bb0c426ea1129821096cb9c9 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-769852657 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListImageFiltersNegativeTestJSON-769852657-project Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: db52aa4e848c4d76a5d63c5f5ea498a0 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-769852657-project Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd04fbc13-7228-43c2-a58c-3fd191015749'} Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d04fbc13-7228-43c2-a58c-3fd191015749 Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:54:21.784103 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d04fbc13-7228-43c2-a58c-3fd191015749 could not be found. Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c531bff4-2558-43f9-9739-5b9be6eb3752 tempest-ListImageFiltersNegativeTestJSON-769852657 tempest-ListImageFiltersNegativeTestJSON-769852657-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c531bff4-2558-43f9-9739-5b9be6eb3752 tempest-ListImageFiltersNegativeTestJSON-769852657 tempest-ListImageFiltersNegativeTestJSON-769852657-project] 10.222.0.26 "GET /compute/v2.1/images/d04fbc13-7228-43c2-a58c-3fd191015749" status: 404 len: 62 microversion: 2.1 time: 0.260536 Sep 01 04:54:21.791357 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 873/1757] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:21 2022] GET /compute/v2.1/images/d04fbc13-7228-43c2-a58c-3fd191015749 => generated 62 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 04:54:21.799405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:21.799904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:21.801556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:21.805511 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20114860-b409-47b4-832f-dbba2e3ee2ed tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 200 len: 1375 microversion: 2.25 time: 0.147878 Sep 01 04:54:21.805760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Action: 'create', calling method: .version_select at 0x7fa75be43040>, body: {"security_group_rule": {"parent_group_id": "af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:21.817963 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 885/1758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:21 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:21.854843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:54:21.855842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Neutron security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:54:21.856436 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.856436 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 138 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: {"security_group_rule": {"parent_group_id": "af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:54:21.859560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 404 to user: Security group af7bb1ef-a80c-4a86-8d91-0e4031fb6d9b does not exist Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-032d902b-42ba-4db7-89c2-e5609413eeb2'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:21.865027 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f475317-5904-4d2e-91c4-96ce29085557 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.071975 Sep 01 04:54:21.871180 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 874/1759] 10.222.0.26 () {60 vars in 1195 bytes} [Thu Sep 1 04:54:21 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:54:21.878291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa75bcc2820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:21.930669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:54:21.933565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Neutron security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab not found {{(pid=128863) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 01 04:54:21.934440 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] HTTP exception thrown: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.934440 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Request method failure captured: Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-group-rules/ed53b19e-873f-4959-b9fe-bab9a0bed6ab HTTP/1.1 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrxBkYfOqyIgWruH58YCfoMyRozSvKJxQjJ_ksQ-OGBSZcQ2pifN6CG5XGezTcnB2nPnWcJaqpiUqZ-JVwuyjYrXzSoBSpYhAJovlCLTeOCB9q-j7pAtUTOypyaftTUzLi2-FY9fjF3jzJD3CTqOkC_MXy_nLsHzxJOblx0-aMwKLs Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57ce8a4d788449198e86678de3de7cec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57ce8a4d788449198e86678de3de7cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 57ce8a4d788449198e86678de3de7cec Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 40a69e252d3f40bf80cf3ad5e46b8125 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-780728497-project Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ed53b19e-873f-4959-b9fe-bab9a0bed6ab'} Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:54:21.938631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Returning 404 to user: Security group rule ed53b19e-873f-4959-b9fe-bab9a0bed6ab does not exist Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-032d6f9e-9f13-4590-81cf-d6674f42d772'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:21.945609 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b855455-f0a1-423a-88f2-2f13aeea9c19 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/ed53b19e-873f-4959-b9fe-bab9a0bed6ab" status: 404 len: 199 microversion: 2.1 time: 0.069288 Sep 01 04:54:21.948727 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 886/1760] 10.222.0.26 () {58 vars in 1287 bytes} [Thu Sep 1 04:54:21 2022] DELETE /compute/v2.1/os-security-group-rules/ed53b19e-873f-4959-b9fe-bab9a0bed6ab => generated 199 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:54:21.952189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:21.952393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:21.960819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.961312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.961744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.962456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:21.962918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:21.963583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:21.970446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e7c93fe-3250-44fb-9ccd-e50cbc1f2b3c tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa7640d6820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:22.549363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:22.563535 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-078d081b-9892-4e99-94b8-a3c075123816 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1316 microversion: 2.1 time: 0.619581 Sep 01 04:54:22.565158 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 875/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:21 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:22.569903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:22.570508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:22.577525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:22.578409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:22.579144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:22.580807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:22.581682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:22.582496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:22.779768 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e7c93fe-3250-44fb-9ccd-e50cbc1f2b3c tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/eca06d08-ee52-48b1-9c83-1d886b47a5a8" status: 202 len: 0 microversion: 2.1 time: 0.828491 Sep 01 04:54:22.781480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 887/1762] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:54:21 2022] DELETE /compute/v2.1/os-security-groups/eca06d08-ee52-48b1-9c83-1d886b47a5a8 => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:22.787844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:22.789133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:22.807492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:22.810552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:22.811220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:22.815196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:22.815960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:22.816677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:22.820989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:22.831190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2125c4a-cb02-4d88-945d-bca8d24ea51f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1461 microversion: 2.1 time: 0.264888 Sep 01 04:54:22.834185 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 876/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:22 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1461 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:22.844335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79b31c70-73c7-4cb1-847a-5ab5f46e2cab tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa75beb1dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:23.080615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:23.091269 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72dfe953-14eb-4d87-8259-b387090598a5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.308266 Sep 01 04:54:23.092366 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 888/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:22 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:23.100218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:23.101083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 90982816-19d1-448f-bd4a-7cda5aab3e2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:23.111707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.112928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.115159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.116715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.117556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.119259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.139883 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] HTTP exception thrown: Instance 90982816-19d1-448f-bd4a-7cda5aab3e2a could not be found. Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Request method failure captured: Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a HTTP/1.1 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlAfvPBQ76lM0yew2K9xtim5Q9GI74X3jEwHlmJo-VVqx_hvWebVMCiRl62xoFE9rSWfDK2U183hBg6LfIXOoH5HpZ1lOtieDfvteVwaaDNkNf3V_rTNi95rfzP3To7MNf-O532ShWWYrw8cM_bwRpgK6E9cGcFsngNjb7yirscYKU Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.25 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ce4ece60266c4a9692b03d795cea8462 Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 90982816-19d1-448f-bd4a-7cda5aab3e2a could not be found. Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '90982816-19d1-448f-bd4a-7cda5aab3e2a'} Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90982816-19d1-448f-bd4a-7cda5aab3e2a could not be found. Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90982816-19d1-448f-bd4a-7cda5aab3e2a could not be found. Sep 01 04:54:23.142290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90982816-19d1-448f-bd4a-7cda5aab3e2a could not be found. Sep 01 04:54:23.148062 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:23.150928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Returning 404 to user: Instance 90982816-19d1-448f-bd4a-7cda5aab3e2a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:23.152023 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d67d67c6-d819-4cb5-a42a-31c4c2f60e64 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a" status: 404 len: 111 microversion: 2.25 time: 0.057882 Sep 01 04:54:23.152988 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 889/1765] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:23 2022] GET /compute/v2.1/servers/90982816-19d1-448f-bd4a-7cda5aab3e2a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:23.168657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:23.169750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:23.178655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.180040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.180672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.182214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.183134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.185491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.222450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79b31c70-73c7-4cb1-847a-5ab5f46e2cab tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/468232f8-3696-472f-ac92-b8a49351cf4e" status: 202 len: 0 microversion: 2.1 time: 0.383935 Sep 01 04:54:23.223674 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 877/1766] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:54:22 2022] DELETE /compute/v2.1/os-security-groups/468232f8-3696-472f-ac92-b8a49351cf4e => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:23.232924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-683a3a97-8581-415b-96eb-b1c50c498fbc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '.version_select at 0x7fa75be59f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:23.280977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-683a3a97-8581-415b-96eb-b1c50c498fbc tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896213627" status: 204 len: 0 microversion: 2.25 time: 0.055183 Sep 01 04:54:23.293058 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 878/1767] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 04:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896213627 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:54:23.299172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ae482c5-707e-4cd0-8e4a-9cf90fcf8058 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa75beb69d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:23.508814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:23.526629 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97922417-ca32-41a2-9c57-abbecdb39549 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1461 microversion: 2.1 time: 0.368171 Sep 01 04:54:23.528008 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 890/1768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:23 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1461 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:23.556884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:23.562298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:23.581101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.581594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.582032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.582742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.587419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.591028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.712242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:54:23.712657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:54:23.713377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:54:23.713812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:54:23.714218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:54:23.827232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:23.856572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.857090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.860112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.864079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.866656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.867850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.879740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ae482c5-707e-4cd0-8e4a-9cf90fcf8058 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/fb7fcc6d-f1cc-41f4-b738-d2da7ef521b9" status: 202 len: 0 microversion: 2.1 time: 0.585095 Sep 01 04:54:23.881779 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 879/1769] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:54:23 2022] DELETE /compute/v2.1/os-security-groups/fb7fcc6d-f1cc-41f4-b738-d2da7ef521b9 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:23.894868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:23.896044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:23.907429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.908256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.908920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.912540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.913316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.913966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:23.934181 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dad18f0-0130-4307-a073-80a6ef3ead2e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 1065 microversion: 2.1 time: 0.383796 Sep 01 04:54:23.935222 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 891/1770] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:54:23 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 1065 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 04:54:23.949150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-98514b69-5e5a-469d-9b24-c6473523ac49 req-12beea8b-0ba5-4da8-838d-7613fe40b095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "name": "network-vif-plugged", "status": "completed", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:23.972173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-98514b69-5e5a-469d-9b24-c6473523ac49 req-12beea8b-0ba5-4da8-838d-7613fe40b095 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:23.972753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-98514b69-5e5a-469d-9b24-c6473523ac49 req-12beea8b-0ba5-4da8-838d-7613fe40b095 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:23.977105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-98514b69-5e5a-469d-9b24-c6473523ac49 req-12beea8b-0ba5-4da8-838d-7613fe40b095 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:24.015906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-98514b69-5e5a-469d-9b24-c6473523ac49 req-12beea8b-0ba5-4da8-838d-7613fe40b095 service nova] Creating event network-vif-plugged:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:54:24.033155 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-98514b69-5e5a-469d-9b24-c6473523ac49 req-12beea8b-0ba5-4da8-838d-7613fe40b095 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096117 Sep 01 04:54:24.049810 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 892/1771] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:24.057815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2354a3e7-2da2-4dad-9f22-c57e7496d20b tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa75bcbf160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:24.401933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:24.421559 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0683fe2d-41f7-4941-ab8c-51a188e8b152 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1316 microversion: 2.1 time: 0.534873 Sep 01 04:54:24.437396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 880/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:23 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:24.449657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:24.452170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:24.466762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:24.468458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:24.469308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:24.471530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:24.472404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:24.473964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:24.808948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2354a3e7-2da2-4dad-9f22-c57e7496d20b tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/0eb4073f-e7bb-45f9-a5cf-5cb679a2cddb" status: 202 len: 0 microversion: 2.1 time: 0.757187 Sep 01 04:54:24.809828 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 893/1773] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:54:24 2022] DELETE /compute/v2.1/os-security-groups/0eb4073f-e7bb-45f9-a5cf-5cb679a2cddb => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:24.878997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:24.909115 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2df2d08-0445-420d-89d5-0814dda17b36 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 0.470155 Sep 01 04:54:24.919435 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 881/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:24 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:25.053242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62919dd1-50ec-487d-ab8c-721fabfcf53d tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75beb6790>, body: {"keypair": {"name": "tempest-keypair-1626963734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9zDtW/dKyAu7h87gBMBrs3wcx1gJjiaqO5stmUYJYGV1+1srIP74q7QKGQ5ejh3y0BEGrFvMK8WXOxibde7hCtoTVspUxRDl6VKnWhhJftKxyIEHn9CFUP6y4j6SOxaA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:25.079747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-62919dd1-50ec-487d-ab8c-721fabfcf53d tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:25.098097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-62919dd1-50ec-487d-ab8c-721fabfcf53d tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:25.136429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.137246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:25.147801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.149499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.150181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.151301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.152202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.152963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.163284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62919dd1-50ec-487d-ab8c-721fabfcf53d tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.250178 Sep 01 04:54:25.164253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 882/1775] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 253 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:54:25.179865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.181075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:25.195587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.199016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.200393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.207497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.207982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.208419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.249907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:54:25.397790 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0cc94fd-ffe1-430e-b392-4172c7f661fd tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "DELETE /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 204 len: 0 microversion: 2.25 time: 0.225852 Sep 01 04:54:25.398316 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 883/1776] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:54:25 2022] DELETE /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:54:25.410593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7f36cfd-d57f-4a79-8480-92a2e0a2e527 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] Calling method '.version_select at 0x7fa75bf1d9d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.448752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:25.462831 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c54fb0a-11cc-44cb-8605-1903d83d1da9 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.651829 Sep 01 04:54:25.465752 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 894/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:24 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:25.484472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c5537c0-b1a8-4291-a8e1-84b71c93624a tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bcc2af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.504495 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c5537c0-b1a8-4291-a8e1-84b71c93624a tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1626963734" status: 200 len: 513 microversion: 2.2 time: 0.037036 Sep 01 04:54:25.505510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 895/1778] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Sep 1 04:54:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1626963734 => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:25.515661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.517122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:25.528522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.529806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.530741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.532124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.533292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.534193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.821414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:25.829486 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7f36cfd-d57f-4a79-8480-92a2e0a2e527 tempest-SecurityGroupRulesNegativeTestJSON-780728497 tempest-SecurityGroupRulesNegativeTestJSON-780728497-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f6b7a289-b1b5-439c-845f-d3e170019e18" status: 202 len: 0 microversion: 2.1 time: 0.428616 Sep 01 04:54:25.830783 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 884/1779] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:54:25 2022] DELETE /compute/v2.1/os-security-groups/f6b7a289-b1b5-439c-845f-d3e170019e18 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:25.838476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.839698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:25.854198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.854926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.855885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.857000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:25.859576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:25.860146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:25.899460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:25.902068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:25.902978 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d1d7475-d032-4c66-ade0-e3e5e06c54b3 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1550 microversion: 2.25 time: 0.395561 Sep 01 04:54:25.903689 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 896/1780] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:25 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1550 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:25.915443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce27aedc-8038-4242-8edc-0c1994d3aff1 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa7641389d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.971198 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce27aedc-8038-4242-8edc-0c1994d3aff1 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626963734" status: 204 len: 0 microversion: 2.2 time: 0.058289 Sep 01 04:54:25.980369 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 897/1781] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Sep 1 04:54:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626963734 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:25.992962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:25.993598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:26.013825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:26.017237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:26.018051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:26.019027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:26.023226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:26.033372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:26.364368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:26.377509 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-208e1cdd-5766-495b-a61a-1f53de9de8ad tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1465 microversion: 2.1 time: 0.545132 Sep 01 04:54:26.385197 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 885/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:25 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1465 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:26.391382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cdbd890-179a-44b2-ae25-627a495e4d5c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75bd873a0>, body: {"keypair": {"name": "tempest-keypair-588847716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0xjKONZCZQNKspAZbRd33l6V8G7UhxRFAA/MM/zOlnFKvY8M+lGfq+jLo0wUDty2VGfpYiAXSwkhYoW67V9FH6YtOlMBtqM+j0xqb0YcN6UohzX+ghk6mOwxOTK58oiQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:26.411961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7cdbd890-179a-44b2-ae25-627a495e4d5c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:26.418573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7cdbd890-179a-44b2-ae25-627a495e4d5c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:26.460768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cdbd890-179a-44b2-ae25-627a495e4d5c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.073316 Sep 01 04:54:26.461764 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 886/1783] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:54:26.471904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1496913918", "metadata": {"image_type": "test"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:26.474804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:26.483260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:26.483757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:26.484679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:26.485442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:26.485901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:26.486319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:26.495991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:26.506731 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7086417-97bc-4fb1-927c-a1276ff31629 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 0.522722 Sep 01 04:54:26.507994 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 898/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:25 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:26.514602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ac80f6c-cf59-4596-bb23-9033313fa7fd tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bc21e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:26.532453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:26.544337 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ac80f6c-cf59-4596-bb23-9033313fa7fd tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588847716" status: 204 len: 0 microversion: 2.2 time: 0.034743 Sep 01 04:54:26.545578 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 899/1785] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Sep 1 04:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588847716 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:26.553600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Getting quotas for project 657aec8cb7944e229be7f018c48faf26. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:26.557670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:26.560550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Getting quotas for user aa3671675b3e42b0bf27cac10347b02a and project 657aec8cb7944e229be7f018c48faf26. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:26.561061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:26.574001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:26.575129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:26.575966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:26.576871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:26.577577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:26.578165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:26.842612 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2aeb6926-5823-4f20-ba41-0a83e7c0c95f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "POST /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007/action" status: 202 len: 0 microversion: 2.1 time: 0.378853 Sep 01 04:54:26.844420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 887/1786] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:54:26 2022] POST /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:54:26.850399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-65ffa8d7-9bf2-4433-b562-67280496bf20 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75bebf040>, body: {"keypair": {"name": "tempest-keypair-1986646557", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:26.872828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-65ffa8d7-9bf2-4433-b562-67280496bf20 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:26.883666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-65ffa8d7-9bf2-4433-b562-67280496bf20 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:26.931297 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-65ffa8d7-9bf2-4433-b562-67280496bf20 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.084958 Sep 01 04:54:26.932853 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 888/1787] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:26 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:54:26.947555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c37973f3-ab74-439d-a9b7-6be6632c40cc tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75be43940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.019589 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c37973f3-ab74-439d-a9b7-6be6632c40cc tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.085313 Sep 01 04:54:27.026938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 889/1788] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:26 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:27.031769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.037188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:27.047758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:27.056478 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4452a0a-4736-4f6d-862c-d5d1fa6b9839 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.508613 Sep 01 04:54:27.056660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:27.057070 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 900/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:26 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:27.059842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:27.060497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:27.062048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:27.066839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:27.067481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:27.080084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-802771c9-165c-4f66-8b84-77b67bb91c49 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bc21670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.132580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-802771c9-165c-4f66-8b84-77b67bb91c49 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986646557" status: 204 len: 0 microversion: 2.2 time: 0.056372 Sep 01 04:54:27.138978 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 901/1790] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Sep 1 04:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986646557 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:27.147692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16f8b53b-26ae-4864-aa23-20cabddb6a74 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75bcbf040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1651946169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUl4yPfvM1LqBCwGu23RlPl1b6ovmphFcH6wBT0d2Ar3n/6Auox/mLD+5yYz5rk3l5cVnyCQlamZmNswhobYmD6vTqedLWJEW7rKZVDWPPS9JF4vFRCz6hLkkgoUduvKA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:27.172020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-16f8b53b-26ae-4864-aa23-20cabddb6a74 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:27.182285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-16f8b53b-26ae-4864-aa23-20cabddb6a74 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:27.219372 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16f8b53b-26ae-4864-aa23-20cabddb6a74 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.076075 Sep 01 04:54:27.220782 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 902/1791] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 01 04:54:27.235870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a49d8525-a39b-49b1-adac-0f257f278dfb tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75bc47550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1594227907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiNtTdlc9ZePOW6kwkWrt8mCP/zvdU+Cy+XEkgWSs2Zc4qQAufIt6eNrVLgdnbgZFwHb81QXn7defWmJjz6laoSm6oU6YD1p1gB8/82NqiXsjQclOUnYSwGaDMexDETiA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:27.260887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a49d8525-a39b-49b1-adac-0f257f278dfb tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:27.269040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a49d8525-a39b-49b1-adac-0f257f278dfb tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:27.320019 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a49d8525-a39b-49b1-adac-0f257f278dfb tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.089664 Sep 01 04:54:27.320899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 903/1792] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:54:27.336597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-626776b3-8f1e-4b6d-ac85-a4e8ae2e71f8 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa764153280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1927226718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpTHITpDMSdJOgl/wW/Gs0I8bxXq5kGm8kRlF3RqfoDqhBg9ghpYSq6rn0HJYcMaCQ9Mzku3oDFUYCc7q4EY2UAsq3AQZJLprNSjRVhHe+Lx75PjicDVDOL3B/j9+gn/w=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:27.363528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-626776b3-8f1e-4b6d-ac85-a4e8ae2e71f8 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:27.369772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-626776b3-8f1e-4b6d-ac85-a4e8ae2e71f8 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:27.400948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-626776b3-8f1e-4b6d-ac85-a4e8ae2e71f8 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.069911 Sep 01 04:54:27.403138 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 904/1793] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:27 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:54:27.414950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77ab1e80-f6fc-4e72-be29-3baa94fef7c0 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bc21820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.421277 n-d-820368-37 devstack@n-api.service[128863]: WARNING oslo_db.sqlalchemy.utils [None req-77ab1e80-f6fc-4e72-be29-3baa94fef7c0 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 01 04:54:27.432112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77ab1e80-f6fc-4e72-be29-3baa94fef7c0 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.022578 Sep 01 04:54:27.433869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 905/1794] 10.222.0.26 () {60 vars in 1177 bytes} [Thu Sep 1 04:54:27 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:27.451123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8eeeb366-c233-4acf-a0f5-ba92b86b782f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bd7e160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.477744 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8eeeb366-c233-4acf-a0f5-ba92b86b782f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1927226718" status: 204 len: 0 microversion: 2.2 time: 0.034846 Sep 01 04:54:27.478918 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 906/1795] 10.222.0.26 () {60 vars in 1321 bytes} [Thu Sep 1 04:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1927226718 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:27.491304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a4e9bb8-59cf-4a12-8dff-2f4ddabd4fa7 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bd183a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.495292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:27.510405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:27.512864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:27.516036 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f7f4b81-4f1a-4f5a-af1a-15af8e98e820 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1550 microversion: 2.25 time: 0.491785 Sep 01 04:54:27.517747 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 890/1796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:27 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1550 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:27.533888 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a4e9bb8-59cf-4a12-8dff-2f4ddabd4fa7 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1594227907" status: 204 len: 0 microversion: 2.2 time: 0.049645 Sep 01 04:54:27.534421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.534666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:27.536164 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 907/1797] 10.222.0.26 () {60 vars in 1321 bytes} [Thu Sep 1 04:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1594227907 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:27.540956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:27.547466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04e228a9-291a-495b-8ffa-6e569e1aff45 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bd4a3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.553009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:27.554150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:27.554774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:27.556126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:27.556695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:27.557412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:27.579892 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04e228a9-291a-495b-8ffa-6e569e1aff45 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1651946169" status: 204 len: 0 microversion: 2.2 time: 0.038719 Sep 01 04:54:27.584549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:27.604862 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 908/1798] 10.222.0.26 () {60 vars in 1321 bytes} [Thu Sep 1 04:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1651946169 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:54:27.615843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9439b616-d306-4de1-90ea-6424dee1a522 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75bc253a0>, body: {"keypair": {"name": "tempest-keypair-236180070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQh7if2fsTmoTksy2YYuRGdbT7OV8tEncPjvQdvUBuqsQMjzEmQCPQMrBIoc+iqTuMQzfJLl48Op2xXb1E4YrzMLUc8TfVdwycjASsY9jVdwfWLMtYb+E0JjRPtyhoVeQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:27.643554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9439b616-d306-4de1-90ea-6424dee1a522 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:27.655318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9439b616-d306-4de1-90ea-6424dee1a522 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:27.689892 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9439b616-d306-4de1-90ea-6424dee1a522 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.083671 Sep 01 04:54:27.697023 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 909/1799] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Sep 1 04:54:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 01 04:54:27.713827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf94deab-1916-484c-92ce-7b8f8573e7ae tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bc471f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.743831 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf94deab-1916-484c-92ce-7b8f8573e7ae tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-236180070" status: 200 len: 512 microversion: 2.2 time: 0.044111 Sep 01 04:54:27.745802 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 910/1800] 10.222.0.26 () {60 vars in 1255 bytes} [Thu Sep 1 04:54:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-236180070 => generated 512 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:27.766460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f63179a9-987e-4128-a2ee-01ef8fefab83 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bd185e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.780372 n-d-820368-37 devstack@n-api.service[128863]: WARNING oslo_db.sqlalchemy.utils [None req-f63179a9-987e-4128-a2ee-01ef8fefab83 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 01 04:54:27.787649 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f63179a9-987e-4128-a2ee-01ef8fefab83 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.032140 Sep 01 04:54:27.789182 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 911/1801] 10.222.0.26 () {60 vars in 1177 bytes} [Thu Sep 1 04:54:27 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:27.800979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfc66658-6aa2-44a7-adc8-59cfcb83409c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bcbf430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:27.828588 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfc66658-6aa2-44a7-adc8-59cfcb83409c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-236180070" status: 204 len: 0 microversion: 2.2 time: 0.032557 Sep 01 04:54:27.829928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 912/1802] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Sep 1 04:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-236180070 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:54:27.867779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Action: 'create', calling method: .version_select at 0x7fa75bcc2430>, body: {"keypair": {"name": "tempest-keypair-468745925", "type": "x509"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:27.933198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:27.946317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:28.024948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.processutils [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp80mf7e2w/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp80mf7e2w/temp.key -subj /CN=86699015d5574f4da174821c26a8236d -extensions v3_req_client {{(pid=128863) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 01 04:54:28.113956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:28.126125 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d22fee3-0c2c-4b55-b927-38d17b1cb616 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 0.597395 Sep 01 04:54:28.132478 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 891/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:27 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:28.138234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a325368b-629d-4bc1-8af5-899d6db73c36 req-9e928572-43d6-485a-811c-a46d7ea85458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28faec93-25bd-420c-a9e7-85836885a76b", "name": "network-vif-deleted", "tag": "60ba55a3-9242-45b7-bdc3-cca385154f4a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:28.162321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a325368b-629d-4bc1-8af5-899d6db73c36 req-9e928572-43d6-485a-811c-a46d7ea85458 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:28.163273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a325368b-629d-4bc1-8af5-899d6db73c36 req-9e928572-43d6-485a-811c-a46d7ea85458 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:28.163862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a325368b-629d-4bc1-8af5-899d6db73c36 req-9e928572-43d6-485a-811c-a46d7ea85458 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:28.193129 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a325368b-629d-4bc1-8af5-899d6db73c36 req-9e928572-43d6-485a-811c-a46d7ea85458 service nova] Creating event network-vif-deleted:60ba55a3-9242-45b7-bdc3-cca385154f4a for instance 28faec93-25bd-420c-a9e7-85836885a76b on n-h2-820368-37 Sep 01 04:54:28.205208 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a325368b-629d-4bc1-8af5-899d6db73c36 req-9e928572-43d6-485a-811c-a46d7ea85458 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071235 Sep 01 04:54:28.207658 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 892/1804] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:28.214708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7d21174-00cc-46ec-ba95-130b3152fa68 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75be59d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:28.278101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7d21174-00cc-46ec-ba95-130b3152fa68 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.068703 Sep 01 04:54:28.278927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 893/1805] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:28 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:28.295018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:28.295929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:28.308336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:28.308848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:28.309744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:28.310718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:28.311198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:28.311735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:28.380917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.processutils [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp80mf7e2w/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp80mf7e2w/temp.key -subj /CN=86699015d5574f4da174821c26a8236d -extensions v3_req_client" returned: 0 in 0.355s {{(pid=128863) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 01 04:54:28.383769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.processutils [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp80mf7e2w/temp.key -password pass: {{(pid=128863) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 01 04:54:28.452221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.processutils [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp80mf7e2w/temp.key -password pass:" returned: 0 in 0.069s {{(pid=128863) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 01 04:54:28.488704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:28.499606 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d837e863-ce92-4c8c-9b36-175d37f2d1d8 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.217673 Sep 01 04:54:28.500918 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 894/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:28 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:28.519195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:28.527548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Getting quotas for user 86699015d5574f4da174821c26a8236d and project b303af229fc644d79b9c78aa8d32bb5e. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:28.543963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:28.544799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:28.555152 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91f97eeb-5fe7-47a0-bfb6-95c76bcf2d4f tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.697631 Sep 01 04:54:28.557211 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 913/1807] 10.222.0.26 () {62 vars in 1198 bytes} [Thu Sep 1 04:54:27 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 701 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:28.560008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:28.561745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:28.562356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:28.575107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:28.577438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:28.577917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:28.586401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fb3b071-9962-4904-866b-c96f3a164a4c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bd4a430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:28.598365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:28.604522 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fb3b071-9962-4904-866b-c96f3a164a4c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-468745925" status: 200 len: 1533 microversion: 2.2 time: 0.040506 Sep 01 04:54:28.605785 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 914/1808] 10.222.0.26 () {60 vars in 1255 bytes} [Thu Sep 1 04:54:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-468745925 => generated 1533 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:28.617766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b5cceac-5689-4511-b9a0-71e533cf112c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bcceca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:28.626228 n-d-820368-37 devstack@n-api.service[128863]: WARNING oslo_db.sqlalchemy.utils [None req-0b5cceac-5689-4511-b9a0-71e533cf112c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 01 04:54:28.634486 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b5cceac-5689-4511-b9a0-71e533cf112c tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.020150 Sep 01 04:54:28.641203 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 915/1809] 10.222.0.26 () {60 vars in 1177 bytes} [Thu Sep 1 04:54:28 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:28.648085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bde05ca-5a8c-4b27-8ad3-d9851dc71db7 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] Calling method '.version_select at 0x7fa75bd184c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:28.649491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:28.649987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:28.650420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:28.650872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lazy-loading 'fault' on Instance uuid 28faec93-25bd-420c-a9e7-85836885a76b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:54:28.679828 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bde05ca-5a8c-4b27-8ad3-d9851dc71db7 tempest-KeyPairsV22TestJSON-396281922 tempest-KeyPairsV22TestJSON-396281922-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468745925" status: 204 len: 0 microversion: 2.2 time: 0.036718 Sep 01 04:54:28.687894 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 916/1810] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Sep 1 04:54:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468745925 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:28.759781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:28.772377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:28.773731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:28.774958 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63338600-4bd1-4c07-95e7-c4c29792acac tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 200 len: 1352 microversion: 2.25 time: 0.237646 Sep 01 04:54:28.776126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 895/1811] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:28 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 1352 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:54:29.159544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:29.160924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:29.175389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.177634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.178571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.181455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.182246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.183007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.298250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b07b84c-d90a-49ab-9a1e-e1e6748f785e tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bdf79d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:29.373260 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b07b84c-d90a-49ab-9a1e-e1e6748f785e tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.078970 Sep 01 04:54:29.381100 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 896/1812] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:29 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:29.523229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:29.524822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:29.544666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.545373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.545991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.546865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.547503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.548091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.773323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:29.785870 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b22587fd-3dcd-4b3e-80a1-020cd76cea7e tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 0.631430 Sep 01 04:54:29.790742 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 917/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:29 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:29.811269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:29.812394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 28faec93-25bd-420c-a9e7-85836885a76b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:29.819602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.820413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.821057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.822170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.822837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.823730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.841810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] HTTP exception thrown: Instance 28faec93-25bd-420c-a9e7-85836885a76b could not be found. Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Request method failure captured: Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b HTTP/1.1 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlAfvPBQ76lM0yew2K9xtim5Q9GI74X3jEwHlmJo-VVqx_hvWebVMCiRl62xoFE9rSWfDK2U183hBg6LfIXOoH5HpZ1lOtieDfvteVwaaDNkNf3V_rTNi95rfzP3To7MNf-O532ShWWYrw8cM_bwRpgK6E9cGcFsngNjb7yirscYKU Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.25 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ce4ece60266c4a9692b03d795cea8462 Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 28faec93-25bd-420c-a9e7-85836885a76b could not be found. Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '28faec93-25bd-420c-a9e7-85836885a76b'} Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28faec93-25bd-420c-a9e7-85836885a76b could not be found. Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28faec93-25bd-420c-a9e7-85836885a76b could not be found. Sep 01 04:54:29.844866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28faec93-25bd-420c-a9e7-85836885a76b could not be found. Sep 01 04:54:29.850611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:29.853003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Returning 404 to user: Instance 28faec93-25bd-420c-a9e7-85836885a76b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:29.854498 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2c70f84-b54b-4225-a929-c785b66503c2 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b" status: 404 len: 111 microversion: 2.25 time: 0.048568 Sep 01 04:54:29.855796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 918/1814] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:29 2022] GET /compute/v2.1/servers/28faec93-25bd-420c-a9e7-85836885a76b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:29.864974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:29.865932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:29.874649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.876365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.877186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.880036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:29.881394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:29.882866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:29.916498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:54:30.025857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:30.084578 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bcfc865-2cef-4092-85b7-df88fc548322 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 204 len: 0 microversion: 2.25 time: 0.224067 Sep 01 04:54:30.085643 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 919/1815] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:54:29 2022] DELETE /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:54:30.093688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:30.094362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:30.101381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:30.101882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:30.102370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:30.103168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:30.105312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:30.105823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:30.174437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:54:30.206058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:30.219837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5635f118-2b9f-4142-9eef-5d13454beac0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1717 microversion: 2.1 time: 0.700444 Sep 01 04:54:30.222356 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 897/1816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:29 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1717 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:30.239484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:30.240434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:30.252973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:30.254447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:30.255138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:30.257729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:30.258401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:30.260587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:30.359795 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38952939-956d-498a-9101-ccbaea185207 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "DELETE /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 204 len: 0 microversion: 2.1 time: 0.271505 Sep 01 04:54:30.360354 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 920/1817] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:54:30 2022] DELETE /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:54:30.377428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:30.378159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:30.401386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:30.402134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:30.402678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:30.403446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:30.403888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:30.419525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:31.282564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:31.301951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:31.305599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:31.307840 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40e8248b-71e7-43f8-89a4-cc46d521ba6b tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1563 microversion: 2.25 time: 1.083990 Sep 01 04:54:31.308764 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 898/1818] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:30 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1563 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:31.319828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e5947d0-f07a-4294-b375-0623b37f0112 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75beb1550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:31.405756 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e5947d0-f07a-4294-b375-0623b37f0112 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.095543 Sep 01 04:54:31.407101 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 899/1819] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:31 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:31.412666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:31.413562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:31.423993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:31.424872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:31.425601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:31.426548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:31.427256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:31.428021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:31.641811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:31.651989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b32562a5-5381-4128-a9a9-29bae6a8431d tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1664 microversion: 2.1 time: 1.285682 Sep 01 04:54:31.652597 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 921/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:30 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1664 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:31.679366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:31.682348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:31.707489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:31.707997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:31.708446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:31.709197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:31.709662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:31.710079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:32.783084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:32.802831 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a325d246-2535-400c-8b84-db8a8e16ff60 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.391603 Sep 01 04:54:32.806526 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 900/1821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:31 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:32.826258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:32.829977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:32.843252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:32.843682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:32.844122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:32.847033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:32.849382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:32.850041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:34.141801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:34.151242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb6b13f7-3e7d-41ea-a5e3-425c416cd3c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1707 microversion: 2.1 time: 2.487097 Sep 01 04:54:34.156182 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 922/1822] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:31 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1707 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:34.181694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a67018f-785e-458d-acb6-2de7f4727128 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bc213a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:34.308184 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a67018f-785e-458d-acb6-2de7f4727128 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.143315 Sep 01 04:54:34.320777 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 923/1823] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:34 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:34.333461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:34.334342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:34.355607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:34.356871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:34.357607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:34.358798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:34.359690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:34.363591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:34.828216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:34.889823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:34.895680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:34.904838 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff9df4d7-4cbc-470c-a0f5-401726a96269 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1563 microversion: 2.25 time: 2.095672 Sep 01 04:54:34.908012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:34.925877 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 901/1824] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:32 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1563 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:34.936424 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1e40721-5c44-4247-a4f3-a4ff0d4a1239 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1664 microversion: 2.1 time: 0.614082 Sep 01 04:54:34.944973 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 924/1825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:34 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1664 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:34.959067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cce00d5-91c5-4713-afef-73398cdd6b2c tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '.version_select at 0x7fa764138790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:34.959865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:34.962472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:34.973971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cce00d5-91c5-4713-afef-73398cdd6b2c tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:34.978752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:34.980410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:34.981093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:34.981494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cce00d5-91c5-4713-afef-73398cdd6b2c tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:34.982194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cce00d5-91c5-4713-afef-73398cdd6b2c tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:34.986998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:34.987837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:34.988524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:35.016341 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cce00d5-91c5-4713-afef-73398cdd6b2c tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.066959 Sep 01 04:54:35.020968 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 925/1826] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:54:34 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:35.033878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-35426776-3710-49a2-b077-3ed83d24520c req-592e1a03-d226-4aa7-9d3f-0c26410345f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513b9001-2495-4749-bf46-15acf99d948a", "name": "network-vif-unplugged", "status": "completed", "tag": "17d561fb-d413-419b-8808-72b59db5261d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:35.070853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-35426776-3710-49a2-b077-3ed83d24520c req-592e1a03-d226-4aa7-9d3f-0c26410345f9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:35.077113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-35426776-3710-49a2-b077-3ed83d24520c req-592e1a03-d226-4aa7-9d3f-0c26410345f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:35.080594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-35426776-3710-49a2-b077-3ed83d24520c req-592e1a03-d226-4aa7-9d3f-0c26410345f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:35.121194 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-35426776-3710-49a2-b077-3ed83d24520c req-592e1a03-d226-4aa7-9d3f-0c26410345f9 service nova] Creating event network-vif-unplugged:17d561fb-d413-419b-8808-72b59db5261d for instance 513b9001-2495-4749-bf46-15acf99d948a on n-h1-820368-37 Sep 01 04:54:35.139945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-35426776-3710-49a2-b077-3ed83d24520c req-592e1a03-d226-4aa7-9d3f-0c26410345f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116443 Sep 01 04:54:35.147200 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 926/1827] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:35.169335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:35.174963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:35.187829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:35.198173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:35.204648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:35.206870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:35.209029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:35.210498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:35.951513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:35.975323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64b55a74-423b-4373-9e18-7bef43ec3398 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.048009 Sep 01 04:54:35.981245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 902/1828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:34 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:36.012834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce41b197-3bea-4da2-b37b-99ff32be402c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75beecc10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:36.161189 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66462a74-0f4a-4fd4-b28f-2713b4c11fdb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1860 microversion: 2.1 time: 1.011726 Sep 01 04:54:36.162697 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce41b197-3bea-4da2-b37b-99ff32be402c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.180071 Sep 01 04:54:36.163921 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 903/1829] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:35 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:36.173286 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 927/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:35 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1860 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:36.180338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:36.180934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:36.198946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.199632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-77ab2045-3125-470b-9db0-88e91ff68c20 req-44e2187c-5325-493c-911c-911478c4bba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6", "name": "network-vif-deleted", "tag": "769d5c39-23ff-4ba9-a1b2-dd29b194edd1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:36.207756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.208477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.209754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.211523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.218730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.259412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-77ab2045-3125-470b-9db0-88e91ff68c20 req-44e2187c-5325-493c-911c-911478c4bba8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.267735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-77ab2045-3125-470b-9db0-88e91ff68c20 req-44e2187c-5325-493c-911c-911478c4bba8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.269570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-77ab2045-3125-470b-9db0-88e91ff68c20 req-44e2187c-5325-493c-911c-911478c4bba8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.328691 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-77ab2045-3125-470b-9db0-88e91ff68c20 req-44e2187c-5325-493c-911c-911478c4bba8 service nova] Creating event network-vif-deleted:769d5c39-23ff-4ba9-a1b2-dd29b194edd1 for instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 on n-h2-820368-37 Sep 01 04:54:36.360451 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-77ab2045-3125-470b-9db0-88e91ff68c20 req-44e2187c-5325-493c-911c-911478c4bba8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188995 Sep 01 04:54:36.361078 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 904/1831] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:36.363356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.378013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:36.378727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:36.379647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.380096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.380561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lazy-loading 'fault' on Instance uuid 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:54:36.409619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.410743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.411369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.412261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.412915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.414135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.577452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:36.590444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:36.599651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce4ece60266c4a9692b03d795cea8462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c74dd6c8acf14c5883658f846d1b34c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:36.611964 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-caa2a6b7-5fa3-4865-bcf2-f628d0563409 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 200 len: 1351 microversion: 2.25 time: 0.437393 Sep 01 04:54:36.615892 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 928/1832] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:36 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 1351 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:54:36.667848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:36.669008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:36.693072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.693578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.694019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.694742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:36.699866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:36.700352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:36.831898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:36.848952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6fa7aad-78cf-42a3-b1ad-4a2135f35b9a tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1597 microversion: 2.1 time: 0.474708 Sep 01 04:54:36.850589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 905/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:36 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1597 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:37.018624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:37.019363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:37.028981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:37.034408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:37.035289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:37.035734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:37.036457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:37.047398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:37.049452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:37.718096 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49f384a6-c173-4b14-ad06-64baf5abb3ab tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1860 microversion: 2.1 time: 1.069561 Sep 01 04:54:37.720719 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 929/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:36 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1860 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:37.736465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cadc701a-0f20-4b05-9ff0-95bd6f1a7e24 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bcc2b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:37.858894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cadc701a-0f20-4b05-9ff0-95bd6f1a7e24 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.134728 Sep 01 04:54:37.864565 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 930/1835] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:37 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:37.870047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:37.870845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] [instance: 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:37.896097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:37.896827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:37.897469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:37.898555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:37.899237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:37.899906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:37.940177 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] HTTP exception thrown: Instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 could not be found. Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Request method failure captured: Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 HTTP/1.1 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDlAfvPBQ76lM0yew2K9xtim5Q9GI74X3jEwHlmJo-VVqx_hvWebVMCiRl62xoFE9rSWfDK2U183hBg6LfIXOoH5HpZ1lOtieDfvteVwaaDNkNf3V_rTNi95rfzP3To7MNf-O532ShWWYrw8cM_bwRpgK6E9cGcFsngNjb7yirscYKU Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.25 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c74dd6c8acf14c5883658f846d1b34c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c74dd6c8acf14c5883658f846d1b34c7 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-220253113 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ce4ece60266c4a9692b03d795cea8462 Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-220253113-project Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 could not be found. Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6'} Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 could not be found. Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 could not be found. Sep 01 04:54:37.942206 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 could not be found. Sep 01 04:54:37.947431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:37.949617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] Returning 404 to user: Instance 45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:37.950664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66558414-c9c2-458a-901e-05bd74ad1484 tempest-LiveAutoBlockMigrationV225Test-220253113 tempest-LiveAutoBlockMigrationV225Test-220253113-project] 10.222.0.26 "GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6" status: 404 len: 111 microversion: 2.25 time: 0.084899 Sep 01 04:54:37.951965 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 931/1836] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:54:37 2022] GET /compute/v2.1/servers/45a4aee6-40e9-4f2a-b3b0-e01b623ce3a6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:54:37.957100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0f8c450e-193f-4324-bcae-1bfd6c180ee4 req-8376d04b-80b0-4787-bdf1-94215dbca22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "name": "network-vif-plugged", "status": "completed", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:37.971308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0f8c450e-193f-4324-bcae-1bfd6c180ee4 req-8376d04b-80b0-4787-bdf1-94215dbca22f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:37.974993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0f8c450e-193f-4324-bcae-1bfd6c180ee4 req-8376d04b-80b0-4787-bdf1-94215dbca22f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:37.975655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0f8c450e-193f-4324-bcae-1bfd6c180ee4 req-8376d04b-80b0-4787-bdf1-94215dbca22f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.004884 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0f8c450e-193f-4324-bcae-1bfd6c180ee4 req-8376d04b-80b0-4787-bdf1-94215dbca22f service nova] Creating event network-vif-plugged:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:54:38.020867 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0f8c450e-193f-4324-bcae-1bfd6c180ee4 req-8376d04b-80b0-4787-bdf1-94215dbca22f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067247 Sep 01 04:54:38.022085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 932/1837] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:38.028471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:38.029183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:38.052762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.053570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.054197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.055121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.055769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.056366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.233027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:38.233480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:38.246379 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-565471c1-b334-4d44-8093-6da5f47ce2eb tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.235931 Sep 01 04:54:38.249571 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 906/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:37 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:38.249780 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a88faa90-d727-4552-9a52-dce957aa763b tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1597 microversion: 2.1 time: 0.224622 Sep 01 04:54:38.251674 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 933/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:38 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1597 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:38.269405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:38.270729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:38.279362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.280175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.280882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.281820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.282492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.283185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.448517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lazy-loading 'services' on Instance uuid 0b21455b-3a86-47bf-a77f-098f46a1e18e {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:54:38.491232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d218a6c9-a9f2-429b-a582-22df9b87373f req-5ccdf3f9-0b4f-4481-b831-5a9e1ee530f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513b9001-2495-4749-bf46-15acf99d948a", "name": "network-vif-deleted", "tag": "17d561fb-d413-419b-8808-72b59db5261d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:38.511756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d218a6c9-a9f2-429b-a582-22df9b87373f req-5ccdf3f9-0b4f-4481-b831-5a9e1ee530f1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.512259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d218a6c9-a9f2-429b-a582-22df9b87373f req-5ccdf3f9-0b4f-4481-b831-5a9e1ee530f1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.518169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d218a6c9-a9f2-429b-a582-22df9b87373f req-5ccdf3f9-0b4f-4481-b831-5a9e1ee530f1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.586944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:38.602452 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d218a6c9-a9f2-429b-a582-22df9b87373f req-5ccdf3f9-0b4f-4481-b831-5a9e1ee530f1 service nova] Creating event network-vif-deleted:17d561fb-d413-419b-8808-72b59db5261d for instance 513b9001-2495-4749-bf46-15acf99d948a on n-h1-820368-37 Sep 01 04:54:38.610740 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d218a6c9-a9f2-429b-a582-22df9b87373f req-5ccdf3f9-0b4f-4481-b831-5a9e1ee530f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123427 Sep 01 04:54:38.640488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 934/1840] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:38.749081 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-734d1e48-63d7-4f57-8017-10883932ba49 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments/577ce66e-98b0-4d7b-921c-c013cab4b8e2" status: 202 len: 0 microversion: 2.1 time: 0.497756 Sep 01 04:54:38.754677 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 907/1841] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 04:54:38 2022] DELETE /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments/577ce66e-98b0-4d7b-921c-c013cab4b8e2 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:38.764528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:38.768022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:38.788536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.789867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.790250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.791660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:38.792486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:38.793195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:38.867047 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7517562-5c4b-4d89-ac10-97cad0897dad tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107390 Sep 01 04:54:38.873426 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 935/1842] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:38 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:54:38.886109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31df9bbb-f050-40bb-9378-3ed83cf8460f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bf0b8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:39.008095 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31df9bbb-f050-40bb-9378-3ed83cf8460f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.130358 Sep 01 04:54:39.020938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 908/1843] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:38 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:39.276059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:39.278089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:39.278725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:39.281405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:39.302765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.306203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.309381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.310384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.310917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.313315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.314470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.316730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.317042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.320327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.323974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.324575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.422674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.423473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.425174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.427846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lazy-loading 'fault' on Instance uuid 513b9001-2495-4749-bf46-15acf99d948a {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:54:39.726433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e4095ea5213430c879aa801822dac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaafcc3055b24c4ca9be6effa2fbeb3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:39.746146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd1c737d-44e2-466d-b521-d251155d4d10 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 200 len: 1316 microversion: 2.1 time: 0.474484 Sep 01 04:54:39.749295 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 909/1844] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:39 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:39.880880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:39.886233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:39.900628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.903487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.904324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.905278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:39.906554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:39.908275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:39.991114 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d95fa2f-8a1f-4cb8-a632-97a005a8b86a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114928 Sep 01 04:54:39.991731 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 910/1845] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:39 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:54:40.024825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70d65e59-d8d0-4122-89ce-514fc50eb015 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa760208ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:40.051818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:40.063118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22f8b328-a7bb-477f-a6ce-461895eb5e04 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 0.797094 Sep 01 04:54:40.069077 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 936/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:39 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:40.115569 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70d65e59-d8d0-4122-89ce-514fc50eb015 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.094287 Sep 01 04:54:40.116485 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 911/1847] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:40 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:40.777132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:40.780181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] [instance: 513b9001-2495-4749-bf46-15acf99d948a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:40.802180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:40.802984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:40.803630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:40.804549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:40.805182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:40.805794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:40.823851 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] HTTP exception thrown: Instance 513b9001-2495-4749-bf46-15acf99d948a could not be found. Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Request method failure captured: Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a HTTP/1.1 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrBWokIS9c8hX2njNpKDlrfgy7vr2QD5MIxVXBQAQPwRFoajO8a7pFooRpMJuZhTPgg5z6k2mQNLrYOt-7V-sFfpj5zNwLwEgJ6VRQtbRQW0mT9XC7aJenLUiAAey5h6IXLWhdobIl9OBSdp83d79cZCiKFAw366f7ikgesVwI1T7w Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: aaafcc3055b24c4ca9be6effa2fbeb3f Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestFqdnHostnames-1752846515 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaafcc3055b24c4ca9be6effa2fbeb3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aaafcc3055b24c4ca9be6effa2fbeb3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aaafcc3055b24c4ca9be6effa2fbeb3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aaafcc3055b24c4ca9be6effa2fbeb3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestFqdnHostnames-1752846515 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: aaafcc3055b24c4ca9be6effa2fbeb3f Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1752846515 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestFqdnHostnames-1752846515-project Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 4e4095ea5213430c879aa801822dac27 Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestFqdnHostnames-1752846515-project Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 513b9001-2495-4749-bf46-15acf99d948a could not be found. Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '513b9001-2495-4749-bf46-15acf99d948a'} Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513b9001-2495-4749-bf46-15acf99d948a could not be found. Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513b9001-2495-4749-bf46-15acf99d948a could not be found. Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:54:40.826036 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513b9001-2495-4749-bf46-15acf99d948a could not be found. Sep 01 04:54:40.831961 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:54:40.833874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Returning 404 to user: Instance 513b9001-2495-4749-bf46-15acf99d948a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:54:40.835010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b0015a6-a608-404b-8378-2f8f126e1192 tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a" status: 404 len: 111 microversion: 2.1 time: 0.069817 Sep 01 04:54:40.836092 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 937/1848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:40 2022] GET /compute/v2.1/servers/513b9001-2495-4749-bf46-15acf99d948a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:54:40.844770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d5c1aa1-3c09-45cc-bf9c-3156a65792ff tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] Calling method '.version_select at 0x7fa7602d0280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:40.896566 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d5c1aa1-3c09-45cc-bf9c-3156a65792ff tempest-ServersTestFqdnHostnames-1752846515 tempest-ServersTestFqdnHostnames-1752846515-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018250195" status: 202 len: 0 microversion: 2.1 time: 0.055776 Sep 01 04:54:40.897835 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 912/1849] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:54:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018250195 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:54:41.010171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:41.021548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:41.033436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a33bcd1-a43b-4364-9ccb-6713d967c0e9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Action: 'create', calling method: .version_select at 0x7fa7603f3310>, body: {"keypair": {"name": "tempest-keypair-2041043943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHasGMeGHsdtRH0VuPVQe2gDypQUp+JsbYcMA4ITM6xZxjl28P0rjfjtfGwq2ZzlV2LCIlEF85sb+nS32c2Eybc5gC7Tl6wYRZHvTtQiGvAHwsi9JFr5rC4WLNeIS6XQbg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:41.052558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:41.053164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:41.053487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:41.054217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:41.054689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:41.055149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:41.107263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8a33bcd1-a43b-4364-9ccb-6713d967c0e9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Getting quotas for project 10b08b6c59934cb3adc869529add8bc6. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:54:41.133024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8a33bcd1-a43b-4364-9ccb-6713d967c0e9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Getting quotas for user a863fc04a5974165881e104ff252a62d and project 10b08b6c59934cb3adc869529add8bc6. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:54:41.223999 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57ff51f0-d0b9-4038-808d-ef7e8ae8baf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219948 Sep 01 04:54:41.237858 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 938/1850] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:41 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:41.260836 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a33bcd1-a43b-4364-9ccb-6713d967c0e9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.230908 Sep 01 04:54:41.262864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:41.265791 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 913/1851] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 04:54:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 04:54:41.268727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:41.281363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68333be2-65d2-4f85-8903-59cd252a384c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bec2820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:41.291361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:41.294861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:41.295361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:41.296143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:41.296622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:41.297058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:41.395411 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68333be2-65d2-4f85-8903-59cd252a384c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.124463 Sep 01 04:54:41.398557 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 914/1852] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:41 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:41.757574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:41.774917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec53a1b6-379d-41ae-a6bc-821c0840a9ad tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 0.534123 Sep 01 04:54:41.789284 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 939/1853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:41 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:42.237489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:42.240173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:42.260978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:42.264283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:42.265445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:42.266388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:42.267288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:42.268141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:42.343306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d804d3b6-2924-4a82-b25a-b4d06f5f2039 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110616 Sep 01 04:54:42.353126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 915/1854] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:42 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:42.410645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31548c67-3816-45ab-a663-e7923ba45ed7 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd0b700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:42.520502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31548c67-3816-45ab-a663-e7923ba45ed7 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.114438 Sep 01 04:54:42.535062 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 940/1855] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:42 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:42.797707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:42.798615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:42.816832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:42.817302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:42.817830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:42.818429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:42.818876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:42.819311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:43.364401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:43.366674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:43.383575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:43.384100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:43.384708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:43.385325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:43.391396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:43.391875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:43.435877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:43.465101 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-644b097b-c1ab-49ea-9481-179b368511ec tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106869 Sep 01 04:54:43.471719 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 941/1856] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:43 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:54:43.536925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80909897-4930-4860-aba4-f0e0892e26cb tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bc25550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:43.626141 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80909897-4930-4860-aba4-f0e0892e26cb tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.093794 Sep 01 04:54:43.634480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 942/1857] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:43 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:43.840878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:43.866977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebcde244-13ef-4d5d-9c0d-b2ac73d1c426 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.072759 Sep 01 04:54:43.870241 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 916/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:42 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:44.484450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:44.487493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:44.499912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:44.502497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:44.505075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:44.506183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:44.506929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:44.507619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:44.560898 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c1fd1a8-0601-4295-9ebb-f3f0c7b7cd79 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080982 Sep 01 04:54:44.562668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 943/1859] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:44 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:44.660998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f9d58ed-8836-432b-b302-b38e2eb6e56a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bdf7a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:44.739692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f9d58ed-8836-432b-b302-b38e2eb6e56a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.089580 Sep 01 04:54:44.741578 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 917/1860] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:44 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:44.905903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:44.908511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:44.922719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:44.923884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:44.924624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:44.925684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:44.926417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:44.927120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:45.574564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:45.577266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:45.628227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:45.628536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:45.628744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:45.629519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:45.629985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:45.630483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:45.740919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:45.800927 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec16d8b0-c9f8-4dd6-9c37-1f565ae32dc0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230398 Sep 01 04:54:45.808085 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 918/1861] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:45 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:54:45.824648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d76b7b44-42e1-4a45-b354-7059b9dc5d81 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa7602d04c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:45.891431 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d76b7b44-42e1-4a45-b354-7059b9dc5d81 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.079157 Sep 01 04:54:45.900907 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 919/1862] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:45 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:46.404983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:46.423641 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14259bcc-96e8-4512-b558-7cb325980c67 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.538110 Sep 01 04:54:46.429576 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 944/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:44 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:46.816874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:46.819052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:46.835812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:46.837131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:46.844578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:46.845896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:46.847012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:46.847992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:46.908325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e34c4471-f953-4487-ba4f-8ba7d23c4df5 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa7640d6310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:46.966626 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf4b8c5b-e7aa-4d58-ab33-352532f197b2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155743 Sep 01 04:54:46.978739 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e34c4471-f953-4487-ba4f-8ba7d23c4df5 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.076164 Sep 01 04:54:46.985895 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 920/1864] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:46 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:46.993689 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 945/1865] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:46 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:47.455513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:47.457328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:47.471643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:47.474054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:47.475356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:47.478285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:47.480411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:47.482288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:47.993461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:48.024051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:48.051810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:48.054916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:48.057775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:48.060726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:48.061541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:48.065093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:48.158543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4489b073-e55e-4046-86d3-590e7b81c7cb tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169379 Sep 01 04:54:48.161416 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 946/1866] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:47 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:54:48.180575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b76f716-f9bf-4354-9d12-f65254e773ba tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bcbf8b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:48.283996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b76f716-f9bf-4354-9d12-f65254e773ba tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.115726 Sep 01 04:54:48.285281 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 947/1867] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:48 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:48.444301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:48.457588 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9471855-514e-486f-997e-3cae34a9a981 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.007451 Sep 01 04:54:48.474771 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 921/1868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:47 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:49.174334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:49.176820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:49.207890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:49.208818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:49.211495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:49.212567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:49.215205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:49.219600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:49.302836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11495d08-0543-4200-a843-fc0d74f5b4e9 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd66c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:49.316991 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8741062-621f-458b-9f3e-5367e80e4de6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141577 Sep 01 04:54:49.320445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 948/1869] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:49 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:54:49.400731 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11495d08-0543-4200-a843-fc0d74f5b4e9 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.098146 Sep 01 04:54:49.400731 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 922/1870] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:49 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:54:49.483814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:49.484702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:49.489114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1654121820", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "eade7be1-f54e-42e6-932e-fd135c3d6e5f"}, {"port": "cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6", "tag": "port-1"}, {"port": "201b5c85-f058-4d59-a091-8536a41fe19e", "tag": "port-2"}, {"uuid": "07cce719-98d0-43f3-a27c-0f53737b3d78", "tag": "net-1"}, {"uuid": "07cce719-98d0-43f3-a27c-0f53737b3d78"}, {"uuid": "dc5f6a18-97e4-426e-bbfe-922314b51702", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "dc5f6a18-97e4-426e-bbfe-922314b51702", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8fae7fe7-e7ed-4116-82ae-6d99d1f1ae6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "39db5af0-f2e1-448c-86a8-2141c292d80e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "18c30a3e-753d-43b9-83a0-640986ead985", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1609155433"}], "key_name": "tempest-keypair-2041043943", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:54:49.502987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:49.503568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:49.504099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:49.504939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:49.505494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:49.505978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:50.021379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] validate_networks() for [('eade7be1-f54e-42e6-932e-fd135c3d6e5f', None, None, None, None, None), (None, None, 'cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6', None, None, None), (None, None, '201b5c85-f058-4d59-a091-8536a41fe19e', None, None, None), ('07cce719-98d0-43f3-a27c-0f53737b3d78', None, None, None, None, None), ('07cce719-98d0-43f3-a27c-0f53737b3d78', None, None, None, None, None), ('dc5f6a18-97e4-426e-bbfe-922314b51702', '10.2.2.100', None, None, None, None), ('dc5f6a18-97e4-426e-bbfe-922314b51702', '10.2.2.200', None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:54:51.190501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:54:51.428331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:51.442162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e28df9e-f3ab-4830-b5ce-d0fd3fb985c6 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.962650 Sep 01 04:54:51.443725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 923/1871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:49 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:51.454848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:51.462103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:51.491207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:51.492005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:51.492630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:51.493689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:51.494426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:51.495813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:51.566341 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2040e6c-4c75-4f7b-bed3-033323c22fd0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120963 Sep 01 04:54:51.567232 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 924/1872] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:54:51 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:54:51.572036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fdf36ec-8e28-4aeb-979a-c44a1d19f50f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75be59d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:51.651835 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fdf36ec-8e28-4aeb-979a-c44a1d19f50f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1422 microversion: 2.1 time: 0.083293 Sep 01 04:54:51.652879 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 925/1873] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:51 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:52.468550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:52.469811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:54:52.498338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:52.498842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:52.502370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:52.503173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:54:52.503647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:54:52.504098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:54:53.932914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:54:53.941675 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34e44e43-625c-4040-81d8-01fece69b08a tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1470 microversion: 2.1 time: 1.478909 Sep 01 04:54:53.965056 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 926/1874] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:54:52 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1470 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:54:53.976096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a40b5c54-2cfd-4343-8649-37738f4ecf21 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bebf160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:54:59.289084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=26 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:01.221788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a40b5c54-2cfd-4343-8649-37738f4ecf21 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1431 microversion: 2.1 time: 7.255014 Sep 01 04:55:01.223595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 927/1875] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:54:53 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1431 bytes in 7257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:01.233025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:01.238682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:01.249801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:01.252302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:01.252828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:01.253232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:01.254471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:01.256666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:01.257298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:01.993524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:02.052366 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f8bf03a-0dd5-4aaf-aef3-dcb8e94a2cc2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1476 microversion: 2.1 time: 0.827467 Sep 01 04:55:02.059946 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 928/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:01 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1476 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:02.287588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:02.288752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:02.289461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:02.290111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:02.290769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:02.293592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:02.315367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:02.316878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:02.318576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:02.321484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:02.324174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:02.325539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:02.383675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Getting quotas for project 10b08b6c59934cb3adc869529add8bc6. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:02.403786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Getting quotas for user a863fc04a5974165881e104ff252a62d and project 10b08b6c59934cb3adc869529add8bc6. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:02.572338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c54ef2b-10c1-43f7-bf8a-0eb916a7e934 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75bdf7a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-451279223", "description": "tempest-description-538100438"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:02.672211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:02.675855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8fae7fe7-e7ed-4116-82ae-6d99d1f1ae6d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='39db5af0-f2e1-448c-86a8-2141c292d80e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18c30a3e-753d-43b9-83a0-640986ead985',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:02.982452 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c54ef2b-10c1-43f7-bf8a-0eb916a7e934 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.919512 Sep 01 04:55:02.983104 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 929/1877] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:55:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:03.016569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1323bad1-7cb4-459f-91aa-73b507dbe13c req-59d294ab-9eb1-45d5-8911-6066485e7705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "name": "network-vif-unplugged", "status": "completed", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:03.054371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1323bad1-7cb4-459f-91aa-73b507dbe13c req-59d294ab-9eb1-45d5-8911-6066485e7705 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:03.056967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1323bad1-7cb4-459f-91aa-73b507dbe13c req-59d294ab-9eb1-45d5-8911-6066485e7705 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:03.057726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1323bad1-7cb4-459f-91aa-73b507dbe13c req-59d294ab-9eb1-45d5-8911-6066485e7705 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:03.073848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1323bad1-7cb4-459f-91aa-73b507dbe13c req-59d294ab-9eb1-45d5-8911-6066485e7705 service nova] Creating event network-vif-unplugged:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:55:03.089904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1323bad1-7cb4-459f-91aa-73b507dbe13c req-59d294ab-9eb1-45d5-8911-6066485e7705 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089220 Sep 01 04:55:03.093746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 930/1878] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:03.395861 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-759b6fd9-1fe7-4bee-aca3-b9bb382b030d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 13.922747 Sep 01 04:55:03.397913 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 949/1879] 10.222.0.26 () {62 vars in 1189 bytes} [Thu Sep 1 04:54:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 13926 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:55:03.403369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a7e377a-6f54-4e05-b4f2-53359736b70a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bc25af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:03.516118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a7e377a-6f54-4e05-b4f2-53359736b70a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 200 len: 1431 microversion: 2.1 time: 0.116790 Sep 01 04:55:03.516873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 950/1880] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:03 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 1431 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:03.535603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0098692e-049b-43da-8edd-b720e38d4271 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75bd181f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1029446789", "description": "tempest-description-1527628201"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:03.561539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-486448361", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "449bc6b5-e698-48c0-94e8-fa5fb99c143e"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:03.672418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] validate_networks() for [('449bc6b5-e698-48c0-94e8-fa5fb99c143e', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:55:04.094613 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0098692e-049b-43da-8edd-b720e38d4271 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.576360 Sep 01 04:55:04.095921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 951/1881] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:55:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:04.101786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:04.102688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:04.151232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:04.151232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:04.151232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:04.151232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:04.151232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:04.151841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:04.917093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:04.933908 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-18674153-d184-4615-9c90-6d0eb92b7b1d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1476 microversion: 2.1 time: 0.836518 Sep 01 04:55:04.936540 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 952/1882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:04 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1476 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:04.951287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4fe1fb9-bd53-4f46-bb56-bf66893ae2bf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:04.957178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4fe1fb9-bd53-4f46-bb56-bf66893ae2bf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:05.296210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4fe1fb9-bd53-4f46-bb56-bf66893ae2bf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:05.308891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4fe1fb9-bd53-4f46-bb56-bf66893ae2bf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:05.318967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4fe1fb9-bd53-4f46-bb56-bf66893ae2bf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:05.322206 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4fe1fb9-bd53-4f46-bb56-bf66893ae2bf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1286 microversion: 2.32 time: 0.382984 Sep 01 04:55:05.339049 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 953/1883] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:04 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1286 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:05.339049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:05.339049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:05.371400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:05.378561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:05.387809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:05.391778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:05.392871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:05.395606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:05.465926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:05.466994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:05.469109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:05.469960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:05.470682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:05.505027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:05.505520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:05.505960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:05.506701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:05.517736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:05.518283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:05.565313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Getting quotas for project a47f818ce66f46ae8a6907c698a7e5cd. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:05.581283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Getting quotas for user a00d9024b5f7435f9d8f3eb26458ebd2 and project a47f818ce66f46ae8a6907c698a7e5cd. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:05.628799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:05.639860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:05.763158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6599525f-5d81-432c-8b68-474647d83d79 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.660949 Sep 01 04:55:05.764933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 931/1884] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:55:05.773364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1093400662", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d8ddcb08-4914-40cc-8c74-015f2b00c561"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:05.883887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] validate_networks() for [('d8ddcb08-4914-40cc-8c74-015f2b00c561', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:55:05.891283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:05.905824 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-331cb10d-af90-4715-9871-07131c038e3c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1465 microversion: 2.1 time: 0.576191 Sep 01 04:55:05.906476 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 954/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:05 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1465 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:05.932794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca5a338e-71b5-43d5-876a-42522316b403 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:05.933488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca5a338e-71b5-43d5-876a-42522316b403 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:06.190204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca5a338e-71b5-43d5-876a-42522316b403 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:06.209276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca5a338e-71b5-43d5-876a-42522316b403 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:06.215519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca5a338e-71b5-43d5-876a-42522316b403 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:06.218193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca5a338e-71b5-43d5-876a-42522316b403 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1258 microversion: 2.21 time: 0.295519 Sep 01 04:55:06.219441 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 955/1886] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:05 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1258 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:06.235809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd14bcbe-6c60-4f34-afdd-c303d132258b tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd441f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:06.357481 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd14bcbe-6c60-4f34-afdd-c303d132258b tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a6ef865c-7f44-4aad-804f-11f5772882db" status: 200 len: 784 microversion: 2.1 time: 0.134178 Sep 01 04:55:06.370591 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 956/1887] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:06 2022] GET /compute/v2.1/images/a6ef865c-7f44-4aad-804f-11f5772882db => generated 784 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:06.395755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:06.396729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:06.406106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:06.406800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:06.408076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:06.409101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:06.410752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:06.412142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:06.938254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:06.948796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee597c4a-91f9-4b7d-95cf-039049a579d1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1476 microversion: 2.1 time: 0.576284 Sep 01 04:55:06.964075 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 957/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:06 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1476 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:07.286197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:07.287995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:07.288576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:07.289002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:07.289594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:07.314292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:07.314801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:07.315929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:07.316693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:07.317158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:07.317970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:07.383831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Getting quotas for project d32b56cc9bcb454e82b04772b39d3021. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:07.401048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Getting quotas for user f5f03d38ed204f8fad7f83808e798c5a and project d32b56cc9bcb454e82b04772b39d3021. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:07.453066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:07.455364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:07.564073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-582078144", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:07.658203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf92e0f0-bc33-4e77-b1d8-36928a071a67 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.887871 Sep 01 04:55:07.667279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 932/1889] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:55:07.684008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:07.687677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:07.690689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:55:07.709774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:07.736864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:07.738048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:07.741886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:07.742593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:07.743268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.195168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:08.235980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:08.242632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:08.248068 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-270b0003-7077-48ab-98c0-aff2d3db08b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1594 microversion: 2.32 time: 0.575572 Sep 01 04:55:08.269822 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 933/1890] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:07 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1594 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:08.303210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebee04b5-f57f-45cf-a940-16148bc06168 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:08.324390 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebee04b5-f57f-45cf-a940-16148bc06168 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.049605 Sep 01 04:55:08.329499 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 934/1891] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:55:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:08.340302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e6f426d8-1c62-4060-92c3-6978478684e0 req-87c973ac-ad78-479f-8508-653f9206137c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "name": "network-vif-plugged", "status": "completed", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:08.364742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e6f426d8-1c62-4060-92c3-6978478684e0 req-87c973ac-ad78-479f-8508-653f9206137c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.366224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e6f426d8-1c62-4060-92c3-6978478684e0 req-87c973ac-ad78-479f-8508-653f9206137c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.368150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e6f426d8-1c62-4060-92c3-6978478684e0 req-87c973ac-ad78-479f-8508-653f9206137c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.429821 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e6f426d8-1c62-4060-92c3-6978478684e0 req-87c973ac-ad78-479f-8508-653f9206137c service nova] Creating event network-vif-plugged:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:55:08.456343 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e6f426d8-1c62-4060-92c3-6978478684e0 req-87c973ac-ad78-479f-8508-653f9206137c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125108 Sep 01 04:55:08.456942 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 935/1892] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:08.478993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:08.479901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:08.504685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.510801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.511969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.514308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.523100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.523612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.567768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:08.568920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:08.570351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:08.571193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:08.571911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:08.632756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.633251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.633680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.634403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.645021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.645548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.698119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:08.713886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for user 30b46ee5087145e6828acac49bee0b9b and project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:08.750253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:08.757697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:08.955505 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25584c89-e061-4da0-97f9-881852ece26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980206 Sep 01 04:55:08.960257 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 958/1893] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:55:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:55:08.979783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:08.980846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:08.993288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.994422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.995309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:08.996995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:08.998047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:08.998746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:09.230877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:09.244870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:09.251997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:09.253490 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e641e67f-e118-4c62-b4ca-006a6e84119d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1310 microversion: 2.21 time: 0.787534 Sep 01 04:55:09.256558 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 936/1894] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:08 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1310 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:09.269457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:09.270522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:09.290190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:09.291492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:09.292787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:09.295350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:09.296777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:09.297822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:09.321015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:09.331402 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4f29f8d-d801-4b18-822d-94cd162c9d68 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1220 microversion: 2.1 time: 0.369394 Sep 01 04:55:09.332006 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 959/1895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:08 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1220 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:09.353552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13128788-e631-4392-86fd-33d894195e33 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd44ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:10.725153 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13128788-e631-4392-86fd-33d894195e33 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "DELETE /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 204 len: 0 microversion: 2.1 time: 1.388030 Sep 01 04:55:10.726480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 960/1896] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:09 2022] DELETE /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:55:10.733662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:10.734594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:10.764933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:10.767089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:10.767868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:10.769640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:10.773433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:10.778104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:10.854504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:10.865027 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42160420-306b-4692-8b98-4b002d2a7cec tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1476 microversion: 2.1 time: 1.607095 Sep 01 04:55:10.871441 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 937/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:09 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1476 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:10.882730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:10.883771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:10.898035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:10.911272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:10.917384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:10.918943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:10.921458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:10.925331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.179796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.192143 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c5f591d-4374-4e30-8007-0e30b8bdc5a1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1264 microversion: 2.1 time: 0.462111 Sep 01 04:55:11.194562 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 961/1898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:10 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1264 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:11.218421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:11.222420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:11.224202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.237798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.238530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.239173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.242478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.243267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.245002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.261553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.269623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.271867 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbf0d95e-2627-4d10-9928-71363136631e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1594 microversion: 2.32 time: 0.398756 Sep 01 04:55:11.296698 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 938/1899] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:10 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1594 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:11.326555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:11.329046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:11.357536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.358963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.361229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.365316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.366964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.367693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.387089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.408671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.412005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.413805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d2d41df-06f7-4fb7-baaf-0fbd133c5eb6 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1316 microversion: 2.21 time: 0.217926 Sep 01 04:55:11.414987 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 962/1900] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:11 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:11.420827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b73f8c17-51b9-4e66-bd05-9ca3f4d05f9f req-85a2792e-fc96-468e-b36b-f2df4248b247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "name": "network-vif-unplugged", "status": "completed", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:11.451001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b73f8c17-51b9-4e66-bd05-9ca3f4d05f9f req-85a2792e-fc96-468e-b36b-f2df4248b247 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.451847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b73f8c17-51b9-4e66-bd05-9ca3f4d05f9f req-85a2792e-fc96-468e-b36b-f2df4248b247 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.452470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b73f8c17-51b9-4e66-bd05-9ca3f4d05f9f req-85a2792e-fc96-468e-b36b-f2df4248b247 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.492540 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b73f8c17-51b9-4e66-bd05-9ca3f4d05f9f req-85a2792e-fc96-468e-b36b-f2df4248b247 service nova] Creating event network-vif-unplugged:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:55:11.501165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b73f8c17-51b9-4e66-bd05-9ca3f4d05f9f req-85a2792e-fc96-468e-b36b-f2df4248b247 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084568 Sep 01 04:55:11.504751 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 963/1901] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:11.516507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a9ffe2-92ce-491b-b5d1-3a32222f6b48 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd7e9d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:11.571867 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f4a9ffe2-92ce-491b-b5d1-3a32222f6b48 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] HTTP exception thrown: Image not found. Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a9ffe2-92ce-491b-b5d1-3a32222f6b48 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Request method failure captured: Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 HTTP/1.1 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrw29XfIKDpHb-pHhB4zFAH3nkvH7USSKgH5UoRypKNqQSZcKPyKd-GEjzYrewttFImT6rm6WQYdBNmkyn0lFFtSzjOWvDBexguU0tisSWxrg2-1VfVMCn2F0XLfjOz8u93gbgNsU_MGFQXl96Yq65_sX7ohxoREwZvkrDe7Q6aTeY Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 657aec8cb7944e229be7f018c48faf26 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_657aec8cb7944e229be7f018c48faf26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 657aec8cb7944e229be7f018c48faf26 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerTestJSON-978453747-project Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: aa3671675b3e42b0bf27cac10347b02a Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerTestJSON-978453747-project Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8'} Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 04:55:11.576231 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 could not be found. Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a9ffe2-92ce-491b-b5d1-3a32222f6b48 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:11.581192 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4a9ffe2-92ce-491b-b5d1-3a32222f6b48 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 404 len: 62 microversion: 2.1 time: 0.072582 Sep 01 04:55:11.587112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 964/1902] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:11 2022] GET /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:55:11.605537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1876003758"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:11.619323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:11.642203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.642765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.645571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.646465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.646987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.648293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.718943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:11.738599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6c2ba61-c8e5-4a4e-8509-e53bce785883 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1274 microversion: 2.1 time: 0.435584 Sep 01 04:55:11.744785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 939/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:11 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1274 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:11.898412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:11.899634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:11.922167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.922746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.923222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:11.932676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:11.933229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:11.938336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:12.056272 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-702d0811-e6ed-4a2c-a3fc-3af209e46a77 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "POST /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007/action" status: 202 len: 0 microversion: 2.1 time: 0.462417 Sep 01 04:55:12.071589 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 965/1904] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:55:11 2022] POST /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 04:55:12.116248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d00ae15a-18ea-4797-8825-df5212934f66 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd7e160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:12.238395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d00ae15a-18ea-4797-8825-df5212934f66 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.143407 Sep 01 04:55:12.252444 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 966/1905] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:12 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:12.264063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:12.266857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:12.294669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:12.296024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:12.298773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:12.302325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:12.304713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:12.308901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:12.703929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:12.716226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0a7a1de-1b61-4df2-92e6-41949aac34d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1270 microversion: 2.1 time: 0.462273 Sep 01 04:55:12.732441 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 967/1906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:12 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1270 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:12.749449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:12.750617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:12.758469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:12.761626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:12.763732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:12.764803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:12.765447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:12.766037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.105688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.129044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.131810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.135902 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3639ba0-5225-4b7e-90f7-65bda1210d37 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1594 microversion: 2.32 time: 0.401326 Sep 01 04:55:13.137989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 968/1907] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:12 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1594 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:13.157543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:13.160664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:13.192854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.196525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.197316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.197779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.198714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.201822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.202471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.210170 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9139b4e7-d64a-49a3-b7fe-2b31ca5a253b tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1461 microversion: 2.1 time: 1.316142 Sep 01 04:55:13.213617 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 940/1908] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:11 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1461 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:13.227704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:13.232231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:13.254446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.258521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.262663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.264005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.265495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.266146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.467712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.482553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.493264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:13.501177 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4154205-cf0a-4598-88f8-dd36878b9bda tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1316 microversion: 2.21 time: 0.361237 Sep 01 04:55:13.516505 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 969/1909] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:13 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:13.529210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:13.531883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:13.539055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.539664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.540242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.541323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.542673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.543276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.673203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ae104e6-8262-48ea-b494-1c9f30427c6d tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.153267 Sep 01 04:55:13.675672 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 970/1910] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:55:13 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:13.683113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cfcad3b4-a31e-4d44-a943-b85db5b66f89 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd448b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:13.761681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cfcad3b4-a31e-4d44-a943-b85db5b66f89 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.084765 Sep 01 04:55:13.762592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 971/1911] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:13 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:13.767395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:13.786555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:13.801548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.815726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.816459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.817423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.819619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.820252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.879396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:13.880156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:13.880794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:13.881425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lazy-loading 'fault' on Instance uuid 0c6ec29e-34ea-4c49-935d-463a602a9d4c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:55:14.980736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:14.993692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9af78da3-9f57-48ad-acdc-918c31ff58e6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1316 microversion: 2.1 time: 1.778592 Sep 01 04:55:15.006477 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 941/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:13 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1316 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:15.038853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:15.041697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:15.079956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:15.089274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:15.092563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:15.093592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:15.094589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:15.098410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:15.421744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:15.430851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7424dd6-e81a-436b-ac3c-f556459a6c5d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1270 microversion: 2.1 time: 0.407531 Sep 01 04:55:15.444061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 942/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:15 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1270 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:15.449761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:15.450384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:15.476799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:15.477277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:15.516146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:15.516146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:15.516146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:15.516146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:15.528224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:15.597286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e73d0208-8fea-4d66-ba9b-561601c81494 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1597 microversion: 2.1 time: 1.833260 Sep 01 04:55:15.598954 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 972/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:13 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1597 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:15.612287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:15.616759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:15.642474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:15.646420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:15.647054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:15.648532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:15.649130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:15.651597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:15.703766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:16.092006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:16.113545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:16.115959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:16.121485 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1493e87c-29ae-48c4-9912-4e56c49bc1f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1662 microversion: 2.32 time: 0.676090 Sep 01 04:55:16.143236 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 943/1915] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:15 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1662 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:16.177198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa3d1999-a70c-45ef-8b48-ae28644f17b3 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75beecb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:16.282568 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa3d1999-a70c-45ef-8b48-ae28644f17b3 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.135582 Sep 01 04:55:16.285260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 944/1916] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:16 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:16.305345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:16.331893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:16.358112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:16.368599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:16.373230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:16.377994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:16.398640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:16.400976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:16.646492 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68802065-eea7-48fd-b932-85a512745f11 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action" status: 202 len: 0 microversion: 2.1 time: 0.359305 Sep 01 04:55:16.647195 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 945/1917] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:55:16 2022] POST /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:16.660282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:16.661269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:16.675971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:16.676690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:16.677423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:16.678412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:16.679061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:16.679619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:16.917780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:16.932821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:16.934338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:16.935562 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f504041-f649-458d-b8cf-445d3fe57d0d tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 1.334586 Sep 01 04:55:16.936142 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 973/1918] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:15 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:16.962004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:16.979586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:16.986121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:16.986602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:16.987081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:16.987819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:16.988280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:16.988709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:17.362933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:17.423407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:17.875728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:17.891100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd748850-226d-4706-aa26-748953aedf67 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1270 microversion: 2.1 time: 0.951094 Sep 01 04:55:17.892638 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 974/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:16 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1270 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:17.908315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:17.910979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:17.936113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:17.940418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:17.943114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:17.946482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:17.948337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:17.950246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:18.449575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:18.464662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63496277-5f04-4989-bd2a-5bc7717d038e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1316 microversion: 2.1 time: 1.816172 Sep 01 04:55:18.472486 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 946/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:16 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1316 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:18.498401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4e03b060-f64b-48d6-a042-fe89012231d3 req-0aa1f689-bd36-4e59-8eca-6cdc4fde309f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0fd1e6-1370-45f3-a929-babdf4d83a00", "tag": "d1c80f20-805f-4b32-ae66-153ceb23fad5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:18.526063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e03b060-f64b-48d6-a042-fe89012231d3 req-0aa1f689-bd36-4e59-8eca-6cdc4fde309f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:18.528719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e03b060-f64b-48d6-a042-fe89012231d3 req-0aa1f689-bd36-4e59-8eca-6cdc4fde309f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:18.531462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e03b060-f64b-48d6-a042-fe89012231d3 req-0aa1f689-bd36-4e59-8eca-6cdc4fde309f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:18.568164 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4e03b060-f64b-48d6-a042-fe89012231d3 req-0aa1f689-bd36-4e59-8eca-6cdc4fde309f service nova] Creating event network-changed:d1c80f20-805f-4b32-ae66-153ceb23fad5 for instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 on n-h1-820368-37 Sep 01 04:55:18.582079 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4e03b060-f64b-48d6-a042-fe89012231d3 req-0aa1f689-bd36-4e59-8eca-6cdc4fde309f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106513 Sep 01 04:55:18.589029 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 947/1921] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:18.602168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:18.608912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:18.636098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:18.636592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:18.637020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:18.645196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:18.647088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:18.651946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:18.667359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:18.736714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:18.808000 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b73912eb-792c-4b6b-a34b-287581fba009 tempest-ServersAdminTestJSON-248773315 tempest-ServersAdminTestJSON-248773315-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1614 microversion: 2.1 time: 0.905539 Sep 01 04:55:18.814603 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 975/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:17 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1614 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:18.819704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7acc569e-e13a-434f-b919-d490a23085c2 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd18b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:18.958457 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7acc569e-e13a-434f-b919-d490a23085c2 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.142462 Sep 01 04:55:18.959767 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 976/1923] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:18 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:18.970124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:18.981924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:18.989158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:18.989665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:18.990084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:18.990869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:18.991295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:18.991725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:19.870096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:19.887187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:19.891983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:19.893319 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4245d05c-a6f5-4b18-a8b2-d5d7a47de586 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1662 microversion: 2.32 time: 1.302674 Sep 01 04:55:19.915833 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 948/1924] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:18 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1662 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:19.922958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0fdee8af-231a-4e36-be41-10c0e51f585b req-aca67281-5718-4c24-b36f-5d58118e8b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "name": "network-vif-plugged", "status": "completed", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:19.941482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0fdee8af-231a-4e36-be41-10c0e51f585b req-aca67281-5718-4c24-b36f-5d58118e8b68 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:19.943880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0fdee8af-231a-4e36-be41-10c0e51f585b req-aca67281-5718-4c24-b36f-5d58118e8b68 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:19.953987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0fdee8af-231a-4e36-be41-10c0e51f585b req-aca67281-5718-4c24-b36f-5d58118e8b68 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:19.971124 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0fdee8af-231a-4e36-be41-10c0e51f585b req-aca67281-5718-4c24-b36f-5d58118e8b68 service nova] Creating event network-vif-plugged:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:55:19.990148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0fdee8af-231a-4e36-be41-10c0e51f585b req-aca67281-5718-4c24-b36f-5d58118e8b68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071312 Sep 01 04:55:19.992122 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 949/1925] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:20.031435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:20.033929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:20.051479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:20.054403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:20.055902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:20.058224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:20.060221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:20.062406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:20.139938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:55:20.143973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:20.168935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:20.170693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:20.184495 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69d3dbd7-4a5e-4be3-be9b-24f4cff9ef95 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 1.223432 Sep 01 04:55:20.185702 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 977/1926] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:18 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:20.190724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:20.191607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:20.215481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:20.226320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:20.226972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:20.228035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:20.228888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:20.230550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:20.488786 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3052827b-bbc3-49b2-a1c7-2da0368eff2c tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 204 len: 0 microversion: 2.1 time: 0.493122 Sep 01 04:55:20.493902 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 950/1927] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:55:19 2022] DELETE /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:55:20.515876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:20.522307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:20.548660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:20.549165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:20.549724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:20.550444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:20.550911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:20.566116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:21.203567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:21.232179 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-649b135d-71e5-417d-9960-79457ef9cf23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 1.044710 Sep 01 04:55:21.233213 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 978/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:20 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:21.282199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61701026-41e8-415d-b843-7bba950767fb tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bcce700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:21.316060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:21.328750 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab9450ef-a8e7-409f-959d-243bd17d9127 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1316 microversion: 2.1 time: 0.830455 Sep 01 04:55:21.329360 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 951/1929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:20 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:21.351244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:21.352477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:21.363277 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61701026-41e8-415d-b843-7bba950767fb tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.106960 Sep 01 04:55:21.363870 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 979/1930] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:21 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:21.368809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:21.375461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:21.379184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:21.380677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:21.381877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:21.383039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:21.388405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:21.390532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:21.407108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:21.407660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:21.410595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:21.413155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:21.413682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:21.414148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:22.625919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:22.642946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae1a59ca-17a9-4ee5-b49e-7dfc706a716d tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1469 microversion: 2.1 time: 1.309723 Sep 01 04:55:22.643589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 952/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:21 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1469 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:22.697799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:22.700974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:22.727381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:22.731536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:22.735252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:22.738777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:22.740262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:22.740876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:22.788421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:22.798824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:22.800856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:22.808004 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e7c11c6-fa83-40c6-bfb7-d3330686d1d9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1709 microversion: 2.32 time: 1.442866 Sep 01 04:55:22.808638 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 980/1932] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:21 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1709 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:22.831620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:22.833068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:22.862936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:22.863489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:22.864118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:22.864867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:22.865334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:22.865768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:24.185285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:24.196240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f322cb6a-26eb-467b-978c-334149647103 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 1.386381 Sep 01 04:55:24.209620 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 981/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:22 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:24.212531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:24.213377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:24.224981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:24.227757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:24.228441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:24.229374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:24.229869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:24.230313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:24.339504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:24.360346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:24.368351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:24.370111 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28fffc8c-910e-4359-b5c6-b4036aff690a tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 1.698368 Sep 01 04:55:24.372055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 953/1934] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:22 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:24.379618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ff44aa8-2d71-4b03-9fc7-92c66a4d3a09 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa760208ee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:24.457700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ff44aa8-2d71-4b03-9fc7-92c66a4d3a09 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.083510 Sep 01 04:55:24.468981 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 954/1935] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:24 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:24.669742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2c70002-8dcf-4ea6-b02c-7a31ab99fb74 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Action: 'create', calling method: .version_select at 0x7fa75bbf7430>, body: {"keypair": {"name": "tempest-keypair-1969979244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVs9arv/en/4UtFm6+A0aksErH0hNhYoj/i4282GWiOhVAPEWaitRFI3ox5MpQWLK/2IpkonD3KoPtH/7cVXKS6Y34eYcSZst1A9z5PPx/0BAE+eDN8w8bQri2IENcj0A=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:24.716921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f2c70002-8dcf-4ea6-b02c-7a31ab99fb74 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Getting quotas for project 568534cc6c9e45fea2f352a241b54e78. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:24.729451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f2c70002-8dcf-4ea6-b02c-7a31ab99fb74 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Getting quotas for user 3c1a2e72acea4cbebb5887ab53185a04 and project 568534cc6c9e45fea2f352a241b54e78. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:24.793963 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2c70002-8dcf-4ea6-b02c-7a31ab99fb74 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.323285 Sep 01 04:55:24.794868 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 955/1936] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:55:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:24.803853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:24.804479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:24.819751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:24.820251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:24.824062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:24.824610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:24.825087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:24.825664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:25.510648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:25.519170 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcfc386c-c161-4abc-abbd-be99044bf512 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1316 microversion: 2.1 time: 1.318464 Sep 01 04:55:25.549179 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 982/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:24 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1316 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:25.559515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:25.575267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:25.599798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:25.600309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:25.600773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:25.601486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:25.602070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:25.602406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:26.020294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:26.032527 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99d0a6ea-981c-465b-b8d6-440d6881dbbf tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1469 microversion: 2.1 time: 1.236456 Sep 01 04:55:26.036437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 956/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:24 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1469 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:26.044973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f9db3b78-ea8c-4cf1-841c-1a357af39244 req-2d38c406-09e6-46db-97e3-e8d35299d701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "addb6642-bb7b-4f86-b31f-3c83b106e37d", "tag": "24b8ec48-f98d-477f-ac8a-f510a9d49283"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:26.069300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f9db3b78-ea8c-4cf1-841c-1a357af39244 req-2d38c406-09e6-46db-97e3-e8d35299d701 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:26.073211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f9db3b78-ea8c-4cf1-841c-1a357af39244 req-2d38c406-09e6-46db-97e3-e8d35299d701 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:26.074157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f9db3b78-ea8c-4cf1-841c-1a357af39244 req-2d38c406-09e6-46db-97e3-e8d35299d701 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:26.104211 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f9db3b78-ea8c-4cf1-841c-1a357af39244 req-2d38c406-09e6-46db-97e3-e8d35299d701 service nova] Creating event network-changed:24b8ec48-f98d-477f-ac8a-f510a9d49283 for instance addb6642-bb7b-4f86-b31f-3c83b106e37d on n-h2-820368-37 Sep 01 04:55:26.129660 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f9db3b78-ea8c-4cf1-841c-1a357af39244 req-2d38c406-09e6-46db-97e3-e8d35299d701 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091609 Sep 01 04:55:26.133603 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 957/1939] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:26.146098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:26.151144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:26.171478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:26.173627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:26.174752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:26.178158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:26.179673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:26.181113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:26.935148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:26.966808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:26.969980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:26.972227 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9dffe650-f854-4f08-9f5d-db2af922106d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1709 microversion: 2.32 time: 1.421435 Sep 01 04:55:26.974984 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 983/1940] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:25 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1709 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:26.983901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:26.984911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:27.035724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:27.043470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:27.081204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:27.089027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:27.091619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:27.093901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:27.435018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:27.449542 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae19d44f-9df0-4960-82af-9bc2e899138f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 1.314080 Sep 01 04:55:27.459062 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 958/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:26 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:27.496737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18d2567e-4a43-46f0-81bc-a9c05c425752 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa760329310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:27.681497 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18d2567e-4a43-46f0-81bc-a9c05c425752 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.218637 Sep 01 04:55:27.689125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 959/1942] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:27 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:27.734161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:27.740228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:27.797654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:27.848759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:27.856886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:27.861733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:27.871065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:27.871906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:27.880197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:28.355471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:28.373943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:28.381912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:28.383458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdca4196-61ba-4ed7-9364-d7a6d2273351 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 1.406971 Sep 01 04:55:28.387540 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 984/1943] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:26 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:28.403755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:28.409849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:28.421900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:28.422939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:28.423646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:28.428226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:28.429095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:28.429762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:28.528252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:28.530000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:28.532626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:28.534431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lazy-loading 'fault' on Instance uuid e9817b3f-a4c3-415b-80d2-223a97d07d36 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:55:28.869487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:28.893283 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4fdaaf9-b643-4766-9617-a80538c4ca8f tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 200 len: 1304 microversion: 2.1 time: 0.500550 Sep 01 04:55:28.912174 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 985/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:28 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 1304 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:28.918032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:28.943997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:28.990791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:28.991927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:28.997836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:29.000782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:29.001656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:29.002310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.003690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:30.028752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d992cb9b-3a58-4cf5-966f-55a21ce153e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1316 microversion: 2.1 time: 2.331099 Sep 01 04:55:30.032844 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 960/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:27 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1316 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:30.045047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3095e123-35d4-450a-adc3-48b604173b6b", "tag": "f036356c-d9db-46a2-b7a9-6ee990be7c92"}, {"server_uuid": "e9817b3f-a4c3-415b-80d2-223a97d07d36", "name": "network-vif-deleted", "tag": "1f7f1217-76b5-4c96-b44a-1789c165fa1d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:30.077411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:30.078027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:30.083516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.107341 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] Creating event network-changed:f036356c-d9db-46a2-b7a9-6ee990be7c92 for instance 3095e123-35d4-450a-adc3-48b604173b6b on n-h1-820368-37 Sep 01 04:55:30.108023 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] Creating event network-vif-deleted:1f7f1217-76b5-4c96-b44a-1789c165fa1d for instance e9817b3f-a4c3-415b-80d2-223a97d07d36 on n-h2-820368-37 Sep 01 04:55:30.133659 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-003f1f85-72ba-408d-b68c-91f23af46f50 req-33f91a24-206d-4cd9-9c62-18c6405b6503 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.099463 Sep 01 04:55:30.136428 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 961/1946] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:30.148586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:30.155923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:30.171061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:30.171679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:30.172659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.174102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:30.187045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:30.187664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.529180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:30.551615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:30.553281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:30.554708 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a5cc799-33c8-4b09-8e7f-0111ba5f2234 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1756 microversion: 2.32 time: 1.641028 Sep 01 04:55:30.555691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 986/1947] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:28 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1756 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:30.570760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2d174d6e-b17e-4236-a10e-cc6a17cc4e0c req-789a7f73-0352-418e-b68f-8f61514cdda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0fd1e6-1370-45f3-a929-babdf4d83a00", "name": "network-vif-plugged", "status": "completed", "tag": "d1c80f20-805f-4b32-ae66-153ceb23fad5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:30.582586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2d174d6e-b17e-4236-a10e-cc6a17cc4e0c req-789a7f73-0352-418e-b68f-8f61514cdda2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:30.591754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2d174d6e-b17e-4236-a10e-cc6a17cc4e0c req-789a7f73-0352-418e-b68f-8f61514cdda2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:30.592391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2d174d6e-b17e-4236-a10e-cc6a17cc4e0c req-789a7f73-0352-418e-b68f-8f61514cdda2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.593741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:30.609364 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8563e3ce-a77e-4410-9930-91be6245aefc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 0.471306 Sep 01 04:55:30.614178 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2d174d6e-b17e-4236-a10e-cc6a17cc4e0c req-789a7f73-0352-418e-b68f-8f61514cdda2 service nova] Creating event network-vif-plugged:d1c80f20-805f-4b32-ae66-153ceb23fad5 for instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 on n-h1-820368-37 Sep 01 04:55:30.615328 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 962/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:30 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:30.620454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f5bf375-8616-48aa-8e25-899feef7d120 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa7600cb160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:30.638554 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2d174d6e-b17e-4236-a10e-cc6a17cc4e0c req-789a7f73-0352-418e-b68f-8f61514cdda2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081584 Sep 01 04:55:30.639708 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 987/1949] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:30.673669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:30.681006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:30.703039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:30.704615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:30.705230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.706167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:30.708558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:30.709460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:30.716025 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f5bf375-8616-48aa-8e25-899feef7d120 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.099460 Sep 01 04:55:30.717015 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 963/1950] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:30 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:30.727274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1099170820", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f25b9d6c-7bec-470b-b7bd-55236454e2a2"}], "security_groups": [{"name": "tempest-securitygroup--1568594794"}], "key_name": "tempest-keypair-1969979244", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:31.084549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] validate_networks() for [('f25b9d6c-7bec-470b-b7bd-55236454e2a2', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:55:31.614122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:31.631083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:31.636168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:31.639129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-239117f6-8cda-42af-a524-7c4973914667 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 0.997906 Sep 01 04:55:31.657592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 988/1951] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:30 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:31.664292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:31.665265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: e9817b3f-a4c3-415b-80d2-223a97d07d36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:31.677642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:31.678442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:31.679099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:31.680102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:31.680589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:31.683523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:31.736534 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] HTTP exception thrown: Instance e9817b3f-a4c3-415b-80d2-223a97d07d36 could not be found. Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Request method failure captured: Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 HTTP/1.1 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqOVh3wfqF3LZRyzAI7ikJKlAKgXv9-fPvUvv1ugzjfXXHHS77Zys3e8WPt3xnaqylLdSTgCoBQCaLdRx68HgryZJA3QeoexmfA133rHHwcMRnHml5o7YRLFG9c-TiI4S5tonnHtLsMWW4eJSMleKHYCFde6NsK3xHltZAouk4ghTA Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f54577a158c74f57819ef92429fbda99 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f54577a158c74f57819ef92429fbda99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f54577a158c74f57819ef92429fbda99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f54577a158c74f57819ef92429fbda99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f54577a158c74f57819ef92429fbda99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f54577a158c74f57819ef92429fbda99 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminTestJSON-1154636962-project Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9db030290d94441abeba1f5c11690005 Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminTestJSON-1154636962-project Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e9817b3f-a4c3-415b-80d2-223a97d07d36 could not be found. Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e9817b3f-a4c3-415b-80d2-223a97d07d36'} Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9817b3f-a4c3-415b-80d2-223a97d07d36 could not be found. Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9817b3f-a4c3-415b-80d2-223a97d07d36 could not be found. Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:31.754979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9817b3f-a4c3-415b-80d2-223a97d07d36 could not be found. Sep 01 04:55:31.762247 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:31.768396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Returning 404 to user: Instance e9817b3f-a4c3-415b-80d2-223a97d07d36 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:31.775272 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d258d81-6508-4422-894c-f719ff2290d3 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36" status: 404 len: 111 microversion: 2.1 time: 0.115822 Sep 01 04:55:31.776489 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 989/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:31 2022] GET /compute/v2.1/servers/e9817b3f-a4c3-415b-80d2-223a97d07d36 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:55:31.789741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-514341015", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "59c92b9b-a4b3-4189-97d1-ab9f2663410e"}], "block_device_mapping_v2": [{"uuid": "a47faeca-c3c4-4b21-be5c-f6bec391ca29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:31.919031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] validate_networks() for [('59c92b9b-a4b3-4189-97d1-ab9f2663410e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:55:32.893310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Getting quotas for project 568534cc6c9e45fea2f352a241b54e78. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:32.902711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Getting quotas for user 3c1a2e72acea4cbebb5887ab53185a04 and project 568534cc6c9e45fea2f352a241b54e78. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:32.920996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:32.921860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:32.922957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:32.923616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:32.924248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:32.938402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:32.939359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:32.940992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:32.942163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:32.943029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:32.943771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:33.001878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Getting quotas for project 568534cc6c9e45fea2f352a241b54e78. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:33.018341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Getting quotas for user 3c1a2e72acea4cbebb5887ab53185a04 and project 568534cc6c9e45fea2f352a241b54e78. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:33.049529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:33.068239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:33.185844 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16e30924-e2b4-4d3c-86d7-2dd46d82de39 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.467387 Sep 01 04:55:33.189381 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 964/1953] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:55:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:55:33.197894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:33.203874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:33.221275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:33.222528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:33.223321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:33.226842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:33.227927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:33.231619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:33.252233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:34.574367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:34.591886 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-163aaa01-e37c-4bf2-a42c-21c09031200e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1505 microversion: 2.1 time: 1.401133 Sep 01 04:55:34.593106 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 965/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:33 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1505 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:34.598297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:34.601591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:34.616772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:34.619227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:34.620365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:34.621998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:34.624519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:34.625114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:34.826014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:34.827106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:34.827765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:34.828510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:34.829219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:34.831446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:34.848772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:34.867196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:34.867924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:34.868968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:34.869578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:34.870996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:34.943158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:34.954932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Getting quotas for user 6c067efaa01740ee9284a943d574f086 and project 8fff25d859dc49438f78d39d3e70e6f8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:35.117034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:35.132864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:35.135008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:35.140924 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5707675-d6fc-4642-8518-3ed1deebd1f3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1803 microversion: 2.32 time: 0.546207 Sep 01 04:55:35.141769 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 966/1955] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:34 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1803 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:35.160603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:35.163012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a47faeca-c3c4-4b21-be5c-f6bec391ca29',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:35.184828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:35.188894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:35.201542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:35.204605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:35.205266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:35.207736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:35.208395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:35.211916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:35.470407 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdd283ff-23be-431e-86a2-d61d55503aa6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.692542 Sep 01 04:55:35.476702 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 990/1956] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:55:35.493911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fc70ee2-01ca-4693-8750-143c8d0bc64f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd7e940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:35.608086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fc70ee2-01ca-4693-8750-143c8d0bc64f tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.129323 Sep 01 04:55:35.610200 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 991/1957] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:35 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:35.618754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:35.619839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:35.627991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:35.628931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:35.629665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:35.631331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:35.632790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:35.633546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:35.678375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:55:35.796169 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2420d0b-9a03-492e-983c-105b355dd123 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 204 len: 0 microversion: 2.1 time: 0.183809 Sep 01 04:55:35.797020 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 992/1958] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:55:35 2022] DELETE /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:55:35.810008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:35.812304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:35.827711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:35.829769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:35.830391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:35.831181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:35.832838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:35.833296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:35.911491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:35.989672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:36.002644 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb9c005b-e39a-4d23-bcd7-c8ec58b1177e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 0.831978 Sep 01 04:55:36.003655 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 967/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:35 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:36.019159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:36.020288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:36.034799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.037260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.039725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.040722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.049619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.050265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.215052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:36.235391 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7459ffce-ae46-4a9d-87f4-8b64ee8043c2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1328 microversion: 2.1 time: 0.218802 Sep 01 04:55:36.260119 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 968/1960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:36 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:36.270150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-451279223"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:36.270954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:36.302582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.303500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.304220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.306522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.307389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.308070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.444359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:36.467376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:36.469535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:36.475753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a57b5b65-9a5c-4799-8dcc-9ee502306185 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 0.677295 Sep 01 04:55:36.476649 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 993/1961] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:35 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:36.495166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:36.496070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:36.515859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.518565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.526003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.527228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.527907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.528785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.817727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:36.837557 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3241711f-b118-45f2-9b9a-b1955b77fa5b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1102 microversion: 2.1 time: 0.356543 Sep 01 04:55:36.841400 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 994/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:36 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1102 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:36.860905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:36.861736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:36.896253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.896888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.901575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:36.902439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:36.903205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:36.903663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:37.073810 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Adding security group 2259fb6d-8352-4a20-9a56-3f9cadfcc8c6 to port d1c80f20-805f-4b32-ae66-153ceb23fad5 Sep 01 04:55:37.649041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:37.668812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2fc01f2-1c46-4d93-93c6-2a62a1519649 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1468 microversion: 2.1 time: 0.825862 Sep 01 04:55:37.690048 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 995/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:36 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1468 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:37.715258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:37.715976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:37.730018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:37.735188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:37.736347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:37.737151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:37.739083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:37.740457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:38.511990 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b3ab17b-5dce-4c94-85dc-05b9e85099fd tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00/action" status: 202 len: 0 microversion: 2.1 time: 2.250274 Sep 01 04:55:38.513562 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 969/1964] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:55:36 2022] POST /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00/action => generated 0 bytes in 2252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:38.520983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d8e1436-b15c-48b8-94f9-06ccd0d87bc8 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bf1d1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:38.609771 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d8e1436-b15c-48b8-94f9-06ccd0d87bc8 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1427 microversion: 2.1 time: 0.094965 Sep 01 04:55:38.618155 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 970/1965] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:38 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:38.635811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:38.640999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:38.666064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:38.666609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:38.667079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:38.672526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:38.675502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:38.679034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:40.448084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:40.470514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:40.472113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:40.473341 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa151670-e2ff-461c-b198-622a2cb28c7b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1850 microversion: 2.32 time: 2.782251 Sep 01 04:55:40.473921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 996/1966] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:37 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1850 bytes in 2783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:40.492533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:40.493284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:40.505592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:40.506091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:40.506554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:40.507292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:40.507913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:40.508523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:40.649090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:40.660993 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9a4066f-3cf9-44e9-8c25-4ffdb9781296 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 2.037543 Sep 01 04:55:40.665501 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 971/1967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:38 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:40.673312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:40.678177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:40.693916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:40.695322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:40.697040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:40.702163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:40.702826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:40.703455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.287891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:41.308149 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4118d5b4-5a5c-405f-8982-ae18ddf12e95 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.833016 Sep 01 04:55:41.309294 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 997/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:40 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:41.314272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:41.314913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:41.325995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.326785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.327309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.328082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.328924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.329475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.511055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:41.525483 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-908d6557-79a1-4537-8077-0b116d923f68 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1168 microversion: 2.1 time: 0.214946 Sep 01 04:55:41.526401 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 998/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:41 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1168 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:41.531593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9fca4023-6745-4726-b6ef-a48a0f2495d2 req-97125168-fd9a-4981-947a-a61298dd67a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addb6642-bb7b-4f86-b31f-3c83b106e37d", "name": "network-vif-plugged", "status": "completed", "tag": "24b8ec48-f98d-477f-ac8a-f510a9d49283"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:41.542260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9fca4023-6745-4726-b6ef-a48a0f2495d2 req-97125168-fd9a-4981-947a-a61298dd67a6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.542837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9fca4023-6745-4726-b6ef-a48a0f2495d2 req-97125168-fd9a-4981-947a-a61298dd67a6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.543297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9fca4023-6745-4726-b6ef-a48a0f2495d2 req-97125168-fd9a-4981-947a-a61298dd67a6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.556401 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9fca4023-6745-4726-b6ef-a48a0f2495d2 req-97125168-fd9a-4981-947a-a61298dd67a6 service nova] Creating event network-vif-plugged:24b8ec48-f98d-477f-ac8a-f510a9d49283 for instance addb6642-bb7b-4f86-b31f-3c83b106e37d on n-h2-820368-37 Sep 01 04:55:41.560434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:41.563224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9fca4023-6745-4726-b6ef-a48a0f2495d2 req-97125168-fd9a-4981-947a-a61298dd67a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035271 Sep 01 04:55:41.568274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 999/1970] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:41.574905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1029446789"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:41.575817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:41.577990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:41.580233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:41.582034 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7297efc1-34c3-4720-87c4-717ef94db894 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1358 microversion: 2.21 time: 0.915002 Sep 01 04:55:41.583060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.583330 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 972/1971] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:40 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1358 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:41.583806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.584272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.585024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.585484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.585914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.590609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:41.593032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:41.602710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.604081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.604706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.606660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.607683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.608926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.873601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:41.885217 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c18f1918-d2a3-41fa-b479-38313c140d61 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 200 len: 1426 microversion: 2.1 time: 0.300067 Sep 01 04:55:41.886401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 973/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:41 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 1426 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:41.891202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2e2d3edd-8481-452f-bd76-aa6d3ce1b1a2 req-5e47d941-ced5-4ccd-9f41-fbfe1c3cb964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0fd1e6-1370-45f3-a929-babdf4d83a00", "tag": "d1c80f20-805f-4b32-ae66-153ceb23fad5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:41.902681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e2d3edd-8481-452f-bd76-aa6d3ce1b1a2 req-5e47d941-ced5-4ccd-9f41-fbfe1c3cb964 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:41.903210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e2d3edd-8481-452f-bd76-aa6d3ce1b1a2 req-5e47d941-ced5-4ccd-9f41-fbfe1c3cb964 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:41.903969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e2d3edd-8481-452f-bd76-aa6d3ce1b1a2 req-5e47d941-ced5-4ccd-9f41-fbfe1c3cb964 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:41.919335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2e2d3edd-8481-452f-bd76-aa6d3ce1b1a2 req-5e47d941-ced5-4ccd-9f41-fbfe1c3cb964 service nova] Creating event network-changed:d1c80f20-805f-4b32-ae66-153ceb23fad5 for instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 on n-h1-820368-37 Sep 01 04:55:41.927630 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2e2d3edd-8481-452f-bd76-aa6d3ce1b1a2 req-5e47d941-ced5-4ccd-9f41-fbfe1c3cb964 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039676 Sep 01 04:55:41.928918 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 974/1973] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:41.935339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39685616-1a5e-4407-86d0-2a1b14e2df66 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa7603f3c10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:41.995367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39685616-1a5e-4407-86d0-2a1b14e2df66 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1436 microversion: 2.1 time: 0.064567 Sep 01 04:55:42.005654 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 975/1974] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:41 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1436 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:42.012438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:42.013424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:42.020921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:42.021417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:42.021897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:42.022859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:42.024681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:42.025179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:42.420240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Adding security group 1fa3715b-3887-448d-87a6-7a4ba3c577e9 to port d1c80f20-805f-4b32-ae66-153ceb23fad5 Sep 01 04:55:42.888308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:42.928999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:42.937037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:42.938320 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d857249-cc51-4a3b-91cf-f75b75971565 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1838 microversion: 2.32 time: 0.930603 Sep 01 04:55:42.955136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 976/1975] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:42 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1838 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:42.961713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:42.962583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:42.964788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:42.971947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:42.972597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:42.973026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:42.973922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:42.974558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:42.975168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:43.040246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:43.522862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:43.533548 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd75079f-72ba-42df-a29e-3edbe2519566 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 0.577092 Sep 01 04:55:43.534498 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 977/1976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:42 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:43.539690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-052b7b5e-7492-47f3-a919-77cdba9b1d74 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa7607823a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:43.589807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-052b7b5e-7492-47f3-a919-77cdba9b1d74 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 200 len: 1436 microversion: 2.1 time: 0.053940 Sep 01 04:55:43.590968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 978/1977] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 04:55:43 2022] GET /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 1436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:43.596300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:43.597159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:43.605947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:43.606723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:43.607253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:43.608017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:43.608670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:43.609489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:44.446024 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8058ee2e-9d21-4400-92d0-c0c0abc58d5c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00/action" status: 202 len: 0 microversion: 2.1 time: 2.876184 Sep 01 04:55:44.448524 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1000/1978] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:55:41 2022] POST /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00/action => generated 0 bytes in 2879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:44.455402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:44.456318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:44.465255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:44.465755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:44.466201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:44.468490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:44.470422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:44.472403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:44.505016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:44.514916 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f41b3446-3d39-431e-b5b3-98c6b4867610 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.922174 Sep 01 04:55:44.521994 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 979/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:43 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:44.532218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:44.533560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:44.543928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:44.544427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:44.544866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:44.545571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:44.551188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:44.551638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:44.901152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:44.983081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:45.071968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.084086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92fdd434-32cf-4606-ba91-349cf0423ac7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1210 microversion: 2.1 time: 0.634095 Sep 01 04:55:45.084858 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1001/1980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:44 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1210 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:45.090655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:45.091683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: cf3ae373-b7f4-4601-88dd-03677d4c4277] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:45.100880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.101750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.102520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.103377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.104040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.104520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.126228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] HTTP exception thrown: Instance cf3ae373-b7f4-4601-88dd-03677d4c4277 could not be found. Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Request method failure captured: Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 HTTP/1.1 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDqOVh3wfqF3LZRyzAI7ikJKlAKgXv9-fPvUvv1ugzjfXXHHS77Zys3e8WPt3xnaqylLdSTgCoBQCaLdRx68HgryZJA3QeoexmfA133rHHwcMRnHml5o7YRLFG9c-TiI4S5tonnHtLsMWW4eJSMleKHYCFde6NsK3xHltZAouk4ghTA Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f54577a158c74f57819ef92429fbda99 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f54577a158c74f57819ef92429fbda99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f54577a158c74f57819ef92429fbda99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f54577a158c74f57819ef92429fbda99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f54577a158c74f57819ef92429fbda99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f54577a158c74f57819ef92429fbda99 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminTestJSON-1154636962-project Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9db030290d94441abeba1f5c11690005 Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminTestJSON-1154636962-project Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance cf3ae373-b7f4-4601-88dd-03677d4c4277 could not be found. Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'cf3ae373-b7f4-4601-88dd-03677d4c4277'} Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3ae373-b7f4-4601-88dd-03677d4c4277 could not be found. Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3ae373-b7f4-4601-88dd-03677d4c4277 could not be found. Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:45.129303 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3ae373-b7f4-4601-88dd-03677d4c4277 could not be found. Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Returning 404 to user: Instance cf3ae373-b7f4-4601-88dd-03677d4c4277 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:45.132646 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0218e17e-fc4e-47c8-b46a-fa2ea2ec2541 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277" status: 404 len: 111 microversion: 2.1 time: 0.045117 Sep 01 04:55:45.133182 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1002/1981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:45 2022] GET /compute/v2.1/servers/cf3ae373-b7f4-4601-88dd-03677d4c4277 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:55:45.141239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-65d3acda-dfd7-4889-b2e6-71cda0d590a6 req-02d19a45-8387-4ffd-92f2-9abb88194dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095e123-35d4-450a-adc3-48b604173b6b", "name": "network-vif-plugged", "status": "completed", "tag": "f036356c-d9db-46a2-b7a9-6ee990be7c92"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:45.147859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.155784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65d3acda-dfd7-4889-b2e6-71cda0d590a6 req-02d19a45-8387-4ffd-92f2-9abb88194dab service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.156363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65d3acda-dfd7-4889-b2e6-71cda0d590a6 req-02d19a45-8387-4ffd-92f2-9abb88194dab service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.156911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65d3acda-dfd7-4889-b2e6-71cda0d590a6 req-02d19a45-8387-4ffd-92f2-9abb88194dab service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.158384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.160419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.161768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f9ef4c1-5957-4cc9-a06b-8e9a7b9e9e25 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1551 microversion: 2.21 time: 0.638599 Sep 01 04:55:45.173836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-65d3acda-dfd7-4889-b2e6-71cda0d590a6 req-02d19a45-8387-4ffd-92f2-9abb88194dab service nova] Creating event network-vif-plugged:f036356c-d9db-46a2-b7a9-6ee990be7c92 for instance 3095e123-35d4-450a-adc3-48b604173b6b on n-h1-820368-37 Sep 01 04:55:45.178997 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 980/1982] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:44 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1551 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:45.179405 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-65d3acda-dfd7-4889-b2e6-71cda0d590a6 req-02d19a45-8387-4ffd-92f2-9abb88194dab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043787 Sep 01 04:55:45.184469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:45.184921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1003/1983] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:45.187297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:45.190445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:45.191346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:45.195095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.196544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.197407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.198398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.198792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.199494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.200071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.200929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.201531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.202102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.207481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.208160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:45.943376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.958218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.963698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.965453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:45.966829 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4456d81-3e79-405b-a6e1-4211af79d236 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1859 microversion: 2.32 time: 0.780719 Sep 01 04:55:45.969383 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1004/1984] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:45 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1859 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:45.970788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6598d70d-403f-45db-b44b-372f65055f45 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1465 microversion: 2.1 time: 0.790604 Sep 01 04:55:45.972361 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 981/1985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:45 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1465 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:45.975258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3ae373-b7f4-4601-88dd-03677d4c4277", "name": "network-vif-deleted", "tag": "634ec57c-6cc7-4904-a960-fc82804f80de"}, {"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "c48ec7dc-e437-426b-bbc6-6eee0e32594f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:45.987144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:45.988081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:45.995824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:45.996892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:45.997388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.007197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.008037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.009790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.016347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.018102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.018654 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] Creating event network-vif-deleted:634ec57c-6cc7-4904-a960-fc82804f80de for instance cf3ae373-b7f4-4601-88dd-03677d4c4277 on n-h1-820368-37 Sep 01 04:55:46.019202 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] Creating event network-changed:c48ec7dc-e437-426b-bbc6-6eee0e32594f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:55:46.019529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.030951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e43b86dd-6b0d-4f0e-92ff-abe0026ed42a req-25aff0ea-4f44-4dab-888c-2c8bfa4cbf37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059692 Sep 01 04:55:46.032542 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1005/1986] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:46.038495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:46.039310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:46.048256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.049424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.049424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.050134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.050710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.051328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.478274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:46.486740 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f04b425-4b43-447f-abf1-d2542ff56f03 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1312 microversion: 2.1 time: 0.452654 Sep 01 04:55:46.487394 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1006/1987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:46 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1312 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:46.492609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:46.493131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:46.507290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.508080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.508748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.509583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.510157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.510588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.540244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:55:46.548273 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-acdc1eb1-aaff-49db-a65a-543de2784932 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.574780 Sep 01 04:55:46.562121 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 982/1988] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Sep 1 04:55:45 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00/os-security-groups => generated 1157 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:46.567538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:46.568034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:46.580477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.580971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.581595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.582324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.582775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.587904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.618611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:55:46.660161 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7d98beb-7dec-4d2f-b247-0e840882c3d0 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 204 len: 0 microversion: 2.1 time: 0.171419 Sep 01 04:55:46.660843 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1007/1989] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:55:46 2022] DELETE /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:55:46.666707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:46.667463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:46.673992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.675195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.675692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.676348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.677444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.678046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.711852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78fe21e4-023c-401c-b409-a232047bbaa4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "DELETE /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 204 len: 0 microversion: 2.21 time: 0.147370 Sep 01 04:55:46.712383 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 983/1990] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:55:46 2022] DELETE /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 04:55:46.718024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01509ab4-ce02-4c68-ac7d-af3eccde67d5 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa7602d0940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:46.884243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:46.910444 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0453fb4-ad70-4026-a8af-2cb5d0667ce6 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.245253 Sep 01 04:55:46.924259 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1008/1991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:46 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:46.931960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:46.932597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:46.939787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.940309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.940806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:46.941527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:46.942143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:46.942715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.180319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.189772 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb3293b9-dc99-4cd6-947c-8ce4b86b4931 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.264227 Sep 01 04:55:47.190503 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01509ab4-ce02-4c68-ac7d-af3eccde67d5 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "DELETE /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c" status: 204 len: 0 microversion: 2.1 time: 0.476615 Sep 01 04:55:47.195349 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 984/1992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:46 2022] DELETE /compute/v2.1/images/22545695-47cf-4e8e-8279-21d2d78e701c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:55:47.200392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df48dc80-0b1a-4850-815d-fe5903dd650b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75bec2ca0>, body: {"security_group": {"name": " tempest-securitygroup -188916643 ", "description": "tempest-description-261861346"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:47.203729 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1009/1993] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:46 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:47.209801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.210417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:47.216953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.217482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.218068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.218775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.219300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.219723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.438138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.446410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-470b1f64-d838-4c8f-9ddb-16f86862b2c2 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1467 microversion: 2.1 time: 0.241344 Sep 01 04:55:47.446869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1010/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:47 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1467 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:47.452874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.453574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:47.460717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.461245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.461948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.462860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.463527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.463984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.468768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:47.505834 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df48dc80-0b1a-4850-815d-fe5903dd650b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.309257 Sep 01 04:55:47.506502 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 985/1995] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:55:47 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:47.512209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.513128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:47.521472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.522190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.522524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.523279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.523847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.526167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.549539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:47.728548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.743300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.746334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.748431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2e6826d-7a8d-40d5-8c98-f6960b9a854b tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1557 microversion: 2.21 time: 0.300386 Sep 01 04:55:47.749466 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1011/1996] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:47 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1557 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:47.757413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c126ae47-8575-47b0-8a2c-2cc08dff3aac req-3112806e-fbbb-4c1e-ae89-b8e6c54117c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "name": "network-vif-unplugged", "status": "completed", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:47.776982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c126ae47-8575-47b0-8a2c-2cc08dff3aac req-3112806e-fbbb-4c1e-ae89-b8e6c54117c3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.777842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c126ae47-8575-47b0-8a2c-2cc08dff3aac req-3112806e-fbbb-4c1e-ae89-b8e6c54117c3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.778631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c126ae47-8575-47b0-8a2c-2cc08dff3aac req-3112806e-fbbb-4c1e-ae89-b8e6c54117c3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.791273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.795167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c126ae47-8575-47b0-8a2c-2cc08dff3aac req-3112806e-fbbb-4c1e-ae89-b8e6c54117c3 service nova] Creating event network-vif-unplugged:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:55:47.800553 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c126ae47-8575-47b0-8a2c-2cc08dff3aac req-3112806e-fbbb-4c1e-ae89-b8e6c54117c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049456 Sep 01 04:55:47.801315 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1012/1997] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:47.806325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e099014d-1d67-4b1d-88d0-b41f5aaf3b42 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '.version_select at 0x7fa75bd44b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.807383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.808849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.810045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1b8ce6e-6e94-4360-be78-106e361b505e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.302308 Sep 01 04:55:47.810588 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 986/1998] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:47 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:47.817911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.818668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:47.825874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.826502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.827256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.827958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.828394 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e099014d-1d67-4b1d-88d0-b41f5aaf3b42 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] HTTP exception thrown: Image not found. Sep 01 04:55:47.828526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.828808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e099014d-1d67-4b1d-88d0-b41f5aaf3b42 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Request method failure captured: Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 HTTP/1.1 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrw29XfIKDpHb-pHhB4zFAH3nkvH7USSKgH5UoRypKNqQSZcKPyKd-GEjzYrewttFImT6rm6WQYdBNmkyn0lFFtSzjOWvDBexguU0tisSWxrg2-1VfVMCn2F0XLfjOz8u93gbgNsU_MGFQXl96Yq65_sX7ohxoREwZvkrDe7Q6aTeY Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 657aec8cb7944e229be7f018c48faf26 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_657aec8cb7944e229be7f018c48faf26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 657aec8cb7944e229be7f018c48faf26 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerTestJSON-978453747-project Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: aa3671675b3e42b0bf27cac10347b02a Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerTestJSON-978453747-project Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8'} Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 to delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 could not be found. Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.830291 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e099014d-1d67-4b1d-88d0-b41f5aaf3b42 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e099014d-1d67-4b1d-88d0-b41f5aaf3b42 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "DELETE /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8" status: 404 len: 62 microversion: 2.1 time: 0.029485 Sep 01 04:55:47.834167 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1013/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:47 2022] DELETE /compute/v2.1/images/a2e4e8c9-5d7d-47f6-8ed6-c8ee315359a8 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:55:47.837056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e855e15c-8737-4e7b-86c0-208a1f24fa15 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bd68c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.921937 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e855e15c-8737-4e7b-86c0-208a1f24fa15 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774" status: 200 len: 222 microversion: 2.1 time: 0.088602 Sep 01 04:55:47.922724 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1014/2000] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:55:47 2022] GET /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774 => generated 222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:47.932585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:47.932585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:47.936024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.936528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.936966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.937692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:47.938154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:47.938581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:47.966236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:55:47.988865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:47.998148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32053792-92b0-4cda-b88e-fa5586a7c95d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1462 microversion: 2.1 time: 0.185204 Sep 01 04:55:47.998865 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 987/2001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:47 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1462 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:48.004054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.004732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:48.011220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.011763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.012202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.012902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.013355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.013780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.063766 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbbcf8be-3910-49cc-a800-ba966e0f3bc6 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 204 len: 0 microversion: 2.1 time: 0.139715 Sep 01 04:55:48.064362 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1015/2002] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:55:47 2022] DELETE /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:55:48.069797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3ce7f3e-6e55-45da-b2ea-a3ec3abbd073 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75be95c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.232245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:48.240806 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38dab149-32f4-4f57-af97-aa8404e64e43 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.240419 Sep 01 04:55:48.241309 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 988/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:47 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:48.333997 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3ce7f3e-6e55-45da-b2ea-a3ec3abbd073 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774" status: 202 len: 0 microversion: 2.1 time: 0.268366 Sep 01 04:55:48.334733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1016/2004] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:55:48 2022] DELETE /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:48.340031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.340818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:48.350272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.350781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.351375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.352158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.352825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.353550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.359221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.361096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:48.368724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.369193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.370090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.370986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.371439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.371855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.562816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:48.571865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-272897d4-d153-4e3a-a298-687b92606b9c tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1471 microversion: 2.1 time: 0.236105 Sep 01 04:55:48.572693 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1017/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:48 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:48.593427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a225e1-f89f-4445-9d87-2fc1d0aedce3", "tag": "372b75ae-1ae8-4a2a-8b57-4da47c595b94"}, {"name": "network-changed", "server_uuid": "0e0fd1e6-1370-45f3-a929-babdf4d83a00", "tag": "d1c80f20-805f-4b32-ae66-153ceb23fad5"}, {"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6"}, {"name": "network-changed", "server_uuid": "6535537b-a849-4fd7-89ea-09bd5159ab15", "tag": "e67cd756-582f-4d99-bef6-fa5bc89db4f3"}, {"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "201b5c85-f058-4d59-a091-8536a41fe19e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:48.609631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.610373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.611166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.631995 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Creating event network-changed:372b75ae-1ae8-4a2a-8b57-4da47c595b94 for instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 on n-h2-820368-37 Sep 01 04:55:48.632744 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Creating event network-changed:d1c80f20-805f-4b32-ae66-153ceb23fad5 for instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 on n-h1-820368-37 Sep 01 04:55:48.633742 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Creating event network-changed:cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:55:48.634335 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Creating event network-changed:e67cd756-582f-4d99-bef6-fa5bc89db4f3 for instance 6535537b-a849-4fd7-89ea-09bd5159ab15 on n-h2-820368-37 Sep 01 04:55:48.635718 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] Creating event network-changed:201b5c85-f058-4d59-a091-8536a41fe19e for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:55:48.648767 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5b985096-86f4-425a-8954-4f6931d2e227 req-cd037d51-62c1-4229-84cb-1e0ae754fea5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 847 microversion: 2.1 time: 0.064800 Sep 01 04:55:48.650102 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1018/2006] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 847 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:48.655870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.656769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:48.664035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.664960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.665558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.666291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.666754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.667212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.714468 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7de5fa8f-b078-4e98-af1f-6b9c1dcd9424 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1615 microversion: 2.1 time: 0.468503 Sep 01 04:55:48.718681 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 989/2007] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:48 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1615 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:48.725289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bd668b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.772248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:55:48.773374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 7066420f-2051-491a-8d53-5c6d9f158774 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:55:48.773948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.773948 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774 HTTP/1.1 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7066420f-2051-491a-8d53-5c6d9f158774'} Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:55:48.777263 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-b6042260-6c60-4433-8967-86a4d09fde8d'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-714b4118-e287-425f-af2d-0ce4f00f47f0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774" status: 404 len: 194 microversion: 2.1 time: 0.059705 Sep 01 04:55:48.786765 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 990/2008] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:55:48 2022] GET /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:55:48.799637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:48.800132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:48.818222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.818927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.819360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:48.820260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:48.820869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:48.821282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.163238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:49.172914 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e756bfce-ce25-46ae-b726-547de8304251 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.521268 Sep 01 04:55:49.173659 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1019/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:48 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:49.182875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:49.184004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:49.194345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.195120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.195768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.197261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.198012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.198663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.263760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:49.272073 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-153360e8-559a-475c-a8f1-0fb16a643042 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1467 microversion: 2.1 time: 0.478379 Sep 01 04:55:49.272769 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 991/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:48 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1467 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:49.278413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:49.279388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:49.286485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.287244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.287812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.288567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.289088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.289728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.316613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '91aa0ad569df44b6a2c89bc623f45f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74170ca5a3fb4cc4a75eacf71a959f12', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:49.317187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] flavor_id is None. Assuming migration. {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4194}} Sep 01 04:55:49.317628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 04:55:49.432802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:49.441929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:49.443436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:49.444658 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e412140c-8524-42ad-8d9c-c2953225cbf4 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1557 microversion: 2.21 time: 0.170654 Sep 01 04:55:49.445221 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 992/2011] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:49 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:49.459005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a837bdf-551b-48e1-bc41-2736c0d397d7 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75ba0c280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-245682512", "description": "tempest-description-1789374590"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:49.609987 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebbd35b1-b82c-4325-8557-319093cb67d6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b/action" status: 202 len: 0 microversion: 2.1 time: 0.434856 Sep 01 04:55:49.610915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1020/2012] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:55:49 2022] POST /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:49.615794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:49.616561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:49.623575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.624079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.624688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.626905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.626905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.626905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.629368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a837bdf-551b-48e1-bc41-2736c0d397d7 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.182656 Sep 01 04:55:49.630636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 993/2013] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:55:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:49.635829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:49.636553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:49.645872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.646587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.647309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:49.649189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:49.661802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:49.663925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:50.207261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:50.217971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:50.219832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:50.221221 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4800a143-5c65-466e-9b67-feefba180374 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.609237 Sep 01 04:55:50.222011 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1021/2014] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:49 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:50.227745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:50.228358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:50.236586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:50.237184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:50.237623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:50.239934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:50.240407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:50.240907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:50.271410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:50.287915 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93c4175a-f969-4e30-a301-e1d15093cad4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.655923 Sep 01 04:55:50.288830 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 994/2015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:49 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:50.295320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:50.296174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:50.311146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:50.311755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:50.312291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:50.313877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:50.314550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:50.315272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:50.673435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3671675b3e42b0bf27cac10347b02a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657aec8cb7944e229be7f018c48faf26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:50.681820 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43720b46-5b9c-489c-80f8-c1d5b78a359a tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 200 len: 1471 microversion: 2.1 time: 0.458770 Sep 01 04:55:50.683017 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1022/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:50 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 1471 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:50.696002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-031e1cd7-715e-4748-80c6-8e42990462de tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75be95e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1934739370", "description": "tempest-description-749394591"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:50.766348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:50.776680 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d9fd71b-8105-471c-8ba3-a69bb46af595 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1471 microversion: 2.1 time: 0.486765 Sep 01 04:55:50.777446 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 995/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:50 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:50.786136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:50.787301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:50.797871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:50.798737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:50.799541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:50.800774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:50.801792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:50.802753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:51.279965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9db030290d94441abeba1f5c11690005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54577a158c74f57819ef92429fbda99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:51.291261 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4845a5cf-2f1e-4fad-9a9f-3fff675584b7 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 200 len: 1467 microversion: 2.1 time: 0.512111 Sep 01 04:55:51.292937 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 996/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:50 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 1467 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:51.299141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:51.299793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:51.308331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:51.308820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:51.309448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:51.310210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:51.312759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:51.313215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:51.451844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-031e1cd7-715e-4748-80c6-8e42990462de tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.766372 Sep 01 04:55:51.453689 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1023/2019] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:55:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:51.462981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:51.463788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:51.471639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:51.472244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:51.472897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:51.474567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:51.475171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:51.475688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:51.921809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:51.935953 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08ac24e4-51a4-4672-ae40-ebdfbba77e56 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.641509 Sep 01 04:55:51.936592 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 997/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:51 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:51.949015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:51.949642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:51.971490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:51.971992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:51.972449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:51.973340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:51.987720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:51.988205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:52.568679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:52.593950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:52.596106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:52.598090 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-587d6afd-a559-431e-ae08-fd30a67370e8 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1557 microversion: 2.21 time: 1.141251 Sep 01 04:55:52.602378 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1024/2021] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:51 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1557 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:52.624335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:52.625306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:52.635886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:52.636743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:52.638055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:52.639885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:52.641051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:52.641713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:53.247335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:53.257491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:53.259113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:53.260303 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b538d024-40c1-443a-b88a-7c51de408025 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 1.322748 Sep 01 04:55:53.261236 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 998/2022] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:51 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:53.267185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8081eab8-1f85-4cb6-b159-dbe46d7a5293 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75bf1d790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1323766352", "description": "tempest-description-1508124051"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:53.427498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:53.441060 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c25fb83-2012-4e63-82fe-81d525beb84f tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.833384 Sep 01 04:55:53.442592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1025/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:52 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:53.447606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:53.448498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] [instance: 4bf13a9e-6572-4d1c-9e35-1b0f285a8007] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:53.454764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:53.455365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:53.456153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:53.457505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:53.458148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:53.458910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] HTTP exception thrown: Instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 could not be found. Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Request method failure captured: Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 HTTP/1.1 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDrw29XfIKDpHb-pHhB4zFAH3nkvH7USSKgH5UoRypKNqQSZcKPyKd-GEjzYrewttFImT6rm6WQYdBNmkyn0lFFtSzjOWvDBexguU0tisSWxrg2-1VfVMCn2F0XLfjOz8u93gbgNsU_MGFQXl96Yq65_sX7ohxoREwZvkrDe7Q6aTeY Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 657aec8cb7944e229be7f018c48faf26 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_657aec8cb7944e229be7f018c48faf26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/657aec8cb7944e229be7f018c48faf26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 657aec8cb7944e229be7f018c48faf26 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-978453747 Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerTestJSON-978453747-project Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: aa3671675b3e42b0bf27cac10347b02a Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerTestJSON-978453747-project Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 could not be found. Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4bf13a9e-6572-4d1c-9e35-1b0f285a8007'} Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 could not be found. Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:53.482735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 could not be found. Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 could not be found. Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] Returning 404 to user: Instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cef49aea-328d-4284-ad55-01b06f319998 tempest-ImagesOneServerTestJSON-978453747 tempest-ImagesOneServerTestJSON-978453747-project] 10.222.0.26 "GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007" status: 404 len: 111 microversion: 2.1 time: 0.036078 Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1026/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:53 2022] GET /compute/v2.1/servers/4bf13a9e-6572-4d1c-9e35-1b0f285a8007 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:55:53.486335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6b30fd72-55c5-498e-8edd-9794de770f45 req-f7f2e7a8-0a20-48ae-a069-5adf909394e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf13a9e-6572-4d1c-9e35-1b0f285a8007", "name": "network-vif-deleted", "tag": "4e2d7a66-1e22-4a5a-85b7-515827033be3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:53.495529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6b30fd72-55c5-498e-8edd-9794de770f45 req-f7f2e7a8-0a20-48ae-a069-5adf909394e7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:53.496425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6b30fd72-55c5-498e-8edd-9794de770f45 req-f7f2e7a8-0a20-48ae-a069-5adf909394e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:53.496563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6b30fd72-55c5-498e-8edd-9794de770f45 req-f7f2e7a8-0a20-48ae-a069-5adf909394e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:53.509740 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6b30fd72-55c5-498e-8edd-9794de770f45 req-f7f2e7a8-0a20-48ae-a069-5adf909394e7 service nova] Creating event network-vif-deleted:4e2d7a66-1e22-4a5a-85b7-515827033be3 for instance 4bf13a9e-6572-4d1c-9e35-1b0f285a8007 on n-h1-820368-37 Sep 01 04:55:53.515127 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6b30fd72-55c5-498e-8edd-9794de770f45 req-f7f2e7a8-0a20-48ae-a069-5adf909394e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Sep 01 04:55:53.515730 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1027/2025] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:53.522193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:53.523173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:53.536212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:53.537155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:53.538806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:53.540374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:53.541441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:53.544692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.108870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:54.134442 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8081eab8-1f85-4cb6-b159-dbe46d7a5293 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.871810 Sep 01 04:55:54.135561 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 999/2026] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:55:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:54.142319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-16f5cb7d-c3f7-4e23-94da-9be8a6c70304 req-2dd96eef-d037-4511-a0cc-e0db6d2d5997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ec29e-34ea-4c49-935d-463a602a9d4c", "name": "network-vif-deleted", "tag": "f128c0f7-bee5-485e-b4ea-28db4e0b1de9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:54.144010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47be7404-7e56-46e4-ba9b-fa23a74e57d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1471 microversion: 2.1 time: 0.626027 Sep 01 04:55:54.160744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-16f5cb7d-c3f7-4e23-94da-9be8a6c70304 req-2dd96eef-d037-4511-a0cc-e0db6d2d5997 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.162405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-16f5cb7d-c3f7-4e23-94da-9be8a6c70304 req-2dd96eef-d037-4511-a0cc-e0db6d2d5997 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.163118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-16f5cb7d-c3f7-4e23-94da-9be8a6c70304 req-2dd96eef-d037-4511-a0cc-e0db6d2d5997 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.176469 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1028/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:53 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:54.179793 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-16f5cb7d-c3f7-4e23-94da-9be8a6c70304 req-2dd96eef-d037-4511-a0cc-e0db6d2d5997 service nova] Creating event network-vif-deleted:f128c0f7-bee5-485e-b4ea-28db4e0b1de9 for instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c on n-h2-820368-37 Sep 01 04:55:54.184557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4cd166b0-4e1a-4221-b306-535c08960dc5 req-6cd140d9-60e2-480f-bc03-9ba745439dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a225e1-f89f-4445-9d87-2fc1d0aedce3", "name": "network-vif-plugged", "status": "completed", "tag": "372b75ae-1ae8-4a2a-8b57-4da47c595b94"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:54.190302 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-16f5cb7d-c3f7-4e23-94da-9be8a6c70304 req-2dd96eef-d037-4511-a0cc-e0db6d2d5997 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052751 Sep 01 04:55:54.197273 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1000/2028] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:54.203285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:54.204718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] [instance: 0c6ec29e-34ea-4c49-935d-463a602a9d4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:54.209625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:54.213257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.214149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.214730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cd166b0-4e1a-4221-b306-535c08960dc5 req-6cd140d9-60e2-480f-bc03-9ba745439dbc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.215136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.215553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cd166b0-4e1a-4221-b306-535c08960dc5 req-6cd140d9-60e2-480f-bc03-9ba745439dbc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.216296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cd166b0-4e1a-4221-b306-535c08960dc5 req-6cd140d9-60e2-480f-bc03-9ba745439dbc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.217767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.218952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.219502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.240163 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4cd166b0-4e1a-4221-b306-535c08960dc5 req-6cd140d9-60e2-480f-bc03-9ba745439dbc service nova] Creating event network-vif-plugged:372b75ae-1ae8-4a2a-8b57-4da47c595b94 for instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 on n-h2-820368-37 Sep 01 04:55:54.246459 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] HTTP exception thrown: Instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c could not be found. Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Request method failure captured: Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c HTTP/1.1 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDqOVh3wfqF3LZRyzAI7ikJKlAKgXv9-fPvUvv1ugzjfXXHHS77Zys3e8WPt3xnaqylLdSTgCoBQCaLdRx68HgryZJA3QeoexmfA133rHHwcMRnHml5o7YRLFG9c-TiI4S5tonnHtLsMWW4eJSMleKHYCFde6NsK3xHltZAouk4ghTA Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f54577a158c74f57819ef92429fbda99 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f54577a158c74f57819ef92429fbda99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f54577a158c74f57819ef92429fbda99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f54577a158c74f57819ef92429fbda99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f54577a158c74f57819ef92429fbda99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f54577a158c74f57819ef92429fbda99 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminTestJSON-1154636962 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersAdminTestJSON-1154636962-project Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9db030290d94441abeba1f5c11690005 Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminTestJSON-1154636962-project Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c could not be found. Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '0c6ec29e-34ea-4c49-935d-463a602a9d4c'} Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c could not be found. Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c could not be found. Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:54.249652 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c could not be found. Sep 01 04:55:54.256628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:54.258466 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4cd166b0-4e1a-4221-b306-535c08960dc5 req-6cd140d9-60e2-480f-bc03-9ba745439dbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071783 Sep 01 04:55:54.258466 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1029/2029] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:54.260187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] Returning 404 to user: Instance 0c6ec29e-34ea-4c49-935d-463a602a9d4c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:54.261601 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89d33df7-0dfc-43be-83cd-f196ae4589c1 tempest-ServersAdminTestJSON-1154636962 tempest-ServersAdminTestJSON-1154636962-project] 10.222.0.26 "GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c" status: 404 len: 111 microversion: 2.1 time: 0.062472 Sep 01 04:55:54.265513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:54.266252 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1001/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:54 2022] GET /compute/v2.1/servers/0c6ec29e-34ea-4c49-935d-463a602a9d4c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:55:54.268539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:54.272685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:54.273399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:54.288218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.290703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.293685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.294340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.294646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.294811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.295644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.295914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.296619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.298814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:54.299539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:54.303812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:54.583486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:54.595599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:54.597617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a00d9024b5f7435f9d8f3eb26458ebd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a47f818ce66f46ae8a6907c698a7e5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:54.598199 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34ce1774-3878-496d-999c-2671baaa54d2 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 200 len: 1515 microversion: 2.21 time: 0.330903 Sep 01 04:55:54.614799 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1002/2031] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:54 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 1515 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:54.619920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51b99e9e-5bff-417b-9621-fa409e3d0d47 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bf23280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:55.361653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:55.373442 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7563c88f-9edf-48b2-a1ca-01eca07f67b0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 1.114793 Sep 01 04:55:55.373988 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1030/2032] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:54 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:55.381213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:55.382008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:55.390746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:55.391853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:55.392479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:55.393965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:55.394748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:55.395360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:55.881862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:55.888964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:55.892986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:55.894516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:55.895681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85d339b0-dc0c-41db-9070-497ca9bbcb83 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.520619 Sep 01 04:55:55.896730 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1031/2033] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:55 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:55.909837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51b99e9e-5bff-417b-9621-fa409e3d0d47 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.293845 Sep 01 04:55:55.910863 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1003/2034] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:55:54 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:55.921273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:55.922144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:55.929156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:55.929894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:55.931304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:55.932242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:55.932936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:55.933713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.088272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:56.097062 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d50197c8-3847-4ddc-a691-172e42c7796a tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1396 microversion: 2.1 time: 0.199129 Sep 01 04:55:56.098121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1032/2035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:55 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1396 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:56.103326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:56.104345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:56.110774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.111658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.112255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.113159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.113607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.114021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.257183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6e3d82a-7be3-4b76-a799-abbbcafe3253 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Action: 'create', calling method: .version_select at 0x7fa760088790>, body: {"keypair": {"name": "tempest-keypair-706757872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3FUzm3ugj8UZkrBY/XJYQwUB26CIzVq3QNQpLvlDcrAoNI/2zLOOtRQEFx3aKMxYCK0k7tWqnkuyT4QVqb1JysixSdH/Pe2gEkTX0iT/rp+EMAXLPMWLFCdt897UiY7g=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:56.279852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:55:56.287770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c6e3d82a-7be3-4b76-a799-abbbcafe3253 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:56.295515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-c6e3d82a-7be3-4b76-a799-abbbcafe3253 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for user c113681a71a44a9ab49d8e2d6ffd76a5 and project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:56.329264 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6e3d82a-7be3-4b76-a799-abbbcafe3253 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.416678 Sep 01 04:55:56.330261 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1004/2036] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:55:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:56.335539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "fb9959fe-6d22-4449-b3ec-6dbc63f6f116"}, {"server_uuid": "addb6642-bb7b-4f86-b31f-3c83b106e37d", "name": "network-vif-deleted", "tag": "24b8ec48-f98d-477f-ac8a-f510a9d49283"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:56.354493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.355346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.355952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.370106 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] Creating event network-changed:fb9959fe-6d22-4449-b3ec-6dbc63f6f116 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:55:56.371158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] Creating event network-vif-deleted:24b8ec48-f98d-477f-ac8a-f510a9d49283 for instance addb6642-bb7b-4f86-b31f-3c83b106e37d on n-h2-820368-37 Sep 01 04:55:56.377812 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-95e1affa-f5ac-4fe2-ad54-4a10368c3284 req-7989d108-7ed0-4d09-85e4-8bb4e42efe06 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045996 Sep 01 04:55:56.378579 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1005/2037] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:56.384374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:56.385116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:56.391939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.392359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.392797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.393515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.393960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.394389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.411190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] HTTP exception thrown: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Request method failure captured: Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d HTTP/1.1 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDskhqOIlwBCGShAvC8arZIjwd77LQzQaxetXYVZ2-Jm_nDqUDbicxQOTQqLXaELaVKdoSqJrSf-bDCtLE4fveWPDTdP_HkNNaK0xAsk3qNcxZKtWop3DZJzYqTc27Eb4sPsES3iWAYDj8DSsDG0SP6EfTyXfPJW4EJYZsRfDfYI0-Y Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.21 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a47f818ce66f46ae8a6907c698a7e5cd Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a47f818ce66f46ae8a6907c698a7e5cd Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceActionsV221TestJSON-678508583-project Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a00d9024b5f7435f9d8f3eb26458ebd2 Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceActionsV221TestJSON-678508583-project Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'addb6642-bb7b-4f86-b31f-3c83b106e37d'} Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:56.413042 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:56.417176 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:56.418398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Returning 404 to user: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:56.419307 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c017a2b9-3883-4309-a4e1-132017f96361 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 404 len: 111 microversion: 2.21 time: 0.039336 Sep 01 04:55:56.419890 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1006/2038] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:56 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:55:56.425393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5f06754-d347-4598-8895-79688f08c1ac tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75beb1a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:56.574819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:56.583159 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-daf00f7f-4f72-44c1-8361-f3d58ca16e64 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.484042 Sep 01 04:55:56.594652 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1033/2039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:56 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:56.594652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38c5f78f-d564-49b5-8c1e-7cef9983025c tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75be91f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:56.601876 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38c5f78f-d564-49b5-8c1e-7cef9983025c tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-706757872" status: 200 len: 497 microversion: 2.1 time: 0.016706 Sep 01 04:55:56.602678 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1034/2040] 10.222.0.26 () {58 vars in 1215 bytes} [Thu Sep 1 04:55:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-706757872 => generated 497 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:56.615893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:56.616680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:56.629353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.630154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.630950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:56.631919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:56.632767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:56.633495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.098382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:57.108150 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa9c7f6c-89a2-466f-9b8b-23800210e517 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.498678 Sep 01 04:55:57.109364 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1035/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:56 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:57.115315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '.version_select at 0x7fa75bc21e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:57.115997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:57.123509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.124085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.124730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.125661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.126312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.126975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.162424 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5f06754-d347-4598-8895-79688f08c1ac tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0" status: 202 len: 0 microversion: 2.1 time: 0.741146 Sep 01 04:55:57.163114 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1007/2042] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:55:56 2022] DELETE /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:57.168799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fb1e1f5-240f-4634-a0f0-ddfd9ee19a81 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75bec2310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:57.210433 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fb1e1f5-240f-4634-a0f0-ddfd9ee19a81 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706757872" status: 202 len: 0 microversion: 2.1 time: 0.045956 Sep 01 04:55:57.211889 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1008/2043] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 04:55:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706757872 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:57.222415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:57.223174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:57.235906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.237325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.237916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.238908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.239503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.240087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.284252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb17473f-4b3a-46be-b86c-b4b756d25890 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.172555 Sep 01 04:55:57.285065 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1036/2044] 10.222.0.26 () {60 vars in 1337 bytes} [Thu Sep 1 04:55:57 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d/os-instance-actions => generated 611 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:55:57.294689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:57.295593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:57.314462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.315069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.315567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.319407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.320124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.320947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.878910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:57.888981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:57.890390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:57.891592 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90208eda-bd05-478b-be09-9f76f5675431 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.678374 Sep 01 04:55:57.892411 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1009/2045] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:57 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:55:57.892766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:57.901683 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a1fb2f1-e4aa-45cd-9775-1b06cf30643e tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1576 microversion: 2.1 time: 0.611711 Sep 01 04:55:57.902384 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1037/2046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:57 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1576 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:57.908256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bff38c75-a774-4584-a72c-ba480023fe7e tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Action: 'create', calling method: .version_select at 0x7fa75bdd73a0>, body: {"keypair": {"name": "tempest-keypair-251180768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrMVTo3UlUsJbi6VG1no5Cgaafli8wK57bD2ngniIHZanFCvvJIMawjnCtDOD8x8I45N62xg1WJjsIpNGmFM8IVi7+lQJo2lsEidD9EcYhmSKVvOSTqR6GFRJ2g6ATTlw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:57.912531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75beecd30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:57.928697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bff38c75-a774-4584-a72c-ba480023fe7e tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:57.935272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bff38c75-a774-4584-a72c-ba480023fe7e tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for user c113681a71a44a9ab49d8e2d6ffd76a5 and project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:57.963924 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bff38c75-a774-4584-a72c-ba480023fe7e tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060218 Sep 01 04:55:57.964522 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1038/2047] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:55:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:57.969396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:57.969914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:57.976196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.976775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.977171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.977924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:57.978376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:57.978797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:57.993487 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] HTTP exception thrown: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Request method failure captured: Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d HTTP/1.1 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDskhqOIlwBCGShAvC8arZIjwd77LQzQaxetXYVZ2-Jm_nDqUDbicxQOTQqLXaELaVKdoSqJrSf-bDCtLE4fveWPDTdP_HkNNaK0xAsk3qNcxZKtWop3DZJzYqTc27Eb4sPsES3iWAYDj8DSsDG0SP6EfTyXfPJW4EJYZsRfDfYI0-Y Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.21 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a47f818ce66f46ae8a6907c698a7e5cd Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a47f818ce66f46ae8a6907c698a7e5cd Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-InstanceActionsV221TestJSON-678508583-project Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a00d9024b5f7435f9d8f3eb26458ebd2 Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceActionsV221TestJSON-678508583-project Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'addb6642-bb7b-4f86-b31f-3c83b106e37d'} Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:57.995290 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Returning 404 to user: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cea9b24-86bb-4fca-83ea-2591cca571c1 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "DELETE /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 404 len: 111 microversion: 2.21 time: 0.031168 Sep 01 04:55:57.998755 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1039/2048] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 04:55:57 2022] DELETE /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:55:58.005684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:58.005684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:58.018701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:58.018701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:58.018701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:58.018701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:58.018701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:58.018701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:58.034255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:55:58.035252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:55:58.035829 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.035829 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 HTTP/1.1 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'c2c8a0ce-83b1-4421-8851-d1adfdcc43e0'} Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:55:58.038057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] Sep 01 04:55:58.042452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:55:58.046335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:55:58.046335 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-5abe6235-2849-4842-b700-7f96528a7e8c'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:58.047537 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6bad5c1c-8650-4983-a4fe-21736932f30b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0" status: 404 len: 194 microversion: 2.1 time: 0.139613 Sep 01 04:55:58.048444 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1010/2049] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:55:57 2022] GET /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:55:58.183078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-220060049", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:58.238184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:55:58.731512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:58.739466 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-700fb697-898d-45b4-a239-0481d0596f1d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.740818 Sep 01 04:55:58.740063 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1040/2050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:57 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:58.745361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:58.746051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:58.756019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:58.756515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:58.756951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:58.757657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:58.758242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:58.758812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:58.974022 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b089d33c-4a65-41ef-836d-3c0c67682d1d tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232552 Sep 01 04:55:58.974789 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1041/2051] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:55:58 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:55:58.987218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5577b27-55ad-464e-b7c0-7e218fdb2e2e tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75bd18280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:59.014472 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5577b27-55ad-464e-b7c0-7e218fdb2e2e tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251180768" status: 202 len: 0 microversion: 2.1 time: 0.031040 Sep 01 04:55:59.020414 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1042/2052] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 04:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251180768 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:55:59.026746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:59.027353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] [instance: addb6642-bb7b-4f86-b31f-3c83b106e37d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:59.034559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.035085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.035515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:59.036356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.036856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.037276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:59.052013 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] HTTP exception thrown: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Request method failure captured: Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d HTTP/1.1 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDskhqOIlwBCGShAvC8arZIjwd77LQzQaxetXYVZ2-Jm_nDqUDbicxQOTQqLXaELaVKdoSqJrSf-bDCtLE4fveWPDTdP_HkNNaK0xAsk3qNcxZKtWop3DZJzYqTc27Eb4sPsES3iWAYDj8DSsDG0SP6EfTyXfPJW4EJYZsRfDfYI0-Y Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.21 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a47f818ce66f46ae8a6907c698a7e5cd Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a47f818ce66f46ae8a6907c698a7e5cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a47f818ce66f46ae8a6907c698a7e5cd Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-678508583 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-InstanceActionsV221TestJSON-678508583-project Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a00d9024b5f7435f9d8f3eb26458ebd2 Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceActionsV221TestJSON-678508583-project Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'addb6642-bb7b-4f86-b31f-3c83b106e37d'} Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:59.053674 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] Returning 404 to user: Instance addb6642-bb7b-4f86-b31f-3c83b106e37d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:55:59.058200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6270308c-afe5-4f75-b8bb-6957082f4846 tempest-InstanceActionsV221TestJSON-678508583 tempest-InstanceActionsV221TestJSON-678508583-project] 10.222.0.26 "GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d" status: 404 len: 111 microversion: 2.21 time: 0.033393 Sep 01 04:55:59.059396 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1043/2053] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:55:59 2022] GET /compute/v2.1/servers/addb6642-bb7b-4f86-b31f-3c83b106e37d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:55:59.064853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17286276-4d43-4dbd-98d5-88a29be3b220 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bf3fca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:59.198870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:55:59.199426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:55:59.200041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:55:59.200751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:55:59.201182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:55:59.212430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.212920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.213356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:59.214095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.215202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.222690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:59.253461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Getting quotas for project 24e7cb0f97274583a7089105f884024f. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:55:59.261505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Getting quotas for user ee99b34c78f648d09c60cbce4820ef54 and project 24e7cb0f97274583a7089105f884024f. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:55:59.283327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:55:59.286144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:55:59.340214 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f32a805c-0c29-471f-990f-c560f66e4328 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.290414 Sep 01 04:55:59.341187 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1011/2054] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:55:59.346228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:55:59.347474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:55:59.354970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.355852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.356492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:59.357486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.358143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.359125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:55:59.937594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:55:59.950666 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce1204b4-ef21-4a8a-ace1-2b4531ebec27 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.608092 Sep 01 04:55:59.951789 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1012/2055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:55:59 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:55:59.960400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ca58bfc4-dcd9-4ff6-bcdc-2269ac9c3259 req-4833b8d0-e7f6-42da-9c1a-45f4e20c2fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "544e2bf0-4b9c-43c6-8255-e002a4396e1f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:55:59.975057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca58bfc4-dcd9-4ff6-bcdc-2269ac9c3259 req-4833b8d0-e7f6-42da-9c1a-45f4e20c2fbf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:55:59.976551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca58bfc4-dcd9-4ff6-bcdc-2269ac9c3259 req-4833b8d0-e7f6-42da-9c1a-45f4e20c2fbf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:55:59.977225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca58bfc4-dcd9-4ff6-bcdc-2269ac9c3259 req-4833b8d0-e7f6-42da-9c1a-45f4e20c2fbf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.000291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ca58bfc4-dcd9-4ff6-bcdc-2269ac9c3259 req-4833b8d0-e7f6-42da-9c1a-45f4e20c2fbf service nova] Creating event network-changed:544e2bf0-4b9c-43c6-8255-e002a4396e1f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:00.008288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ca58bfc4-dcd9-4ff6-bcdc-2269ac9c3259 req-4833b8d0-e7f6-42da-9c1a-45f4e20c2fbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054673 Sep 01 04:56:00.009586 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1013/2056] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:00.015185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:00.016139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:00.023439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.025043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.025775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.026681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.027377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.027983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.038513 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17286276-4d43-4dbd-98d5-88a29be3b220 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf" status: 202 len: 0 microversion: 2.1 time: 0.977264 Sep 01 04:56:00.039275 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1044/2057] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:55:59 2022] DELETE /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:00.046574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ad40e63-7202-4704-91eb-d964a25be7a8 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Action: 'create', calling method: .version_select at 0x7fa75bc21af0>, body: {"keypair": {"name": "tempest-keypair-1683083534", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:00.080448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7ad40e63-7202-4704-91eb-d964a25be7a8 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:00.088910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7ad40e63-7202-4704-91eb-d964a25be7a8 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for user c113681a71a44a9ab49d8e2d6ffd76a5 and project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:00.126945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ad40e63-7202-4704-91eb-d964a25be7a8 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.086554 Sep 01 04:56:00.127546 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1045/2058] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:56:00 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:00.140604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:00.141303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:00.148212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.148835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.149285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.150001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.150621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.151236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.343097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:00.351242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c5aef2f-2cc6-41bd-8e70-d41129eb333d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1217 microversion: 2.1 time: 0.222632 Sep 01 04:56:00.365487 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1046/2059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:00 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:00.370871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:00.371702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:00.382685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.383948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.384399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.385262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.385726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.386183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.589706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:00.599965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:00.601392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:00.602789 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93c8ab05-5332-4ad6-b4c5-55516eb7d480 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.591700 Sep 01 04:56:00.603433 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1014/2060] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:00 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:00.608858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75b9b49d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:00.739423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:56:00.741231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 9bad736e-a571-433d-8c39-08eac2f306bf not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:56:00.743055 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.743055 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf HTTP/1.1 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9bad736e-a571-433d-8c39-08eac2f306bf'} Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:56:00.746264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] Sep 01 04:56:00.749751 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:00.754369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:56:00.754369 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-af6f1c14-cfc8-4f75-8d83-a687164608e6'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:00.759704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71bc3db8-6ff2-4484-b69d-946b90aea4d0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf" status: 404 len: 194 microversion: 2.1 time: 0.155058 Sep 01 04:56:00.763308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1015/2061] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:56:00 2022] GET /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:56:00.768344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:00.776380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:00.787769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.788395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.789475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.790277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.790935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.791534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.796289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:00.816745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:00.826085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a264ea2-aefc-4eab-bba0-642734d4c697 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.459380 Sep 01 04:56:00.840626 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1047/2062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:00 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:00.847003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-932817ea-51cf-42fd-896a-f430035144a6 req-8080a077-d869-402b-82d2-2341395b9db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a225e1-f89f-4445-9d87-2fc1d0aedce3", "tag": "372b75ae-1ae8-4a2a-8b57-4da47c595b94"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:00.858623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-932817ea-51cf-42fd-896a-f430035144a6 req-8080a077-d869-402b-82d2-2341395b9db5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:00.859421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-932817ea-51cf-42fd-896a-f430035144a6 req-8080a077-d869-402b-82d2-2341395b9db5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:00.860125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-932817ea-51cf-42fd-896a-f430035144a6 req-8080a077-d869-402b-82d2-2341395b9db5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:00.874673 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-932817ea-51cf-42fd-896a-f430035144a6 req-8080a077-d869-402b-82d2-2341395b9db5 service nova] Creating event network-changed:372b75ae-1ae8-4a2a-8b57-4da47c595b94 for instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 on n-h2-820368-37 Sep 01 04:56:00.879704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-932817ea-51cf-42fd-896a-f430035144a6 req-8080a077-d869-402b-82d2-2341395b9db5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037583 Sep 01 04:56:00.884412 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1048/2063] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:00.891724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbc1b29a-eea7-45e6-85d7-fbe692dcf366 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75bdd7670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:00.915989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbc1b29a-eea7-45e6-85d7-fbe692dcf366 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683083534" status: 202 len: 0 microversion: 2.1 time: 0.028728 Sep 01 04:56:00.916832 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1049/2064] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683083534 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:00.928348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb1cc0fb-d32f-45ca-86ae-2df8e1e41a79 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75be07940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:01.866324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:01.875100 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8449e989-283d-467c-9bf1-4fa56f8acba5 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1576 microversion: 2.1 time: 1.110339 Sep 01 04:56:01.875672 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1016/2065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:00 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1576 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:01.880510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20186414-5755-479b-b97d-7d2d559529cd tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Action: 'create', calling method: .version_select at 0x7fa75bdf7550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2108456232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEek/aJ43MdTC53bmn4dYZuZp+6sNlIHnJq41P0D2Y/pPDHv3PEn04FG5w8asZl1Ez60FXA/Ensz9e1NxrExGhBWFud6vE9Vfb1oCk2DWR8Mh9doyCOGl+HyLc1oJtqSwg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:01.898404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-20186414-5755-479b-b97d-7d2d559529cd tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:01.906688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-20186414-5755-479b-b97d-7d2d559529cd tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for user c113681a71a44a9ab49d8e2d6ffd76a5 and project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:01.934758 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20186414-5755-479b-b97d-7d2d559529cd tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.057863 Sep 01 04:56:01.935425 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1017/2066] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:56:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:01.940144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:01.940741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:01.947356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:01.947860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:01.948283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:01.948981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:01.949419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:01.949829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:02.558389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:02.571216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2be0126-a72a-48fa-be8a-2c013fe27cc2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.630626 Sep 01 04:56:02.571216 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1018/2067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:01 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:02.583655 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb1cc0fb-d32f-45ca-86ae-2df8e1e41a79 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a" status: 202 len: 0 microversion: 2.1 time: 1.665331 Sep 01 04:56:02.586421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:02.587422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:02.590078 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1050/2068] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:56:00 2022] DELETE /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a => generated 0 bytes in 1673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:02.594132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:02.594640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:02.595072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:02.595801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:02.596241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:02.596667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:02.598036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:02.599068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:02.608417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:02.609021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:02.609686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:02.610752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:02.611257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:02.611665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:02.799357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:02.808160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ea6b073-63a8-48da-a515-b1d1e209aedb tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1279 microversion: 2.1 time: 0.226111 Sep 01 04:56:02.808933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1019/2069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:02 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1279 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:02.825682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:02.826330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:02.833339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:02.833827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:02.834257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:02.835020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:02.835481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:02.835980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:03.275291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:03.287275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:03.288706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:03.290322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2433c577-81a3-437d-9010-9dfc1580ba63 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.698438 Sep 01 04:56:03.303113 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1051/2070] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:02 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:03.303113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c3ec6c2-249d-4c19-b4c2-b5450f3ff8c2 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Action: 'create', calling method: .version_select at 0x7fa75bec54c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-62313120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB45qEzmW996LSCz/z/tvfgEc9X2DW+ZxTsiwmFZ8YSnxlfFyUTJbquBtIGl0kNEu48+0nFS/7donQTpi5Z4TKsRO4IEGidZvhZ59mCDgjVbmviP53J2xBHlDYVAqu77DQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:03.318002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6c3ec6c2-249d-4c19-b4c2-b5450f3ff8c2 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:03.325521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6c3ec6c2-249d-4c19-b4c2-b5450f3ff8c2 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for user c113681a71a44a9ab49d8e2d6ffd76a5 and project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:03.364191 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c3ec6c2-249d-4c19-b4c2-b5450f3ff8c2 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.071937 Sep 01 04:56:03.373464 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1052/2071] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:56:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:03.375351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "739c6b63-c324-4919-91d7-6b309360928d"}, {"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:03.393670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:03.394144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:03.394568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:03.407483 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] Creating event network-changed:739c6b63-c324-4919-91d7-6b309360928d for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:03.408058 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] Creating event network-changed:fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:03.413818 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e5286af9-d1be-43a9-9f53-93b443621b1e req-237af074-f9a0-4524-8c8d-59d9bacdb639 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047235 Sep 01 04:56:03.415282 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1053/2072] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:03.420522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bf39ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:03.437261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:03.446081 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d996210b-7beb-4ce4-93b3-5ff44964fd9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.634912 Sep 01 04:56:03.446689 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1020/2073] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:02 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:03.451724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2dd16d8-510d-42f4-b2f7-ea550aa7e8b9 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Action: 'create', calling method: .version_select at 0x7fa75ba0c700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-104028728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3ASh9269h0Bmp2HLAqldSfB5W3G+eXSNl0nHttWrTbdGk4zOP2l+OkgaIflguEOHszX6m8p6IMXbuxxYTvyIPPqzwpBPDeu3gdewTtwB9L5ZcqPWpqbgoK4G23fufEjA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:03.481686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e2dd16d8-510d-42f4-b2f7-ea550aa7e8b9 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:03.487778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e2dd16d8-510d-42f4-b2f7-ea550aa7e8b9 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Getting quotas for user c113681a71a44a9ab49d8e2d6ffd76a5 and project 3f0d6c8a933d41588e9d7680644b848c. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:03.520287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2dd16d8-510d-42f4-b2f7-ea550aa7e8b9 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.072439 Sep 01 04:56:03.521230 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1021/2074] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:56:03 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:03.531564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fd5bc72-b985-4576-9d88-154f473a7395 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75b7bb940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:03.537152 n-d-820368-37 devstack@n-api.service[128862]: WARNING oslo_db.sqlalchemy.utils [None req-6fd5bc72-b985-4576-9d88-154f473a7395 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 01 04:56:03.545607 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fd5bc72-b985-4576-9d88-154f473a7395 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.018061 Sep 01 04:56:03.546299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1022/2075] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:56:03 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:03.557382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-226de062-6f63-4155-a7dc-ce1d11addb52 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75b7bea60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:03.582443 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-226de062-6f63-4155-a7dc-ce1d11addb52 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-104028728" status: 202 len: 0 microversion: 2.1 time: 0.028969 Sep 01 04:56:03.583455 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1023/2076] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-104028728 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:03.589307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:03.590108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:03.596584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:03.597076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:03.597509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:03.598218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:03.598671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:03.599126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:03.961491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:56:03.962317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:56:03.962993 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.962993 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a HTTP/1.1 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '1c6ef844-1ab1-477b-9d00-dbd050a72c1a'} Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:56:03.965102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6d55122e-3508-424e-955e-9989ab74d82c'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7b96d6d-31c1-4f5d-b79a-bf0fcae62d59 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a" status: 404 len: 194 microversion: 2.1 time: 0.550266 Sep 01 04:56:03.972028 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1054/2077] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:56:03 2022] GET /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a => generated 194 bytes in 552 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:56:03.975977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7b7335d-683d-42fb-8e35-3c97cb3aa423 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75bf3fca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:04.008607 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7b7335d-683d-42fb-8e35-3c97cb3aa423 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-62313120" status: 202 len: 0 microversion: 2.1 time: 0.039149 Sep 01 04:56:04.009216 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1055/2078] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-62313120 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:04.014585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:04.015499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:04.022566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:04.023086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:04.023641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:04.024357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:04.024818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:04.025250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:04.185397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:04.193832 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe8dd32b-edaf-407f-9e82-10d857691784 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1279 microversion: 2.1 time: 0.183174 Sep 01 04:56:04.194463 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1056/2079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:04 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:04.199827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c807a33-7e4e-4b0c-a16c-aee357383d35 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bf3f1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:04.409088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:04.417768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-920d2d5d-272f-4fa2-bcf4-563cefb0dc95 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.832783 Sep 01 04:56:04.431076 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1024/2080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:03 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:04.437450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f36fc7b2-4424-4925-af1f-cd86d1c4f7e2 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] Calling method '.version_select at 0x7fa75b7bbaf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:04.462842 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f36fc7b2-4424-4925-af1f-cd86d1c4f7e2 tempest-KeyPairsV2TestJSON-1868032975 tempest-KeyPairsV2TestJSON-1868032975-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2108456232" status: 202 len: 0 microversion: 2.1 time: 0.030074 Sep 01 04:56:04.463579 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1025/2081] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Sep 1 04:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2108456232 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:04.468516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:04.473333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:04.480318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:04.480809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:04.481247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:04.481960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:04.482414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:04.482836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:05.060591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:05.067414 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c807a33-7e4e-4b0c-a16c-aee357383d35 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.871617 Sep 01 04:56:05.078258 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1057/2082] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 04:56:04 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:05.084086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:05.085520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:05.087535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:05.090471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:05.092698 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fda25765-a31e-4190-9c97-e4d5ea5b1dfb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.627637 Sep 01 04:56:05.093651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:05.093766 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1026/2083] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:04 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:05.094521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:05.095375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:05.096441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:05.097238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:05.097784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:05.115864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d23ca94-da1d-4493-b07b-2a268420b27b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75bd78280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-336711521", "description": "tempest-description-1333354258"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:05.628308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:05.644450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd5c4e82-3784-4abe-b51a-adb3b4388961 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.564507 Sep 01 04:56:05.645051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1058/2084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:05 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:05.664842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:05.665711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:05.671872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:05.672421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:05.672852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:05.673722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:05.674175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:05.674596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.242132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d23ca94-da1d-4493-b07b-2a268420b27b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.147092 Sep 01 04:56:06.243369 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1027/2085] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:56:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:06.248395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:06.249240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:06.272137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.275582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.276326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.277273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.279567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.280166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.445996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:06.456209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3424f67-04bb-43eb-a550-1ac02b9496c2 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 0.794586 Sep 01 04:56:06.457525 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1059/2086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:05 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:06.463511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-31b2b536-f1b2-4402-afcb-42beadc3a49a req-fcffd67c-41f8-4014-ba61-e7d60404f9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535537b-a849-4fd7-89ea-09bd5159ab15", "name": "network-vif-plugged", "status": "completed", "tag": "e67cd756-582f-4d99-bef6-fa5bc89db4f3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:06.476846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-31b2b536-f1b2-4402-afcb-42beadc3a49a req-fcffd67c-41f8-4014-ba61-e7d60404f9e3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.477723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-31b2b536-f1b2-4402-afcb-42beadc3a49a req-fcffd67c-41f8-4014-ba61-e7d60404f9e3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.478342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-31b2b536-f1b2-4402-afcb-42beadc3a49a req-fcffd67c-41f8-4014-ba61-e7d60404f9e3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.493010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-31b2b536-f1b2-4402-afcb-42beadc3a49a req-fcffd67c-41f8-4014-ba61-e7d60404f9e3 service nova] Creating event network-vif-plugged:e67cd756-582f-4d99-bef6-fa5bc89db4f3 for instance 6535537b-a849-4fd7-89ea-09bd5159ab15 on n-h2-820368-37 Sep 01 04:56:06.499470 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-31b2b536-f1b2-4402-afcb-42beadc3a49a req-fcffd67c-41f8-4014-ba61-e7d60404f9e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040079 Sep 01 04:56:06.500365 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1060/2087] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:06.507059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:06.508199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:06.515486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.516444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.517288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.518358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.519176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.519946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.771721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:06.785948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f7cb23d-1daf-4a20-8365-4a4bb5ad2d44 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.541169 Sep 01 04:56:06.787933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1028/2088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:06 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:06.944756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Calling method '.version_select at 0x7fa75bd78a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:06.958416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.958933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.959578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.960930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:06.961644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:06.962721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:06.992501 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-064b857c-98a6-40b5-a23e-dcda34b4d22f tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.202946 Sep 01 04:56:06.993721 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1029/2089] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 1 04:56:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:07.011133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7930547-aca2-4527-b7b8-71c74f1ce4f6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa7605999d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1369955855", "description": "tempest-description-1985987713"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:07.066337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:07.091692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:07.093282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:07.094541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6150a94-98fe-4c88-8f9f-acb2e98bdd61 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.592802 Sep 01 04:56:07.095350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1061/2090] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:06 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:07.100403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:07.101229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:07.112910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:07.113746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:07.115061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:07.116339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:07.116997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:07.117911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:07.488518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:07.501988 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ffbbca20-8bba-4e7b-a3df-ef05fd1bf237 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.405380 Sep 01 04:56:07.503219 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1062/2091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:07 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:07.520172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1361107238", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:07.551923 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7930547-aca2-4527-b7b8-71c74f1ce4f6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.556770 Sep 01 04:56:07.554600 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1030/2092] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:56:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:07.561904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:07.564358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:07.593324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:07.594463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:07.595401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:07.596594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:07.597788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:07.598315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:07.605998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:56:07.955461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:07.965066 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4677cac0-4df4-46ec-babc-8c3fb9118c33 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 0.408890 Sep 01 04:56:07.970233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1031/2093] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:07 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:07.984013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1374225104", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d8ddcb08-4914-40cc-8c74-015f2b00c561"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:08.091843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] validate_networks() for [('d8ddcb08-4914-40cc-8c74-015f2b00c561', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:56:08.150005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Getting quotas for project fefd5b36e8bf48a0a1e423a10981d269. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:08.151703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:08.161961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Getting quotas for user 89e1b06767ea42989825dd88eebf9192 and project fefd5b36e8bf48a0a1e423a10981d269. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:08.188056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Request method failure captured: Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 1752 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtmLUzQEonv3shZOGIGq8EMcN4L8sQ6abjqu4QDHrV9ID0-tC6MBeVBkwbCLpFSTq_MfuPOLGG5cMthU4nic1OgQeKjOp77kevpXNQjPHvbJyhV2a_JDasTU71k1bYi0CR9dNC3lPRg3xb3ouR7Tu3c6dEY_bL-t5z45BqGmGiVG8Y Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: fefd5b36e8bf48a0a1e423a10981d269 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1926252236 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fefd5b36e8bf48a0a1e423a10981d269"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fefd5b36e8bf48a0a1e423a10981d269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fefd5b36e8bf48a0a1e423a10981d269"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fefd5b36e8bf48a0a1e423a10981d269"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1926252236 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: fefd5b36e8bf48a0a1e423a10981d269 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1926252236 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 89e1b06767ea42989825dd88eebf9192 Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1361107238", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:56:08.190174 n-d-820368-37 devstack@n-api.service[128863]: exception: Maximum number of metadata items exceeds 128 Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1361107238', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:08.192086 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1649fa92-219f-4a8c-8fad-6e0a97a97372 tempest-AbsoluteLimitsNegativeTestJSON-1926252236 tempest-AbsoluteLimitsNegativeTestJSON-1926252236-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.687550 Sep 01 04:56:08.201234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1063/2094] 10.222.0.26 () {60 vars in 1148 bytes} [Thu Sep 1 04:56:07 2022] POST /compute/v2.1/servers => generated 87 bytes in 689 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:56:08.210488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:08.212680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:08.224516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:08.225021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:08.225461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:08.226192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:08.231106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:08.231574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:08.282241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:08.708794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:08.729854 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cae24416-227a-4f89-8528-d061e0df337a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1198 microversion: 2.1 time: 0.535631 Sep 01 04:56:08.730767 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1064/2095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:08 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1198 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:08.736219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b8e4e486-51b2-4726-ad55-bada429f0a24 req-870c1b3c-93b4-4f31-8b70-0fc203b1c161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d", "tag": "54bda722-fcc6-492f-8227-bf1c8722de1f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:08.757013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b8e4e486-51b2-4726-ad55-bada429f0a24 req-870c1b3c-93b4-4f31-8b70-0fc203b1c161 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:08.757612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b8e4e486-51b2-4726-ad55-bada429f0a24 req-870c1b3c-93b4-4f31-8b70-0fc203b1c161 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:08.758123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b8e4e486-51b2-4726-ad55-bada429f0a24 req-870c1b3c-93b4-4f31-8b70-0fc203b1c161 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:08.790502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b8e4e486-51b2-4726-ad55-bada429f0a24 req-870c1b3c-93b4-4f31-8b70-0fc203b1c161 service nova] Creating event network-changed:54bda722-fcc6-492f-8227-bf1c8722de1f for instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d on n-h1-820368-37 Sep 01 04:56:08.806338 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b8e4e486-51b2-4726-ad55-bada429f0a24 req-870c1b3c-93b4-4f31-8b70-0fc203b1c161 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074326 Sep 01 04:56:08.810544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1065/2096] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:08.817302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:08.827524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:08.841129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:08.841971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:08.842655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:08.845108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:08.845824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:08.846587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:09.751359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:09.757315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:56:09.757913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:56:09.758371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:56:09.758776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:56:09.759221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:56:09.766534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:09.774299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:09.777400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:09.780324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88c9a15f-e7af-422e-8832-3016401fe434 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.969051 Sep 01 04:56:09.783496 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1066/2097] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:08 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:09.788140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:09.789262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:09.789262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:09.790009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:09.790445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:09.791049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:09.796839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:09.797391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:09.810979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:09.811367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:09.811822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:09.812604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:09.812970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:09.813388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:09.817901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Getting quotas for project d32b56cc9bcb454e82b04772b39d3021. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:09.824010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Getting quotas for user f5f03d38ed204f8fad7f83808e798c5a and project d32b56cc9bcb454e82b04772b39d3021. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:09.838635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:56:09.841441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:09.921977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-344015bb-9bdc-4e44-899e-7bf8e88b92a1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.949661 Sep 01 04:56:09.922641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1032/2098] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:56:09.939012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:09.954450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:09.973080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:09.974563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:09.976103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:09.977402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:09.978015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:09.978628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:10.243756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:10.254935 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d74c9b2-944b-437b-9fd7-90415df92299 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.468027 Sep 01 04:56:10.260141 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1067/2099] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:09 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:10.271411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:10.272200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:10.279220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:10.280426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:10.281033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:10.281751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:10.282213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:10.282671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:10.341158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:10.352537 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40840d0f-14d6-4508-bc6d-3de180de8e76 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 0.427365 Sep 01 04:56:10.354277 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1033/2100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:09 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:10.359573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c907da3-49f3-46fb-b24a-cfbd3c2ce528 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:10.360137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c907da3-49f3-46fb-b24a-cfbd3c2ce528 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:10.470246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c907da3-49f3-46fb-b24a-cfbd3c2ce528 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:10.477560 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c907da3-49f3-46fb-b24a-cfbd3c2ce528 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1216 microversion: 2.1 time: 0.122396 Sep 01 04:56:10.478950 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1034/2101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:10 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:10.616532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:10.627498 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42ea0365-2e03-4669-965b-093773f983d0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1381 microversion: 2.1 time: 0.365954 Sep 01 04:56:10.643764 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1068/2102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:10 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1381 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:10.831403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1aabd777-1658-49fe-85e8-f156492a52c1 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-902994662", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:10.834906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1aabd777-1658-49fe-85e8-f156492a52c1 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] HTTP exception thrown: min_count must be <= max_count Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1aabd777-1658-49fe-85e8-f156492a52c1 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Request method failure captured: Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 183 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtqgTxQjQCcVsTkb3FqhrOISu862lvfGGl0Q4PJGELhG3j_Z9BBsojDnAm5lCkPKNxyMQnLEgRqkRpnBBHl3Opdq6xD6sX6xvfpdEwwXyZA49mIvpjThLrlkxpAHFAHk8N3D8MuyBN8WgrYV9hTRgtTO7V_vXoTEXZVDtE4u5gSKFk Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d57af069c62644e8a3293300b5b3f816 Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-902994662", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: exception: min_count must be <= max_count Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-902994662', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 01 04:56:10.839211 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:10.844811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1aabd777-1658-49fe-85e8-f156492a52c1 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Returning 400 to user: min_count must be <= max_count {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:10.844811 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1aabd777-1658-49fe-85e8-f156492a52c1 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.209318 Sep 01 04:56:10.856453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1035/2103] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:10 2022] POST /compute/v2.1/servers => generated 74 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 04:56:10.877777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:10.879602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:10.891067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:10.892724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:10.893509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:10.896080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:10.898541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:10.901869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:10.996372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:10.996993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:11.023608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:11.024650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:11.027467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:11.028377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:11.028861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:11.030663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:11.468238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:11.481751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:11.483230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:11.484968 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d033c5c-713b-44aa-9a76-054851d8c439 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.627439 Sep 01 04:56:11.485795 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1036/2104] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:10 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:11.513162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fafce7f3-b3bd-46b3-8c11-d56a8160b88c tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-212723524", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "max_count": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fafce7f3-b3bd-46b3-8c11-d56a8160b88c tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Request method failure captured: Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 167 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtqgTxQjQCcVsTkb3FqhrOISu862lvfGGl0Q4PJGELhG3j_Z9BBsojDnAm5lCkPKNxyMQnLEgRqkRpnBBHl3Opdq6xD6sX6xvfpdEwwXyZA49mIvpjThLrlkxpAHFAHk8N3D8MuyBN8WgrYV9hTRgtTO7V_vXoTEXZVDtE4u5gSKFk Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d57af069c62644e8a3293300b5b3f816 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-212723524", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "max_count": 0}} Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-212723524', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'max_count': 0}}} Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 0 Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:56:11.517217 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fafce7f3-b3bd-46b3-8c11-d56a8160b88c tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:11.524763 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fafce7f3-b3bd-46b3-8c11-d56a8160b88c tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016766 Sep 01 04:56:11.528742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1037/2105] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:11.533614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:11.535302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:11.543789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:11.544332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:11.544772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:11.545584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:11.546043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:11.546469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:11.589324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c56eb8d6-575a-407d-8bc5-aa190e219e81 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1534 microversion: 2.1 time: 0.943448 Sep 01 04:56:11.590349 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1069/2106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:10 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1534 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:11.595375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:11.595975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:11.602499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:11.603257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:11.604129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:11.605365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:11.605830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:11.606253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.047363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:12.059068 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fff3753-49ff-4d1f-a97e-82c898b6a81e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.529053 Sep 01 04:56:12.061147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1038/2107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:11 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:12.066479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:12.067198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:12.073987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.074557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.075085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.076031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.076549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.077051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.112390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:12.126410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91038c5b-bbac-4a43-bb52-3fbd6f73b150 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 0.534517 Sep 01 04:56:12.127054 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1070/2108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:11 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:12.143822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9a1a5be-d03d-4c7b-8b95-e5093faf7af5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1186678843", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "max_count": 2.5}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9a1a5be-d03d-4c7b-8b95-e5093faf7af5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Request method failure captured: Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 170 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtqgTxQjQCcVsTkb3FqhrOISu862lvfGGl0Q4PJGELhG3j_Z9BBsojDnAm5lCkPKNxyMQnLEgRqkRpnBBHl3Opdq6xD6sX6xvfpdEwwXyZA49mIvpjThLrlkxpAHFAHk8N3D8MuyBN8WgrYV9hTRgtTO7V_vXoTEXZVDtE4u5gSKFk Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d57af069c62644e8a3293300b5b3f816 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1186678843", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "max_count": 2.5}} Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1186678843', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'max_count': 2.5}}} Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 2.5 Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:56:12.149752 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9a1a5be-d03d-4c7b-8b95-e5093faf7af5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9a1a5be-d03d-4c7b-8b95-e5093faf7af5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020192 Sep 01 04:56:12.153203 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1071/2109] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:12.157702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:12.158480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:12.168840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.169338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.169880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.170554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.171211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.171654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.234586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:12.251939 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a5d064f-9e6b-45c8-aac9-c96127c3f8a9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1274 microversion: 2.1 time: 0.188250 Sep 01 04:56:12.253001 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1039/2110] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:12 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:12.276515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f1cea00-a5b0-44cb-b63a-e3f4913e2836 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1193958307", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 0}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f1cea00-a5b0-44cb-b63a-e3f4913e2836 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Request method failure captured: Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 168 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtqgTxQjQCcVsTkb3FqhrOISu862lvfGGl0Q4PJGELhG3j_Z9BBsojDnAm5lCkPKNxyMQnLEgRqkRpnBBHl3Opdq6xD6sX6xvfpdEwwXyZA49mIvpjThLrlkxpAHFAHk8N3D8MuyBN8WgrYV9hTRgtTO7V_vXoTEXZVDtE4u5gSKFk Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d57af069c62644e8a3293300b5b3f816 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1193958307", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 0}} Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1193958307', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'min_count': 0}}} Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 0 Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:56:12.282861 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f1cea00-a5b0-44cb-b63a-e3f4913e2836 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f1cea00-a5b0-44cb-b63a-e3f4913e2836 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018821 Sep 01 04:56:12.286722 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1040/2111] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:12 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:12.344364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c960888-52bc-4b13-98e6-dde87328b5c5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1659224273", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 2.5}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c960888-52bc-4b13-98e6-dde87328b5c5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Request method failure captured: Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 170 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtqgTxQjQCcVsTkb3FqhrOISu862lvfGGl0Q4PJGELhG3j_Z9BBsojDnAm5lCkPKNxyMQnLEgRqkRpnBBHl3Opdq6xD6sX6xvfpdEwwXyZA49mIvpjThLrlkxpAHFAHk8N3D8MuyBN8WgrYV9hTRgtTO7V_vXoTEXZVDtE4u5gSKFk Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/71b71a90ed804d298bf791bc0e487ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 71b71a90ed804d298bf791bc0e487ab4 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-356689486 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d57af069c62644e8a3293300b5b3f816 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-356689486-project Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1659224273", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 2.5}} Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1659224273', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'min_count': 2.5}}} Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 2.5 Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:56:12.348838 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c960888-52bc-4b13-98e6-dde87328b5c5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:12.356076 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c960888-52bc-4b13-98e6-dde87328b5c5 tempest-MultipleCreateNegativeTestJSON-356689486 tempest-MultipleCreateNegativeTestJSON-356689486-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012247 Sep 01 04:56:12.362039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1041/2112] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:12.519874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:12.520581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:12.531144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.534773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.537233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.541473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.542013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.543227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.745675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-515b49bb-80b1-4518-8e89-5bdd1bfe311e tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1534 microversion: 2.1 time: 0.591636 Sep 01 04:56:12.763645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1072/2113] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:12 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1534 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:12.768992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:12.774220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.775079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.775748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.776905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.777507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.778121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.828849 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a588288-271e-4975-bcbd-457e883e4a7a tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.063788 Sep 01 04:56:12.834875 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1073/2114] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:56:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:12.845364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-820368-37", "block_migration": false, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:12.856121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:12.872627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.873253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.873724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.874677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:12.875938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:12.876564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:12.919007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lazy-loading 'flavor' on Instance uuid 6535537b-a849-4fd7-89ea-09bd5159ab15 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:56:12.942769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Going to try to live migrate instance to n-h1-820368-37 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:56:13.306720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:13.334165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:13.337057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:13.339469 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d7dcd48-f52f-4e80-9371-473d006c67d0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.823481 Sep 01 04:56:13.340708 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1042/2115] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:12 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:13.358110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:13.359014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:13.367558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:13.368699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:13.369726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:13.371687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:13.372587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:13.373181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:13.618360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:13.627248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49fc73b7-784a-4e00-84cd-f5e8de3df477 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.285093 Sep 01 04:56:13.633698 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1043/2116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:13 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:13.643132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:13.644250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:13.664675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:13.665575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:13.666158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:13.667197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:13.667907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:13.668392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:13.925664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:13.936601 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5774af2a-fbda-4e96-a19d-1f88d21d97c0 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 0.301304 Sep 01 04:56:13.937818 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1044/2117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:13 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:13.949904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:13.952104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:13.961468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:13.962232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:13.962928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:13.963935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:13.964458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:13.965115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:14.163617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:14.176708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7356cec7-3ee8-433b-aca3-f7cde75cac0d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 0.237433 Sep 01 04:56:14.192713 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1045/2118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:13 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:14.368511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:14.369141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:14.381961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:14.387674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:14.391594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:14.395257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:14.396112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:14.396854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:14.407650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:15.245800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:15.258565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:15.264376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:15.268890 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de7f4ee0-a664-48e5-aad5-e32b7141b260 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.905368 Sep 01 04:56:15.279690 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1046/2119] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:14 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:56:15.286612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:15.288105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:15.305257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:15.306105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:15.306749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:15.307685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:15.308312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:15.308910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:15.848313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:15.858925 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0c8a945-a3bc-4d23-8890-b1f9ba08491c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.577258 Sep 01 04:56:15.874277 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1047/2120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:15 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:15.880915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:15.881939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:15.889506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:15.890402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:15.891118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:15.892064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:15.892797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:15.893461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:16.007797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf04cc80-1762-46c0-b7f3-efe53d696e93 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15/action" status: 202 len: 0 microversion: 2.1 time: 3.166135 Sep 01 04:56:16.017709 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1074/2121] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:12 2022] POST /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15/action => generated 0 bytes in 3178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:56:16.044604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:16.045966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:16.071776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:16.073166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:16.073630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:16.074396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:16.074856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:16.075312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:16.573329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:16.620933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3c89f88-f875-4b4d-92bd-500216bfbe9c tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 0.726432 Sep 01 04:56:16.625443 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1048/2122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:15 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:16.662142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:16.662761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:16.667404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:16.677256 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9aeed6fc-1e40-41e6-94ed-f3048ec58759 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 0.657664 Sep 01 04:56:16.679098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1075/2123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:16 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:16.688746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:16.690428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:16.703360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:16.704767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:16.705507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:16.705998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:16.706427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:16.706740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:16.707169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:16.707615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:16.708027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:16.709138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:16.711695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:16.713212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:17.378841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:17.396306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:17.398169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:17.399901 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-561248a4-5d57-4c50-aba1-ec22ad63718e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.718874 Sep 01 04:56:17.401037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1076/2124] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:16 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:17.406677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f581996c-661c-43d5-9056-71bd522e7782 req-65b4452f-545f-4e09-8970-e2fa9cea2b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d", "name": "network-vif-plugged", "status": "completed", "tag": "54bda722-fcc6-492f-8227-bf1c8722de1f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:17.418848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f581996c-661c-43d5-9056-71bd522e7782 req-65b4452f-545f-4e09-8970-e2fa9cea2b38 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:17.420111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f581996c-661c-43d5-9056-71bd522e7782 req-65b4452f-545f-4e09-8970-e2fa9cea2b38 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:17.420740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f581996c-661c-43d5-9056-71bd522e7782 req-65b4452f-545f-4e09-8970-e2fa9cea2b38 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:17.438790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f581996c-661c-43d5-9056-71bd522e7782 req-65b4452f-545f-4e09-8970-e2fa9cea2b38 service nova] Creating event network-vif-plugged:54bda722-fcc6-492f-8227-bf1c8722de1f for instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d on n-h1-820368-37 Sep 01 04:56:17.444917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f581996c-661c-43d5-9056-71bd522e7782 req-65b4452f-545f-4e09-8970-e2fa9cea2b38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042315 Sep 01 04:56:17.446302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1077/2125] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:17.463594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:17.484099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:17.491614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50c688a0-104a-4bc2-88c2-3386f5baf2fa tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.862173 Sep 01 04:56:17.496825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:17.517354 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1049/2126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:16 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:17.531053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:17.532712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:17.536090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:17.538395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:17.539177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:17.541658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:17.626928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ccc49aa7-7ae1-46ac-9797-669a2212c303 req-7fb8e3da-39fa-4b8e-8d66-fbafb2a6fb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558a8f7d-f3d8-4536-a644-92259b3b5301", "tag": "bf66f97d-2570-41d3-b24f-d326d977be7c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:17.654448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ccc49aa7-7ae1-46ac-9797-669a2212c303 req-7fb8e3da-39fa-4b8e-8d66-fbafb2a6fb2a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:17.655019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ccc49aa7-7ae1-46ac-9797-669a2212c303 req-7fb8e3da-39fa-4b8e-8d66-fbafb2a6fb2a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:17.655475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ccc49aa7-7ae1-46ac-9797-669a2212c303 req-7fb8e3da-39fa-4b8e-8d66-fbafb2a6fb2a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:17.703685 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ccc49aa7-7ae1-46ac-9797-669a2212c303 req-7fb8e3da-39fa-4b8e-8d66-fbafb2a6fb2a service nova] Creating event network-changed:bf66f97d-2570-41d3-b24f-d326d977be7c for instance 558a8f7d-f3d8-4536-a644-92259b3b5301 on n-h2-820368-37 Sep 01 04:56:17.720175 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ccc49aa7-7ae1-46ac-9797-669a2212c303 req-7fb8e3da-39fa-4b8e-8d66-fbafb2a6fb2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097977 Sep 01 04:56:17.723612 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1050/2127] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:56:17.738482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:17.740442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:17.759404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:17.759904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:17.760348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:17.777354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:17.778513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:17.782956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:18.174914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:18.409883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:18.421330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e12325fc-a7a4-4214-8d5b-347f4c7ed42b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1476 microversion: 2.1 time: 0.973555 Sep 01 04:56:18.425728 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1078/2128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:17 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1476 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:18.439567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:18.440473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:18.460222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:18.460560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:18.461151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:18.462111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:18.462575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:18.463038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:19.393672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:19.421613 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccbb21dc-2d1c-4a82-a168-37e87e8fc6d8 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1321 microversion: 2.1 time: 1.696364 Sep 01 04:56:19.428692 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1051/2129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:17 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1321 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:19.436326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:19.437382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:19.451120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:19.452351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:19.453018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:19.453949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:19.455889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:19.456686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:19.808343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:19.824639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:19.839291 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-193eb4f9-acf9-4b32-bcd5-a4617676a40d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 1.411974 Sep 01 04:56:19.840869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1079/2130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:18 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:19.855705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:19.856322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:19.864618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:19.864618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:19.864618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:19.865137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:19.865905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:19.866532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:20.389309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:20.411223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:20.413078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:20.415074 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f2d650f-2c83-4e82-88ac-adbeb99f1747 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.984034 Sep 01 04:56:20.415697 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1052/2131] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:19 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:20.431792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:20.432477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:20.440208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:20.441300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:20.445643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:20.446842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:20.447602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:20.448879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:20.477950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=28 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:20.569548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:20.582926 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf0e10ef-71af-48e2-8183-e7c2b722a8c0 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.739006 Sep 01 04:56:20.583862 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1080/2132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:19 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:20.806092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1431317469", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "cefae6b8-d8f3-46c4-9243-a9e44ecdac4f"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:20.932731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] validate_networks() for [('cefae6b8-d8f3-46c4-9243-a9e44ecdac4f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:56:21.019328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:21.040145 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-467a32e4-750d-49c1-838a-9a3a7b60039f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1475 microversion: 2.1 time: 0.620921 Sep 01 04:56:21.045767 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1053/2133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:20 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1475 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:21.068651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:21.069623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:21.090169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:21.091183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:21.093142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:21.096078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:21.096831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:21.098259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:21.751078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:21.767881 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a6577f5-d65a-41d7-8872-a3251d1a8100 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1470 microversion: 2.1 time: 0.715975 Sep 01 04:56:21.769356 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1054/2134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:21 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1470 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:21.783986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095e123-35d4-450a-adc3-48b604173b6b", "name": "network-vif-unplugged", "status": "completed", "tag": "f036356c-d9db-46a2-b7a9-6ee990be7c92"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:21.813763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:21.814656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:21.815663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:21.846165 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] Creating event network-vif-unplugged:f036356c-d9db-46a2-b7a9-6ee990be7c92 for instance 3095e123-35d4-450a-adc3-48b604173b6b on n-h2-820368-37 Sep 01 04:56:21.870565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] Instance 3095e123-35d4-450a-adc3-48b604173b6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:56:21.902058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f5ef56cc-7bd4-410c-84fe-83d87a26e3c3 req-50e7d659-f04d-45e5-8ae0-4d541793e808 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130009 Sep 01 04:56:21.904935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1055/2135] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:21.923032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:21.923840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:21.940420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:21.942286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:21.944298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:21.946439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:21.948435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:21.949046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:22.448166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:22.461122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42595b42-b8ed-463f-83f1-eed8d1a085d5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 0.553730 Sep 01 04:56:22.481664 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1056/2136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:21 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:22.491901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:22.493660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:22.512562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:22.513535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:22.514214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:22.520668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:22.521352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:22.525485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:22.530057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:56:22.530962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:56:22.531679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:56:22.532433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:56:22.533053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:56:22.551560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:22.553769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:22.554565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:22.559054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:22.562247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:22.564432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:22.603546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Getting quotas for project ab7bd356b55b4fd996c4446c4abe520d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:22.616674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Getting quotas for user d31906a3e93045b38459f9ea31225e79 and project ab7bd356b55b4fd996c4446c4abe520d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:22.658523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Going to run 3 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:56:22.665155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:22.763026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=506f9a3f-69a9-4eac-9611-7b8e14a34990,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:22.864027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=d736779b-121f-4fda-93a1-4c27bb7e33eb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:23.199395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-684f39ff-d82d-4305-9f17-9e99b89608c7 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613615 Sep 01 04:56:23.207539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:23.211585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1081/2137] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:56:23.230747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:23.234451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:23.235625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:23.235828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:23.239794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a237c34-8bdc-4da3-b8a6-3dfe5918ad0d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.756534 Sep 01 04:56:23.255651 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1057/2138] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:22 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:23.262839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:23.263758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:23.270775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:23.282335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:23.313901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:23.321353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:23.431834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.729935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbbca72d-d044-4557-a0aa-4ab1e4ee16ce tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:23.731184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bbbca72d-d044-4557-a0aa-4ab1e4ee16ce tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] [instance: 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:23.744071 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bbbca72d-d044-4557-a0aa-4ab1e4ee16ce tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] HTTP exception thrown: Instance 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0 could not be found. Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbbca72d-d044-4557-a0aa-4ab1e4ee16ce tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Request method failure captured: Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/6ff0d7d9-1f2b-4188-9bc0-83c7648904e0/action HTTP/1.1 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtd_HPCtVoUTbzoGasCcQ_0L6IzeP_1DM_d3PycEPqcdSWEZ9aQ-3a0Pg0oqH6sX4U_PaKavhhRZZLdRASmJKcjHU_I8IS51bc_otRmULCwoyuET_AUpKrfXZ51UJjfDv9FSzOsJujWstNiIJljJPL8chd9al8XBEShYQ-lsnQabRk Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a21dcfb7554042589c1f6e58ebc620cc Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: {"migrate": {}} Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0 could not be found. Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '6ff0d7d9-1f2b-4188-9bc0-83c7648904e0', 'body': {'migrate': {}}} Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0 could not be found. Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0 could not be found. Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:23.754510 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:23.758496 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:23.758496 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:23.758496 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:23.758496 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:23.758496 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0 could not be found. Sep 01 04:56:23.758496 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:23.760741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bbbca72d-d044-4557-a0aa-4ab1e4ee16ce tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Returning 404 to user: Instance 6ff0d7d9-1f2b-4188-9bc0-83c7648904e0 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:23.762289 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bbbca72d-d044-4557-a0aa-4ab1e4ee16ce tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6ff0d7d9-1f2b-4188-9bc0-83c7648904e0/action" status: 404 len: 111 microversion: 2.1 time: 0.502141 Sep 01 04:56:23.763489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1058/2139] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:23 2022] POST /compute/v2.1/servers/6ff0d7d9-1f2b-4188-9bc0-83c7648904e0/action => generated 111 bytes in 507 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:56:23.768267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:23.770900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:23.806506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:23.808021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:23.809417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:23.810263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:23.812791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:23.813347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:24.980321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:24.990007 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa7041c5-8853-4a5d-a7c2-548b640cf525 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 1.776809 Sep 01 04:56:25.008233 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1082/2140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:23 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:25.015495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:25.034791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:25.035946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:56:25.126972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:25.127679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:25.130642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:25.131554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:25.133937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:25.135700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:25.162461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:25.195227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Listed batch of 3 results from cell out of 997 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:56:25.203642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b7b6c9d-7989-4b88-8792-a0531424b1fa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1475 microversion: 2.1 time: 1.438318 Sep 01 04:56:25.211059 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1059/2141] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:23 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1475 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:25.226125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:25.227566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:25.257188 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-277eca0a-3353-4c4b-be0c-df74e5dd4e41 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.247607 Sep 01 04:56:25.257855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:25.258931 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1083/2142] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:56:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:25.270027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-834381102", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:25.293094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:25.299664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:25.304413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:25.305180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:25.305922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:25.367289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:56:26.148618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:26.166627 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1ece79c-e4aa-4041-9cdc-f707cfd9628d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 0.952192 Sep 01 04:56:26.173112 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1060/2143] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:25 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:26.214992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:26.216648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:26.243576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:26.259631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:26.260956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:26.264945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:26.269096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:26.270256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:26.477204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:56:26.477711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:56:26.482397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:56:26.484150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:56:26.485973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:56:26.525396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:26.529177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:26.529726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:26.530842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:26.536619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:26.537177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:26.616564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Getting quotas for project 24e7cb0f97274583a7089105f884024f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:26.635602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Getting quotas for user ee99b34c78f648d09c60cbce4820ef54 and project 24e7cb0f97274583a7089105f884024f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:26.702701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:56:26.705669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:26.708148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:26.729130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:26.734284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:26.735580 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f18bd2ba-6525-44f6-ba38-43a3bee0ab39 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.560522 Sep 01 04:56:26.745615 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1061/2144] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:26 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:26.761494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3095e123-35d4-450a-adc3-48b604173b6b", "tag": "f036356c-d9db-46a2-b7a9-6ee990be7c92"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:26.792846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:26.794814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:26.796953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:26.841878 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33991d32-b5be-45f4-be20-04f8355ca0d3 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579956 Sep 01 04:56:26.843032 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1084/2145] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:56:26.872242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] Creating event network-changed:f036356c-d9db-46a2-b7a9-6ee990be7c92 for instance 3095e123-35d4-450a-adc3-48b604173b6b on n-h2-820368-37 Sep 01 04:56:26.887923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] Instance 3095e123-35d4-450a-adc3-48b604173b6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:56:26.976513 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-77149fa3-1921-4ba8-abbd-ae8f02f544a1 req-8b5e17d8-9ae0-4f1e-92c8-a2e2e75adc8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229182 Sep 01 04:56:26.978305 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1062/2146] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:26.986621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:26.987866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:27.000534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:27.001744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:27.002386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:27.003364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:27.004256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:27.004906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:27.042436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1827450319", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "64397fb9-f841-4d52-92b9-7f46a3043d7f"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:27.155209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:27.156088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] validate_networks() for [('64397fb9-f841-4d52-92b9-7f46a3043d7f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:56:27.191802 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bd2ba55-1fcd-43d5-8bf8-eba82b0db23f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1275 microversion: 2.1 time: 0.211310 Sep 01 04:56:27.194380 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1063/2147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:26 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:27.201441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:27.202969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:27.210996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:27.212268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:27.212911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:27.213882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:27.214831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:27.215495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:28.205613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:28.217630 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fefcabb-329b-4a6e-ac5b-1fe79081bc5a tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 1.021758 Sep 01 04:56:28.218221 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1064/2148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:27 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:28.233584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:28.240397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:28.254645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:28.255437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:28.256018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:28.256890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:28.258444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:28.264566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:28.270456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:29.205992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:29.225597 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92e6e5ad-585d-4221-bfa1-4f346db756a0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1473 microversion: 2.1 time: 0.995906 Sep 01 04:56:29.226810 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1065/2149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:28 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1473 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:29.239074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:29.241026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:29.250008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.251193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.252919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.254343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.255062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.255635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.352465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:56:29.353824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:56:29.355354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:56:29.356235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:56:29.356928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:56:29.375412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.379563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.380259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.381194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.381675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.382200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.394371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:29.432878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cf157ef-ac62-4a52-a3f1-26e06ff5337d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1273 microversion: 2.1 time: 0.200254 Sep 01 04:56:29.436809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Getting quotas for project f2826413aa7a44a0853fd64434c62e7a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:29.449867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Getting quotas for user 08c9c29857a64ec6960897ea536072a2 and project f2826413aa7a44a0853fd64434c62e7a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:29.453088 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1066/2150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:29 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:29.483903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:29.488167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:56:29.488562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:29.491273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:29.515806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.516312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.516761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.517482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.528978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.530207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.535439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:29.614168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-867a9232-a3c2-431d-8b3e-a867157eb32c tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.764850 Sep 01 04:56:29.615928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1085/2151] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:56:29.624826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:29.631705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:29.644963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.651916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.652721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:29.653770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:29.654276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:29.654997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.059020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.077467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6acf997c-375f-4567-8418-1ded91633923 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 1.621167 Sep 01 04:56:31.096636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1067/2152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:29 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:31.111833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:31.112551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:31.125487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.125992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.126437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.133702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.134280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.135499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.188859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.210906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.214262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.221496 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dc9f19c-caa6-4701-a26e-81775b592cc3 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 1.603362 Sep 01 04:56:31.223566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1086/2153] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:29 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:31.235477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-22e42eb0-f92b-4047-b1cc-575bbae56f0d req-30e0639e-351c-4812-8fbb-c0730c701871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558a8f7d-f3d8-4536-a644-92259b3b5301", "name": "network-vif-plugged", "status": "completed", "tag": "bf66f97d-2570-41d3-b24f-d326d977be7c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:31.267486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22e42eb0-f92b-4047-b1cc-575bbae56f0d req-30e0639e-351c-4812-8fbb-c0730c701871 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.268005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22e42eb0-f92b-4047-b1cc-575bbae56f0d req-30e0639e-351c-4812-8fbb-c0730c701871 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.268449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22e42eb0-f92b-4047-b1cc-575bbae56f0d req-30e0639e-351c-4812-8fbb-c0730c701871 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.304576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.308919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-22e42eb0-f92b-4047-b1cc-575bbae56f0d req-30e0639e-351c-4812-8fbb-c0730c701871 service nova] Creating event network-vif-plugged:bf66f97d-2570-41d3-b24f-d326d977be7c for instance 558a8f7d-f3d8-4536-a644-92259b3b5301 on n-h2-820368-37 Sep 01 04:56:31.317168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b9d79c1-4c43-4ac4-b2de-31fbe3011c94 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1281 microversion: 2.1 time: 0.217131 Sep 01 04:56:31.318765 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1068/2154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:31 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:31.324699 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-22e42eb0-f92b-4047-b1cc-575bbae56f0d req-30e0639e-351c-4812-8fbb-c0730c701871 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099661 Sep 01 04:56:31.325666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1087/2155] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:31.331041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:31.331912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:31.338571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:31.340962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:31.348133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.349206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.353829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.354851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.355500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.356102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.359567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.362036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.362669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.365675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.366480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.367109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.570500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.579759 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99c9d27d-97bb-424a-abe3-ee6dd6e1b8d8 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1221 microversion: 2.1 time: 0.252181 Sep 01 04:56:31.580989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1088/2156] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:31 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1221 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:31.595181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:31.595983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:31.624557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.625484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.626109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.627162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.627957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.628668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.883430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:31.894544 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-002ca008-2dd0-49db-9c52-390ba35c95bc tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.574364 Sep 01 04:56:31.897928 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1069/2157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:31 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:31.903221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:31.916272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:31.945245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.951442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.954231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.955244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:31.955935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:31.959659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:31.979319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:32.008720 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee474d11-da4a-4d60-8048-3a347a3d01e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1470 microversion: 2.1 time: 0.426476 Sep 01 04:56:32.014857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1089/2158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:31 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:32.034311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:32.034857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:32.049669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.052753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.053190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.053972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.054431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.054863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.223421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a3a1a59-035c-437e-b3ad-c55bd7d6f9a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b/action" status: 204 len: 0 microversion: 2.1 time: 0.194298 Sep 01 04:56:32.224084 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1090/2159] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:32 2022] POST /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:32.233127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:32.239524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:32.253099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.264769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.266243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.269149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.271947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.273157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.854001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:32.868701 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f3acdb9-482b-4971-a548-12b6c6ded40f tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 0.968095 Sep 01 04:56:32.870342 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1070/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:31 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:32.873557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:32.879016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:32.882178 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-710af1d1-210f-4f16-bdbf-e6b72d7f4b21 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 0.653333 Sep 01 04:56:32.884556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:32.885460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1091/2161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:32 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:32.898743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:32.900465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.900978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.901441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.901809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:32.902155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.902847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.903092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.921438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.922167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.922959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:32.923919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:32.924625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:32.925416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:33.693187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:33.713802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:33.715299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:33.719873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:33.739206 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1db195ad-4c94-476a-a558-10ccfd07b193 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1470 microversion: 2.1 time: 0.863750 Sep 01 04:56:33.740533 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1071/2162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:32 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1470 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:33.742703 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa2d3f67-fedf-4c9b-a0da-d64a6d7a9b71 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.848303 Sep 01 04:56:33.747081 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1092/2163] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:32 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:33.756734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:33.764002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:33.765302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:33.767347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:33.791774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:33.792616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:33.793233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:33.793666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:33.794321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:33.795202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:33.797158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:33.800076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:33.800681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:33.802415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:33.804255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:33.806756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.037339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:34.045864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfa2db23-f00d-4bae-b5ca-66ec9964cedf tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1221 microversion: 2.1 time: 0.300233 Sep 01 04:56:34.058984 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1093/2164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:33 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1221 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:34.064106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:34.064776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:34.078123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.078868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.079558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.082692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.083395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.083988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.628923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:34.631256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:34.647741 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f987e12-8e05-4a7e-b334-1d1dac8a89ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.899319 Sep 01 04:56:34.648327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1072/2165] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:33 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:34.662085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f89fe95-5962-442a-bf1a-49f44fb97aa2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.601459 Sep 01 04:56:34.663303 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1094/2166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:34 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:34.670970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4f15a43c-75b0-45ef-9c71-ace3b936b5ad req-65e68ffc-3493-4883-93e9-5832b8c2e963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "506f9a3f-69a9-4eac-9611-7b8e14a34990", "tag": "f53cdf69-211f-4ea6-ac8f-5cfbf4e66102"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:34.679803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:34.682431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:34.687688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4f15a43c-75b0-45ef-9c71-ace3b936b5ad req-65e68ffc-3493-4883-93e9-5832b8c2e963 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.688394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4f15a43c-75b0-45ef-9c71-ace3b936b5ad req-65e68ffc-3493-4883-93e9-5832b8c2e963 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.688949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4f15a43c-75b0-45ef-9c71-ace3b936b5ad req-65e68ffc-3493-4883-93e9-5832b8c2e963 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.696688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.698585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.699252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.702995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.703708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.704870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.716114 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4f15a43c-75b0-45ef-9c71-ace3b936b5ad req-65e68ffc-3493-4883-93e9-5832b8c2e963 service nova] Creating event network-changed:f53cdf69-211f-4ea6-ac8f-5cfbf4e66102 for instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 on n-h1-820368-37 Sep 01 04:56:34.734454 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4f15a43c-75b0-45ef-9c71-ace3b936b5ad req-65e68ffc-3493-4883-93e9-5832b8c2e963 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070941 Sep 01 04:56:34.735321 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1073/2167] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:34.745876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:34.749738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:34.764423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.768669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.769407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:34.770332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:34.771569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:34.773518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:35.795739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:35.805056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-121ca653-9490-45ff-b111-67f42d32e0e5 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 1.135757 Sep 01 04:56:35.818869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1095/2168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:34 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:35.824228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:35.825157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:35.832028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:35.832840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:35.833484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:35.834401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:35.835266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:35.836015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:35.896393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:35.911823 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18574887-6d68-4859-aaed-43aceda93ef5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1316 microversion: 2.1 time: 1.174975 Sep 01 04:56:35.930010 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1074/2169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:34 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1316 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:35.938167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:35.945709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:35.961472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:35.964700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:35.965958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:35.968402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:35.969068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:35.971752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.400594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:36.411771 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba519f07-fa06-4dd1-b536-b8508308be51 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1470 microversion: 2.1 time: 0.591273 Sep 01 04:56:36.412721 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1096/2170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:35 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:36.417977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:36.418814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:36.425556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.426338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.427025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.427854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.428323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.428899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.473270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:36.486302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:36.488022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:36.489290 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-930b8fa6-1bda-4ffa-9aea-c2b47e1ea4a9 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.557929 Sep 01 04:56:36.490126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1075/2171] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:35 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:36.495898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:36.496580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:36.503301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.504184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.504818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.505807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.506327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.507048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.547523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:36.557754 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba62c5f2-7c15-4e21-8a33-4f7e66cf0d1b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1285 microversion: 2.1 time: 0.143841 Sep 01 04:56:36.558977 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1097/2172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:36 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:36.564164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:36.564962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:36.571861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.572584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.573173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.575637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.576148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.576881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.932788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:36.943519 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-928790d6-a833-4826-ab7c-7e399d1564dd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.451809 Sep 01 04:56:36.944098 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1076/2173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:36 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:36.948694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-edb9af57-fc2d-40d3-8fc6-501a9a3aab20 req-c1a6ba6f-b79d-4f3d-b365-f0c96c860f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bed841-c4bb-4349-a588-1e9afe86cae3", "tag": "d49f9948-006a-471c-a4ee-03fba0f0f492"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:36.959552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-edb9af57-fc2d-40d3-8fc6-501a9a3aab20 req-c1a6ba6f-b79d-4f3d-b365-f0c96c860f6c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:36.960620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-edb9af57-fc2d-40d3-8fc6-501a9a3aab20 req-c1a6ba6f-b79d-4f3d-b365-f0c96c860f6c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:36.961200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-edb9af57-fc2d-40d3-8fc6-501a9a3aab20 req-c1a6ba6f-b79d-4f3d-b365-f0c96c860f6c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:36.979843 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-edb9af57-fc2d-40d3-8fc6-501a9a3aab20 req-c1a6ba6f-b79d-4f3d-b365-f0c96c860f6c service nova] Creating event network-changed:d49f9948-006a-471c-a4ee-03fba0f0f492 for instance b2bed841-c4bb-4349-a588-1e9afe86cae3 on n-h1-820368-37 Sep 01 04:56:36.987582 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-edb9af57-fc2d-40d3-8fc6-501a9a3aab20 req-c1a6ba6f-b79d-4f3d-b365-f0c96c860f6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042199 Sep 01 04:56:36.988405 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1077/2174] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:36.993768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5d311005-65ee-4084-b4ac-d17d0a3bd6c2 req-e206e8f9-cfde-48f0-94ce-800e53a11930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "943d4f75-5e82-407d-a752-7bf18308d1ce", "tag": "83e1d7a4-e73d-4932-88bf-debb22e0f2dd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:37.009003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5d311005-65ee-4084-b4ac-d17d0a3bd6c2 req-e206e8f9-cfde-48f0-94ce-800e53a11930 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.010215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5d311005-65ee-4084-b4ac-d17d0a3bd6c2 req-e206e8f9-cfde-48f0-94ce-800e53a11930 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.010755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5d311005-65ee-4084-b4ac-d17d0a3bd6c2 req-e206e8f9-cfde-48f0-94ce-800e53a11930 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.029497 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5d311005-65ee-4084-b4ac-d17d0a3bd6c2 req-e206e8f9-cfde-48f0-94ce-800e53a11930 service nova] Creating event network-changed:83e1d7a4-e73d-4932-88bf-debb22e0f2dd for instance 943d4f75-5e82-407d-a752-7bf18308d1ce on n-h1-820368-37 Sep 01 04:56:37.036200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5d311005-65ee-4084-b4ac-d17d0a3bd6c2 req-e206e8f9-cfde-48f0-94ce-800e53a11930 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046608 Sep 01 04:56:37.037159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1078/2175] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:37.049137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:37.049869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:37.054450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:37.055888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.058389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.059150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.059807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.060752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.061419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.062032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.064811 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8b50915-7a09-442f-8aae-8a47bfa4e0b5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.504624 Sep 01 04:56:37.065503 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1098/2176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:36 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:37.076423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:37.077308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:37.086718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.087499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.088117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.089034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.095346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.096134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.129853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.444853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:37.455044 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53f95ba7-67e4-4cdd-ad2b-a327e35d86ba tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 0.410149 Sep 01 04:56:37.455892 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1079/2177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:37 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:37.461138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:37.461756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:37.468190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.468678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.469112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.470002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.470453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.471162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.494107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:37.510365 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-487b9ec7-2ed5-4daa-b39e-a3e38e756796 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1504 microversion: 2.1 time: 0.440110 Sep 01 04:56:37.511511 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1099/2178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:37 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:37.533330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:37.534634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:37.548014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.548517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.548959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.549679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.550128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.550556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.925266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:37.934537 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d6326a1-8708-4289-8318-ddcc309ff511 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1470 microversion: 2.1 time: 0.477258 Sep 01 04:56:37.935236 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1080/2179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:37 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:37.939809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-336711521"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:37.940700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:37.950635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.951268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.951711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:37.952467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:37.952917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:37.953309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:38.072917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:38.082919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:38.084623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:38.086360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-111d45b7-3631-4ff6-82e9-54a994dd0ebf tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.561772 Sep 01 04:56:38.087053 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1100/2180] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:37 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:38.092069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:38.092940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:38.099481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:38.099977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:38.100422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:38.101708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:38.102184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:38.102615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:38.210426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:38.219339 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fcfced2-9342-45b8-a926-7436f1fa5d0b tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1283 microversion: 2.1 time: 0.130863 Sep 01 04:56:38.219885 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1101/2181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:38 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1283 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:38.230964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:38.230964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:38.232576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:38.233250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:38.233901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:38.234577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:38.235067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:38.235595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:38.362011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Adding security group 64681e3c-7cc2-48ac-9e35-cf743009944c to port bf66f97d-2570-41d3-b24f-d326d977be7c Sep 01 04:56:38.645002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:38.655618 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0373e212-d3b5-4a7d-b8bf-3ed66412ac67 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.434489 Sep 01 04:56:38.656312 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1102/2182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:38 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:38.663722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:38.664340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:38.676565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:38.677226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:38.678002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:38.679076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:38.679548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:38.680090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:39.410361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:39.472674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=18 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:39.617426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:39.625819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-508b7375-db63-438d-a203-ddbb6d2e2400 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.968097 Sep 01 04:56:39.626486 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1103/2183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:38 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:39.631218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:39.631835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:39.638992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:39.639498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:39.639938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:39.641464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:39.641990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:39.642541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:39.980445 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6744f277-484c-4e69-8516-3cd050eabd9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301/action" status: 202 len: 0 microversion: 2.1 time: 2.044076 Sep 01 04:56:39.989023 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1081/2184] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:37 2022] POST /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301/action => generated 0 bytes in 2053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:39.997234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:39.998528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:40.008886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:40.009556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:40.011525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:40.012641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:40.013346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:40.014003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:40.249681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:40.260268 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2f6dde9-d05f-49bd-bc97-3f7ddfcd316d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 0.632594 Sep 01 04:56:40.261476 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1104/2185] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:39 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:40.266467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:40.267321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:40.274701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:40.275445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:40.276034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:40.276898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:40.277504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:40.278178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:40.777482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:40.791954 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3f5208a-4009-47b4-9892-1c84059d7028 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1462 microversion: 2.1 time: 0.801355 Sep 01 04:56:40.799568 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1082/2186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:39 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1462 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:40.812818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:40.813665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:40.824953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:40.825695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:40.826410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:40.827309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:40.828525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:40.830542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.065462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:41.094397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:41.096289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:41.098597 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-065dea90-acbc-4a3e-a5c8-dd5c18f84a85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.835971 Sep 01 04:56:41.099262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1105/2187] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:40 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:41.113800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:41.114713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:41.123707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.124729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.125007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.125844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.126405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.127546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.375548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:41.388650 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45ae2a48-545f-4e11-b18d-ea060f8b1c47 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.584858 Sep 01 04:56:41.388650 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1083/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:40 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:41.393233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad032dfd-9de7-4e73-b047-759c319ae5f8 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75b7be700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:41.630678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:41.642042 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b8e2e2e-4147-4811-bc60-e0ef77d579f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.533020 Sep 01 04:56:41.659676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1106/2189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:41 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:41.746835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-ad032dfd-9de7-4e73-b047-759c319ae5f8 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use.", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:56:41.748104 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ad032dfd-9de7-4e73-b047-759c319ae5f8 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.748104 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad032dfd-9de7-4e73-b047-759c319ae5f8 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c HTTP/1.1 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: exception: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '64681e3c-7cc2-48ac-9e35-cf743009944c'} Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:56:41.750302 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] Sep 01 04:56:41.754381 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:41.756943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558a8f7d-f3d8-4536-a644-92259b3b5301", "tag": "bf66f97d-2570-41d3-b24f-d326d977be7c"}, {"name": "network-changed", "server_uuid": "d736779b-121f-4fda-93a1-4c27bb7e33eb", "tag": "127d6758-9ca0-42e0-9e45-ed6505a6f2cf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:41.759443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad032dfd-9de7-4e73-b047-759c319ae5f8 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 400 to user: Security Group 64681e3c-7cc2-48ac-9e35-cf743009944c in use. Sep 01 04:56:41.759443 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-a535fdf0-0b72-4357-85eb-86bbe575dfa7'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:41.759443 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad032dfd-9de7-4e73-b047-759c319ae5f8 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c" status: 400 len: 185 microversion: 2.1 time: 0.369157 Sep 01 04:56:41.759816 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1084/2190] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:56:41 2022] DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c => generated 185 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:41.769868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a414d35f-b086-4dcb-be7a-92c0490cd105 req-e258c36f-fed1-4b8b-8f24-3e113962f4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:41.774186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.774689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.775156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.787641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a414d35f-b086-4dcb-be7a-92c0490cd105 req-e258c36f-fed1-4b8b-8f24-3e113962f4f9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.788473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a414d35f-b086-4dcb-be7a-92c0490cd105 req-e258c36f-fed1-4b8b-8f24-3e113962f4f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.789008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a414d35f-b086-4dcb-be7a-92c0490cd105 req-e258c36f-fed1-4b8b-8f24-3e113962f4f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.793611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.804750 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] Creating event network-changed:bf66f97d-2570-41d3-b24f-d326d977be7c for instance 558a8f7d-f3d8-4536-a644-92259b3b5301 on n-h2-820368-37 Sep 01 04:56:41.804969 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] Creating event network-changed:127d6758-9ca0-42e0-9e45-ed6505a6f2cf for instance d736779b-121f-4fda-93a1-4c27bb7e33eb on n-h2-820368-37 Sep 01 04:56:41.805283 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a414d35f-b086-4dcb-be7a-92c0490cd105 req-e258c36f-fed1-4b8b-8f24-3e113962f4f9 service nova] Creating event network-vif-plugged:cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:41.813114 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a414d35f-b086-4dcb-be7a-92c0490cd105 req-e258c36f-fed1-4b8b-8f24-3e113962f4f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051784 Sep 01 04:56:41.814468 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5598f65b-9af6-41cf-9960-6e26f3290cf5 req-651f7088-e306-49c7-96ac-19beaceeff19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.153109 Sep 01 04:56:41.814974 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1085/2191] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:41.816425 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1107/2192] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:41.823363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5fa61ba1-c92f-4473-b114-fa69dff09fa6 req-279a6524-7451-4de7-8c5a-94ea145aa165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535537b-a849-4fd7-89ea-09bd5159ab15", "name": "network-vif-unplugged", "status": "completed", "tag": "e67cd756-582f-4d99-bef6-fa5bc89db4f3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:41.828031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:41.829759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:41.836842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5fa61ba1-c92f-4473-b114-fa69dff09fa6 req-279a6524-7451-4de7-8c5a-94ea145aa165 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.837699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5fa61ba1-c92f-4473-b114-fa69dff09fa6 req-279a6524-7451-4de7-8c5a-94ea145aa165 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.838791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5fa61ba1-c92f-4473-b114-fa69dff09fa6 req-279a6524-7451-4de7-8c5a-94ea145aa165 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.843400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.844678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.845134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.846022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.847992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.848925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.872087 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5fa61ba1-c92f-4473-b114-fa69dff09fa6 req-279a6524-7451-4de7-8c5a-94ea145aa165 service nova] Creating event network-vif-unplugged:e67cd756-582f-4d99-bef6-fa5bc89db4f3 for instance 6535537b-a849-4fd7-89ea-09bd5159ab15 on n-h2-820368-37 Sep 01 04:56:41.879016 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5fa61ba1-c92f-4473-b114-fa69dff09fa6 req-279a6524-7451-4de7-8c5a-94ea145aa165 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062195 Sep 01 04:56:41.880396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1086/2193] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:41.888183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:41.889049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:41.898045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.899170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.899840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:41.901924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:41.904045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:41.905704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.475616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:42.485048 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bff99b04-a865-4cf2-83aa-9d53bd52ec30 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1615 microversion: 2.1 time: 0.602731 Sep 01 04:56:42.485617 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d594088d-43d7-4643-a987-16495efe017b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.667576 Sep 01 04:56:42.485843 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1087/2194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:41 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1615 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1108/2195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:41 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.502928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.510812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.511496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.511750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:42.513908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:42.521753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.522487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.523182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.524055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.524717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.525151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.631237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3214d6cb-7011-4cb3-8093-8a8e191f82c2 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301/action" status: 202 len: 0 microversion: 2.1 time: 0.124682 Sep 01 04:56:42.633371 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1088/2196] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:42 2022] POST /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:56:42.639262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:42.640969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:42.649039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.649637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.650368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.651258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.651828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.652300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.681898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:42.690409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7777c1c8-2366-4f40-9a68-035691d3ceb9 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 0.202569 Sep 01 04:56:42.691309 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1109/2197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:42 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:42.710214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:42.711398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:42.719475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.720201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.720899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.721803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:42.722410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:42.723021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:42.968566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:42.984807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:42.984973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:42.986878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:42.988367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c74f9e83-3e52-40a7-ab49-6c2d2d6d15c1 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.353976 Sep 01 04:56:42.989161 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1089/2198] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:42 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:43.000768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5d5c22c-8459-482a-b5ee-b54dea077e98 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '.version_select at 0x7fa75b7b0af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:43.001646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5c22c-8459-482a-b5ee-b54dea077e98 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.003053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5c22c-8459-482a-b5ee-b54dea077e98 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.003698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d5c22c-8459-482a-b5ee-b54dea077e98 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.007672 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ffa59cd-08ac-4c69-ba71-52e7b302d727 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.303229 Sep 01 04:56:43.008365 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1110/2199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:42 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:43.015348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:43.016407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:43.018160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5d5c22c-8459-482a-b5ee-b54dea077e98 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1963 microversion: 2.1 time: 0.027797 Sep 01 04:56:43.019135 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1090/2200] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:56:42 2022] GET /compute/v2.1/os-migrations => generated 1963 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:43.024447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:43.025303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:43.026720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.027372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.027905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.028763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.029726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.030396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.053774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.055699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.056142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.057369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.057982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.060192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.302534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:43.310542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:43.318840 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10bf04e8-b777-4805-9b40-51b1761d0b0e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1574 microversion: 2.1 time: 0.308805 Sep 01 04:56:43.319735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1111/2201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:43 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1574 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:43.324006 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2f65faa-252f-4506-b4ec-f43611083269 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.303773 Sep 01 04:56:43.324832 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1091/2202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:43 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:43.337299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-965713868", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:43.401576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:56:43.510758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:43.512126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:43.521041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.521779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.522218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.523307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.523919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.525432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.736313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:56:43.736826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:43.737648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:56:43.739375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:56:43.740077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:56:43.740594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:56:43.745585 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b241485-cd90-47dd-8bff-0cdf2722cd6c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.240571 Sep 01 04:56:43.746176 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1092/2203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:43 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:43.755355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:43.755355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:43.761606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.761606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.761606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.761606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.761606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.761606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.771844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.773176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.775063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.776836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.778651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.779651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.811586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:56:43.824661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for user 30b46ee5087145e6828acac49bee0b9b and project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:56:43.845162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:56:43.847474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:56:43.900168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e068abae-0801-448b-b658-a944fdd2dac1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565870 Sep 01 04:56:43.901137 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1112/2204] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:56:43.907064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-406e72bc-4d5b-420b-a5d4-970e08a88211 req-e502a3b3-f41a-4712-a5bd-3d7958f7c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa79642a-051d-4c76-b9b6-afbef5d42824", "tag": "1a2593a5-9a25-45d3-9415-62e1074708a3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:43.931105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-406e72bc-4d5b-420b-a5d4-970e08a88211 req-e502a3b3-f41a-4712-a5bd-3d7958f7c8d3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.932164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-406e72bc-4d5b-420b-a5d4-970e08a88211 req-e502a3b3-f41a-4712-a5bd-3d7958f7c8d3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.932811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-406e72bc-4d5b-420b-a5d4-970e08a88211 req-e502a3b3-f41a-4712-a5bd-3d7958f7c8d3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.936411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:43.946669 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0abeef2f-9c02-4d3f-b88a-4649b78fcab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 0.199275 Sep 01 04:56:43.947852 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1093/2205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:43 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:43.952999 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-406e72bc-4d5b-420b-a5d4-970e08a88211 req-e502a3b3-f41a-4712-a5bd-3d7958f7c8d3 service nova] Creating event network-changed:1a2593a5-9a25-45d3-9415-62e1074708a3 for instance fa79642a-051d-4c76-b9b6-afbef5d42824 on n-h2-820368-37 Sep 01 04:56:43.955041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095e123-35d4-450a-adc3-48b604173b6b", "name": "network-vif-plugged", "status": "completed", "tag": "f036356c-d9db-46a2-b7a9-6ee990be7c92"}, {"server_uuid": "506f9a3f-69a9-4eac-9611-7b8e14a34990", "name": "network-vif-plugged", "status": "completed", "tag": "f53cdf69-211f-4ea6-ac8f-5cfbf4e66102"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "fb9959fe-6d22-4449-b3ec-6dbc63f6f116"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:43.958019 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-406e72bc-4d5b-420b-a5d4-970e08a88211 req-e502a3b3-f41a-4712-a5bd-3d7958f7c8d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055349 Sep 01 04:56:43.959362 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1113/2206] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:43.966811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4a72bb97-7fed-47d6-b53d-6c75959e34a0 req-ff86c717-19ce-4e20-95aa-f5915285460a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6535537b-a849-4fd7-89ea-09bd5159ab15", "tag": "e67cd756-582f-4d99-bef6-fa5bc89db4f3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:43.971244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.971966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.973023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.979179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4a72bb97-7fed-47d6-b53d-6c75959e34a0 req-ff86c717-19ce-4e20-95aa-f5915285460a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:43.979679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4a72bb97-7fed-47d6-b53d-6c75959e34a0 req-ff86c717-19ce-4e20-95aa-f5915285460a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:43.980100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4a72bb97-7fed-47d6-b53d-6c75959e34a0 req-ff86c717-19ce-4e20-95aa-f5915285460a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:43.992406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4a72bb97-7fed-47d6-b53d-6c75959e34a0 req-ff86c717-19ce-4e20-95aa-f5915285460a service nova] Creating event network-changed:e67cd756-582f-4d99-bef6-fa5bc89db4f3 for instance 6535537b-a849-4fd7-89ea-09bd5159ab15 on n-h2-820368-37 Sep 01 04:56:43.993388 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Creating event network-vif-plugged:f036356c-d9db-46a2-b7a9-6ee990be7c92 for instance 3095e123-35d4-450a-adc3-48b604173b6b on n-h2-820368-37 Sep 01 04:56:43.993991 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Creating event network-vif-plugged:f53cdf69-211f-4ea6-ac8f-5cfbf4e66102 for instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 on n-h1-820368-37 Sep 01 04:56:43.994577 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] Creating event network-vif-plugged:fb9959fe-6d22-4449-b3ec-6dbc63f6f116 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:44.008086 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-645937e1-c695-4467-b554-83940058fe49 req-ec4eda86-873a-45da-8bee-ee5747044e49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.057968 Sep 01 04:56:44.008253 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4a72bb97-7fed-47d6-b53d-6c75959e34a0 req-ff86c717-19ce-4e20-95aa-f5915285460a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047037 Sep 01 04:56:44.008760 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1114/2207] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:44.014033 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1094/2208] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:44.019323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89fb29f6-0f3a-4e3f-834b-e6f73fcea72e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.020039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89fb29f6-0f3a-4e3f-834b-e6f73fcea72e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.021294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.022258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.031206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.031935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.032509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.033729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.034708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.035478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.119437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89fb29f6-0f3a-4e3f-834b-e6f73fcea72e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.129472 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89fb29f6-0f3a-4e3f-834b-e6f73fcea72e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1212 microversion: 2.1 time: 0.119459 Sep 01 04:56:44.130256 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1115/2209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1212 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:44.141129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.142040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.152282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.152974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.153411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.154117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.154631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.155101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.407774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.422399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.424047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.425301 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00207971-9bcb-407e-9433-9003bbfe6f31 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.409662 Sep 01 04:56:44.441163 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1095/2210] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:44.441163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.441163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.441163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.441163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.441163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.442071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.442071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.442586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.459193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.476425 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da919bc9-9ae4-4556-b0c3-3ffb0b91c9ed tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.343584 Sep 01 04:56:44.477702 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1116/2211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:44.483192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.484149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.491070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.491805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.492425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.493322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.494053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.494538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.692584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.701316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-363f3e98-8dfc-4298-bcbd-0c87a5775ac6 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1574 microversion: 2.1 time: 0.273813 Sep 01 04:56:44.712220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1096/2212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1574 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:44.712542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.718315 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54d799ae-49ce-43cb-8667-6c1004fb5857 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.239411 Sep 01 04:56:44.718921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1117/2213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:44.771070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.771680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.779603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.780096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.780530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.781241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.781876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.782559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.928355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:44.938154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c52313af-8985-42f7-b794-fe6339e89909 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.171992 Sep 01 04:56:44.939121 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1097/2214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:44.972838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:44.974313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:44.981649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.982173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.982605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:44.983330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:44.983766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:44.984182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:45.153867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:45.154300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:45.161052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:45.161537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:45.161966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:45.162684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:45.163326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:45.163750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:45.269938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:45.287602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-909d57dd-1223-44c5-8e02-48b15019016b tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 0.319324 Sep 01 04:56:45.299151 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1118/2215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:44 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:45.305138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:45.316249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45c9d909-40f9-49cb-8d25-8712c2aeaa8d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1208 microversion: 2.1 time: 0.166748 Sep 01 04:56:45.317319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1098/2216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:45 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1208 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:45.454647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:45.455594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:45.465035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:45.465797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:45.466384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:45.467383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:45.468005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:45.468727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:45.510242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:45.511811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:45.521929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:45.523087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:45.524194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:45.525316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:45.526026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:45.526629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.002259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:46.007875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:46.010412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.021546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:46.023467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:46.025174 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74184ccb-a4b7-4135-a4de-898124f643b3 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.523567 Sep 01 04:56:46.025288 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abea865c-6b27-46dd-9cc5-7ad9e0fae0dd tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.575600 Sep 01 04:56:46.026252 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1119/2217] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:45 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:46.026503 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1099/2218] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:45 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:46.032227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:46.033236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:46.034979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:46.035542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:46.043214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.043703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.044167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.045106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.045434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.045814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.058929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.060017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.060708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.061691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.062341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.063024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.707172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:46.716843 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1f907c6-b2ea-4819-ac54-1058dab13968 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.688909 Sep 01 04:56:46.718114 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1100/2219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:46 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:46.727557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:46.728518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:46.736991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.737791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.738483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.740361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.741095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.742309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.795325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:46.811174 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d66bab6-471d-4625-872a-2997bcfe8da9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1574 microversion: 2.1 time: 0.782190 Sep 01 04:56:46.813159 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1120/2220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:46 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1574 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:46.818903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed841-c4bb-4349-a588-1e9afe86cae3", "name": "network-vif-plugged", "status": "completed", "tag": "d49f9948-006a-471c-a4ee-03fba0f0f492"}, {"server_uuid": "943d4f75-5e82-407d-a752-7bf18308d1ce", "name": "network-vif-plugged", "status": "completed", "tag": "83e1d7a4-e73d-4932-88bf-debb22e0f2dd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:46.833019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.833976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.834913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.857174 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] Creating event network-vif-plugged:d49f9948-006a-471c-a4ee-03fba0f0f492 for instance b2bed841-c4bb-4349-a588-1e9afe86cae3 on n-h1-820368-37 Sep 01 04:56:46.859780 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] Creating event network-vif-plugged:83e1d7a4-e73d-4932-88bf-debb22e0f2dd for instance 943d4f75-5e82-407d-a752-7bf18308d1ce on n-h1-820368-37 Sep 01 04:56:46.870945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5589cce1-afd4-43a0-9863-a57f713f0462 req-231020d6-51a5-44b9-89bd-10c5b2fba3e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056084 Sep 01 04:56:46.872111 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1121/2221] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:46.877663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:46.878356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:46.918380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.918778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.919266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:46.919981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:46.920429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:46.920853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:47.795704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:47.805129 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3628b716-5526-425d-9634-4e28e9cf3c93 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 1.084749 Sep 01 04:56:47.818330 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1101/2222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:46 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:47.828278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:47.829347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:47.837864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:47.838785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:47.839479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:47.840656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:47.841399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:47.842024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:47.886154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:47.899576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1befc91-2805-4017-932a-2e12a9195d83 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1321 microversion: 2.1 time: 1.024948 Sep 01 04:56:47.900436 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1122/2223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:46 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1321 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:47.907380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:47.908744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:47.920106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:47.920755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:47.921280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:47.922171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:47.922623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:47.923072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:47.969926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:47.981059 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e16aa4b-390d-45c1-b9f2-59bcf0253881 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1270 microversion: 2.1 time: 0.161046 Sep 01 04:56:47.981957 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1102/2224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:47 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:47.988949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:47.989844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:47.997873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:47.998579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:47.999204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.000055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.000674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.001235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.030696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.548013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:48.560723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:48.562169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:48.563372 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a117e17c-b9f8-46e3-bc1f-2e30c709c140 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.660638 Sep 01 04:56:48.563936 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1123/2225] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:47 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:48.569595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:48.570479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:48.576498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.576908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.577544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.578236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.578680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.579184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.636300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:48.645070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d823a6a-590e-40c3-8c68-58f28b780240 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.661817 Sep 01 04:56:48.645845 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1103/2226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:47 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:48.664128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:48.664736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:48.672106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.672906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.673636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.674143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.674773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.675370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.949893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:48.957898 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a0517c4-c2e6-47be-b26f-75221a195b69 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1323 microversion: 2.1 time: 0.392794 Sep 01 04:56:48.958441 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1124/2227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:48 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:48.963445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:48.964030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:48.970204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.970676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.971425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:48.972129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:48.972578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:48.973000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.002855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.012274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c124ccd4-c123-4b85-af30-e8f727ef7875 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1574 microversion: 2.1 time: 0.351848 Sep 01 04:56:49.016040 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1104/2228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:48 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1574 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:49.021862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "201b5c85-f058-4d59-a091-8536a41fe19e"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "544e2bf0-4b9c-43c6-8255-e002a4396e1f"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "c48ec7dc-e437-426b-bbc6-6eee0e32594f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:49.035337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.035929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.036392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.048928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Creating event network-vif-plugged:201b5c85-f058-4d59-a091-8536a41fe19e for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:49.049512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Creating event network-vif-plugged:544e2bf0-4b9c-43c6-8255-e002a4396e1f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:49.050164 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] Creating event network-vif-plugged:c48ec7dc-e437-426b-bbc6-6eee0e32594f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:49.056280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2dd14c87-bd78-4cb8-b300-17e565482248 req-17d294bd-05f3-43d8-adc5-bc331e3925b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038376 Sep 01 04:56:49.056885 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1105/2229] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:49.063366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:49.063366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:49.071173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.071684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.072208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.072793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.073238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.073855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.279557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.291875 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c226ad6f-7893-42b4-972a-5a2f51b548c6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.332006 Sep 01 04:56:49.294293 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1125/2230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:48 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:49.299374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:49.301267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:49.309841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.310338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.310977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.311694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.312157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.312581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.360219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.369161 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2bd7cacb-5de2-4ea3-8b31-a9ea518ae1ac tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1471 microversion: 2.1 time: 0.310834 Sep 01 04:56:49.369761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1106/2231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:49 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:49.389583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:49.390113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:49.396230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.396658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.397134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.398154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.398610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.399065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.423593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lazy-loading 'flavor' on Instance uuid 943d4f75-5e82-407d-a752-7bf18308d1ce {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:56:49.497029 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a8591b5-c721-42b3-806d-6ec07a481ac6 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce/action" status: 202 len: 0 microversion: 2.1 time: 0.110861 Sep 01 04:56:49.501537 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1107/2232] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:49 2022] POST /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:56:49.507528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:49.508257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:49.515624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.516048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.516477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.518169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.518169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.518169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.532427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.544759 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-066485b0-3c50-43e3-a74b-cf550c3cbce8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.250547 Sep 01 04:56:49.545278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1126/2233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:49 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:49.586139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:49.587079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:49.589368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.595829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.596332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.597051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.597811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.598274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.598729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.913733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.925345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.927014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:49.928516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ea2e5c9-4a2e-42be-99eb-882da802229c tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.346288 Sep 01 04:56:49.929495 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1127/2234] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:49 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:49.934949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:49.935824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:49.943639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.944951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.945478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.946445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:49.946919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:49.947415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:49.987717 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb9991e1-2b53-4e2f-9527-1a41598d2cc4 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1632 microversion: 2.1 time: 0.484088 Sep 01 04:56:49.989084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1108/2235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:49 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1632 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:49.995726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:49.997687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:50.008853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:50.023230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:50.023861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:50.024633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:50.025161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:50.027841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:50.276301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:50.284567 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc690a0d-d6ae-416a-a6e9-d7ccc09a6bd0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 200 len: 1517 microversion: 2.1 time: 0.294093 Sep 01 04:56:50.295479 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1109/2236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:49 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 1517 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:50.301487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:50.304481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:50.305735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:50.310240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f836bedc-8f1b-4304-af37-3241e03d9fd0 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.379419 Sep 01 04:56:50.323891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1128/2237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:49 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:50.327923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:50.327923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:50.328277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:50.328849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:50.329485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:50.329910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:50.331369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:50.332128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:50.339079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:50.339833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:50.340414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:50.341263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:50.341860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:50.342425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.001176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:51.008555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:51.016724 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f4ad3f8-d7d7-4753-a0ca-1dd0ad23a63d tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1323 microversion: 2.1 time: 0.691406 Sep 01 04:56:51.030157 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45d96cd4-7235-4ecb-aa98-a4d6001b8417 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1574 microversion: 2.1 time: 0.733182 Sep 01 04:56:51.032432 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1129/2238] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:50 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:51.037979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:51.038981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:51.040337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1110/2239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:50 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1574 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:51.046385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:51.047050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:51.047350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.048135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.048678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.049581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.050050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.050648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.054083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.054662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.055273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.056037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.056519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.056994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.543682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:51.551786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:51.553543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f46552d8-ac08-4d6e-b9ef-3b4164621153 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1391 microversion: 2.1 time: 0.519528 Sep 01 04:56:51.554735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1130/2240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:51 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1391 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:51.560077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:51.560705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:51.568527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.569847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.570328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.571090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.571593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.572006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.582989 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b79f8ebe-7457-46f0-9e23-74c1bf7273a5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.540970 Sep 01 04:56:51.596017 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1111/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:51 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:51.596017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:51.596017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:51.603170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.603652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.604094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:51.604807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:51.605312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:51.605735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.254415 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-524d47cb-55df-4327-a6d7-6e32493e4ef8 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1615 microversion: 2.1 time: 0.668859 Sep 01 04:56:52.255616 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1112/2242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:51 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1615 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:52.262506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:52.265185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-plugged", "status": "completed", "tag": "739c6b63-c324-4919-91d7-6b309360928d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:52.278913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:52.280775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:52.281798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.282015 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23a3e6c2-6962-4341-a7b0-f09cc568be75 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.726215 Sep 01 04:56:52.282490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.282612 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1131/2243] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:51 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:52.283148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.287904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:52.288915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:52.295582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.296073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.296504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.297211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.297811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.298236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.313944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] Creating event network-vif-plugged:fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:52.315266 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] Creating event network-vif-plugged:739c6b63-c324-4919-91d7-6b309360928d for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:52.323759 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fb1046ef-29a8-4a1f-ab87-bb81370c6370 req-eb398914-ac6c-41df-915a-13d0c2883351 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067290 Sep 01 04:56:52.324662 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1113/2244] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:52.332995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:52.333996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:52.341261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.341739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.342170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.342920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.343369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.343805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.735241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:52.748916 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd16d72a-0512-45bb-b9d2-fd5c4a92a6fc tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.465011 Sep 01 04:56:52.750485 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1132/2245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:52 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:52.768986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:52.778801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:52.779609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:52.782053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96efeccd-6425-4497-ba39-f32bab3d82a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1323 microversion: 2.1 time: 0.453426 Sep 01 04:56:52.785143 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1114/2246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:52 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:52.787924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.788854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.789411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.790405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.791018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.791557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.792292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:52.793034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:52.809124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.810814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.812401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.813367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.814878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.815592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.948982 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] HTTP exception thrown: Cannot 'migrate' instance 943d4f75-5e82-407d-a752-7bf18308d1ce while it is in vm_state suspended Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Request method failure captured: Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce/action HTTP/1.1 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtd_HPCtVoUTbzoGasCcQ_0L6IzeP_1DM_d3PycEPqcdSWEZ9aQ-3a0Pg0oqH6sX4U_PaKavhhRZZLdRASmJKcjHU_I8IS51bc_otRmULCwoyuET_AUpKrfXZ51UJjfDv9FSzOsJujWstNiIJljJPL8chd9al8XBEShYQ-lsnQabRk Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a21dcfb7554042589c1f6e58ebc620cc Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: {"migrate": {}} Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: exception: Cannot 'migrate' instance 943d4f75-5e82-407d-a752-7bf18308d1ce while it is in vm_state suspended Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '943d4f75-5e82-407d-a752-7bf18308d1ce', 'body': {'migrate': {}}} Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce in vm_state suspended. Cannot resize while the instance is in this state. Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:52.952351 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 943d4f75-5e82-407d-a752-7bf18308d1ce while it is in vm_state suspended Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 943d4f75-5e82-407d-a752-7bf18308d1ce while it is in vm_state suspended Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Returning 409 to user: Cannot 'migrate' instance 943d4f75-5e82-407d-a752-7bf18308d1ce while it is in vm_state suspended {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e8a8bcc-2af0-40f0-b84d-dc7acb767c37 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce/action" status: 409 len: 148 microversion: 2.1 time: 0.167878 Sep 01 04:56:52.962535 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1115/2247] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:52 2022] POST /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce/action => generated 148 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:56:52.983228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:52.986505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:52.995922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.996401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.996832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:52.997734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:52.998185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:52.998601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.266794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:53.279112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bafa558-9be1-4259-9ca5-9b5389bf4b8a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1574 microversion: 2.1 time: 0.518814 Sep 01 04:56:53.279950 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1133/2248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:52 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1574 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:53.289009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.289638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:53.302659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.303910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.304615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.305617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.306187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.306711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.406446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:53.419993 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecee4d9b-0b67-451d-aacc-4b95aff2b26e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1381 microversion: 2.1 time: 0.459656 Sep 01 04:56:53.419993 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1116/2249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:52 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1381 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:53.421484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d086398-5bae-4aee-b900-c4be48210c4a tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d086398-5bae-4aee-b900-c4be48210c4a tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Request method failure captured: Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d/action HTTP/1.1 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 39 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtd_HPCtVoUTbzoGasCcQ_0L6IzeP_1DM_d3PycEPqcdSWEZ9aQ-3a0Pg0oqH6sX4U_PaKavhhRZZLdRASmJKcjHU_I8IS51bc_otRmULCwoyuET_AUpKrfXZ51UJjfDv9FSzOsJujWstNiIJljJPL8chd9al8XBEShYQ-lsnQabRk Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a21dcfb7554042589c1f6e58ebc620cc Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: {"os-resetState": {"state": "invalid"}} Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'invalid' Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:56:53.425196 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d086398-5bae-4aee-b900-c4be48210c4a tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:53.429374 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d086398-5bae-4aee-b900-c4be48210c4a tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d/action" status: 400 len: 144 microversion: 2.1 time: 0.009098 Sep 01 04:56:53.432108 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1117/2250] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:53 2022] POST /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d/action => generated 144 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:53.437467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.438126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:53.451210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.452029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.452614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.453363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.453984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.454415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.574926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:53.583431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e748db1-231c-487b-a9ad-f1cd1a08b8b0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.302584 Sep 01 04:56:53.584063 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1134/2251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:53 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:53.591578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6ebda3a9-20d1-4741-9040-83bead3816da req-c2182be7-1495-4742-9e30-a3a6c9e5222e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d490dd8-5b01-4820-9370-37d90a24a24c", "tag": "283c5331-2b11-4256-8c18-a3648fa570e4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:53.604244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ebda3a9-20d1-4741-9040-83bead3816da req-c2182be7-1495-4742-9e30-a3a6c9e5222e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.604244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ebda3a9-20d1-4741-9040-83bead3816da req-c2182be7-1495-4742-9e30-a3a6c9e5222e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.604244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ebda3a9-20d1-4741-9040-83bead3816da req-c2182be7-1495-4742-9e30-a3a6c9e5222e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.616379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6ebda3a9-20d1-4741-9040-83bead3816da req-c2182be7-1495-4742-9e30-a3a6c9e5222e service nova] Creating event network-changed:283c5331-2b11-4256-8c18-a3648fa570e4 for instance 0d490dd8-5b01-4820-9370-37d90a24a24c on n-h2-820368-37 Sep 01 04:56:53.622040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6ebda3a9-20d1-4741-9040-83bead3816da req-c2182be7-1495-4742-9e30-a3a6c9e5222e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Sep 01 04:56:53.622680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1135/2252] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:53.627939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e246551-b6bf-4b16-b2a0-d456c267aa01 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e246551-b6bf-4b16-b2a0-d456c267aa01 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Request method failure captured: Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d/action HTTP/1.1 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 31 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtd_HPCtVoUTbzoGasCcQ_0L6IzeP_1DM_d3PycEPqcdSWEZ9aQ-3a0Pg0oqH6sX4U_PaKavhhRZZLdRASmJKcjHU_I8IS51bc_otRmULCwoyuET_AUpKrfXZ51UJjfDv9FSzOsJujWstNiIJljJPL8chd9al8XBEShYQ-lsnQabRk Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a21dcfb7554042589c1f6e58ebc620cc Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: {"os-resetState": {"state": 1}} Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d', 'body': {'os-resetState': {'state': 1}}} Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 1 Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 01 04:56:53.632108 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e246551-b6bf-4b16-b2a0-d456c267aa01 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:53.636486 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e246551-b6bf-4b16-b2a0-d456c267aa01 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d/action" status: 400 len: 120 microversion: 2.1 time: 0.009908 Sep 01 04:56:53.637142 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1136/2253] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:53 2022] POST /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:53.641291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-109697e3-b4d6-48b3-aef7-2656166556bb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '.version_select at 0x7fa75bf39820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.644630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109697e3-b4d6-48b3-aef7-2656166556bb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.645111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109697e3-b4d6-48b3-aef7-2656166556bb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.645546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109697e3-b4d6-48b3-aef7-2656166556bb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.656710 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-109697e3-b4d6-48b3-aef7-2656166556bb tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1963 microversion: 2.1 time: 0.018878 Sep 01 04:56:53.657312 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1137/2254] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:56:53 2022] GET /compute/v2.1/os-migrations => generated 1963 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:53.662408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e6c43c9-fdc9-45d4-9708-99d89ab81759 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:53.664864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e6c43c9-fdc9-45d4-9708-99d89ab81759 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Failed to fetch instance by id 999 {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 04:56:53.665397 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3e6c43c9-fdc9-45d4-9708-99d89ab81759 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e6c43c9-fdc9-45d4-9708-99d89ab81759 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Request method failure captured: Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 37 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtd_HPCtVoUTbzoGasCcQ_0L6IzeP_1DM_d3PycEPqcdSWEZ9aQ-3a0Pg0oqH6sX4U_PaKavhhRZZLdRASmJKcjHU_I8IS51bc_otRmULCwoyuET_AUpKrfXZ51UJjfDv9FSzOsJujWstNiIJljJPL8chd9al8XBEShYQ-lsnQabRk Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b32c80d34f4b4b1fabed0e8f3897adc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b32c80d34f4b4b1fabed0e8f3897adc8 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1876880793 Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a21dcfb7554042589c1f6e58ebc620cc Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1876880793-project-admin Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: {"os-resetState": {"state": "error"}} Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 999 could not be found. Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:53.674213 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:53.678649 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:53.678649 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 01 04:56:53.678649 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:53.678649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e6c43c9-fdc9-45d4-9708-99d89ab81759 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:53.678649 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e6c43c9-fdc9-45d4-9708-99d89ab81759 tempest-ServersAdminNegativeTestJSON-1876880793 tempest-ServersAdminNegativeTestJSON-1876880793-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.017550 Sep 01 04:56:53.678649 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1138/2255] 10.222.0.26 () {60 vars in 1179 bytes} [Thu Sep 1 04:56:53 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:56:53.681600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.682349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:53.691006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.691401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.691834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.692538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.692990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.693411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.694913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:53.704236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:53.705684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:53.706860 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-acaf492c-f2b6-4281-8e4b-e119e2e5668f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.273476 Sep 01 04:56:53.707445 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1118/2256] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:53 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:53.719091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.719091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:53.723516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.723516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.723516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.723516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.723968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.724325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.761520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:56:53.795983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:53.822488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:53.857235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3fcc52f5-068b-4bc1-bd24-b159c9468778 tempest-LiveMigrationTest-908042464 tempest-LiveMigrationTest-908042464-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1534 microversion: 2.1 time: 0.179215 Sep 01 04:56:53.873226 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1139/2257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:53 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1534 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:53.885999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.887030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:53.894316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.895267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.896077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.898165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.898948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.899645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.902250 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fc6514d-a33a-46f9-9a9d-aeea70b07f42 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 204 len: 0 microversion: 2.1 time: 0.193425 Sep 01 04:56:53.910386 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1119/2258] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:56:53 2022] DELETE /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:53.919908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:53.927326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:53.928918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:53.935937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.936771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.937564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:53.938484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:53.939793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:53.940419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.128557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:54.193014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:54.201535 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee44203a-dc70-4493-b3c2-9161acfbd627 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.326684 Sep 01 04:56:54.215499 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1140/2259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:53 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:54.220336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:54.220645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:54.221154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:54.229250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.229595 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4da478de-b488-4e03-a794-5bfff07be854 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1323 microversion: 2.1 time: 0.316925 Sep 01 04:56:54.229884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.230323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.231384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.231592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.232052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.236885 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1120/2260] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:53 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:54.251437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:54.252547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:54.260312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:56:54.260624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.261306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.261942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.262871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.263557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.264280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.350105 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85f55bbe-38a6-4d27-bb2c-517ebf6c4837 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 204 len: 0 microversion: 2.1 time: 0.132938 Sep 01 04:56:54.351050 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1141/2261] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:56:54 2022] DELETE /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:54.356265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:54.357052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:54.365041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.365041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.365041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.365041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.365490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.365895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.426694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:54.436332 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6632efd0-57bb-4976-97ff-38f690af9fce tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1468 microversion: 2.1 time: 0.197937 Sep 01 04:56:54.437128 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1121/2262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:54 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:54.441584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ea176888-f7ab-4367-a49e-f9b1454f5b14 req-4ae7ffa2-ddcc-4ec2-8ac6-2abb9fab9e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d736779b-121f-4fda-93a1-4c27bb7e33eb", "name": "network-vif-plugged", "status": "completed", "tag": "127d6758-9ca0-42e0-9e45-ed6505a6f2cf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:54.454042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ea176888-f7ab-4367-a49e-f9b1454f5b14 req-4ae7ffa2-ddcc-4ec2-8ac6-2abb9fab9e15 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.455212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ea176888-f7ab-4367-a49e-f9b1454f5b14 req-4ae7ffa2-ddcc-4ec2-8ac6-2abb9fab9e15 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.455820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ea176888-f7ab-4367-a49e-f9b1454f5b14 req-4ae7ffa2-ddcc-4ec2-8ac6-2abb9fab9e15 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.470155 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ea176888-f7ab-4367-a49e-f9b1454f5b14 req-4ae7ffa2-ddcc-4ec2-8ac6-2abb9fab9e15 service nova] Creating event network-vif-plugged:127d6758-9ca0-42e0-9e45-ed6505a6f2cf for instance d736779b-121f-4fda-93a1-4c27bb7e33eb on n-h2-820368-37 Sep 01 04:56:54.475599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ea176888-f7ab-4367-a49e-f9b1454f5b14 req-4ae7ffa2-ddcc-4ec2-8ac6-2abb9fab9e15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037364 Sep 01 04:56:54.476253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1122/2263] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:54.481389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:54.482069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:54.488934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.489432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.489861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.490649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.491269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.491696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.534639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:54.546233 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2caaf4e8-08f5-45c7-ae78-ebafe9584543 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1572 microversion: 2.1 time: 0.193878 Sep 01 04:56:54.559133 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1142/2264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:54 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1572 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:54.567408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1369955855"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:54.568208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:54.575241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.575733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.576174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.576897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.577348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.577769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.674584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:54.683541 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6442c52d-9e3c-4eb8-a73c-7fbd8a897e86 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1387 microversion: 2.1 time: 0.206087 Sep 01 04:56:54.684316 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1123/2265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:54 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1387 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:54.689063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:54.689721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:54.700562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.701067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.701504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:54.702222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:54.702674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:54.703203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:55.135474 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Adding security group 7c47f1dd-3515-4fcb-ba42-795395af39ab to port bf66f97d-2570-41d3-b24f-d326d977be7c Sep 01 04:56:55.382133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:55.390874 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d4f0078-55c6-4278-be5b-68a41b5479a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.705467 Sep 01 04:56:55.391794 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1124/2266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:54 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:55.396387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:55.397062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:55.403820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:55.404600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:55.405064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:55.405757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:55.406279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:55.406688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:55.698270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:55.709411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:55.711610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:55.713207 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db724993-ddd7-4ea2-935d-cbae2c944ad5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1880 microversion: 2.32 time: 0.320398 Sep 01 04:56:55.728961 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1125/2267] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:55 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1880 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:55.730750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:55.731490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:55.739025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:55.741685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:55.741685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:55.741685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:55.742186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:55.742667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:55.880444 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-427e3f64-c651-4310-ac3b-df721218e761 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301/action" status: 202 len: 0 microversion: 2.1 time: 1.317080 Sep 01 04:56:55.885079 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1143/2268] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:56:54 2022] POST /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301/action => generated 0 bytes in 1322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:56:55.890722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:55.891615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:55.899109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:55.899576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:55.900521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:55.901426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:55.902047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:55.902642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.203370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:56.232467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5823f99f-c2c8-4252-b406-19b0eb8fb3b7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.504847 Sep 01 04:56:56.247084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1126/2269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:55 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:56.253918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:56.254961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:56.269758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.271031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.271953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.273234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.273919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.276785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.489909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:56.504351 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8124548-a2cf-43c3-8341-6736249195fe tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1323 microversion: 2.1 time: 0.617584 Sep 01 04:56:56.523434 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1144/2270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:55 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:56.532588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:56.550820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:56.550820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.552054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.552494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.553498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.554165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.554863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.704004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:56.713463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:56.715402 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-050d433f-b7c4-4593-9c28-37661e12298c tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1345 microversion: 2.1 time: 0.190398 Sep 01 04:56:56.716258 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1145/2271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:56 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:56.723473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9146298-2438-4685-99d8-04cb24fe37f9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bdd7940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:56.727486 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-633b77ff-4528-4d59-849b-960a7d92dab1 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1468 microversion: 2.1 time: 0.478809 Sep 01 04:56:56.728079 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1127/2272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:56 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1468 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:56.745060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-de661272-1963-4ca0-984a-9f69ef8157e2 req-3e57d7b8-5f4f-4608-921a-9af9691cdcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "558a8f7d-f3d8-4536-a644-92259b3b5301", "tag": "bf66f97d-2570-41d3-b24f-d326d977be7c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:56.755845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-de661272-1963-4ca0-984a-9f69ef8157e2 req-3e57d7b8-5f4f-4608-921a-9af9691cdcf6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.756544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-de661272-1963-4ca0-984a-9f69ef8157e2 req-3e57d7b8-5f4f-4608-921a-9af9691cdcf6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.756980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-de661272-1963-4ca0-984a-9f69ef8157e2 req-3e57d7b8-5f4f-4608-921a-9af9691cdcf6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.782613 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-de661272-1963-4ca0-984a-9f69ef8157e2 req-3e57d7b8-5f4f-4608-921a-9af9691cdcf6 service nova] Creating event network-changed:bf66f97d-2570-41d3-b24f-d326d977be7c for instance 558a8f7d-f3d8-4536-a644-92259b3b5301 on n-h2-820368-37 Sep 01 04:56:56.790607 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-de661272-1963-4ca0-984a-9f69ef8157e2 req-3e57d7b8-5f4f-4608-921a-9af9691cdcf6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053318 Sep 01 04:56:56.791532 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1128/2273] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:56.797220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:56.798080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:56.800247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:56.807938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.808531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.809031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:56.809808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:56.810330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:56.810840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.338478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-b9146298-2438-4685-99d8-04cb24fe37f9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use.", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:56:57.339473 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b9146298-2438-4685-99d8-04cb24fe37f9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.339473 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9146298-2438-4685-99d8-04cb24fe37f9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab HTTP/1.1 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: exception: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7c47f1dd-3515-4fcb-ba42-795395af39ab'} Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:56:57.343469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] Sep 01 04:56:57.349070 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:57.355955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9146298-2438-4685-99d8-04cb24fe37f9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 400 to user: Security Group 7c47f1dd-3515-4fcb-ba42-795395af39ab in use. Sep 01 04:56:57.355955 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-66455967-d255-46a7-9a74-92be2e97e2c3'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:57.355955 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9146298-2438-4685-99d8-04cb24fe37f9 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab" status: 400 len: 185 microversion: 2.1 time: 0.635322 Sep 01 04:56:57.355955 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1146/2274] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:56:56 2022] DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab => generated 185 bytes in 637 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:56:57.372658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:57.381869 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ea45f8e-4ab5-44f4-857b-78c34695b835 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.588424 Sep 01 04:56:57.395229 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1129/2275] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:56 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:57.402153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9182c1b1-7edc-4dac-bb13-b73f6b0e6f2b req-facd7c52-1cc7-4b26-a781-be8285f81e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6535537b-a849-4fd7-89ea-09bd5159ab15", "name": "network-vif-deleted", "tag": "e67cd756-582f-4d99-bef6-fa5bc89db4f3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:57.413053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9182c1b1-7edc-4dac-bb13-b73f6b0e6f2b req-facd7c52-1cc7-4b26-a781-be8285f81e7e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.413816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9182c1b1-7edc-4dac-bb13-b73f6b0e6f2b req-facd7c52-1cc7-4b26-a781-be8285f81e7e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.414419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9182c1b1-7edc-4dac-bb13-b73f6b0e6f2b req-facd7c52-1cc7-4b26-a781-be8285f81e7e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.427602 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9182c1b1-7edc-4dac-bb13-b73f6b0e6f2b req-facd7c52-1cc7-4b26-a781-be8285f81e7e service nova] Creating event network-vif-deleted:e67cd756-582f-4d99-bef6-fa5bc89db4f3 for instance 6535537b-a849-4fd7-89ea-09bd5159ab15 on n-h1-820368-37 Sep 01 04:56:57.434848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9182c1b1-7edc-4dac-bb13-b73f6b0e6f2b req-facd7c52-1cc7-4b26-a781-be8285f81e7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038210 Sep 01 04:56:57.445854 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1130/2276] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:57.445956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2332bea5-e318-4a52-afa7-955fa074bf21 req-b1527e22-82f9-4dd9-ad4d-0b16243bfe34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa79642a-051d-4c76-b9b6-afbef5d42824", "name": "network-vif-plugged", "status": "completed", "tag": "1a2593a5-9a25-45d3-9415-62e1074708a3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:57.447724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:57.447724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:57.456899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.458148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.458803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.459817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.460472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.461076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.474165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2332bea5-e318-4a52-afa7-955fa074bf21 req-b1527e22-82f9-4dd9-ad4d-0b16243bfe34 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.474682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2332bea5-e318-4a52-afa7-955fa074bf21 req-b1527e22-82f9-4dd9-ad4d-0b16243bfe34 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.475604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2332bea5-e318-4a52-afa7-955fa074bf21 req-b1527e22-82f9-4dd9-ad4d-0b16243bfe34 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.500962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2332bea5-e318-4a52-afa7-955fa074bf21 req-b1527e22-82f9-4dd9-ad4d-0b16243bfe34 service nova] Creating event network-vif-plugged:1a2593a5-9a25-45d3-9415-62e1074708a3 for instance fa79642a-051d-4c76-b9b6-afbef5d42824 on n-h2-820368-37 Sep 01 04:56:57.511135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2332bea5-e318-4a52-afa7-955fa074bf21 req-b1527e22-82f9-4dd9-ad4d-0b16243bfe34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154025 Sep 01 04:56:57.519315 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1147/2277] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:57.525710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:57.526439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:57.548797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.549315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.549737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.550496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.551039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.551468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.942165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:57.960770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:57.962917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:57.965113 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14665cbe-c653-46ba-a114-1cfcf4016608 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2834 microversion: 2.32 time: 0.523720 Sep 01 04:56:57.966199 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1131/2278] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:56:57 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2834 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:57.973390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:57.976246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:57.976759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:57.983299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.983796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.984348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.985291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:57.986092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:57.986667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:57.988917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be663ca0-61c1-40f2-bb73-e37693806d71 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.467898 Sep 01 04:56:57.990079 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1148/2279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:57 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:57.995844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:57.996800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.003494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.004350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.005001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.005922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.006842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.007754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.019914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:56:58.118618 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-535a33f9-ccbb-4eaf-930b-3d2546db9207 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 204 len: 0 microversion: 2.1 time: 0.150476 Sep 01 04:56:58.119651 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1132/2280] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:56:57 2022] DELETE /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:58.124815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.125510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.132309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.132857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.133290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.134002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.134614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.135073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.185698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:58.194982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5dd39b1e-a75c-490b-8bc2-4b4aa42e207f tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1517 microversion: 2.1 time: 0.203226 Sep 01 04:56:58.206925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1149/2281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:57 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.206925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.206925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.211766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.212274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.212719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.213513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.213981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.214413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.219059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:58.227764 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dcc76c5-1a15-47a4-b6b7-6e43dccf4cf2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1183 microversion: 2.1 time: 0.106895 Sep 01 04:56:58.228689 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1133/2282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.233895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.234602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.250076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.250076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.250076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.250076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.250076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.250076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.266031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.266521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.266993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.267464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lazy-loading 'fault' on Instance uuid 943d4f75-5e82-407d-a752-7bf18308d1ce {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:56:58.348490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:58.363939 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c55a76e5-2212-4869-aed1-ea8b0138cc4d tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 200 len: 1311 microversion: 2.1 time: 0.167066 Sep 01 04:56:58.365581 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1150/2283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 1311 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.373304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.376961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.388232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.388728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.389399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.391093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.391754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.393015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.423682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb9f4c35-efff-409c-9c4b-16057a0128db tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.193645 Sep 01 04:56:58.424288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1134/2284] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1/os-interface => generated 1832 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:56:58.430937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.431811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.438849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.439615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.440797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.441660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.451771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.452550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.711452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:58.726850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:58.736783 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99d94066-b296-4b0b-8e8b-b63a565757e5 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1647 microversion: 2.1 time: 0.367523 Sep 01 04:56:58.737270 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac61ca50-3cc9-4df5-adbc-53750006c707 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 200 len: 1517 microversion: 2.1 time: 0.311612 Sep 01 04:56:58.738253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1135/2285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.743700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.744268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.751049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.751698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.752131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.752982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.753585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.754006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.772578 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1151/2286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1647 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.783602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:58.784396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:58.791493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.792413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.793044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.793907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:58.794517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:58.795188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:58.825236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:56:58.944161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:58.949770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.964262 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01f99eb6-3e5a-4a91-92e4-1b7c2394f88f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.222368 Sep 01 04:56:58.970822 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1136/2287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.977082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e5fdb94c-4022-428b-a1db-10d0debc0a1b req-7f34a908-2b4e-46c0-b8da-4886e6587049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "943d4f75-5e82-407d-a752-7bf18308d1ce", "name": "network-vif-deleted", "tag": "83e1d7a4-e73d-4932-88bf-debb22e0f2dd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:58.996017 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d77180e-f0a5-4ff5-b2ce-40ba67b0bfe5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 204 len: 0 microversion: 2.1 time: 0.219921 Sep 01 04:56:58.996902 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1152/2288] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:56:58 2022] DELETE /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:59.000609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5fdb94c-4022-428b-a1db-10d0debc0a1b req-7f34a908-2b4e-46c0-b8da-4886e6587049 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.001457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5fdb94c-4022-428b-a1db-10d0debc0a1b req-7f34a908-2b4e-46c0-b8da-4886e6587049 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.002102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5fdb94c-4022-428b-a1db-10d0debc0a1b req-7f34a908-2b4e-46c0-b8da-4886e6587049 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.017944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.018898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.021267 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e5fdb94c-4022-428b-a1db-10d0debc0a1b req-7f34a908-2b4e-46c0-b8da-4886e6587049 service nova] Creating event network-vif-deleted:83e1d7a4-e73d-4932-88bf-debb22e0f2dd for instance 943d4f75-5e82-407d-a752-7bf18308d1ce on n-h1-820368-37 Sep 01 04:56:59.026741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.027056 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e5fdb94c-4022-428b-a1db-10d0debc0a1b req-7f34a908-2b4e-46c0-b8da-4886e6587049 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054423 Sep 01 04:56:59.028138 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1137/2289] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:56:59.030976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.031586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.032417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.032963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.033848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.038849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.040305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.049082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.049683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.050185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.051774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.052354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.053153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.299824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:59.306916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:59.310272 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ebbfc6f-b2c8-4442-ae5d-b544ad9b2e32 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.280649 Sep 01 04:56:59.319050 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1138/2290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:59 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:59.319050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.319455 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57bba1a1-c2ec-47be-ad79-584a68f4b309 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 200 len: 1523 microversion: 2.1 time: 0.315120 Sep 01 04:56:59.319538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.328144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.329199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.329637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.330346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.330957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.331540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.331734 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1153/2291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:58 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:59.391095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.392512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 943d4f75-5e82-407d-a752-7bf18308d1ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.397995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:59.406869 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bab2d3ca-0c41-4838-86ea-a9ba3e6e2099 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1183 microversion: 2.1 time: 0.094557 Sep 01 04:56:59.420579 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1139/2292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:59 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:59.420812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.420812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.420812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.420812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.420812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.420812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.438494 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] HTTP exception thrown: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce could not be found. Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Request method failure captured: Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce HTTP/1.1 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtco3LllIhsOL3G-l33mW3TnEoDFdYmY55smUprF_1hbkfYgRefw3mFwjoKupP1XszjPZZG7-FXa7m8GKZl-zjVUjtiTvVhQRStRw_m0o-XvWV8tcD18lokkDXMV5BoGCp6aIXq3OWsE7WCdZXNLGys7ujYGN6AqUNjsZw1Js-e4_4 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 24e7cb0f97274583a7089105f884024f Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2122923042 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24e7cb0f97274583a7089105f884024f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24e7cb0f97274583a7089105f884024f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24e7cb0f97274583a7089105f884024f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24e7cb0f97274583a7089105f884024f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2122923042 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 24e7cb0f97274583a7089105f884024f Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2122923042 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-2122923042-project Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ee99b34c78f648d09c60cbce4820ef54 Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2122923042-project Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce could not be found. Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '943d4f75-5e82-407d-a752-7bf18308d1ce'} Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce could not be found. Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce could not be found. Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:59.439933 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce could not be found. Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Returning 404 to user: Instance 943d4f75-5e82-407d-a752-7bf18308d1ce could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf7db4ab-6af5-42b8-b588-b12fd642c221 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce" status: 404 len: 111 microversion: 2.1 time: 0.057224 Sep 01 04:56:59.443544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1154/2293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:59 2022] GET /compute/v2.1/servers/943d4f75-5e82-407d-a752-7bf18308d1ce => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:56:59.453252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.454142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.463072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.463750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.464425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.465530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.465772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.466276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.499221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:56:59.601985 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abf16e3f-f080-487f-91fc-a976b43ab8fe tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 204 len: 0 microversion: 2.1 time: 0.154207 Sep 01 04:56:59.605839 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1140/2294] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:56:59 2022] DELETE /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:59.612559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.612559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.623233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.623778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.624209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.625240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.625690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.626127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.697222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cf8c597c-d956-489b-9d54-1fd7b4726d37 req-bfda30ec-acc9-493f-8c72-4ebad2ee8d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "tag": "c48ec7dc-e437-426b-bbc6-6eee0e32594f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:56:59.710815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf8c597c-d956-489b-9d54-1fd7b4726d37 req-bfda30ec-acc9-493f-8c72-4ebad2ee8d62 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.711386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf8c597c-d956-489b-9d54-1fd7b4726d37 req-bfda30ec-acc9-493f-8c72-4ebad2ee8d62 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.711868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cf8c597c-d956-489b-9d54-1fd7b4726d37 req-bfda30ec-acc9-493f-8c72-4ebad2ee8d62 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.729364 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cf8c597c-d956-489b-9d54-1fd7b4726d37 req-bfda30ec-acc9-493f-8c72-4ebad2ee8d62 service nova] Creating event network-changed:c48ec7dc-e437-426b-bbc6-6eee0e32594f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 04:56:59.737173 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cf8c597c-d956-489b-9d54-1fd7b4726d37 req-bfda30ec-acc9-493f-8c72-4ebad2ee8d62 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045859 Sep 01 04:56:59.737831 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1141/2295] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:56:59.779884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.781808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:56:59.786357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:59.789731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.790281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.790659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.791414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:56:59.791867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:56:59.792286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:56:59.795381 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d321ce59-311c-467f-93e8-4e27c97ad29a tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1476 microversion: 2.1 time: 0.188062 Sep 01 04:56:59.811837 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1155/2296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:59 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:59.980842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:56:59.987372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:56:59.991847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:00.002841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.006798 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3989d010-d9a7-45fc-8139-f94e53d3c9c4 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1647 microversion: 2.1 time: 0.230525 Sep 01 04:57:00.008708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.009111 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1142/2297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:59 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1647 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:00.009582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.010407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.010968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.011457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.029009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.179517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:00.188029 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b668b7c6-8d42-49fb-b02a-9e072fee822b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.204801 Sep 01 04:57:00.189025 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1156/2298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:56:59 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:00.332558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:00.333676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:00.340661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:00.341656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:00.342028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.342691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.343346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.344253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.344697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.345116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.370063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.370609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.371082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.371956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.372424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.373011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.776935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:00.794099 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34a3c035-2bde-4371-9ef3-a0fbe2af2dc7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 0.458864 Sep 01 04:57:00.795510 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1143/2299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:00 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:00.804673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:00.809012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:00.809645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:00.816276 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef3d1530-8866-4745-8f38-743c86c98773 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 200 len: 1523 microversion: 2.1 time: 0.482557 Sep 01 04:57:00.816535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.817019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.817533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.817873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1157/2300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:00 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 1523 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:00.822947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.823507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:00.823695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.824232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.824621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:00.837481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.838253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.838874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.839800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:00.840419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:00.841398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:00.920831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:00.930285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f43fd9bf-88d1-4a81-adbd-1b4d5b85b0ef tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 200 len: 1183 microversion: 2.1 time: 0.133517 Sep 01 04:57:00.931390 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1144/2301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:00 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 1183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:01.028315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:01.029064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:01.037012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.038393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.038601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:01.039181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.040013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.040578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.041240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.049766 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7d131b5-683f-46d4-af30-c657d8d08794 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1476 microversion: 2.1 time: 0.230400 Sep 01 04:57:01.050589 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1158/2302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:00 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1476 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:01.210303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:01.211702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:01.219359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.220214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.220908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.221800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.222494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.228693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.253012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:01.262700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a4471bb-4698-4005-a414-03cd76d868f3 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1647 microversion: 2.1 time: 0.238262 Sep 01 04:57:01.264126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1145/2303] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:01 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1647 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:01.371118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:01.379587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2962c419-7aec-42c8-8b50-f2ff82b0cb9d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.173688 Sep 01 04:57:01.380255 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1159/2304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:01 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:01.815643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:01.816608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:01.827928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.828742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.829339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.830218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.830818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.838638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:01.839906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:01.843813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.855069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.863876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.864868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:01.866353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:01.870400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:01.872173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:02.095774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:02.138940 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b236d226-22e8-4300-8897-0ad9fc8ec54c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 200 len: 1481 microversion: 2.1 time: 0.288204 Sep 01 04:57:02.140438 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1160/2305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:01 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 1481 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:02.166736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:02.167307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 6535537b-a849-4fd7-89ea-09bd5159ab15] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:02.181433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:02.181976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:02.182474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:02.183318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:02.192147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:02.193155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:02.225379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] HTTP exception thrown: Instance 6535537b-a849-4fd7-89ea-09bd5159ab15 could not be found. Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Request method failure captured: Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 HTTP/1.1 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm9nOt2H0Ss_KgzK_IFM3N-B1zJ-WaGabWaTFjlDCnILdurAgwbYUZGE5iQYTwvpt0_-fWHgq6Ml3djxKsSgYHuR98tr5Bw2-faxFb6AVpEWz_iSswAwYuQ5OOV_E4-j_d1QWzPeQOFEIR8h9CJdS1Q4rQL-6FuVNiIiXZE9rJmTjs Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationTest-133360327 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c067efaa01740ee9284a943d574f086 Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 6535537b-a849-4fd7-89ea-09bd5159ab15 could not be found. Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '6535537b-a849-4fd7-89ea-09bd5159ab15'} Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6535537b-a849-4fd7-89ea-09bd5159ab15 could not be found. Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6535537b-a849-4fd7-89ea-09bd5159ab15 could not be found. Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:02.227178 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6535537b-a849-4fd7-89ea-09bd5159ab15 could not be found. Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Returning 404 to user: Instance 6535537b-a849-4fd7-89ea-09bd5159ab15 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:02.231630 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ea15926-daa5-4528-96d7-c7a98360c3d1 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15" status: 404 len: 111 microversion: 2.1 time: 0.073012 Sep 01 04:57:02.239363 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1161/2306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:02 2022] GET /compute/v2.1/servers/6535537b-a849-4fd7-89ea-09bd5159ab15 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:02.249486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:02.250213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:02.268062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:02.268567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:02.269059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:02.269817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:02.270268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:02.273521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:02.996898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee99b34c78f648d09c60cbce4820ef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e7cb0f97274583a7089105f884024f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:03.007282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68210e59-39a0-47b3-81af-4cfe43c71886 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 200 len: 1434 microversion: 2.1 time: 0.766395 Sep 01 04:57:03.018910 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1162/2307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:02 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 1434 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:03.018910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:03.018910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:03.026107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.026919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.027458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.028266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.028818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.029351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.322996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:03.344453 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-409bc68d-d4b7-427d-b099-31a7a863aae5 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1325 microversion: 2.1 time: 1.532656 Sep 01 04:57:03.358925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1146/2308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:01 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1325 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:03.376625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:03.380629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:03.400589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.402453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.403674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.405253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.407076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.408943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.538134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:03.547410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03dadcff-25f6-482a-8231-f26f6edc229c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1647 microversion: 2.1 time: 0.537990 Sep 01 04:57:03.551172 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1163/2309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:03 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1647 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:03.559447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-86a3f33e-bfd0-4d39-84c8-742d94f5c7a4 req-9cbffac2-37cd-4712-9245-e1e32c3ac1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d", "name": "network-vif-deleted", "tag": "54bda722-fcc6-492f-8227-bf1c8722de1f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:03.583185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86a3f33e-bfd0-4d39-84c8-742d94f5c7a4 req-9cbffac2-37cd-4712-9245-e1e32c3ac1b4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.583952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86a3f33e-bfd0-4d39-84c8-742d94f5c7a4 req-9cbffac2-37cd-4712-9245-e1e32c3ac1b4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.594070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86a3f33e-bfd0-4d39-84c8-742d94f5c7a4 req-9cbffac2-37cd-4712-9245-e1e32c3ac1b4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.628015 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-86a3f33e-bfd0-4d39-84c8-742d94f5c7a4 req-9cbffac2-37cd-4712-9245-e1e32c3ac1b4 service nova] Creating event network-vif-deleted:54bda722-fcc6-492f-8227-bf1c8722de1f for instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d on n-h1-820368-37 Sep 01 04:57:03.648040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-86a3f33e-bfd0-4d39-84c8-742d94f5c7a4 req-9cbffac2-37cd-4712-9245-e1e32c3ac1b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092279 Sep 01 04:57:03.649932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1164/2310] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:03.664004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d24abf46-ab96-4320-804a-70f2b291b12b req-96a28881-2c92-4e99-9614-da0389c5063a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "506f9a3f-69a9-4eac-9611-7b8e14a34990", "name": "network-vif-deleted", "tag": "f53cdf69-211f-4ea6-ac8f-5cfbf4e66102"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:03.677138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d24abf46-ab96-4320-804a-70f2b291b12b req-96a28881-2c92-4e99-9614-da0389c5063a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.677661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d24abf46-ab96-4320-804a-70f2b291b12b req-96a28881-2c92-4e99-9614-da0389c5063a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.678290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d24abf46-ab96-4320-804a-70f2b291b12b req-96a28881-2c92-4e99-9614-da0389c5063a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.697152 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d24abf46-ab96-4320-804a-70f2b291b12b req-96a28881-2c92-4e99-9614-da0389c5063a service nova] Creating event network-vif-deleted:f53cdf69-211f-4ea6-ac8f-5cfbf4e66102 for instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 on n-h1-820368-37 Sep 01 04:57:03.706489 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d24abf46-ab96-4320-804a-70f2b291b12b req-96a28881-2c92-4e99-9614-da0389c5063a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052736 Sep 01 04:57:03.707645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1165/2311] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:03.714400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:03.715285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:03.724163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.724697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.725586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.726009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.726574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.726876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.798952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:03.799447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:03.799876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:03.800328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lazy-loading 'fault' on Instance uuid 506f9a3f-69a9-4eac-9611-7b8e14a34990 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:03.874130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:03.882704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7db3c575-9a89-4da7-9a4c-4a27f3465fe1 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 200 len: 1313 microversion: 2.1 time: 0.173761 Sep 01 04:57:03.883653 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1166/2312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:03 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:04.031945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.034040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] [instance: 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:04.041585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.042238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.042770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.043609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.044344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.044878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.049450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:04.059862 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a439f82a-89f6-40dc-ac9a-6b1862e77867 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.709343 Sep 01 04:57:04.070040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] HTTP exception thrown: Instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d could not be found. Sep 01 04:57:04.071686 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1147/2313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:03 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Request method failure captured: Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d HTTP/1.1 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtco3LllIhsOL3G-l33mW3TnEoDFdYmY55smUprF_1hbkfYgRefw3mFwjoKupP1XszjPZZG7-FXa7m8GKZl-zjVUjtiTvVhQRStRw_m0o-XvWV8tcD18lokkDXMV5BoGCp6aIXq3OWsE7WCdZXNLGys7ujYGN6AqUNjsZw1Js-e4_4 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 24e7cb0f97274583a7089105f884024f Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2122923042 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24e7cb0f97274583a7089105f884024f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/24e7cb0f97274583a7089105f884024f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_24e7cb0f97274583a7089105f884024f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/24e7cb0f97274583a7089105f884024f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2122923042 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 24e7cb0f97274583a7089105f884024f Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2122923042 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-2122923042-project Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ee99b34c78f648d09c60cbce4820ef54 Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2122923042-project Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d could not be found. Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d'} Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d could not be found. Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d could not be found. Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.072358 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d could not be found. Sep 01 04:57:04.075813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.077895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] Returning 404 to user: Instance 0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:04.078979 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-043f3668-8d3b-4ff5-aef5-30b24e109f99 tempest-ServersAdminNegativeTestJSON-2122923042 tempest-ServersAdminNegativeTestJSON-2122923042-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d" status: 404 len: 111 microversion: 2.1 time: 0.051486 Sep 01 04:57:04.079769 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1167/2314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers/0e9409bc-06b7-4e1f-994b-2ef3ea9c0a9d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:57:04.381993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.384922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:04.404327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.405191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.405974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.408636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.414330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.414854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.571426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.572443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:04.582492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.584727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.585421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.586836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.590781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.591534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.829588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:04.843957 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48b0e81c-508f-49ef-89a9-19e5aa5279b0 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1468 microversion: 2.1 time: 0.276280 Sep 01 04:57:04.851696 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1168/2315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:04.870577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:04.880944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c72baa1-5a16-434b-83dc-58dfbb3b1be1 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1520 microversion: 2.1 time: 0.511456 Sep 01 04:57:04.898983 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1148/2316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:04.906929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.906929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:04.913187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.913810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:04.924784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.926959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.927594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.928622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.929228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.929858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.930756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.931715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:04.932347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.932923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:04.933462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.933990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:04.963516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] HTTP exception thrown: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 HTTP/1.1 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '506f9a3f-69a9-4eac-9611-7b8e14a34990'} Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.967735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 404 to user: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5edf5194-c167-48a5-8f6f-680ee8df62f3 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 404 len: 111 microversion: 2.1 time: 0.067181 Sep 01 04:57:04.971912 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1169/2317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:04.978491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] HTTP exception thrown: Instance is not a member of specified network Sep 01 04:57:04.979601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Request method failure captured: Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824/ips/invalid HTTP/1.1 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDt4P1Hi8xl94AoKiVfDc2XBw7RzWoZEMDBqt3jbb587mxu_bUkz1TmCr-Wzlgt7R0pouG70wsScHRekYwQg1Xpc-rkS_TfvFnc-lJdPISYZk9dEUmafAotj-Yxy3midgErh036lw0bjbvfBGxh9LznsnF2EE7bZiI5nVYiCb-BnMpo Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f2826413aa7a44a0853fd64434c62e7a Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f2826413aa7a44a0853fd64434c62e7a Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerAddressesNegativeTestJSON-51211287-project Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 08c9c29857a64ec6960897ea536072a2 Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-51211287-project Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance is not a member of specified network Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': 'fa79642a-051d-4c76-b9b6-afbef5d42824', 'id': 'invalid'} Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 01 04:57:04.981264 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:04.986319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:04.987448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b5a4caf-2597-490d-8833-fd25b4dfbebb tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.079197 Sep 01 04:57:04.992742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1149/2318] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824/ips/invalid => generated 91 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 04:57:04.998409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53eae4b5-bc8a-4663-8549-a52f93644599 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:04.999185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53eae4b5-bc8a-4663-8549-a52f93644599 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Failed to fetch instance by id 999 {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 04:57:04.999831 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-53eae4b5-bc8a-4663-8549-a52f93644599 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] HTTP exception thrown: Instance 999 could not be found. Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53eae4b5-bc8a-4663-8549-a52f93644599 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Request method failure captured: Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDt4P1Hi8xl94AoKiVfDc2XBw7RzWoZEMDBqt3jbb587mxu_bUkz1TmCr-Wzlgt7R0pouG70wsScHRekYwQg1Xpc-rkS_TfvFnc-lJdPISYZk9dEUmafAotj-Yxy3midgErh036lw0bjbvfBGxh9LznsnF2EE7bZiI5nVYiCb-BnMpo Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f2826413aa7a44a0853fd64434c62e7a Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f2826413aa7a44a0853fd64434c62e7a Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerAddressesNegativeTestJSON-51211287-project Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 08c9c29857a64ec6960897ea536072a2 Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-51211287-project Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 999 could not be found. Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '999'} Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 01 04:57:05.001472 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.007717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53eae4b5-bc8a-4663-8549-a52f93644599 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:05.008732 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53eae4b5-bc8a-4663-8549-a52f93644599 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.014718 Sep 01 04:57:05.013630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1150/2319] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:57:05.014700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:05.027833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.028917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:05.038100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:05.044238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.044998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.045681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.046587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.047560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.048572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.059441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.061570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.062081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.062980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.063739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.064180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.116308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:05.288502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21882d0c-a36f-46e2-bc49-01ebd6557b03 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.312563 Sep 01 04:57:05.291701 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1170/2320] 10.222.0.26 () {58 vars in 1230 bytes} [Thu Sep 1 04:57:04 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:05.300625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.307981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:05.319003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.320055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.320634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.321602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.322167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.322745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.401315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ae99dea-798b-4182-b46c-7d646fd5e81f tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 204 len: 0 microversion: 2.1 time: 0.385487 Sep 01 04:57:05.406339 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1151/2321] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:05 2022] DELETE /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:05.414562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a423c8dc-8697-4068-83a9-c34ee8627f3c req-7694cb83-54da-4c69-88a3-3854b8966393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d490dd8-5b01-4820-9370-37d90a24a24c", "name": "network-vif-plugged", "status": "completed", "tag": "283c5331-2b11-4256-8c18-a3648fa570e4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:05.429655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a423c8dc-8697-4068-83a9-c34ee8627f3c req-7694cb83-54da-4c69-88a3-3854b8966393 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.430315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a423c8dc-8697-4068-83a9-c34ee8627f3c req-7694cb83-54da-4c69-88a3-3854b8966393 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.430933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a423c8dc-8697-4068-83a9-c34ee8627f3c req-7694cb83-54da-4c69-88a3-3854b8966393 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.457018 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a423c8dc-8697-4068-83a9-c34ee8627f3c req-7694cb83-54da-4c69-88a3-3854b8966393 service nova] Creating event network-vif-plugged:283c5331-2b11-4256-8c18-a3648fa570e4 for instance 0d490dd8-5b01-4820-9370-37d90a24a24c on n-h2-820368-37 Sep 01 04:57:05.465677 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a423c8dc-8697-4068-83a9-c34ee8627f3c req-7694cb83-54da-4c69-88a3-3854b8966393 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056575 Sep 01 04:57:05.466784 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1152/2322] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:05.473228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c650481-fcdc-41e3-bb0b-a5d0b94459a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c650481-fcdc-41e3-bb0b-a5d0b94459a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 01 04:57:05.480387 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 01 04:57:05.485249 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:05.491916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c650481-fcdc-41e3-bb0b-a5d0b94459a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:05.493090 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c650481-fcdc-41e3-bb0b-a5d0b94459a4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025182 Sep 01 04:57:05.494174 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1153/2323] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:57:05.499516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.500518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:05.509015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.509890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.510553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.511747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.512389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.513038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.546413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.589241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:05.605892 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9808c23e-5853-4371-b3e4-93cc32bacb23 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.311849 Sep 01 04:57:05.609463 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1171/2324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:05.627755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.644811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:05.647974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:05.657387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.657956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.658788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.659586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.660278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.660823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.733666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:57:05.810233 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e096993-c23c-4a42-98db-52b4e5d40836 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.199590 Sep 01 04:57:05.810845 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1172/2325] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers => generated 683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:05.820565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b9a71d32-84d9-4a59-b18b-4e4684f772ee req-1d6058c4-3c26-4895-8f78-204b285e12e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "558a8f7d-f3d8-4536-a644-92259b3b5301", "name": "network-vif-deleted", "tag": "bf66f97d-2570-41d3-b24f-d326d977be7c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:05.837636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.840874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b9a71d32-84d9-4a59-b18b-4e4684f772ee req-1d6058c4-3c26-4895-8f78-204b285e12e4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.840874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b9a71d32-84d9-4a59-b18b-4e4684f772ee req-1d6058c4-3c26-4895-8f78-204b285e12e4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.841824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b9a71d32-84d9-4a59-b18b-4e4684f772ee req-1d6058c4-3c26-4895-8f78-204b285e12e4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.870877 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b9a71d32-84d9-4a59-b18b-4e4684f772ee req-1d6058c4-3c26-4895-8f78-204b285e12e4 service nova] Creating event network-vif-deleted:bf66f97d-2570-41d3-b24f-d326d977be7c for instance 558a8f7d-f3d8-4536-a644-92259b3b5301 on n-h2-820368-37 Sep 01 04:57:05.879452 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b9a71d32-84d9-4a59-b18b-4e4684f772ee req-1d6058c4-3c26-4895-8f78-204b285e12e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067312 Sep 01 04:57:05.880493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1173/2326] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:05.889598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.902991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:05.903870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Sep 01 04:57:05.905380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:05.906835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:05.915626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.916677 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c8b9ee3-a41f-4abd-a66f-dad90e0cb977 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1526 microversion: 2.1 time: 0.421106 Sep 01 04:57:05.916971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.917501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.917784 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1154/2327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1526 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:05.919906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.920891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.921716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.923267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:05.924029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:05.938101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.939092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.940019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.941154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:05.941837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:05.942549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:05.957502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:57:05.988975 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c9d511f-59a3-4f1b-b3f9-ae36b77cd5cd tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.106673 Sep 01 04:57:05.989903 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1174/2328] 10.222.0.26 () {58 vars in 1144 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:06.006325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1a330e1-eb8a-4cb2-aea0-04266cdb84e9 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.021537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.022369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.023039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.023520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lazy-loading 'fault' on Instance uuid 558a8f7d-f3d8-4536-a644-92259b3b5301 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1a330e1-eb8a-4cb2-aea0-04266cdb84e9 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: action_args: {} Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '-1' Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 01 04:57:06.025137 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 01 04:57:06.030110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.037106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1a330e1-eb8a-4cb2-aea0-04266cdb84e9 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:06.039320 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1a330e1-eb8a-4cb2-aea0-04266cdb84e9 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.038379 Sep 01 04:57:06.041342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1175/2329] 10.222.0.26 () {58 vars in 1142 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:57:06.052729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e17dd57f-6e7a-42f2-93bc-f5e210125a85 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e17dd57f-6e7a-42f2-93bc-f5e210125a85 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: action_args: {} Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'testing' Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 01 04:57:06.064808 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 01 04:57:06.070109 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:06.071774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e17dd57f-6e7a-42f2-93bc-f5e210125a85 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:06.076883 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e17dd57f-6e7a-42f2-93bc-f5e210125a85 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.027841 Sep 01 04:57:06.085317 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1176/2330] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 04:57:06 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:57:06.095593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a53750b8-61cc-451e-be0f-9a3a5fdfaebb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.101976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a53750b8-61cc-451e-be0f-9a3a5fdfaebb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:06.103044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a53750b8-61cc-451e-be0f-9a3a5fdfaebb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:06.107325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:06.115322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-a53750b8-61cc-451e-be0f-9a3a5fdfaebb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Flavor 'non_existing_flavor' could not be found {{(pid=128863) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 01 04:57:06.116683 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a53750b8-61cc-451e-be0f-9a3a5fdfaebb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.026439 Sep 01 04:57:06.119390 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-012f5a62-f4b9-4d22-8d92-5c5b84a1b9d1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1306 microversion: 2.1 time: 0.198678 Sep 01 04:57:06.127326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1177/2331] 10.222.0.26 () {58 vars in 1178 bytes} [Thu Sep 1 04:57:06 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:06.132229 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1155/2332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:05 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1306 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:06.141669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.147273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:06.148306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:06.156781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.157299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.157701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.158801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.159623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.160364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.275604 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d205b23-fa53-43ac-a216-206ddce50d56 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.144388 Sep 01 04:57:06.277260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1178/2333] 10.222.0.26 () {58 vars in 1174 bytes} [Thu Sep 1 04:57:06 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:06.299722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.307208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:06.308156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:06.315879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.316590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.317441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.319080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.320422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.320960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.631973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.632786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:06.660397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.661154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.661812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.663045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.663742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.664492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.717007 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5f3d0b8-757a-4468-aa96-02874951b2e5 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.427902 Sep 01 04:57:06.719505 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1156/2334] 10.222.0.26 () {58 vars in 1184 bytes} [Thu Sep 1 04:57:06 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:06.749225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:06.767409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:06.768323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:06.775561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.776050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.776537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.777278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.777709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.778124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.836699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:57:06.917563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:06.936238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:06.936726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:06.937158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:06.989194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:07.006928 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71e923aa-b348-4020-9aa3-551f30b4037f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.378968 Sep 01 04:57:07.007526 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1179/2335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:06 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:07.028027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.028648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:07.042603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.047847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.048379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.049135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.049615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.050040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.057931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:07.129874 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b09f1bfe-bb47-4bec-85ae-3a1b661d10ad tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 0.385461 Sep 01 04:57:07.131189 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1157/2336] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:57:06 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:07.141792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.142689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:07.155867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.156362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.156833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.157544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.157992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.158752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.236639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.237533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.238173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.238957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lazy-loading 'fault' on Instance uuid 558a8f7d-f3d8-4536-a644-92259b3b5301 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:07.275647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:07.306541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-516f723c-9a51-42aa-b0a6-923c479afbca tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1526 microversion: 2.1 time: 0.283495 Sep 01 04:57:07.307209 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1180/2337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:07 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1526 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:07.318311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:07.326308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a2ba8e7-82c9-4fc8-8dcd-5fb6fc0f04f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.332595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a2ba8e7-82c9-4fc8-8dcd-5fb6fc0f04f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:07.335235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a2ba8e7-82c9-4fc8-8dcd-5fb6fc0f04f0 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012989 Sep 01 04:57:07.335427 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e5e1b99-8a65-49c7-a46e-755d338cf341 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 200 len: 1306 microversion: 2.1 time: 0.196303 Sep 01 04:57:07.336064 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1158/2338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:07 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:07.336918 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1181/2339] 10.222.0.26 () {58 vars in 1178 bytes} [Thu Sep 1 04:57:07 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:07.353020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.359442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:07.360139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Searching by: {'deleted': False, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:07.367198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.367682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.368107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.368846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.369295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.369712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.432089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:57:07.486271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d425ae8-eba6-489a-9734-93cc33464a82 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.141224 Sep 01 04:57:07.500625 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1159/2340] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:57:07 2022] GET /compute/v2.1/servers => generated 683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:07.511201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.512216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:07.519429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.520298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.520910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.522518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.523242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.523832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.544287 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] HTTP exception thrown: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 HTTP/1.1 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '506f9a3f-69a9-4eac-9611-7b8e14a34990'} Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:07.546152 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.551284 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.553782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 404 to user: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:07.555420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d6a3e17-8df7-47d7-a551-7209ccdd479e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 404 len: 111 microversion: 2.1 time: 0.049643 Sep 01 04:57:07.566487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.567046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:07.573485 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1182/2341] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:07 2022] DELETE /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:07.580469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.581061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.581575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.582314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.582765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.583353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.618153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:07.739947 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b62399cc-0db8-4aee-85ea-c260e5d3f9ea tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 204 len: 0 microversion: 2.1 time: 0.177961 Sep 01 04:57:07.742502 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1160/2342] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:07 2022] DELETE /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:07.749715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.750224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:07.758055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.758598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.759014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.759803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.760262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.760687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.797301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:07.937573 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66882057-e83e-40a4-9198-97ca7086faeb tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 204 len: 0 microversion: 2.1 time: 0.191586 Sep 01 04:57:07.938796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1183/2343] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:07 2022] DELETE /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:07.948651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:07.949359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: 506f9a3f-69a9-4eac-9611-7b8e14a34990] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:07.961556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.962672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.963602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.964993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:07.965521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:07.966209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:07.988296 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] HTTP exception thrown: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 HTTP/1.1 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '506f9a3f-69a9-4eac-9611-7b8e14a34990'} Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.990531 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. Sep 01 04:57:07.995234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:07.997694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 404 to user: Instance 506f9a3f-69a9-4eac-9611-7b8e14a34990 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:07.999039 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5447f2db-67e3-4931-bd74-0138df5f2b05 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990" status: 404 len: 111 microversion: 2.1 time: 0.055157 Sep 01 04:57:08.003521 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1161/2344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:07 2022] GET /compute/v2.1/servers/506f9a3f-69a9-4eac-9611-7b8e14a34990 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:08.010137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:08.010857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:08.023871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.024378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.025996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.028575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.031386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.032418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.047678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:08.049914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:08.068904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.070648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.071478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.073757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.074236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.076057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.510224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:08.519906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc22ef96-4cb3-4925-baa3-fa4b0ba0fc5c tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1523 microversion: 2.1 time: 0.514889 Sep 01 04:57:08.520592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1184/2345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:08 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:08.523845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:08.526771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:08.527473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:08.534906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-865a2d00-bc88-420c-94c1-2c3d6e49a742 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.504945 Sep 01 04:57:08.535612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.536201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.536997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.538827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.539686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.540289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.545712 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1162/2346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:08 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:08.566493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:08.567729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:08.575506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.576231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.576953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.577810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.579494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.580080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.596561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:08.721740 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5cf65c4-6453-4ae4-9ad7-5a070d688e63 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 204 len: 0 microversion: 2.1 time: 0.199765 Sep 01 04:57:08.726052 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1185/2347] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:08 2022] DELETE /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:08.736109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:08.736927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:08.746647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.747351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.747940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.748756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.749307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.749837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.776011 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 HTTP/1.1 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '558a8f7d-f3d8-4536-a644-92259b3b5301'} Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:08.777912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:08.781864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79352a8f-43b2-4a1b-9641-aeaf719f06bc tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 404 len: 111 microversion: 2.1 time: 0.056147 Sep 01 04:57:08.784650 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1186/2348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:08 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:08.903122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:08.912782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9a1baab-9883-4d39-9467-63d859d02bd7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1526 microversion: 2.1 time: 0.363498 Sep 01 04:57:08.921999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1163/2349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:08 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1526 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:08.921999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:08.921999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:08.935137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.935691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.936188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:08.936915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:08.937369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:08.937796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.036837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.041030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.041556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.041999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.042740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.043238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.043716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.070817 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e91a123-d518-44e6-ab48-129fdf3329b0 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.284923 Sep 01 04:57:09.071754 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1187/2350] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:57:08 2022] GET /compute/v2.1/os-services => generated 949 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:09.083924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57b02066-fdf7-4cc9-8893-615d56d0130a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa760056550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.148927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:09.157682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b8130e6-987b-4c3b-be7e-52e2692cbcf7 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1667 microversion: 2.1 time: 0.242715 Sep 01 04:57:09.158604 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1164/2351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:08 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1667 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:09.177289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b884afac-a89f-46e4-bdbe-32860c624413 req-11bce1b1-125d-48bd-ab9c-af85299bb0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa79642a-051d-4c76-b9b6-afbef5d42824", "name": "network-vif-deleted", "tag": "1a2593a5-9a25-45d3-9415-62e1074708a3"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:09.188284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b884afac-a89f-46e4-bdbe-32860c624413 req-11bce1b1-125d-48bd-ab9c-af85299bb0dc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.188759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b884afac-a89f-46e4-bdbe-32860c624413 req-11bce1b1-125d-48bd-ab9c-af85299bb0dc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.189190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b884afac-a89f-46e4-bdbe-32860c624413 req-11bce1b1-125d-48bd-ab9c-af85299bb0dc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.202049 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b884afac-a89f-46e4-bdbe-32860c624413 req-11bce1b1-125d-48bd-ab9c-af85299bb0dc service nova] Creating event network-vif-deleted:1a2593a5-9a25-45d3-9415-62e1074708a3 for instance fa79642a-051d-4c76-b9b6-afbef5d42824 on n-h2-820368-37 Sep 01 04:57:09.208217 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b884afac-a89f-46e4-bdbe-32860c624413 req-11bce1b1-125d-48bd-ab9c-af85299bb0dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Sep 01 04:57:09.208770 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1165/2352] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:09.214289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.218075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.218561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.219802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.220117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.220572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.220999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.234711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.250937 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54f6c9d3-299d-4587-8705-d018a597de94 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040481 Sep 01 04:57:09.251857 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1166/2353] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:09.265540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.269218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.269875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.270798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.271965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.272427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.272895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.301557 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a930c26-a6da-46a5-9b0c-bc8e01589747 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040342 Sep 01 04:57:09.308847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1167/2354] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/os-services => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:09.315695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.319933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.320505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.321075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.321842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.322504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.323136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.352120 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f9278cf-72b7-4e9b-8e1f-3a43c444198c tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-820368-37&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.040663 Sep 01 04:57:09.352957 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1168/2355] 10.222.0.26 () {58 vars in 1196 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/os-services?host=n-d-820368-37&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:09.365789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.373879 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57b02066-fdf7-4cc9-8893-615d56d0130a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c" status: 202 len: 0 microversion: 2.1 time: 0.300674 Sep 01 04:57:09.374590 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1188/2356] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:09 2022] DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:09.380326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.382209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.382748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.384970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.385468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.385974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.400907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-838dc856-afd7-41c2-98a7-a359f442c40a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bd18430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.417376 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae221ae6-b2b6-48fe-9867-3d85a3d26061 tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.055685 Sep 01 04:57:09.420218 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1169/2357] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/os-services => generated 949 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:09.430423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.434402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.435138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.435592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.436543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.436980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.437417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.465251 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e1558c5-3fbe-4653-aab4-16301d274c5f tempest-ServicesAdminNegativeTestJSON-33906620 tempest-ServicesAdminNegativeTestJSON-33906620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.038860 Sep 01 04:57:09.466454 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1170/2358] 10.222.0.26 () {58 vars in 1198 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:57:09.651230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67699568-18be-4603-af19-1648c15bc4ce tempest-ServicesAdminNegativeTestJSON-1457744939 tempest-ServicesAdminNegativeTestJSON-1457744939-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.656037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67699568-18be-4603-af19-1648c15bc4ce tempest-ServicesAdminNegativeTestJSON-1457744939 tempest-ServicesAdminNegativeTestJSON-1457744939-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f39cab215c444089bc97b18fdd7f2973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c08fe66a326462398acd4376ba1f378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67699568-18be-4603-af19-1648c15bc4ce tempest-ServicesAdminNegativeTestJSON-1457744939 tempest-ServicesAdminNegativeTestJSON-1457744939-project] Request method failure captured: Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDuju0rxm2FBGE9DVe4HNxA4wzg8L0jqR8_-Judyw6V65EPQ7ZCyal_2asvtvIQNmTaJIK6p2iQM9UWk8xc2vOBnxDZq8mzOkYolNCBqfamd5G3Pmb3TiKaTmL52J7OouNUsGQjH-ihGqdwqiaIL9nNSADYX22ZfGT7kuypN3cd4njE Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 6c08fe66a326462398acd4376ba1f378 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1457744939 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c08fe66a326462398acd4376ba1f378"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c08fe66a326462398acd4376ba1f378"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c08fe66a326462398acd4376ba1f378"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c08fe66a326462398acd4376ba1f378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1457744939 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 6c08fe66a326462398acd4376ba1f378 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1457744939 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServicesAdminNegativeTestJSON-1457744939-project Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f39cab215c444089bc97b18fdd7f2973 Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1457744939-project Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 01 04:57:09.666076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67699568-18be-4603-af19-1648c15bc4ce tempest-ServicesAdminNegativeTestJSON-1457744939 tempest-ServicesAdminNegativeTestJSON-1457744939-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67699568-18be-4603-af19-1648c15bc4ce tempest-ServicesAdminNegativeTestJSON-1457744939 tempest-ServicesAdminNegativeTestJSON-1457744939-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.194292 Sep 01 04:57:09.680768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1171/2359] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/os-services => generated 112 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:09.682400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.682400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:09.689263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.690165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.690661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.691438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:09.691876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:09.692302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:09.925959 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-838dc856-afd7-41c2-98a7-a359f442c40a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab" status: 202 len: 0 microversion: 2.1 time: 0.545887 Sep 01 04:57:09.926954 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1189/2360] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:09 2022] DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:09.977159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:09.984726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:10.011405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.016012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.022583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.027778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.034212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.035450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.065478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:10.089294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f8907dc-e95f-4739-b46f-116a06aaa34e tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1523 microversion: 2.1 time: 0.417055 Sep 01 04:57:10.094345 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1172/2361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:10.100164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43287897-cc30-4140-bc18-d23cf81dea94 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'create', calling method: .version_select at 0x7fa75b6f58b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1246219599", "description": "tempest-description-632537860"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:10.455445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:10.465345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2c8869f-1809-47e1-aeb8-8467fc4bd5ec tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1312 microversion: 2.1 time: 0.535536 Sep 01 04:57:10.465956 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1190/2362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:09 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:10.470600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:10.471239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:10.501786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.502295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.502775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.503557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.504016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.504506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.560485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.561215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.562545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.563388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lazy-loading 'fault' on Instance uuid fa79642a-051d-4c76-b9b6-afbef5d42824 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:10.709672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08c9c29857a64ec6960897ea536072a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2826413aa7a44a0853fd64434c62e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:10.723305 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1db684a3-b572-494b-91da-788794a625f6 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 200 len: 1315 microversion: 2.1 time: 0.252063 Sep 01 04:57:10.724139 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1191/2363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:10 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:10.740161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:10.741161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:10.748269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.752306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.753004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.757631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:10.758500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:10.759117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:10.924509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:10.941165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0afc8ef-a3d5-46c0-a018-32c7f8f6c891 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 200 len: 1599 microversion: 2.1 time: 0.203941 Sep 01 04:57:10.943545 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1192/2364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:10 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:10.996547 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43287897-cc30-4140-bc18-d23cf81dea94 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.894142 Sep 01 04:57:11.022965 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1173/2365] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:57:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:11.027549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b2e596b-3c4a-4dd5-a08a-34d7b18b6827 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Action: 'update', calling method: .version_select at 0x7fa7604c19d0>, body: {"security_group": {"name": "tempest-sg-hth-411965651", "description": "tempest-description-hth-1871425592"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:11.091395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5b2ae65f-d9c6-4632-b855-968cf124e4b1 req-5c772809-59c7-431e-84db-873a2ba95e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b21455b-3a86-47bf-a77f-098f46a1e18e", "name": "network-vif-deleted", "tag": "505d6c37-58cb-45c9-a9d6-0f8252a15906"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:11.125272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5b2ae65f-d9c6-4632-b855-968cf124e4b1 req-5c772809-59c7-431e-84db-873a2ba95e74 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:11.125807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5b2ae65f-d9c6-4632-b855-968cf124e4b1 req-5c772809-59c7-431e-84db-873a2ba95e74 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:11.128229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5b2ae65f-d9c6-4632-b855-968cf124e4b1 req-5c772809-59c7-431e-84db-873a2ba95e74 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:11.157959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5b2ae65f-d9c6-4632-b855-968cf124e4b1 req-5c772809-59c7-431e-84db-873a2ba95e74 service nova] Creating event network-vif-deleted:505d6c37-58cb-45c9-a9d6-0f8252a15906 for instance 0b21455b-3a86-47bf-a77f-098f46a1e18e on n-h1-820368-37 Sep 01 04:57:11.171568 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5b2ae65f-d9c6-4632-b855-968cf124e4b1 req-5c772809-59c7-431e-84db-873a2ba95e74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089050 Sep 01 04:57:11.174737 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1174/2366] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:11.190733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:11.191826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:11.203675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:11.204179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:11.204602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:11.205472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:11.205933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:11.210694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.010648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:12.015098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:12.021777 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68196040-46ec-4f20-a60d-04d6d3d1f688 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1523 microversion: 2.1 time: 0.843792 Sep 01 04:57:12.025144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1175/2367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:11 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1523 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:12.034794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9b1929ee-a47a-4481-909e-a6c457b911b1 req-4f2dead4-19f5-4ff0-aeef-ab1051d6c149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed841-c4bb-4349-a588-1e9afe86cae3", "name": "network-vif-deleted", "tag": "d49f9948-006a-471c-a4ee-03fba0f0f492"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:12.051668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b1929ee-a47a-4481-909e-a6c457b911b1 req-4f2dead4-19f5-4ff0-aeef-ab1051d6c149 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.052616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b1929ee-a47a-4481-909e-a6c457b911b1 req-4f2dead4-19f5-4ff0-aeef-ab1051d6c149 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.052616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b1929ee-a47a-4481-909e-a6c457b911b1 req-4f2dead4-19f5-4ff0-aeef-ab1051d6c149 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.066315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9b1929ee-a47a-4481-909e-a6c457b911b1 req-4f2dead4-19f5-4ff0-aeef-ab1051d6c149 service nova] Creating event network-vif-deleted:d49f9948-006a-471c-a4ee-03fba0f0f492 for instance b2bed841-c4bb-4349-a588-1e9afe86cae3 on n-h1-820368-37 Sep 01 04:57:12.072103 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9b1929ee-a47a-4481-909e-a6c457b911b1 req-4f2dead4-19f5-4ff0-aeef-ab1051d6c149 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045251 Sep 01 04:57:12.073066 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1176/2368] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:12.079693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.080614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:12.088176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.089010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.090308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.091346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.092065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.093156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.130664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b2e596b-3c4a-4dd5-a08a-34d7b18b6827 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/54c35a9c-d4b2-475f-8d51-e745b19a9d08" status: 200 len: 217 microversion: 2.1 time: 1.118568 Sep 01 04:57:12.138960 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1193/2369] 10.222.0.26 () {60 vars in 1290 bytes} [Thu Sep 1 04:57:11 2022] PUT /compute/v2.1/os-security-groups/54c35a9c-d4b2-475f-8d51-e745b19a9d08 => generated 217 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:12.147189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.148415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] [instance: fa79642a-051d-4c76-b9b6-afbef5d42824] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:12.156258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.157060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.157871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.159316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.160126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.160755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.190675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] HTTP exception thrown: Instance fa79642a-051d-4c76-b9b6-afbef5d42824 could not be found. Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Request method failure captured: Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 HTTP/1.1 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDt4P1Hi8xl94AoKiVfDc2XBw7RzWoZEMDBqt3jbb587mxu_bUkz1TmCr-Wzlgt7R0pouG70wsScHRekYwQg1Xpc-rkS_TfvFnc-lJdPISYZk9dEUmafAotj-Yxy3midgErh036lw0bjbvfBGxh9LznsnF2EE7bZiI5nVYiCb-BnMpo Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f2826413aa7a44a0853fd64434c62e7a Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2826413aa7a44a0853fd64434c62e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f2826413aa7a44a0853fd64434c62e7a Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-51211287 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerAddressesNegativeTestJSON-51211287-project Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 08c9c29857a64ec6960897ea536072a2 Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-51211287-project Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance fa79642a-051d-4c76-b9b6-afbef5d42824 could not be found. Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'fa79642a-051d-4c76-b9b6-afbef5d42824'} Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa79642a-051d-4c76-b9b6-afbef5d42824 could not be found. Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa79642a-051d-4c76-b9b6-afbef5d42824 could not be found. Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.196025 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa79642a-051d-4c76-b9b6-afbef5d42824 could not be found. Sep 01 04:57:12.199695 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.203120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] Returning 404 to user: Instance fa79642a-051d-4c76-b9b6-afbef5d42824 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:12.205629 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a68f9a4-cbee-408e-bfbe-6ce8fe1f28c7 tempest-ServerAddressesNegativeTestJSON-51211287 tempest-ServerAddressesNegativeTestJSON-51211287-project] 10.222.0.26 "GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824" status: 404 len: 111 microversion: 2.1 time: 0.064068 Sep 01 04:57:12.208193 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1194/2370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:12 2022] GET /compute/v2.1/servers/fa79642a-051d-4c76-b9b6-afbef5d42824 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:12.218424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.224316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: 0b21455b-3a86-47bf-a77f-098f46a1e18e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:12.239012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.242948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.243547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.246466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.248190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.248684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.279356 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] HTTP exception thrown: Instance 0b21455b-3a86-47bf-a77f-098f46a1e18e could not be found. Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Request method failure captured: Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e HTTP/1.1 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm9nOt2H0Ss_KgzK_IFM3N-B1zJ-WaGabWaTFjlDCnILdurAgwbYUZGE5iQYTwvpt0_-fWHgq6Ml3djxKsSgYHuR98tr5Bw2-faxFb6AVpEWz_iSswAwYuQ5OOV_E4-j_d1QWzPeQOFEIR8h9CJdS1Q4rQL-6FuVNiIiXZE9rJmTjs Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationTest-133360327 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c067efaa01740ee9284a943d574f086 Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 0b21455b-3a86-47bf-a77f-098f46a1e18e could not be found. Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0b21455b-3a86-47bf-a77f-098f46a1e18e'} Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b21455b-3a86-47bf-a77f-098f46a1e18e could not be found. Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b21455b-3a86-47bf-a77f-098f46a1e18e could not be found. Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:12.282562 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b21455b-3a86-47bf-a77f-098f46a1e18e could not be found. Sep 01 04:57:12.287827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:12.289639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Returning 404 to user: Instance 0b21455b-3a86-47bf-a77f-098f46a1e18e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:12.290712 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-100c146a-94e9-4c45-98a8-8466089df82b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e" status: 404 len: 111 microversion: 2.1 time: 0.080507 Sep 01 04:57:12.295916 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1195/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:12 2022] GET /compute/v2.1/servers/0b21455b-3a86-47bf-a77f-098f46a1e18e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:12.301606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45c3a301-af25-4d71-b798-8a8346e56b47 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa760043790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.489453 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45c3a301-af25-4d71-b798-8a8346e56b47 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/54c35a9c-d4b2-475f-8d51-e745b19a9d08" status: 200 len: 217 microversion: 2.1 time: 0.192298 Sep 01 04:57:12.490086 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1196/2372] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 04:57:12 2022] GET /compute/v2.1/os-security-groups/54c35a9c-d4b2-475f-8d51-e745b19a9d08 => generated 217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:12.495186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2863df31-fdaf-45c4-ac13-1a87a5b47395 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '.version_select at 0x7fa760056790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.527766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:12.544187 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2863df31-fdaf-45c4-ac13-1a87a5b47395 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575979223" status: 202 len: 0 microversion: 2.1 time: 0.052575 Sep 01 04:57:12.544830 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1197/2373] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1575979223 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:12.548281 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7999b68d-8e9a-493d-a8d8-0a67dfcc3c93 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1462 microversion: 2.1 time: 0.468673 Sep 01 04:57:12.559986 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1177/2374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:12 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1462 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:12.560222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3819654-b47d-4586-98d2-65620684637c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75b4f4b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.572964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:12.576639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:12.586682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.587522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.588179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.589184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.590190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.590839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.729823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:12.739094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 04:57:12.756892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:57:12.757899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:57:12.757899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:57:12.758915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:57:12.759128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:57:12.934028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e15acf53-3387-4e2d-8826-aafdce8a76db tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c/action" status: 202 len: 0 microversion: 2.1 time: 0.366191 Sep 01 04:57:12.938117 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1178/2375] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:57:12 2022] POST /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:12.943571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:12.944354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:12.951410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.951904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.952339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:12.953055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:12.953501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:12.953916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.518145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:13.529918 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0e06226-2360-4429-9aa4-95122c0a47d3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1471 microversion: 2.1 time: 0.590582 Sep 01 04:57:13.548053 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1179/2376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:12 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1471 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:13.556605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:13.557306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:13.576381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.577030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.577670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.580163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.581389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.582678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.608765 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3819654-b47d-4586-98d2-65620684637c tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/54c35a9c-d4b2-475f-8d51-e745b19a9d08" status: 202 len: 0 microversion: 2.1 time: 1.062215 Sep 01 04:57:13.610793 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1198/2377] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:12 2022] DELETE /compute/v2.1/os-security-groups/54c35a9c-d4b2-475f-8d51-e745b19a9d08 => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:13.624296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:13.625633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:13.655787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.658816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.659431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.663204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.664980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.666275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.699274 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.700514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 HTTP/1.1 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '558a8f7d-f3d8-4536-a644-92259b3b5301'} Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:13.701484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.705078 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.705678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.705678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.707326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lazy-loading 'fault' on Instance uuid d736779b-121f-4fda-93a1-4c27bb7e33eb {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:13.708020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:13.732258 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84e20094-25d2-4369-b327-9ad368f2faaa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 404 len: 111 microversion: 2.1 time: 0.117293 Sep 01 04:57:13.733335 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1199/2378] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:13 2022] DELETE /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:57:13.745484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:13.746252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 558a8f7d-f3d8-4536-a644-92259b3b5301] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:13.762054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.762266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.762730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.763585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:13.764054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:13.764487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:13.796371 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 HTTP/1.1 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '558a8f7d-f3d8-4536-a644-92259b3b5301'} Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.798030 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. Sep 01 04:57:13.803262 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.804523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Instance 558a8f7d-f3d8-4536-a644-92259b3b5301 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:13.806858 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f711eb8-6037-4828-9066-d66742af664f tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301" status: 404 len: 111 microversion: 2.1 time: 0.068407 Sep 01 04:57:13.807491 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1200/2379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:13 2022] GET /compute/v2.1/servers/558a8f7d-f3d8-4536-a644-92259b3b5301 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:13.818823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bc328b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:13.845114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31906a3e93045b38459f9ea31225e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7bd356b55b4fd996c4446c4abe520d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:13.862826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:57:13.863718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 7c47f1dd-3515-4fcb-ba42-795395af39ab not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:57:13.864235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.864235 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab HTTP/1.1 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7c47f1dd-3515-4fcb-ba42-795395af39ab'} Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:57:13.866502 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 7c47f1dd-3515-4fcb-ba42-795395af39ab does not exist Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a62b5b2c-6d2f-405c-8099-94223390632b'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41dcbabd-0e55-4a86-b888-10b9d3badbba tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab" status: 404 len: 194 microversion: 2.1 time: 0.056088 Sep 01 04:57:13.870085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1201/2380] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:13 2022] DELETE /compute/v2.1/os-security-groups/7c47f1dd-3515-4fcb-ba42-795395af39ab => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:57:13.876754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bf39af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:13.888032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a6b1fc0-bae0-4216-a59e-12f1bbe1c889 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 200 len: 1313 microversion: 2.1 time: 0.337486 Sep 01 04:57:13.890446 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1180/2381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:13 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:13.955050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:57:13.956097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 64681e3c-7cc2-48ac-9e35-cf743009944c not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:57:13.956911 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.956911 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c HTTP/1.1 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '64681e3c-7cc2-48ac-9e35-cf743009944c'} Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:57:13.959242 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] Sep 01 04:57:13.962641 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:13.968412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 64681e3c-7cc2-48ac-9e35-cf743009944c does not exist Sep 01 04:57:13.968412 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-49bc2233-6519-4f8c-adcd-479220f0c61e'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:13.969658 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96987cf9-3212-43cf-b807-a1929652902b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c" status: 404 len: 194 microversion: 2.1 time: 0.096601 Sep 01 04:57:13.970653 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1202/2382] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:13 2022] DELETE /compute/v2.1/os-security-groups/64681e3c-7cc2-48ac-9e35-cf743009944c => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:13.981350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bc703a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.032072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:57:14.032937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:57:14.033901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.033901 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a HTTP/1.1 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '1c6ef844-1ab1-477b-9d00-dbd050a72c1a'} Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:57:14.036245 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 1c6ef844-1ab1-477b-9d00-dbd050a72c1a does not exist Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-4d42d90d-20fc-4410-b9df-d8a2cdf12cec'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8bf8f22e-bc05-471c-8574-e14aee6b7efa tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a" status: 404 len: 194 microversion: 2.1 time: 0.062634 Sep 01 04:57:14.040588 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1181/2383] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:13 2022] DELETE /compute/v2.1/os-security-groups/1c6ef844-1ab1-477b-9d00-dbd050a72c1a => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:14.051930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa760043e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.107516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-78c838b8-15a8-4494-a075-719635f16f01 req-635c0498-1378-4706-97ac-485ae89a2453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d736779b-121f-4fda-93a1-4c27bb7e33eb", "name": "network-vif-deleted", "tag": "127d6758-9ca0-42e0-9e45-ed6505a6f2cf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:14.114777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:57:14.115541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 9bad736e-a571-433d-8c39-08eac2f306bf not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:57:14.116245 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.116245 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf HTTP/1.1 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9bad736e-a571-433d-8c39-08eac2f306bf'} Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:57:14.121250 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 9bad736e-a571-433d-8c39-08eac2f306bf does not exist Sep 01 04:57:14.125501 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6ba72dd1-58a3-4362-b94c-227629ead825'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:14.132701 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8738bdd5-3f09-480b-8858-b2bc1819b3ff tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf" status: 404 len: 194 microversion: 2.1 time: 0.083392 Sep 01 04:57:14.136533 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1203/2384] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:14 2022] DELETE /compute/v2.1/os-security-groups/9bad736e-a571-433d-8c39-08eac2f306bf => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:14.136703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-78c838b8-15a8-4494-a075-719635f16f01 req-635c0498-1378-4706-97ac-485ae89a2453 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.138008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-78c838b8-15a8-4494-a075-719635f16f01 req-635c0498-1378-4706-97ac-485ae89a2453 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.139819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-78c838b8-15a8-4494-a075-719635f16f01 req-635c0498-1378-4706-97ac-485ae89a2453 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.147999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bf394c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.160472 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-78c838b8-15a8-4494-a075-719635f16f01 req-635c0498-1378-4706-97ac-485ae89a2453 service nova] Creating event network-vif-deleted:127d6758-9ca0-42e0-9e45-ed6505a6f2cf for instance d736779b-121f-4fda-93a1-4c27bb7e33eb on n-h2-820368-37 Sep 01 04:57:14.171690 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-78c838b8-15a8-4494-a075-719635f16f01 req-635c0498-1378-4706-97ac-485ae89a2453 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071845 Sep 01 04:57:14.172625 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1182/2385] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:14.233791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:57:14.234568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:57:14.235193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.235193 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 HTTP/1.1 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'c2c8a0ce-83b1-4421-8851-d1adfdcc43e0'} Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:57:14.238382 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 does not exist Sep 01 04:57:14.242548 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a2bd9e33-3341-4b36-ac2b-7439a88befd2'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:14.250120 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8d6c1c4-6f2a-4cc5-82dc-2dae9b90f07d tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0" status: 404 len: 194 microversion: 2.1 time: 0.104755 Sep 01 04:57:14.250120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1204/2386] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:14 2022] DELETE /compute/v2.1/os-security-groups/c2c8a0ce-83b1-4421-8851-d1adfdcc43e0 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:14.253342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa75bc70700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.307443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.308451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:14.319055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.319968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.320965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.323321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.324622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 04:57:14.325377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Neutron security group 7066420f-2051-491a-8d53-5c6d9f158774 not found {{(pid=128862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 04:57:14.325998 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.325998 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] Sep 01 04:57:14.327316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774 HTTP/1.1 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: exception: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7066420f-2051-491a-8d53-5c6d9f158774'} Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 04:57:14.328190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Security group 7066420f-2051-491a-8d53-5c6d9f158774 does not exist Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: Neutron server returns request_ids: ['req-77d1dda7-e176-407c-8601-9eb90369e19f'] {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4dd8299-8cda-44b0-954a-57a3f0397d12 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774" status: 404 len: 194 microversion: 2.1 time: 0.081059 Sep 01 04:57:14.335697 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1183/2387] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:14 2022] DELETE /compute/v2.1/os-security-groups/7066420f-2051-491a-8d53-5c6d9f158774 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:14.341845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.342998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.349165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:14.362184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.362755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.363304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.364097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.364650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.365223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.405522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:14.411265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:14.556366 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2fe4605-2b3b-409e-8888-e4ed0f67a8b6 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 204 len: 0 microversion: 2.1 time: 0.256579 Sep 01 04:57:14.559518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cfe833b3-f995-45ed-b126-da58d7b5eb9e tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 204 len: 0 microversion: 2.1 time: 0.221960 Sep 01 04:57:14.560104 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1184/2388] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:14 2022] DELETE /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:14.566153 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1205/2389] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:14 2022] DELETE /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:14.576525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.577148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:14.581478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.582460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:14.590203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.591080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.591670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.592572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.593190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.593825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.593936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.594426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.594868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.595616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:14.596080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:14.596516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:14.930228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:14.952646 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3dca110-a498-44eb-b799-96c803f5f7cf tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1485 microversion: 2.1 time: 0.383905 Sep 01 04:57:14.952752 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1206/2390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:14 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1485 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:14.969626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:14.981068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:14.983148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:14.992703 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-accc8fa8-8b64-4749-9401-2800efcb8aab tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1471 microversion: 2.1 time: 0.422049 Sep 01 04:57:14.994776 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1185/2391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:14 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:15.001270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.004559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.005046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.005862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.006324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.006746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.011777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:15.013622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: d736779b-121f-4fda-93a1-4c27bb7e33eb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:15.023695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:15.033881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.034423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.035955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.037763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.039725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.040187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.082137 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] HTTP exception thrown: Instance d736779b-121f-4fda-93a1-4c27bb7e33eb could not be found. Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb HTTP/1.1 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d736779b-121f-4fda-93a1-4c27bb7e33eb could not be found. Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd736779b-121f-4fda-93a1-4c27bb7e33eb'} Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d736779b-121f-4fda-93a1-4c27bb7e33eb could not be found. Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d736779b-121f-4fda-93a1-4c27bb7e33eb could not be found. Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.084925 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d736779b-121f-4fda-93a1-4c27bb7e33eb could not be found. Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 404 to user: Instance d736779b-121f-4fda-93a1-4c27bb7e33eb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:15.089511 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22e65136-4981-4356-94c1-88195eb6a820 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb" status: 404 len: 111 microversion: 2.1 time: 0.090771 Sep 01 04:57:15.090593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1186/2392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:14 2022] GET /compute/v2.1/servers/d736779b-121f-4fda-93a1-4c27bb7e33eb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:15.096767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:15.098061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] [instance: b2bed841-c4bb-4349-a588-1e9afe86cae3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:15.106673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.107516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.108338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.109245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.110109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.110731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.145870 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] HTTP exception thrown: Instance b2bed841-c4bb-4349-a588-1e9afe86cae3 could not be found. Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Request method failure captured: Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 HTTP/1.1 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDtztir-34faiIx67dmkbzwsX_PmS-_F9HJIKRDxpbpoIG47_DzBHAr6Hq9E4xPPptpymEiD-M72hdH9Jf0zeJz1E2X3mEzSe6ky3woVzDvwYthnXSLf6vGUQwKE8oIqVjHtOYNYY-GLEuAvGnMQCpTlgu7--8IZEQjM_FfeDunWcl4 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab7bd356b55b4fd996c4446c4abe520d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ab7bd356b55b4fd996c4446c4abe520d Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-202727079 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d31906a3e93045b38459f9ea31225e79 Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListServersNegativeTestJSON-202727079-project Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b2bed841-c4bb-4349-a588-1e9afe86cae3 could not be found. Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b2bed841-c4bb-4349-a588-1e9afe86cae3'} Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bed841-c4bb-4349-a588-1e9afe86cae3 could not be found. Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bed841-c4bb-4349-a588-1e9afe86cae3 could not be found. Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.148135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bed841-c4bb-4349-a588-1e9afe86cae3 could not be found. Sep 01 04:57:15.151734 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:15.153999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] Returning 404 to user: Instance b2bed841-c4bb-4349-a588-1e9afe86cae3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:15.155311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f8f9672-88c5-4ab7-a45d-d399df2ee8e4 tempest-ListServersNegativeTestJSON-202727079 tempest-ListServersNegativeTestJSON-202727079-project] 10.222.0.26 "GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3" status: 404 len: 111 microversion: 2.1 time: 0.063406 Sep 01 04:57:15.156168 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1187/2393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:15 2022] GET /compute/v2.1/servers/b2bed841-c4bb-4349-a588-1e9afe86cae3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:15.611397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:15.622035 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d0d8df0-c0b9-43e0-a41c-a2f6c4e43b5b tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1648 microversion: 2.1 time: 0.667360 Sep 01 04:57:15.637087 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1207/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:14 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1648 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:15.973928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:15.975243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:15.988507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.989009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.989451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:15.990255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:15.990719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:15.991174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.043161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:16.044401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:16.064693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.069679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.073153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.076185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.076871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.079120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.615964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:16.627334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e316f72-be19-449b-86f7-bc8aba8a8323 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1485 microversion: 2.1 time: 0.658003 Sep 01 04:57:16.632652 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1188/2395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:15 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1485 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:16.645755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:16.646811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:16.659360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.659896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.660333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.661064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.661522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.667346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.668265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:16.701101 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72a33ca8-b918-40c3-a4b2-966eff91fcfc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1471 microversion: 2.1 time: 0.675197 Sep 01 04:57:16.703002 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1208/2396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:16 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1471 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:16.778524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:16.788127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:16.789468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Searching by: {'deleted': False, 'project_id': '568534cc6c9e45fea2f352a241b54e78'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:16.806265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.807592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.808574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.809647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.811100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.812111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:16.861006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:57:16.909471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:16.929278 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3efd07d4-dbb1-48ed-8f1a-2161e569fcb9 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.155440 Sep 01 04:57:16.929898 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1209/2397] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 04:57:16 2022] GET /compute/v2.1/servers => generated 334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:16.944541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:16.959672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:16.960957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Searching by: {'deleted': False, 'project_id': '568534cc6c9e45fea2f352a241b54e78'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 04:57:16.988150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:16.990539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:16.991013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:17.010167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:17.010671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:17.011134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:17.073137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 04:57:17.264056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:17.286279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:17.289556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:17.291757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:17.810978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f03d38ed204f8fad7f83808e798c5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32b56cc9bcb454e82b04772b39d3021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:17.832407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b63c576e-f34f-4340-8648-e1e64fa3b909 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 200 len: 1648 microversion: 2.1 time: 1.190476 Sep 01 04:57:17.838945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1189/2398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:16 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 1648 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:17.848541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3f7dddfb-7a6d-4bae-be02-2122f735a6b5 req-eb5ab1f8-fd71-4fbf-99b9-308168e0227b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0fd1e6-1370-45f3-a929-babdf4d83a00", "name": "network-vif-deleted", "tag": "d1c80f20-805f-4b32-ae66-153ceb23fad5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:17.877397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f7dddfb-7a6d-4bae-be02-2122f735a6b5 req-eb5ab1f8-fd71-4fbf-99b9-308168e0227b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:17.879039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f7dddfb-7a6d-4bae-be02-2122f735a6b5 req-eb5ab1f8-fd71-4fbf-99b9-308168e0227b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:17.879978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f7dddfb-7a6d-4bae-be02-2122f735a6b5 req-eb5ab1f8-fd71-4fbf-99b9-308168e0227b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:17.914579 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3f7dddfb-7a6d-4bae-be02-2122f735a6b5 req-eb5ab1f8-fd71-4fbf-99b9-308168e0227b service nova] Creating event network-vif-deleted:d1c80f20-805f-4b32-ae66-153ceb23fad5 for instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 on n-h1-820368-37 Sep 01 04:57:17.925081 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3f7dddfb-7a6d-4bae-be02-2122f735a6b5 req-eb5ab1f8-fd71-4fbf-99b9-308168e0227b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081706 Sep 01 04:57:17.926158 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1190/2399] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:17.943130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:17.948068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:17.960595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:17.961335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:17.961865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:17.962792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:17.963378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:17.963895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:18.249185 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ffce18b-a0c5-4231-805f-e06393b2dd38 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 1.299084 Sep 01 04:57:18.249895 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1210/2400] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:57:16 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:18.274208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:18.279660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:18.315528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:18.316059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:18.317315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:18.318109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:18.318572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:18.319031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:18.758854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:18.768182 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-768dfb2b-61c0-4129-b989-34497ebb103b tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 200 len: 1485 microversion: 2.1 time: 0.839731 Sep 01 04:57:18.788214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1191/2401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:17 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 1485 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:18.795480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2001ff7-e287-4436-a300-72b9c392f569 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:18.832255 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2001ff7-e287-4436-a300-72b9c392f569 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034294 Sep 01 04:57:18.834930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1192/2402] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:57:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:18.839980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fccf7ade-57e1-4bb3-9de4-0855813265b0 req-1373c26c-ac5a-4281-94e0-717293530b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5034886-1ed0-4985-988a-617e6bb57178", "name": "network-vif-deleted", "tag": "8207761b-ec9f-48b6-ab48-3831645f3314"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:18.880940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fccf7ade-57e1-4bb3-9de4-0855813265b0 req-1373c26c-ac5a-4281-94e0-717293530b0a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:18.882266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fccf7ade-57e1-4bb3-9de4-0855813265b0 req-1373c26c-ac5a-4281-94e0-717293530b0a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:18.882971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fccf7ade-57e1-4bb3-9de4-0855813265b0 req-1373c26c-ac5a-4281-94e0-717293530b0a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:18.913309 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fccf7ade-57e1-4bb3-9de4-0855813265b0 req-1373c26c-ac5a-4281-94e0-717293530b0a service nova] Creating event network-vif-deleted:8207761b-ec9f-48b6-ab48-3831645f3314 for instance c5034886-1ed0-4985-988a-617e6bb57178 on n-h1-820368-37 Sep 01 04:57:18.918744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fccf7ade-57e1-4bb3-9de4-0855813265b0 req-1373c26c-ac5a-4281-94e0-717293530b0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082356 Sep 01 04:57:18.919456 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1193/2403] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:18.926472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:18.927716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] [instance: 0e0fd1e6-1370-45f3-a929-babdf4d83a00] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:18.934790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:18.935338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:18.935975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:18.936762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:18.937286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:18.937722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:18.954174 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] HTTP exception thrown: Instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 could not be found. Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Request method failure captured: Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 HTTP/1.1 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDshGDvKFv4aduykPrXsT_OvEHxSMnys_Dox8FcWgmuusPziHPFSHMP_XDDfA942KvzJbXCMpTycVRJPAMpf15ldhEVD3NJ0f1iGsEtP8lEx83fHzcqmFevnK0LHOFeriEEo5DnMWP43ON7i3-fwIQsbJW_2_e87phJtLtclaSqhITc Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d32b56cc9bcb454e82b04772b39d3021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: d32b56cc9bcb454e82b04772b39d3021 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-418492476 Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: f5f03d38ed204f8fad7f83808e798c5a Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-SecurityGroupsTestJSON-418492476-project Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 could not be found. Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '0e0fd1e6-1370-45f3-a929-babdf4d83a00'} Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 could not be found. Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 could not be found. Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:18.955921 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 could not be found. Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Returning 404 to user: Instance 0e0fd1e6-1370-45f3-a929-babdf4d83a00 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-468ffe3c-a86c-46b2-ab8b-d95ee9b6892a tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00" status: 404 len: 111 microversion: 2.1 time: 0.036782 Sep 01 04:57:18.960233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1194/2404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:18 2022] GET /compute/v2.1/servers/0e0fd1e6-1370-45f3-a929-babdf4d83a00 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:18.970764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01f32cb7-2970-4fc6-8a02-077e8a90e946 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa7602d0dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:18.980553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:18.990233 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9900064d-6b71-4842-81ee-f5658a452bf3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1471 microversion: 2.1 time: 0.739105 Sep 01 04:57:18.990930 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1211/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:18 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1471 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:19.196207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:19.196962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:19.210476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:19.211259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:19.211846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:19.212708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:19.213314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:19.213908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:19.273160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:19.443947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.462760 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f380910-738f-4397-871a-610b351ca7d2 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 204 len: 0 microversion: 2.1 time: 0.271252 Sep 01 04:57:19.463884 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1212/2406] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:19 2022] DELETE /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:19.472989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:19.473659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:19.489550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:19.490109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:19.490671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:19.491637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:19.492290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:19.492887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:19.920924 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01f32cb7-2970-4fc6-8a02-077e8a90e946 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1fa3715b-3887-448d-87a6-7a4ba3c577e9" status: 202 len: 0 microversion: 2.1 time: 0.943044 Sep 01 04:57:19.927965 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1195/2407] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:18 2022] DELETE /compute/v2.1/os-security-groups/1fa3715b-3887-448d-87a6-7a4ba3c577e9 => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:19.930776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:19.961840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:19.968484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: c5034886-1ed0-4985-988a-617e6bb57178] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:19.979859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7cde521-77b3-400b-aa53-a578320652a7 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1700 microversion: 2.1 time: 0.504687 Sep 01 04:57:20.007047 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1213/2408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:19 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1700 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:20.027787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3186bb32-88db-435b-9a7a-55f3622991b1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] Calling method '.version_select at 0x7fa760056ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:20.031771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:20.039591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:20.041061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:20.042092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:20.042786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:20.045976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:20.070717 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] HTTP exception thrown: Instance c5034886-1ed0-4985-988a-617e6bb57178 could not be found. Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Request method failure captured: Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 HTTP/1.1 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDm9nOt2H0Ss_KgzK_IFM3N-B1zJ-WaGabWaTFjlDCnILdurAgwbYUZGE5iQYTwvpt0_-fWHgq6Ml3djxKsSgYHuR98tr5Bw2-faxFb6AVpEWz_iSswAwYuQ5OOV_E4-j_d1QWzPeQOFEIR8h9CJdS1Q4rQL-6FuVNiIiXZE9rJmTjs Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationTest-133360327 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c067efaa01740ee9284a943d574f086 Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance c5034886-1ed0-4985-988a-617e6bb57178 could not be found. Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'c5034886-1ed0-4985-988a-617e6bb57178'} Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5034886-1ed0-4985-988a-617e6bb57178 could not be found. Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5034886-1ed0-4985-988a-617e6bb57178 could not be found. Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:20.073177 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5034886-1ed0-4985-988a-617e6bb57178 could not be found. Sep 01 04:57:20.076743 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:57:20.079295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Returning 404 to user: Instance c5034886-1ed0-4985-988a-617e6bb57178 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:20.080480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06853f55-2db7-471b-a8fc-80067ef00691 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178" status: 404 len: 111 microversion: 2.1 time: 0.147660 Sep 01 04:57:20.081317 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1196/2409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:19 2022] GET /compute/v2.1/servers/c5034886-1ed0-4985-988a-617e6bb57178 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:20.087037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:20.088162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:20.096339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:20.097250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:20.097929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:20.098968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:20.099784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:20.100507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:20.989369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:21.009565 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8581038-7d18-4412-8408-f3f978e129d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1471 microversion: 2.1 time: 0.926425 Sep 01 04:57:21.023308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1197/2410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:20 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1471 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:21.037818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:21.040399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:21.054306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:21.054539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:21.054997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:21.055724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:21.056174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:21.056594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:21.106824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.116324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:57:21.326720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3be451f-71d0-4165-af3f-f20eaeb152af tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 204 len: 0 microversion: 2.1 time: 0.300694 Sep 01 04:57:21.327396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1198/2411] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:57:21 2022] DELETE /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:21.337510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:21.338231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:21.371679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:21.372184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:21.372621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:21.373424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:21.373889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:21.374445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:21.673070 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3186bb32-88db-435b-9a7a-55f3622991b1 tempest-SecurityGroupsTestJSON-418492476 tempest-SecurityGroupsTestJSON-418492476-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2259fb6d-8352-4a20-9a56-3f9cadfcc8c6" status: 202 len: 0 microversion: 2.1 time: 1.663459 Sep 01 04:57:21.680231 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1214/2412] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:57:20 2022] DELETE /compute/v2.1/os-security-groups/2259fb6d-8352-4a20-9a56-3f9cadfcc8c6 => generated 0 bytes in 1671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:21.685951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:21.687310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:21.703398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:21.704683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:21.706006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:21.707199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:21.707820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:21.708459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:22.239032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:22.251688 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72eeeb66-eda0-4522-bfec-a024f811fd87 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1700 microversion: 2.1 time: 0.921577 Sep 01 04:57:22.259158 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1199/2413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:21 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1700 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:22.273080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:22.274337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:22.294491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:22.296993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:22.300162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:22.301088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:22.303255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:22.305780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:22.627428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:22.640502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b45bdff-f48d-4004-9942-1ab4d134595e tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1501 microversion: 2.1 time: 0.958308 Sep 01 04:57:22.643893 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1215/2414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:21 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1501 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:23.093790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:23.109362 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96b3b6c0-9324-4b50-974d-e8aefd1056ca tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.846547 Sep 01 04:57:23.110998 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1200/2415] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:22 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:23.278828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:23.280233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:23.293586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:23.295555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:23.297091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:23.299430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:23.300100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:23.302951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:23.694717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:23.695550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:23.709053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:23.712533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:23.713271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:23.714994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:23.717008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:23.722746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:24.786269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:24.804753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:24.821047 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c18f92b-5f4b-427e-a7a8-50cf7237e7a2 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1501 microversion: 2.1 time: 1.131528 Sep 01 04:57:24.822145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acefb0c9-51ce-4e70-b9f1-d011f150bfe4 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1700 microversion: 2.1 time: 1.547672 Sep 01 04:57:24.838550 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1216/2416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:23 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1700 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:24.839115 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1201/2417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:23 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1501 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:24.848107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:24.849161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:24.860192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:24.861043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:24.861652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:24.863663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:24.864312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:24.866161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:25.595363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-06cbe258-244e-44d7-b9dd-09afc170596c req-7bcc2e5d-4b50-43df-8fb8-7d9e57c8eb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66d0bed-10fc-4364-a359-3a67b537dca5", "name": "network-vif-deleted", "tag": "fbeca0e3-8257-4bb7-accb-1ba5f853687d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:25.617887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06cbe258-244e-44d7-b9dd-09afc170596c req-7bcc2e5d-4b50-43df-8fb8-7d9e57c8eb07 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:25.618394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06cbe258-244e-44d7-b9dd-09afc170596c req-7bcc2e5d-4b50-43df-8fb8-7d9e57c8eb07 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:25.618827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06cbe258-244e-44d7-b9dd-09afc170596c req-7bcc2e5d-4b50-43df-8fb8-7d9e57c8eb07 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:25.654866 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-06cbe258-244e-44d7-b9dd-09afc170596c req-7bcc2e5d-4b50-43df-8fb8-7d9e57c8eb07 service nova] Creating event network-vif-deleted:fbeca0e3-8257-4bb7-accb-1ba5f853687d for instance a66d0bed-10fc-4364-a359-3a67b537dca5 on n-h1-820368-37 Sep 01 04:57:25.669152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-06cbe258-244e-44d7-b9dd-09afc170596c req-7bcc2e5d-4b50-43df-8fb8-7d9e57c8eb07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080570 Sep 01 04:57:25.672971 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1202/2418] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 01 04:57:25.847125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:25.848014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:25.862036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:25.862552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:25.863031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:25.866529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:25.867155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:25.867605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:26.158957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:26.174861 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa7db1e1-5962-4dfc-ad78-abcff54740eb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1632 microversion: 2.1 time: 0.333092 Sep 01 04:57:26.179420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1203/2419] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:25 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1632 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:26.184948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:26.185966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:26.202230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:26.204965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:26.207534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:26.208631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:26.211588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:26.212229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:26.352496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:26.355675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:26.359056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:26.359791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lazy-loading 'fault' on Instance uuid a66d0bed-10fc-4364-a359-3a67b537dca5 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:26.512673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:26.529046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1cea0cf-5ea2-49cc-80b4-a0a8d1c8c0bf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 1.688967 Sep 01 04:57:26.530220 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1217/2420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:24 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:26.585046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c067efaa01740ee9284a943d574f086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fff25d859dc49438f78d39d3e70e6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:26.596868 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e6b7088-d9c3-4e3a-a840-23ae273e4da5 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 200 len: 1301 microversion: 2.1 time: 0.419212 Sep 01 04:57:26.614749 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1204/2421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:26 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 1301 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:27.199431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:27.201365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:27.203843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.210042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:27.210621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:27.211231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:27.212251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:27.212710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:27.213132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:27.260557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.554677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:27.558114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:27.572071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:27.572898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:27.584195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:27.585422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:27.586742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:27.587456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:27.627391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:27.649101 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84666144-d831-4851-b5e2-12753e4edc4b tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1632 microversion: 2.1 time: 0.453333 Sep 01 04:57:27.667260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1218/2422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:27 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1632 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:27.673613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:27.674704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] [instance: a66d0bed-10fc-4364-a359-3a67b537dca5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:27.688439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:27.691113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:27.692306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:27.694109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:27.695146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:27.695816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:27.718127 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] HTTP exception thrown: Instance a66d0bed-10fc-4364-a359-3a67b537dca5 could not be found. Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Request method failure captured: Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 HTTP/1.1 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDm9nOt2H0Ss_KgzK_IFM3N-B1zJ-WaGabWaTFjlDCnILdurAgwbYUZGE5iQYTwvpt0_-fWHgq6Ml3djxKsSgYHuR98tr5Bw2-faxFb6AVpEWz_iSswAwYuQ5OOV_E4-j_d1QWzPeQOFEIR8h9CJdS1Q4rQL-6FuVNiIiXZE9rJmTjs Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8fff25d859dc49438f78d39d3e70e6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationTest-133360327 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8fff25d859dc49438f78d39d3e70e6f8 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationTest-133360327 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c067efaa01740ee9284a943d574f086 Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationTest-133360327-project Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a66d0bed-10fc-4364-a359-3a67b537dca5 could not be found. Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a66d0bed-10fc-4364-a359-3a67b537dca5'} Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66d0bed-10fc-4364-a359-3a67b537dca5 could not be found. Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66d0bed-10fc-4364-a359-3a67b537dca5 could not be found. Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:27.721275 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66d0bed-10fc-4364-a359-3a67b537dca5 could not be found. Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] Returning 404 to user: Instance a66d0bed-10fc-4364-a359-3a67b537dca5 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e3043c3-5b68-4d93-8514-ceb40fe76a72 tempest-LiveMigrationTest-133360327 tempest-LiveMigrationTest-133360327-project] 10.222.0.26 "GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5" status: 404 len: 111 microversion: 2.1 time: 0.057523 Sep 01 04:57:27.728468 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1219/2423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:27 2022] GET /compute/v2.1/servers/a66d0bed-10fc-4364-a359-3a67b537dca5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:28.238477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cb26f7f2-85cf-4987-bb1e-58c848484019 req-5dd623a4-7006-47dd-bad3-8003188df87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a225e1-f89f-4445-9d87-2fc1d0aedce3", "name": "network-vif-deleted", "tag": "372b75ae-1ae8-4a2a-8b57-4da47c595b94"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:28.257823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.261517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb26f7f2-85cf-4987-bb1e-58c848484019 req-5dd623a4-7006-47dd-bad3-8003188df87f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:28.264901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb26f7f2-85cf-4987-bb1e-58c848484019 req-5dd623a4-7006-47dd-bad3-8003188df87f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:28.266583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb26f7f2-85cf-4987-bb1e-58c848484019 req-5dd623a4-7006-47dd-bad3-8003188df87f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:28.322915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cb26f7f2-85cf-4987-bb1e-58c848484019 req-5dd623a4-7006-47dd-bad3-8003188df87f service nova] Creating event network-vif-deleted:372b75ae-1ae8-4a2a-8b57-4da47c595b94 for instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 on n-h2-820368-37 Sep 01 04:57:28.346111 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cb26f7f2-85cf-4987-bb1e-58c848484019 req-5dd623a4-7006-47dd-bad3-8003188df87f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111378 Sep 01 04:57:28.352099 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1220/2424] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:28.675323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:28.676228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:28.690305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:28.690802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:28.691267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:28.692360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:28.692922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:28.697060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:28.789511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:28.791550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:28.793902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:28.794580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lazy-loading 'fault' on Instance uuid 27a225e1-f89f-4445-9d87-2fc1d0aedce3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:57:29.274044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c1a2e72acea4cbebb5887ab53185a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568534cc6c9e45fea2f352a241b54e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:29.285524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-700ee410-c116-4bee-b5e3-917528946071 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 200 len: 1360 microversion: 2.1 time: 0.614714 Sep 01 04:57:29.290807 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1221/2425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:28 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 1360 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:29.366755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:29.386292 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-370edad0-4426-41fc-b3f3-c7e8a94058c8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 1.837264 Sep 01 04:57:29.395627 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1205/2426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:27 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:30.328427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:30.329648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] [instance: 27a225e1-f89f-4445-9d87-2fc1d0aedce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:30.340082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:30.340992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:30.341653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:30.342762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:30.344314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:30.345286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:30.393321 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] HTTP exception thrown: Instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 could not be found. Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Request method failure captured: Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 HTTP/1.1 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDs6CVGROztU7R6QLgtdlUmtXYhOGZ6Etzwq_E5lggrVOXdbzUfqRQQC1i3NEbG56GZzo6HiLchMAy7Rx6shXXFZivKuxnai8MJN6mG8Wxg_ZbCsFtC7vPuqJTSJGNaiKTdd_f6JwcWeA05Yh8U47Yjbzo_OtfnpdYx2Mm_UmW6OuDE Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 568534cc6c9e45fea2f352a241b54e78 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1125342930 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/568534cc6c9e45fea2f352a241b54e78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/568534cc6c9e45fea2f352a241b54e78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_568534cc6c9e45fea2f352a241b54e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/568534cc6c9e45fea2f352a241b54e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1125342930 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 568534cc6c9e45fea2f352a241b54e78 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1125342930 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1125342930-project Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3c1a2e72acea4cbebb5887ab53185a04 Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1125342930-project Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 could not be found. Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '27a225e1-f89f-4445-9d87-2fc1d0aedce3'} Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 could not be found. Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 could not be found. Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:57:30.395218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 could not be found. Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Returning 404 to user: Instance 27a225e1-f89f-4445-9d87-2fc1d0aedce3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:57:30.399032 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95558725-7c65-4b85-a72c-c60f93197ddb tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3" status: 404 len: 111 microversion: 2.1 time: 0.086983 Sep 01 04:57:30.403406 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1222/2427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:30 2022] GET /compute/v2.1/servers/27a225e1-f89f-4445-9d87-2fc1d0aedce3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:57:30.415076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-352d94ad-8005-46d7-9d9f-951e3a41a815 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] Calling method '.version_select at 0x7fa75bc70dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:30.426795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.431474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:30.432108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:30.450275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:30.457889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:30.458779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:30.460082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:30.463463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:30.465641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:30.480929 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-352d94ad-8005-46d7-9d9f-951e3a41a815 tempest-ServersTestJSON-1125342930 tempest-ServersTestJSON-1125342930-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969979244" status: 202 len: 0 microversion: 2.1 time: 0.072372 Sep 01 04:57:30.481536 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1206/2428] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 04:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969979244 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:57:31.164484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:31.168624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.178188 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ae36219-5b9b-4c73-9592-f3c0ebb8602a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.755979 Sep 01 04:57:31.207341 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1223/2429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:30 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:32.203679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:32.204317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:32.221183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:32.222336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:32.222980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:32.223982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:32.224768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:32.225504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:32.703856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:32.715635 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e40474f6-30e8-4c6d-8d0a-f2e32de3753e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.516972 Sep 01 04:57:32.719821 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1207/2430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:32 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:33.745987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:33.747823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:33.762564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:33.763754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:33.764704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:33.766073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:33.767151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:33.767791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:34.170410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:34.187221 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9b676bb-5001-4b76-a65a-1b7a618fcf60 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.447312 Sep 01 04:57:34.203092 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1224/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:33 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:35.219170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:35.219917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:35.229218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:35.230851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:35.231579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:35.232559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:35.233247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:35.233907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:35.746064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:35.762662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6b2fafa-525a-4775-b218-15315aa2c20d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.556017 Sep 01 04:57:35.768169 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1208/2432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:35 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:36.791190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:36.792418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:36.815679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:36.816062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:36.816908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:36.817879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:36.821616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:36.822380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:37.224515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:37.239423 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eb45ed4-edfe-4256-9695-7329528a605f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.452862 Sep 01 04:57:37.241698 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1225/2433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:36 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:38.264041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:38.264717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:38.279387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:38.280273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:38.281025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:38.281976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:38.282645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:38.284082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:38.319928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-636149673", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:38.447840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] validate_networks() for [('82bcea4b-4095-490c-8b6f-42417dff6487', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:57:40.210426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:40.226714 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69fbb983-74db-4604-a794-7bc452e4245d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 1.967501 Sep 01 04:57:40.227375 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1226/2434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:38 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:41.251239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:41.251880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:41.270861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:41.274211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:41.275741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:41.279237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:41.279959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:41.280745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:41.556830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:57:41.557366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:57:41.558878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:57:41.559342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:57:41.559879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:57:41.575494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:41.576198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:41.576843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:41.577813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:41.578601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:41.579251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:41.628304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Getting quotas for project e8126752c03b40c694ebf5e6d4ef20f4. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:57:41.637176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Getting quotas for user a0a98aa31a7d44388cbab5fa701355c8 and project e8126752c03b40c694ebf5e6d4ef20f4. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:57:41.649934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:41.669831 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcbf0d65-c770-49ba-9b29-b18c34af5eea tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.419078 Sep 01 04:57:41.670526 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1227/2435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:41 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:41.699687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:57:41.706169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:57:41.862384 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b78599fc-f9e6-429b-8167-296c7a949c86 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.876391 Sep 01 04:57:41.870563 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1209/2436] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:57:41.885753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-faa8d73d-8d86-4d47-aaa4-1c5d4880f566 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:41.886825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-faa8d73d-8d86-4d47-aaa4-1c5d4880f566 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:42.037822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-faa8d73d-8d86-4d47-aaa4-1c5d4880f566 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:42.048337 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-faa8d73d-8d86-4d47-aaa4-1c5d4880f566 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1223 microversion: 2.1 time: 0.167941 Sep 01 04:57:42.063201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1228/2437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:41 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1223 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:42.696940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:42.697571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:42.720778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:42.721286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:42.721731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:42.722469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:42.722957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:42.723394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:43.072892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:43.073518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:43.100221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:43.101113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:43.103952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:43.105043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:43.105808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:43.107690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:43.334166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:43.356616 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68992a52-d735-4dea-abf5-7cdd6b96d17b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1219 microversion: 2.1 time: 0.287515 Sep 01 04:57:43.357356 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1229/2438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:43 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1219 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:43.471692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:43.485217 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d486253-7d4b-4480-ac26-962ce982f029 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1476 microversion: 2.1 time: 0.793435 Sep 01 04:57:43.487905 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1210/2439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:42 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1476 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:44.379317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:44.380049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:44.390018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:44.393857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:44.399131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:44.400746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:44.401772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:44.402379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:44.512033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:44.514538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:44.527513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:44.533298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:44.536158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:44.538709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:44.540287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:44.542233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:44.622223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:44.637930 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb0ea37c-859c-44ea-a84c-62116e08ea0e tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1281 microversion: 2.1 time: 0.262189 Sep 01 04:57:44.640234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1230/2440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:44 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1281 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:45.213054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:45.223823 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76112dcf-629e-4af3-9262-d70479e92149 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1475 microversion: 2.1 time: 0.716967 Sep 01 04:57:45.227425 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1211/2441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:44 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1475 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:45.667534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:45.667534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:45.698103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:45.700435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:45.701193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:45.704612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:45.705883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:45.707042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:46.046281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:46.061403 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-137c4a83-b9f9-4df8-980c-2411c34ee2a3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1281 microversion: 2.1 time: 0.402318 Sep 01 04:57:46.061846 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1231/2442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:45 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1281 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:46.256139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:46.257437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:46.265438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:46.265939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:46.266377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:46.280067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:46.280567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:46.281016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:46.503010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d490dd8-5b01-4820-9370-37d90a24a24c", "name": "network-vif-unplugged", "status": "completed", "tag": "283c5331-2b11-4256-8c18-a3648fa570e4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:46.526629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:46.528033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:46.528657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:46.562453 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] Creating event network-vif-unplugged:283c5331-2b11-4256-8c18-a3648fa570e4 for instance 0d490dd8-5b01-4820-9370-37d90a24a24c on n-h1-820368-37 Sep 01 04:57:46.578015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] Instance 0d490dd8-5b01-4820-9370-37d90a24a24c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:57:46.602685 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fddfd7ed-6e71-4ea3-b28d-1d29e85c56ef req-c452e1d9-0594-40d1-9581-e98c183174f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100857 Sep 01 04:57:46.604391 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1232/2443] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:46.925189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:46.950058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-364eeb38-331e-4ba4-965c-2f907b0a8210 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1475 microversion: 2.1 time: 0.698044 Sep 01 04:57:46.950686 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1212/2444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:46 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1475 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:47.086417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:47.087814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:47.122664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:47.124416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:47.126013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:47.127054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:47.127723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:47.129247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:47.712072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:47.740055 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee91484e-b0c2-4461-a998-5ffaaaf4f14c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 0.661235 Sep 01 04:57:47.749943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1233/2445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:47 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:47.973370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:47.974772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:47.989438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:47.990267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:47.991475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:47.992419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:47.993066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:47.994218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:48.708576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d490dd8-5b01-4820-9370-37d90a24a24c", "tag": "283c5331-2b11-4256-8c18-a3648fa570e4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:48.724528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:48.725007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:48.725435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:48.757925 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] Creating event network-changed:283c5331-2b11-4256-8c18-a3648fa570e4 for instance 0d490dd8-5b01-4820-9370-37d90a24a24c on n-h1-820368-37 Sep 01 04:57:48.770928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] Instance 0d490dd8-5b01-4820-9370-37d90a24a24c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:57:48.794225 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d16b8123-51a5-4c0c-b5fe-4d0351ab3dde req-8ac1bee4-710d-4486-bbbe-c55526a899f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088479 Sep 01 04:57:48.795402 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1234/2446] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:48.803406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:48.804308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:48.813806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:48.814724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:48.815354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:48.816406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:48.817446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:48.818375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:48.940407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:48.951418 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-733759b4-2d6a-4ec1-9027-68bf9f4e770c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1475 microversion: 2.1 time: 0.983689 Sep 01 04:57:48.963889 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1213/2447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:47 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1475 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:49.453263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a8145c2d-560b-4fab-b2ee-7cf34d5d3415 req-5a635e58-3db0-44ea-9330-d1333267cc1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7068cc22-1bfe-42cf-81ca-efdb90ce5b20", "tag": "f6672e0e-68e6-4fef-af3c-c75a4457a9e5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:49.476872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8145c2d-560b-4fab-b2ee-7cf34d5d3415 req-5a635e58-3db0-44ea-9330-d1333267cc1f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:49.477736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8145c2d-560b-4fab-b2ee-7cf34d5d3415 req-5a635e58-3db0-44ea-9330-d1333267cc1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:49.478523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8145c2d-560b-4fab-b2ee-7cf34d5d3415 req-5a635e58-3db0-44ea-9330-d1333267cc1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:49.508025 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a8145c2d-560b-4fab-b2ee-7cf34d5d3415 req-5a635e58-3db0-44ea-9330-d1333267cc1f service nova] Creating event network-changed:f6672e0e-68e6-4fef-af3c-c75a4457a9e5 for instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 on n-h1-820368-37 Sep 01 04:57:49.515927 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a8145c2d-560b-4fab-b2ee-7cf34d5d3415 req-5a635e58-3db0-44ea-9330-d1333267cc1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391695 Sep 01 04:57:49.517716 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1214/2448] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:49.615035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:49.625392 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4dfc0e61-f115-41cc-939c-a7653144acf2 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 0.828419 Sep 01 04:57:49.625995 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1235/2449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:48 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:49.979387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:49.981250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:50.005519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:50.008719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:50.009327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:50.012304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:50.013109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:50.016635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:50.649509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:50.650816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:50.662407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:50.666048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:50.667320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:50.670076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:50.672069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:50.676824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:50.677501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:50.681446 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2756985-ab9f-458c-82a6-14ad83af351f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1475 microversion: 2.1 time: 0.710682 Sep 01 04:57:50.687473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1215/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:49 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1475 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:51.621825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:51.685587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-347c689f-9763-4aa3-a4d6-0beab815c5de tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 1.037478 Sep 01 04:57:51.687020 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1236/2451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:50 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:51.712643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:51.713450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:51.725031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.726525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.736529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:51.737074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:51.737513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:51.738252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:51.738994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:51.739678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:51.753755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.199801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.296162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:52.311850 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23c4cf79-5a37-46a8-b662-7ad6916eb17d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1475 microversion: 2.1 time: 0.604299 Sep 01 04:57:52.319815 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1216/2452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:51 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1475 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:52.549928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3669ff52-5c3e-4c8a-b537-36332f3d7306 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Action: 'create', calling method: .version_select at 0x7fa75b5238b0>, body: {"keypair": {"name": "tempest-keypair-1329962189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJo8+Isr5dKM92KGuaSLT3BUOAVvannnBG9eEjL/lADFutAlTGEgO2KUgMTP2++ocGB8s9IKyQKvgJ8CWrMQamU2Y2ig+hRuwlndXVpQTqxGlaVwzVVOc+dVnN0IOg9mA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:52.595191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3669ff52-5c3e-4c8a-b537-36332f3d7306 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Getting quotas for project 87e07a7391724191b70b4599382a6d91. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:57:52.603880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3669ff52-5c3e-4c8a-b537-36332f3d7306 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Getting quotas for user dbbad474a30e456d8249d35dc3787468 and project 87e07a7391724191b70b4599382a6d91. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:57:52.645858 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3669ff52-5c3e-4c8a-b537-36332f3d7306 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.450644 Sep 01 04:57:52.646501 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1237/2453] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:57:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:52.707896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:52.708873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:52.721367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:52.722068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:52.722287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:52.729316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:52.730127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:52.730756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:53.036892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:53.039055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:53.062489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:53.063647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:53.065853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:53.069466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:53.070953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:53.072272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:53.181136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:53.208034 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73f7daa8-cc2e-4caf-9521-a5f41c69411c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 0.503296 Sep 01 04:57:53.210251 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1217/2454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:52 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:53.343060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:53.344075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:53.360252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:53.362276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:53.362869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:53.364876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:53.367089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:53.367661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:53.962849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:53.980361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:53.981712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1562bd54-31bb-4180-884f-61cd88f7abcb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1473 microversion: 2.1 time: 0.645834 Sep 01 04:57:53.991937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:54.004741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:54.006492 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4b4fe4b-3fd0-45b4-9e53-cb01a83c4706 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2953 microversion: 2.32 time: 0.981261 Sep 01 04:57:54.007735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1238/2455] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:57:53 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2953 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:57:54.032120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:54.033440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:54.035443 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1218/2456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:53 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:54.043732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:54.044453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:54.044885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:54.045740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:54.056352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:54.056575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:54.240822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:54.241678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:54.258237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:54.264723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:54.267383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:54.268293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:54.269789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:54.273338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:54.902814 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f348dc5c-2638-42d2-aaba-44f1f5fe810a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.874933 Sep 01 04:57:54.916230 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1239/2457] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 04:57:54 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1/os-interface => generated 1832 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:57:55.014745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:55.015103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:55.032256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:55.034714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:55.035741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:55.039614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:55.041116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:55.041575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:55.401431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:55.414095 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba22c940-6208-4812-8fdb-4d84d767fa8b tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 1.183712 Sep 01 04:57:55.415058 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1219/2458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:54 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:55.621500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:55.634911 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37901241-764a-4830-8baf-92a9791b3231 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1470 microversion: 2.1 time: 0.627327 Sep 01 04:57:55.636122 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1240/2459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:55 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1470 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:55.671767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:55.672383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:55.685818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:55.686318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:55.697987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:55.699625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:55.700846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:55.701463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:55.873088 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33b6d941-88b2-470f-8270-ea3f4402c26a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c/action" status: 204 len: 0 microversion: 2.1 time: 0.206687 Sep 01 04:57:55.873807 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1220/2460] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:57:55 2022] POST /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c/action => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:55.883746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:55.884378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:55.894474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:55.896871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:55.897452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:55.898388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:55.898811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:55.903229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:56.445225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:56.446339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:56.454631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:56.468020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:56.468657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:56.469566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:56.470183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:56.470815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:57.133457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:57.144242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-588ee918-2026-43c2-84ad-50554c7557f1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1470 microversion: 2.1 time: 1.265656 Sep 01 04:57:57.149139 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1241/2461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:55 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1470 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:57.157249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fa9e3a03-780b-420f-965c-192dc06a62c3 req-66a601ea-9acb-424f-b849-4a74b2114f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7068cc22-1bfe-42cf-81ca-efdb90ce5b20", "name": "network-vif-plugged", "status": "completed", "tag": "f6672e0e-68e6-4fef-af3c-c75a4457a9e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:57.183539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa9e3a03-780b-420f-965c-192dc06a62c3 req-66a601ea-9acb-424f-b849-4a74b2114f8c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:57.183947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa9e3a03-780b-420f-965c-192dc06a62c3 req-66a601ea-9acb-424f-b849-4a74b2114f8c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:57.184785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa9e3a03-780b-420f-965c-192dc06a62c3 req-66a601ea-9acb-424f-b849-4a74b2114f8c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:57.217323 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fa9e3a03-780b-420f-965c-192dc06a62c3 req-66a601ea-9acb-424f-b849-4a74b2114f8c service nova] Creating event network-vif-plugged:f6672e0e-68e6-4fef-af3c-c75a4457a9e5 for instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 on n-h1-820368-37 Sep 01 04:57:57.227105 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fa9e3a03-780b-420f-965c-192dc06a62c3 req-66a601ea-9acb-424f-b849-4a74b2114f8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076334 Sep 01 04:57:57.228311 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1242/2462] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:57:57.455969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:57.472983 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18a490f9-229b-45df-bdf7-5f6e67db6ac3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 1.026363 Sep 01 04:57:57.487916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1221/2463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:56 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:58.178530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:58.180585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:58.200735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:58.201661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:58.202413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:58.204176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:58.204971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:58.205752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:58.502199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:57:58.502878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:57:58.527617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:58.528109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:58.528539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:58.529251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:58.529696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:58.530110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:59.110754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:59.125757 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b52a3030-e12d-4777-a9e2-fc43be816035 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1470 microversion: 2.1 time: 0.957474 Sep 01 04:57:59.129227 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1243/2464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:58 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1470 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:59.325868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d490dd8-5b01-4820-9370-37d90a24a24c", "name": "network-vif-plugged", "status": "completed", "tag": "283c5331-2b11-4256-8c18-a3648fa570e4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:59.336480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:59.353209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:57:59.359307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:57:59.360082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:57:59.367281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:59.388222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:57:59.404249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d98d861-1f16-40bb-9ea8-4d9720cc8282 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1323 microversion: 2.1 time: 0.903654 Sep 01 04:57:59.405081 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1222/2465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:57:58 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1323 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:59.410717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] Creating event network-vif-plugged:283c5331-2b11-4256-8c18-a3648fa570e4 for instance 0d490dd8-5b01-4820-9370-37d90a24a24c on n-h1-820368-37 Sep 01 04:57:59.437150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1039959968", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "adda0cd8-ce6e-4ac8-85ef-57a9baf59531"}], "security_groups": [{"name": "tempest-securitygroup--993469231"}], "key_name": "tempest-keypair-1329962189", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:57:59.443632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] Instance 0d490dd8-5b01-4820-9370-37d90a24a24c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:57:59.487166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-35ffebb6-a2e6-44d2-8bc2-05c717ccb3cc req-e98b35a2-83ff-4d41-8011-1830413989f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164949 Sep 01 04:57:59.498873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1244/2466] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:57:59.822521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] validate_networks() for [('adda0cd8-ce6e-4ac8-85ef-57a9baf59531', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:00.160662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:00.161671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:00.175082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:00.188002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:00.189659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:00.194571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:00.202527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:00.210146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:00.584947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.188637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:01.203876 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1995772-b8ea-474e-93e6-45568696056f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1470 microversion: 2.1 time: 1.046556 Sep 01 04:58:01.209254 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1245/2467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:00 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1470 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:01.213518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:01.224755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:01.240562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:01.241085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:01.243326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:01.244138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:01.247481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:01.248137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:01.444374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:01.452203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:01.455939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:01.458189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:01.458780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:01.501885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:01.502381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:01.502826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:01.506678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:01.506678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:01.506678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:01.550075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Getting quotas for project 87e07a7391724191b70b4599382a6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:01.561558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Getting quotas for user dbbad474a30e456d8249d35dc3787468 and project 87e07a7391724191b70b4599382a6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:01.593061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:01.600999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:01.620170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:01.627190 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3f25c46-2320-41a1-b775-c5684cf5329f tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1519 microversion: 2.1 time: 0.416023 Sep 01 04:58:01.628423 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1246/2468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:01 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:01.773256 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf3bac93-e091-4c9c-90e2-dc16a36d1b86 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.339887 Sep 01 04:58:01.775717 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1223/2469] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:57:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:01.792252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3fd9d00e-a219-4978-9d4d-0ddb10b0c87b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:01.800375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3fd9d00e-a219-4978-9d4d-0ddb10b0c87b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:01.978383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3fd9d00e-a219-4978-9d4d-0ddb10b0c87b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:01.991264 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3fd9d00e-a219-4978-9d4d-0ddb10b0c87b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1242 microversion: 2.1 time: 0.201886 Sep 01 04:58:01.993038 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1224/2470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:01 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:02.038496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6527acf6-baf1-47f9-96d8-767a520fd292 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-222386683", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6527acf6-baf1-47f9-96d8-767a520fd292 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 242 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-222386683", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-222386683', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '82bcea4b-4095-490c-8b6f-42417dff6487'}]}}} Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:02.049208 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:02.054513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.057035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6527acf6-baf1-47f9-96d8-767a520fd292 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:02.059992 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6527acf6-baf1-47f9-96d8-767a520fd292 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026335 Sep 01 04:58:02.061903 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1225/2471] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:58:02.083216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb15fae5-00a5-44e1-bc62-92ef2c0140d3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:02.083951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb15fae5-00a5-44e1-bc62-92ef2c0140d3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 60cc87a3-b0f6-47e0-9a01-bb45cb054f88] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:02.097824 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bb15fae5-00a5-44e1-bc62-92ef2c0140d3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] HTTP exception thrown: Instance 60cc87a3-b0f6-47e0-9a01-bb45cb054f88 could not be found. Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb15fae5-00a5-44e1-bc62-92ef2c0140d3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/60cc87a3-b0f6-47e0-9a01-bb45cb054f88/metadata HTTP/1.1 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 60cc87a3-b0f6-47e0-9a01-bb45cb054f88 could not be found. Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '60cc87a3-b0f6-47e0-9a01-bb45cb054f88'} Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cc87a3-b0f6-47e0-9a01-bb45cb054f88 could not be found. Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cc87a3-b0f6-47e0-9a01-bb45cb054f88 could not be found. Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:02.109399 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cc87a3-b0f6-47e0-9a01-bb45cb054f88 could not be found. Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb15fae5-00a5-44e1-bc62-92ef2c0140d3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 404 to user: Instance 60cc87a3-b0f6-47e0-9a01-bb45cb054f88 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb15fae5-00a5-44e1-bc62-92ef2c0140d3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/60cc87a3-b0f6-47e0-9a01-bb45cb054f88/metadata" status: 404 len: 111 microversion: 2.1 time: 0.042390 Sep 01 04:58:02.114366 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1226/2472] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:58:02 2022] GET /compute/v2.1/servers/60cc87a3-b0f6-47e0-9a01-bb45cb054f88/metadata => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:58:02.250593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1045577680", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:02.280071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1207329944", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:02.396829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:02.435527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] validate_networks() for [('0be044a0-8aa4-48c9-8459-e6f6f8a634c1', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:02.614437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:03.388028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:03.389007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:03.389494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:03.389904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:03.390469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:03.406068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.406772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.407467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.408736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.409183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.409916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.437798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:03.445483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:03.466821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:03.470780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:03.534811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:03.535518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:03.535879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:03.536298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:03.536720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:03.547054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.547702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.548193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.548932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.549080 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9894835-0342-4552-a4d8-f0a051ac68e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435326 Sep 01 04:58:03.549387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.550011 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1227/2473] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:03.555811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.568525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:03.569048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:03.575830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Getting quotas for project 9437b75278bf49d1823a0cdc21e989e1. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:03.576284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.576769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.577204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.577923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.578373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.578791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.585696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Getting quotas for user 187dbd75fe7f4ad48af7e2e39cdd3a40 and project 9437b75278bf49d1823a0cdc21e989e1. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:03.616749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:03.623884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:03.740180 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91bb2a3d-1a18-4142-842e-fc7af6bc697a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.109672 Sep 01 04:58:03.747281 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1247/2474] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:03.758085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a86d1225-b569-4c0d-b9ae-cdbb38f4995c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-168489615", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a86d1225-b569-4c0d-b9ae-cdbb38f4995c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 498 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-168489615", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-168489615', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '82bcea4b-4095-490c-8b6f-42417dff6487'}]}}} Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 04:58:03.770092 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:03.773608 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:03.779995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a86d1225-b569-4c0d-b9ae-cdbb38f4995c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:03.781249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a86d1225-b569-4c0d-b9ae-cdbb38f4995c tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031706 Sep 01 04:58:03.782025 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1248/2475] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:03 2022] POST /compute/v2.1/servers => generated 687 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:58:03.790712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:03.791941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:03.800962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.801887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.802481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:03.803619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:03.804292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:03.804892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:04.022569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:04.039294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e324ac6-f711-4aaa-936b-22214ae405be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1462 microversion: 2.1 time: 0.484120 Sep 01 04:58:04.055624 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1228/2476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:03 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1462 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:04.090261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:04.114685 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e374248-06b9-4674-aaa7-d6bcb94245d9 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1302 microversion: 2.1 time: 0.327831 Sep 01 04:58:04.126672 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1249/2477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:03 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1302 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:04.155890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cae8790-6c00-40cd-a4b4-e4c0aaf3fcbf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:04.156522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3cae8790-6c00-40cd-a4b4-e4c0aaf3fcbf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:04.333917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3cae8790-6c00-40cd-a4b4-e4c0aaf3fcbf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:04.344750 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cae8790-6c00-40cd-a4b4-e4c0aaf3fcbf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1215 microversion: 2.1 time: 0.213592 Sep 01 04:58:04.350288 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1250/2478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:04 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:04.367318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29f5a7ec-15ec-4821-90d1-bd0376e47400 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:04.369487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29f5a7ec-15ec-4821-90d1-bd0376e47400 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:04.472636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-959041720", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:04.508567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29f5a7ec-15ec-4821-90d1-bd0376e47400 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:04.522582 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29f5a7ec-15ec-4821-90d1-bd0376e47400 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1223 microversion: 2.1 time: 0.164507 Sep 01 04:58:04.525130 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1251/2479] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:04 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1223 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:04.539805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19cc33c9-eaf5-443d-906d-c142b13b7fb3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-206991186", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19cc33c9-eaf5-443d-906d-c142b13b7fb3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 499 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-206991186", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-206991186', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '82bcea4b-4095-490c-8b6f-42417dff6487'}]}}} Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 04:58:04.560618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19cc33c9-eaf5-443d-906d-c142b13b7fb3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:04.564200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19cc33c9-eaf5-443d-906d-c142b13b7fb3 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.035135 Sep 01 04:58:04.578916 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1252/2480] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:04 2022] POST /compute/v2.1/servers => generated 689 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:58:04.606275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:04.606567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:04.610299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:04.626190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:04.630151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:04.630603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:04.631441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:04.631820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:04.634298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.627522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:05.637745 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d34f620d-6ff9-423d-82f2-154251c4d092 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1462 microversion: 2.1 time: 1.039812 Sep 01 04:58:05.638686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1253/2481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:04 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1462 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:05.644398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f869bb17-a55d-4f94-b505-5c14c7bd5dc8 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-286976064", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f869bb17-a55d-4f94-b505-5c14c7bd5dc8 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 753 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-286976064", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-286976064', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '82bcea4b-4095-490c-8b6f-42417dff6487'}]}}} Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:58:05.651632 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:58:05.655037 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:58:05.658171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:05.658171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:05.661138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f869bb17-a55d-4f94-b505-5c14c7bd5dc8 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:05.661138 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f869bb17-a55d-4f94-b505-5c14c7bd5dc8 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.020463 Sep 01 04:58:05.661615 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1254/2482] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:05 2022] POST /compute/v2.1/servers => generated 1197 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 01 04:58:05.666597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:05.671312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:05.686070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.686915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.687875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.688642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.689837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.690495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.721037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:05.721540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:05.722119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:05.722634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:05.723686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:05.735069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.735700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.736248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.737335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.737912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.739039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.758671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Getting quotas for project 53130c48226c4e438198545d730e4075. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:05.764164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Getting quotas for user d5743545749747bb960173ae115011cc and project 53130c48226c4e438198545d730e4075. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:05.772605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:05.783692 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98d41905-3952-4342-9e90-e6625238abd8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1300 microversion: 2.1 time: 0.120481 Sep 01 04:58:05.784638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:05.785022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1255/2483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:05 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:05.786866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:05.790266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:05.790903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:05.797052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.797752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.798351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.799292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.799754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.800184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.837814 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9306b7a-f80d-452a-84a5-96e32cb8703d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793703 Sep 01 04:58:05.838589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1229/2484] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:05.844005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:05.844924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:05.852136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.852634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.853073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.853787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:05.854244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:05.854671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:05.923845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:05.932715 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f84178f-f2af-4507-98fc-7c8367c6b294 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1275 microversion: 2.1 time: 0.146378 Sep 01 04:58:05.934070 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1256/2485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:05 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:05.939659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94afdd52-b8af-4d68-96d2-31a58bc8e0da tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'create', calling method: .version_select at 0x7fa75b4f4310>, body: {"keypair": {"name": "tempest-keypair-1963110847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/5nq6dl9k9aineDMWCJDeVhfiPCObdR5tvPEytLwNNACapJQ0E2iegW3HqlZVPIezJRKDiL6EDbz/cppfUO146OjkVfPxxOZ/KLGJkCjxuINzrPaEkyoLFuv7EuVch9g=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:05.975703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-94afdd52-b8af-4d68-96d2-31a58bc8e0da tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for project 7df1df24b4a84c2a9008685936212a05. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:05.983844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-94afdd52-b8af-4d68-96d2-31a58bc8e0da tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for user 30b46ee5087145e6828acac49bee0b9b and project 7df1df24b4a84c2a9008685936212a05. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:05.996840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:06.012319 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9267bf1b-887f-4765-acc0-1820dc690e57 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1275 microversion: 2.1 time: 0.172086 Sep 01 04:58:06.028281 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1230/2486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:05 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:06.039859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe5bf01d-e1bd-4b6e-b3c1-50f77dee7ed9 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1482451969", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe5bf01d-e1bd-4b6e-b3c1-50f77dee7ed9 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 1266 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1482451969", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "82bcea4b-4095-490c-8b6f-42417dff6487"}]}} Sep 01 04:58:06.050505 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1482451969', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '82bcea4b-4095-490c-8b6f-42417dff6487'}]}}} Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.053285 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 04:58:06.055008 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 04:58:06.057380 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 04:58:06.057380 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.063752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe5bf01d-e1bd-4b6e-b3c1-50f77dee7ed9 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:06.065266 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe5bf01d-e1bd-4b6e-b3c1-50f77dee7ed9 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.035637 Sep 01 04:58:06.066249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94afdd52-b8af-4d68-96d2-31a58bc8e0da tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130857 Sep 01 04:58:06.078746 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1257/2487] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:58:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:06.079523 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1231/2488] 10.222.0.26 () {60 vars in 1148 bytes} [Thu Sep 1 04:58:06 2022] POST /compute/v2.1/servers => generated 2221 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 01 04:58:06.090725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50ac8d9b-0ebe-4906-a3c2-c2d16edebe5d tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:06.103890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a404bdce-89e0-419a-9ccf-d348b7a1e22c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:06.104093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50ac8d9b-0ebe-4906-a3c2-c2d16edebe5d tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: a060f911-3a1c-4ea8-80aa-10f26cf9b36e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:06.104418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a404bdce-89e0-419a-9ccf-d348b7a1e22c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:06.116121 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-50ac8d9b-0ebe-4906-a3c2-c2d16edebe5d tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] HTTP exception thrown: Instance a060f911-3a1c-4ea8-80aa-10f26cf9b36e could not be found. Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50ac8d9b-0ebe-4906-a3c2-c2d16edebe5d tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a060f911-3a1c-4ea8-80aa-10f26cf9b36e/metadata/test2 HTTP/1.1 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a060f911-3a1c-4ea8-80aa-10f26cf9b36e could not be found. Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': 'a060f911-3a1c-4ea8-80aa-10f26cf9b36e', 'id': 'test2'} Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a060f911-3a1c-4ea8-80aa-10f26cf9b36e could not be found. Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a060f911-3a1c-4ea8-80aa-10f26cf9b36e could not be found. Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:06.120608 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:06.124847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:06.124847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:06.124847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a060f911-3a1c-4ea8-80aa-10f26cf9b36e could not be found. Sep 01 04:58:06.124847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:06.130214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50ac8d9b-0ebe-4906-a3c2-c2d16edebe5d tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 404 to user: Instance a060f911-3a1c-4ea8-80aa-10f26cf9b36e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:06.135328 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50ac8d9b-0ebe-4906-a3c2-c2d16edebe5d tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/a060f911-3a1c-4ea8-80aa-10f26cf9b36e/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.049244 Sep 01 04:58:06.149095 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1232/2489] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Sep 1 04:58:06 2022] GET /compute/v2.1/servers/a060f911-3a1c-4ea8-80aa-10f26cf9b36e/metadata/test2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:58:06.175454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:06.175996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:06.192171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:06.192707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:06.193301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:06.202611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:06.203172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:06.203828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:06.261488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:58:06.315765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a404bdce-89e0-419a-9ccf-d348b7a1e22c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:06.324559 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a404bdce-89e0-419a-9ccf-d348b7a1e22c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1218 microversion: 2.1 time: 0.242501 Sep 01 04:58:06.325149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1258/2490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:06 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1218 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:06.474754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f822145-6a39-4962-8ee2-d1d2035b29ad tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 204 len: 0 microversion: 2.1 time: 0.303520 Sep 01 04:58:06.475927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1233/2491] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:58:06 2022] DELETE /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:58:06.484442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:06.485119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:06.494568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:06.497409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:06.498167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:06.499218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:06.499991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:06.500670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:06.809245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:06.809966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:06.827333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:06.828089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:06.828691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:06.830548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:06.831771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:06.833087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.356176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:07.375739 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-682ffbf1-fc72-4557-a68c-d279163a3686 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1525 microversion: 2.1 time: 0.894592 Sep 01 04:58:07.388144 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1259/2492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:06 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1525 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:07.393797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:07.394541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:07.401924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:07.402415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:07.403100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.404047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:07.404700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:07.405316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.405658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:07.418209 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6a0f550-606b-42aa-a658-9fdf65d2994c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.614971 Sep 01 04:58:07.419590 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1234/2493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:06 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:07.425253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:07.426242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:07.432644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:07.433399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:07.434058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.435008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:07.435644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:07.436250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.554708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:07.564710 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b60ef09-4dbd-4109-82df-8d50f0ece7ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1273 microversion: 2.1 time: 0.175057 Sep 01 04:58:07.565594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1260/2494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:07 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:07.573771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:07.575536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:07.582666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:07.587157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:07.587857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.588796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:07.588918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:07.589274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:07.589768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:07.599837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a09057d-b673-450e-8e08-973f5542ddb7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1281 microversion: 2.1 time: 0.178819 Sep 01 04:58:07.600712 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1235/2495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:07 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:07.747402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:07.756650 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-732a48f2-c2cb-484d-8a12-a57f5da50191 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1222 microversion: 2.1 time: 0.189665 Sep 01 04:58:07.771438 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1261/2496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:07 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:08.185939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55fbd9bb-4dc0-41a5-b880-42e6d863f182 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '.version_select at 0x7fa760207430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:08.191163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55fbd9bb-4dc0-41a5-b880-42e6d863f182 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:08.192428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55fbd9bb-4dc0-41a5-b880-42e6d863f182 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:08.193541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55fbd9bb-4dc0-41a5-b880-42e6d863f182 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:08.205491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55fbd9bb-4dc0-41a5-b880-42e6d863f182 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.024302 Sep 01 04:58:08.216245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1236/2497] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 04:58:08 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:08.226061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9443a987-49a2-40ca-947b-7d7a12720c4c tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:08.239355 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9443a987-49a2-40ca-947b-7d7a12720c4c tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015901 Sep 01 04:58:08.241820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1262/2498] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 04:58:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:08.253701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87f5c23d-2e65-4d83-8b1a-d99ca11c8fae tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-115542011", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:08.310223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87f5c23d-2e65-4d83-8b1a-d99ca11c8fae tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.060356 Sep 01 04:58:08.313389 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1237/2499] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Sep 1 04:58:08 2022] POST /compute/v2.1/flavors => generated 498 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:08.325008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea7b0b93-a440-4f08-aa96-8135648999f6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:08.334842 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea7b0b93-a440-4f08-aa96-8135648999f6 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013734 Sep 01 04:58:08.335474 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1263/2500] 10.222.0.26 () {58 vars in 1182 bytes} [Thu Sep 1 04:58:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:58:08.400460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:08.401503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:08.417309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:08.419223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:08.420447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:08.422915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:08.423990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:08.426214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:08.466662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:08.467368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:08.488363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:08.493154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:08.501233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:08.506835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:08.521968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:08.523394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:08.526233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:09.362330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a98aa31a7d44388cbab5fa701355c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8126752c03b40c694ebf5e6d4ef20f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:09.377195 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bdfe8b01-c4cd-4407-8f47-0b6389d2dd30 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 200 len: 1525 microversion: 2.1 time: 0.981685 Sep 01 04:58:09.379859 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1238/2501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:08 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 1525 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:09.388232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1226707476", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:09.493541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:09.557183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:09.575228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b70538f3-bff2-4cfc-80b3-3a8546678d09 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 1.136540 Sep 01 04:58:09.576134 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1264/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:08 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:09.586922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:09.587723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:09.609909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:09.610577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:09.619498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:09.620686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:09.622478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:09.623173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:10.560295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:10.589960 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca795ec6-fc31-48ae-afbe-bd5569b971f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 1.012184 Sep 01 04:58:10.599459 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1265/2503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:09 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:10.607361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:10.607941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:10.615599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:10.616444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:10.616924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:10.618280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:10.618742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:10.619603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:10.795624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:10.797808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:10.798480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:10.799076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:10.799684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:10.813109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:10.813885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:10.814498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:10.815274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:10.815938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:10.816390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:10.836706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:10.842696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for user 30b46ee5087145e6828acac49bee0b9b and project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:10.858342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:10.861626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:10.931368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f279d7d8-8ad0-4dc6-966f-da5b9f835014 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549887 Sep 01 04:58:10.937616 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1239/2504] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:10.943722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:10.945085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:10.953432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:10.953997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:10.954342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:10.955087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:10.955532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:10.955942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.043287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:11.053352 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e7cc701-4b02-4ea6-ba86-db578852f409 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.450754 Sep 01 04:58:11.071776 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1266/2505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:10 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:11.078031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-546b430a-0fc8-4559-9e51-ea96d46bbeaa req-42b0e090-e111-43b3-b769-5e8ab2fe1ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7068cc22-1bfe-42cf-81ca-efdb90ce5b20", "name": "network-vif-deleted", "tag": "f6672e0e-68e6-4fef-af3c-c75a4457a9e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:11.092459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-546b430a-0fc8-4559-9e51-ea96d46bbeaa req-42b0e090-e111-43b3-b769-5e8ab2fe1ffa service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.093467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-546b430a-0fc8-4559-9e51-ea96d46bbeaa req-42b0e090-e111-43b3-b769-5e8ab2fe1ffa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.094197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-546b430a-0fc8-4559-9e51-ea96d46bbeaa req-42b0e090-e111-43b3-b769-5e8ab2fe1ffa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.123392 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-546b430a-0fc8-4559-9e51-ea96d46bbeaa req-42b0e090-e111-43b3-b769-5e8ab2fe1ffa service nova] Creating event network-vif-deleted:f6672e0e-68e6-4fef-af3c-c75a4457a9e5 for instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 on n-h1-820368-37 Sep 01 04:58:11.132035 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-546b430a-0fc8-4559-9e51-ea96d46bbeaa req-42b0e090-e111-43b3-b769-5e8ab2fe1ffa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058777 Sep 01 04:58:11.135400 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1267/2506] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:11.146041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:11.146974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] [instance: 7068cc22-1bfe-42cf-81ca-efdb90ce5b20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:11.155749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.156436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.157061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.158297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.163096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.163913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.187786 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] HTTP exception thrown: Instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 could not be found. Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Request method failure captured: Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 HTTP/1.1 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvBJGAOdhSXzpP8uL88Z8JmUspS0dUdCOniHvBLD5u6BfmXG9UB5_FffKQ7czZk7MA8UeZzhXgd_NbFg1WX0oWzElczBcNxUzneyucG4o6KycbWmjilB2s_9U7kxYVIlpxy8bqCvpmF0k_AECWRChHbwd1R-aLh9U-YS7SqKLRQXa8 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8126752c03b40c694ebf5e6d4ef20f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: e8126752c03b40c694ebf5e6d4ef20f4 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1425658214 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a0a98aa31a7d44388cbab5fa701355c8 Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1425658214-project Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 could not be found. Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7068cc22-1bfe-42cf-81ca-efdb90ce5b20'} Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 could not be found. Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 could not be found. Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:11.189779 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 could not be found. Sep 01 04:58:11.194553 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:11.196134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] Returning 404 to user: Instance 7068cc22-1bfe-42cf-81ca-efdb90ce5b20 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:11.197324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ffb9d007-398b-4dec-ac30-5e5cc8f52e08 tempest-ServerMetadataNegativeTestJSON-1425658214 tempest-ServerMetadataNegativeTestJSON-1425658214-project] 10.222.0.26 "GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20" status: 404 len: 111 microversion: 2.1 time: 0.060689 Sep 01 04:58:11.198593 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1268/2507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:11 2022] GET /compute/v2.1/servers/7068cc22-1bfe-42cf-81ca-efdb90ce5b20 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:58:11.203599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:11.204462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:11.212020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.212951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.213561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.214535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.215279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.216018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.643420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:11.653363 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cf98991-a14a-4713-ad04-aba9e750568d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1318 microversion: 2.1 time: 0.719519 Sep 01 04:58:11.655592 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1240/2508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:10 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:11.674850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:11.676104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:11.685735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.686494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.687204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.688143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.688763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.689352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.846436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:11.848419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:11.855776 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b72eaf99-9517-47da-9b8a-b56cc41194a4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.655827 Sep 01 04:58:11.856630 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1269/2509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:11 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:11.857626 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abb0777e-ef4d-4b86-8c70-66a224b15972 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1283 microversion: 2.1 time: 0.188179 Sep 01 04:58:11.858523 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1241/2510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:11 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1283 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:11.869195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:11.870364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:11.875788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5b731033-ba91-4e56-84cb-bd20920af091 req-db0a5bd4-a7c9-46df-8304-2934d2200e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a734084d-4986-49c0-a6f6-3e8d6a493831", "tag": "4e04edaf-5c78-4536-8947-fefcfeefeadb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:11.877554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.878525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.879422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.880742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.881408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.882075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.886124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b731033-ba91-4e56-84cb-bd20920af091 req-db0a5bd4-a7c9-46df-8304-2934d2200e22 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:11.886593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b731033-ba91-4e56-84cb-bd20920af091 req-db0a5bd4-a7c9-46df-8304-2934d2200e22 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:11.887217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b731033-ba91-4e56-84cb-bd20920af091 req-db0a5bd4-a7c9-46df-8304-2934d2200e22 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:11.899792 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b731033-ba91-4e56-84cb-bd20920af091 req-db0a5bd4-a7c9-46df-8304-2934d2200e22 service nova] Creating event network-changed:4e04edaf-5c78-4536-8947-fefcfeefeadb for instance a734084d-4986-49c0-a6f6-3e8d6a493831 on n-h1-820368-37 Sep 01 04:58:11.905431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5b731033-ba91-4e56-84cb-bd20920af091 req-db0a5bd4-a7c9-46df-8304-2934d2200e22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047394 Sep 01 04:58:11.906327 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1270/2511] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:12.075241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:12.076109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:12.083349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:12.083849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:12.084263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:12.085002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:12.085461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:12.086037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:12.372220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:12.383202 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f1f94ef-bb7f-4b60-9233-95774b60cb06 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 0.522284 Sep 01 04:58:12.384255 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1242/2512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:11 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:12.679987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:12.680597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:12.682957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:12.686552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:12.695121 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e57032f-9daf-45c6-bcdb-349995e0ea82 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.624006 Sep 01 04:58:12.696128 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1271/2513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:12 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:12.696467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:12.697139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:12.697572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:12.698274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:12.698713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:12.700461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:12.881472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:12.882805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:12.889724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:12.890543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:12.891247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:12.892184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:12.892836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:12.893448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:13.567227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:13.762263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:13.779042 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c115a8e4-37bf-45c5-9b50-f3918cd4ee39 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1318 microversion: 2.1 time: 1.102717 Sep 01 04:58:13.780429 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1243/2514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:12 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:13.788013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:13.791901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:13.805778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:13.807774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:13.809797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:13.811125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:13.811892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:13.812712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:13.834515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:13.840946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:13.852844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-389a3f54-4b72-4a6b-892f-18f13809d640 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.975584 Sep 01 04:58:13.855339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1272/2515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:12 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:13.864438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-343dd1fc-2de2-4b42-bf16-1eae2c13974e req-cb36b7f5-46dd-4cb1-9df5-70a475539a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7919d9da-2ca6-4774-aaeb-c29e3b29c02f", "tag": "61a454bd-5cff-407f-bd4f-ea9bb031aee3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:13.881355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-343dd1fc-2de2-4b42-bf16-1eae2c13974e req-cb36b7f5-46dd-4cb1-9df5-70a475539a84 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:13.882405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-343dd1fc-2de2-4b42-bf16-1eae2c13974e req-cb36b7f5-46dd-4cb1-9df5-70a475539a84 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:13.883747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-343dd1fc-2de2-4b42-bf16-1eae2c13974e req-cb36b7f5-46dd-4cb1-9df5-70a475539a84 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:13.919637 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-343dd1fc-2de2-4b42-bf16-1eae2c13974e req-cb36b7f5-46dd-4cb1-9df5-70a475539a84 service nova] Creating event network-changed:61a454bd-5cff-407f-bd4f-ea9bb031aee3 for instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f on n-h1-820368-37 Sep 01 04:58:13.928087 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-343dd1fc-2de2-4b42-bf16-1eae2c13974e req-cb36b7f5-46dd-4cb1-9df5-70a475539a84 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068390 Sep 01 04:58:13.928806 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1273/2516] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:13.943632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:13.964634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:14.010024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.015114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:14.016657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.018683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.024594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.024780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74d9fb61-075b-46d6-ad29-f0f06e07cd26 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1337 microversion: 2.1 time: 0.242615 Sep 01 04:58:14.025095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.025537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.027587 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1244/2517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:13 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1337 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:14.040019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:14.040932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:14.057483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.058072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.058641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.059450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.059974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.060458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.631507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:14.640730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1b0f4a6-9b22-443c-b96c-ba5091e4e7f2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 0.709953 Sep 01 04:58:14.641899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1274/2518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:13 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:14.647606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc60faa4-394d-45cd-89a9-95818ecfb47b", "tag": "df5841fd-df50-4f08-ab9e-6d4875a38f24"}, {"name": "network-changed", "server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:14.670393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:14.675810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.677673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.678605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.683271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d94ba0dc-cae5-43f3-9499-4e656ce39112 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.647018 Sep 01 04:58:14.684488 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1245/2519] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:14 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:14.702929 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] Creating event network-changed:df5841fd-df50-4f08-ab9e-6d4875a38f24 for instance dc60faa4-394d-45cd-89a9-95818ecfb47b on n-h2-820368-37 Sep 01 04:58:14.703533 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] Creating event network-changed:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:58:14.711835 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-63f7aeaa-8151-4d0b-93c7-6472d93f3c8c req-18e2fbac-3de0-4649-a954-b48f0bcd16c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068352 Sep 01 04:58:14.713555 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1275/2520] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:14.802673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:14.804313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:14.811820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.812683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.813362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.814103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.814558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.815012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.875113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:14.875721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:14.882634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.883341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.883575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:14.884275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:14.884722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:14.885139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:15.113432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:15.126351 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97058fd7-eb18-444e-b5c5-b6b0bd5de7ce tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1318 microversion: 2.1 time: 0.327013 Sep 01 04:58:15.127930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1246/2521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:14 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:15.149288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:15.150051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:15.158181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:15.159266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:15.160102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:15.161172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:15.161878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:15.163109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:15.169223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:15.180782 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c6772a8-dd9a-4315-939c-b2ad73717ed3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.310206 Sep 01 04:58:15.181998 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1276/2522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:14 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:15.559283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:15.569932 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23382acd-6bfe-4e67-8704-63e7da56b5cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.440748 Sep 01 04:58:15.571130 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1247/2523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:15 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:15.668156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:15.669366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:15.680596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:15.681602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:15.682355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:15.684107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:15.684855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:15.685962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:15.705924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:15.707358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:15.733831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:15.735702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:15.738518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:15.743673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:15.744597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:15.745921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:16.353464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:16.617362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:16.627933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53ecdf5d-3709-49b3-8dc2-0778968da2df tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.926411 Sep 01 04:58:16.631498 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1248/2524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:15 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:16.638079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:16.638703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:16.658824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:16.661897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:16.662561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:16.664775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:16.668220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:16.669659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:16.681668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:16.695907 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4571ad07-fcef-4a9d-97bf-796f34061c01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 1.033105 Sep 01 04:58:16.697529 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1277/2525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:15 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:16.703784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2fe93072-4d85-485b-ba5a-dabf5151fa5f req-745ea175-1ae9-4b87-a1d0-ba95967a9044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919d9da-2ca6-4774-aaeb-c29e3b29c02f", "name": "network-vif-plugged", "status": "completed", "tag": "61a454bd-5cff-407f-bd4f-ea9bb031aee3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:16.720190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2fe93072-4d85-485b-ba5a-dabf5151fa5f req-745ea175-1ae9-4b87-a1d0-ba95967a9044 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:16.721208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2fe93072-4d85-485b-ba5a-dabf5151fa5f req-745ea175-1ae9-4b87-a1d0-ba95967a9044 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:16.721853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2fe93072-4d85-485b-ba5a-dabf5151fa5f req-745ea175-1ae9-4b87-a1d0-ba95967a9044 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:16.740337 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2fe93072-4d85-485b-ba5a-dabf5151fa5f req-745ea175-1ae9-4b87-a1d0-ba95967a9044 service nova] Creating event network-vif-plugged:61a454bd-5cff-407f-bd4f-ea9bb031aee3 for instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f on n-h1-820368-37 Sep 01 04:58:16.749789 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2fe93072-4d85-485b-ba5a-dabf5151fa5f req-745ea175-1ae9-4b87-a1d0-ba95967a9044 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049584 Sep 01 04:58:16.751145 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1278/2526] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:16.759020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:16.760328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:16.770397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:16.771911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:16.772574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:16.773561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:16.774249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:16.774931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.073517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:17.081708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-394d036b-3311-437d-b28d-9ce316f3c694 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1318 microversion: 2.1 time: 0.449036 Sep 01 04:58:17.091547 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1249/2527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:16 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:17.098712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c42ca0ed-86ab-4e1a-9ebe-eb70f41c29f1 req-14fda9f5-1d06-46c9-889e-5798381a3e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:17.114345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c42ca0ed-86ab-4e1a-9ebe-eb70f41c29f1 req-14fda9f5-1d06-46c9-889e-5798381a3e3e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.114846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c42ca0ed-86ab-4e1a-9ebe-eb70f41c29f1 req-14fda9f5-1d06-46c9-889e-5798381a3e3e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.115496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c42ca0ed-86ab-4e1a-9ebe-eb70f41c29f1 req-14fda9f5-1d06-46c9-889e-5798381a3e3e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.130029 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c42ca0ed-86ab-4e1a-9ebe-eb70f41c29f1 req-14fda9f5-1d06-46c9-889e-5798381a3e3e service nova] Creating event network-changed:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h1-820368-37 Sep 01 04:58:17.136967 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c42ca0ed-86ab-4e1a-9ebe-eb70f41c29f1 req-14fda9f5-1d06-46c9-889e-5798381a3e3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043514 Sep 01 04:58:17.138416 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1250/2528] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:17.142961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:17.149672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:17.150499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:17.152192 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e6d4e1c-b4f5-4787-9c70-6f0e92c0ba5e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.399420 Sep 01 04:58:17.153435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1279/2529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:16 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:17.172347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.173010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.173463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.174240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.174681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.175672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.456922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:17.465859 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09d935c8-1de2-4148-9f9e-bce5f50cc3d8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.326008 Sep 01 04:58:17.467006 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1251/2530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:17 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:17.650861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:17.652077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:17.662012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.663805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.664795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.667516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.668479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.669435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.719244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:17.720856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:17.728266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.728766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.729270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.731303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:17.732730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:17.733317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:17.906692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:17.917730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f14bd72-185d-468f-ab8f-c6102c9a41a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.271082 Sep 01 04:58:17.919187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1280/2531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:17 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:18.103195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:18.104024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:18.111173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:18.112492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.113045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.113467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.114187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.114772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.115233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.125515 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-964449a3-377a-4acc-9ef5-549aeeaa8558 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 0.410049 Sep 01 04:58:18.126469 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1252/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:17 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:18.176794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:18.177850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:18.187907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.188714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.189685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.190764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.191415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.192200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.668038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:18.689542 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae88bb25-85c9-4b7b-9d1b-25984d739c38 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.515253 Sep 01 04:58:18.694017 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1253/2533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:18 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:18.701427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:18.705071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:18.709412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:18.714796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9876806-bea2-441e-bcd4-2c8431fc15d8 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1318 microversion: 2.1 time: 0.614060 Sep 01 04:58:18.717530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1281/2534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:18 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1318 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:18.730449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.732692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.733161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.733922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.734389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.734834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.773639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8684914b-1449-404f-a41b-937dd9f39aaa req-7fc85d2d-f2b5-4f3c-9ff0-9de426215858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a734084d-4986-49c0-a6f6-3e8d6a493831", "name": "network-vif-plugged", "status": "completed", "tag": "4e04edaf-5c78-4536-8947-fefcfeefeadb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:18.784341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:18.787480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8684914b-1449-404f-a41b-937dd9f39aaa req-7fc85d2d-f2b5-4f3c-9ff0-9de426215858 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.788289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8684914b-1449-404f-a41b-937dd9f39aaa req-7fc85d2d-f2b5-4f3c-9ff0-9de426215858 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.789096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8684914b-1449-404f-a41b-937dd9f39aaa req-7fc85d2d-f2b5-4f3c-9ff0-9de426215858 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.806239 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8684914b-1449-404f-a41b-937dd9f39aaa req-7fc85d2d-f2b5-4f3c-9ff0-9de426215858 service nova] Creating event network-vif-plugged:4e04edaf-5c78-4536-8947-fefcfeefeadb for instance a734084d-4986-49c0-a6f6-3e8d6a493831 on n-h1-820368-37 Sep 01 04:58:18.812342 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8684914b-1449-404f-a41b-937dd9f39aaa req-7fc85d2d-f2b5-4f3c-9ff0-9de426215858 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042959 Sep 01 04:58:18.813645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1282/2535] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:58:18.941897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:18.942957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:18.965037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.967402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.968587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:18.970207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:18.971773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:18.973057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:19.113786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:19.122445 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c60e0db8-47d6-48bf-b003-403bddd6dbc3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.427272 Sep 01 04:58:19.123064 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1254/2536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:18 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:19.148123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:19.149008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:19.156332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:19.157627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:19.158702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:19.159817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:19.160702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:19.161273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:19.850705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:19.859010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2afa22d8-8e6d-4f3c-b9da-a373761e5c83 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.924041 Sep 01 04:58:19.862278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1283/2537] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:18 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:19.880857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:19.881579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:19.887993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:19.888744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:19.889266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:19.890067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:19.890643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:19.891193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.019086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:20.033571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8ee7b03-74d2-4c5a-919b-aa59b6d4b5b9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 0.888570 Sep 01 04:58:20.034318 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1255/2538] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:19 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:20.040903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:20.041698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:20.049105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.049911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.051391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.052459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.053301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.054083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.082974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.273400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:20.289051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd7f1bd9-73f7-42ed-a84b-97429172eaf4 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1367 microversion: 2.1 time: 0.412369 Sep 01 04:58:20.290569 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1284/2539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:19 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:20.300714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:20.301721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:20.314232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.315322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.316928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.318389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.320611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.322225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.414286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:20.422618 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f6b00b6-a054-4611-ba75-898dea401d99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1468 microversion: 2.1 time: 0.386745 Sep 01 04:58:20.427813 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1256/2540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:20 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:20.706810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:20.720213 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca04e87c-46b5-4ed0-bdd2-d2267b50a9af tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.426775 Sep 01 04:58:20.721173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1285/2541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:20 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:20.826526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.851670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=26 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.886647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:20.887300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:20.899396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1210742739", "block_migration": true, "disk_over_commit": false}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:20.902174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:20.910635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.913617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.915618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.916376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.916902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.917322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.921434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.921944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.922386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:20.923152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:20.923615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:20.924041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.079303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lazy-loading 'flavor' on Instance uuid 7919d9da-2ca6-4774-aaeb-c29e3b29c02f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:58:21.098106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Going to try to live migrate instance to tempest-host-1210742739 {{(pid=128862) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 04:58:21.117368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] HTTP exception thrown: Compute host tempest-host-1210742739 could not be found. Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Request method failure captured: Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f/action HTTP/1.1 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 107 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDva3y1a-RsCxTeOjCMYDDzBXYzVFT29BjUyl-UvR8IoWwO8G4AcxthMEWsT18cjCz2UoEXUAdSRbXimG7SCaOF83HerbrZ1LT9ibOYs8TrOsix30RC34ssG1mAaZ_tl5QA92opuVKn_cN23g-lzTU8mDEVwteGDGhSyKQco4V2jdNk Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b3a0fb4ef9f64c638799cd2e15cabeea Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationNegativeTest-1516714345 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationNegativeTest-1516714345 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b3a0fb4ef9f64c638799cd2e15cabeea Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1516714345 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationNegativeTest-1516714345-project-admin Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 4afcebfb5e4e49c8a034164b43f45be7 Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationNegativeTest-1516714345-project-admin Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: {"os-migrateLive": {"host": "tempest-host-1210742739", "block_migration": true, "disk_over_commit": false}} Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: exception: Compute host tempest-host-1210742739 could not be found. Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7919d9da-2ca6-4774-aaeb-c29e3b29c02f', 'body': {'os-migrateLive': {'host': 'tempest-host-1210742739', 'block_migration': True, 'disk_over_commit': False}}} Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 01 04:58:21.132131 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1210742739 could not be found. Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1210742739 could not be found. Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1210742739 could not be found. Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:21.136675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Returning 400 to user: Compute host tempest-host-1210742739 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:21.140971 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99b59cee-d9e6-4ec5-a514-e9073d51d5b8 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f/action" status: 400 len: 100 microversion: 2.1 time: 0.690700 Sep 01 04:58:21.144054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1257/2542] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Sep 1 04:58:20 2022] POST /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f/action => generated 100 bytes in 697 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:58:21.155060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:21.158686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:21.181023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.181536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.181966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.186859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.187856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.189454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.322923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:21.332366 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bd567b4-77cc-483c-b5d3-97fd77c2d0a3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.449529 Sep 01 04:58:21.335219 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1286/2543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:20 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:21.340231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:21.341126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:21.347585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.348510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.349202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.350151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.350832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.351523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.639271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:21.670719 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30b3cdfa-3ff5-4fdc-a48e-ddf00421c98e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 0.523329 Sep 01 04:58:21.673007 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1258/2544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:21 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:21.689584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:21.689743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:21.690643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:21.699631 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f768e7fd-aeec-411e-8d8c-00429249d095 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1468 microversion: 2.1 time: 0.362976 Sep 01 04:58:21.703228 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1287/2545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:21 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1468 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:21.705607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.706168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.706878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.709080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.709626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.710105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.741365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:21.741983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:21.750307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.750626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.751098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:21.751927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:21.752523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:21.752956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:22.111065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:22.121270 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46738335-a0a2-42ce-a60b-df8fb4c63e4d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1557 microversion: 2.1 time: 0.445519 Sep 01 04:58:22.124161 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1259/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:21 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1557 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:22.133005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ad02de4d-9a5b-4697-b1ba-435f29aeebbd req-5b2a444a-f9f1-404c-8c66-cc52b6925aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc60faa4-394d-45cd-89a9-95818ecfb47b", "name": "network-vif-plugged", "status": "completed", "tag": "df5841fd-df50-4f08-ab9e-6d4875a38f24"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:22.144810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad02de4d-9a5b-4697-b1ba-435f29aeebbd req-5b2a444a-f9f1-404c-8c66-cc52b6925aa4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:22.145660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad02de4d-9a5b-4697-b1ba-435f29aeebbd req-5b2a444a-f9f1-404c-8c66-cc52b6925aa4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:22.146303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad02de4d-9a5b-4697-b1ba-435f29aeebbd req-5b2a444a-f9f1-404c-8c66-cc52b6925aa4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:22.150371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:22.165663 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cc9f54b-c493-4732-b3e0-3adcb422c744 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.427950 Sep 01 04:58:22.179035 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1288/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:21 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:22.179035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1924462256", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:22.184945 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ad02de4d-9a5b-4697-b1ba-435f29aeebbd req-5b2a444a-f9f1-404c-8c66-cc52b6925aa4 service nova] Creating event network-vif-plugged:df5841fd-df50-4f08-ab9e-6d4875a38f24 for instance dc60faa4-394d-45cd-89a9-95818ecfb47b on n-h2-820368-37 Sep 01 04:58:22.191743 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ad02de4d-9a5b-4697-b1ba-435f29aeebbd req-5b2a444a-f9f1-404c-8c66-cc52b6925aa4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061701 Sep 01 04:58:22.192975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1260/2548] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:22.199217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:22.200120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:22.208976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:22.209742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:22.210410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:22.211930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:22.212608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:22.213489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:22.283658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:22.382287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0024904f-b0eb-40e4-9e9a-8a628e7fea26 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187410 Sep 01 04:58:22.384695 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1261/2549] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:58:22 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:22.391198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:22.392045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:22.410229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:22.412941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:22.416441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:22.419799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:22.423583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:22.424036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.072957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:23.083061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02035182-20ab-44b4-96ed-5ed711ddc9b6 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.696889 Sep 01 04:58:23.083612 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1262/2550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:22 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:23.101025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:23.101766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:23.112795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:23.113632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:23.114344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.115482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:23.115885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:23.116312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.628903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:23.630016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:23.630658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:23.631272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:23.631832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:23.644742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:23.645252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:23.645654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.646351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:23.646794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:23.647269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.668701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Getting quotas for project 53130c48226c4e438198545d730e4075. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:23.675199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Getting quotas for user d5743545749747bb960173ae115011cc and project 53130c48226c4e438198545d730e4075. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:23.693072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:23.695756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:23.750355 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6de2364-21ea-46e9-9b33-775c6ddd0f06 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580731 Sep 01 04:58:23.751679 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1289/2551] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:23.758204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:23.759243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:23.767277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:23.768043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:23.768622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.769682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:23.770437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:23.771057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:23.797033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:23.815344 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ccf3b2a-0241-439c-87c7-d65839a74718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1315 microversion: 2.1 time: 0.730339 Sep 01 04:58:23.820830 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1263/2552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:23 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:23.834914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e22b5c5-d484-4268-817e-2841f52daec9 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:23.835737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e22b5c5-d484-4268-817e-2841f52daec9 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:23.949896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e22b5c5-d484-4268-817e-2841f52daec9 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:23.960928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e22b5c5-d484-4268-817e-2841f52daec9 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1219 microversion: 2.1 time: 0.138607 Sep 01 04:58:23.979290 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1264/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:23 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:24.129537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:24.132671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:24.135008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:24.138576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ce773fe-4027-45e8-ba39-df4ee9c260e2 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.385445 Sep 01 04:58:24.145011 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1290/2554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:23 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:24.182662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:24.183215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:24.183805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:24.184524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:24.194192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:24.195079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:24.226173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-95deb90b-9dc2-43f0-b005-bfdf2c9161ae req-03c6b4cd-ec4f-4d1c-a7c8-39f771385a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "name": "network-vif-plugged", "status": "completed", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:24.246381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-95deb90b-9dc2-43f0-b005-bfdf2c9161ae req-03c6b4cd-ec4f-4d1c-a7c8-39f771385a2e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:24.249034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-95deb90b-9dc2-43f0-b005-bfdf2c9161ae req-03c6b4cd-ec4f-4d1c-a7c8-39f771385a2e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:24.249864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-95deb90b-9dc2-43f0-b005-bfdf2c9161ae req-03c6b4cd-ec4f-4d1c-a7c8-39f771385a2e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:24.280052 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-95deb90b-9dc2-43f0-b005-bfdf2c9161ae req-03c6b4cd-ec4f-4d1c-a7c8-39f771385a2e service nova] Creating event network-vif-plugged:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h1-820368-37 Sep 01 04:58:24.298665 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-95deb90b-9dc2-43f0-b005-bfdf2c9161ae req-03c6b4cd-ec4f-4d1c-a7c8-39f771385a2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076987 Sep 01 04:58:24.304232 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1291/2555] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:58:24.824686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:24.836983 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c5bfaac-4785-48c2-bd48-51a6675d91a7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.735827 Sep 01 04:58:24.837641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:24.838930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:24.861098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:24.861540 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1265/2556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:24 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:24.861922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:24.862370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:24.863310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:24.863780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:24.864211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.009956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:25.020909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:25.032329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.037435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.039219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.039997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.040727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.041175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.142373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:25.189653 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b400c0c3-fa3d-4b33-be68-81e6025fda2c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1271 microversion: 2.1 time: 0.185012 Sep 01 04:58:25.190512 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1266/2557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:25 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:25.224040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:25.226281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:25.230745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:25.238722 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe9d2c13-26c7-4ea8-825e-ef9db240a8ee tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1502 microversion: 2.1 time: 0.402373 Sep 01 04:58:25.239605 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1292/2558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:24 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:25.263851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:25.264035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.264196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:25.264300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.264704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.265940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.266440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.266912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.276289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.276446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.276817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.277526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.277987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.278412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.325745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:25.335456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:58:25.454432 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-464bb072-fbf3-442c-8495-68991c2f757e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 204 len: 0 microversion: 2.1 time: 0.194531 Sep 01 04:58:25.456848 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1293/2559] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:58:25 2022] DELETE /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:58:25.465671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:25.475985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:25.494548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.495484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.498499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.500119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.500698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.501232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.642698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:25.693454 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2ef1ef7-3dbb-47ce-852e-85d9fb670ac7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1379 microversion: 2.1 time: 0.484148 Sep 01 04:58:25.700412 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1267/2560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:25 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1379 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:25.871802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:25.872421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:25.889559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.890631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.891355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.892329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.892966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.894205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.950784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:25.961029 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63b611cb-5cb3-42e9-aac8-2519c16dbb5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1508 microversion: 2.1 time: 0.500282 Sep 01 04:58:25.962133 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1294/2561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:25 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:25.968014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ff083f19-2a40-440a-84ae-1e6793c534ce req-31c15a38-10b9-47c9-8b25-d0770fdb2456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a734084d-4986-49c0-a6f6-3e8d6a493831", "tag": "4e04edaf-5c78-4536-8947-fefcfeefeadb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:25.979582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ff083f19-2a40-440a-84ae-1e6793c534ce req-31c15a38-10b9-47c9-8b25-d0770fdb2456 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:25.980387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ff083f19-2a40-440a-84ae-1e6793c534ce req-31c15a38-10b9-47c9-8b25-d0770fdb2456 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:25.981217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ff083f19-2a40-440a-84ae-1e6793c534ce req-31c15a38-10b9-47c9-8b25-d0770fdb2456 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:25.995704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ff083f19-2a40-440a-84ae-1e6793c534ce req-31c15a38-10b9-47c9-8b25-d0770fdb2456 service nova] Creating event network-changed:4e04edaf-5c78-4536-8947-fefcfeefeadb for instance a734084d-4986-49c0-a6f6-3e8d6a493831 on n-h1-820368-37 Sep 01 04:58:26.004763 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ff083f19-2a40-440a-84ae-1e6793c534ce req-31c15a38-10b9-47c9-8b25-d0770fdb2456 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038662 Sep 01 04:58:26.005922 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1295/2562] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:26.094255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:26.107585 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c03d5fba-f68e-4455-9575-e5ffbb84ea97 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.241836 Sep 01 04:58:26.108921 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1268/2563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:25 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:26.237659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:26.240817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:26.287183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:26.293311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:26.296460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:26.301392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:26.303884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:26.308024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:26.346170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c4c16b14-5e71-4d42-bb45-bc0478c6d429 req-750629f2-476a-4fa0-8010-4b902bd6213a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "name": "network-vif-plugged", "status": "completed", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:26.424075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4c16b14-5e71-4d42-bb45-bc0478c6d429 req-750629f2-476a-4fa0-8010-4b902bd6213a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:26.427564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4c16b14-5e71-4d42-bb45-bc0478c6d429 req-750629f2-476a-4fa0-8010-4b902bd6213a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:26.429865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c4c16b14-5e71-4d42-bb45-bc0478c6d429 req-750629f2-476a-4fa0-8010-4b902bd6213a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:26.450920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:26.475596 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26125ca7-3e84-471d-9ec7-78b4b5eb910d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1279 microversion: 2.1 time: 0.257655 Sep 01 04:58:26.478386 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1296/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:26 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:26.492745 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c4c16b14-5e71-4d42-bb45-bc0478c6d429 req-750629f2-476a-4fa0-8010-4b902bd6213a service nova] Creating event network-vif-plugged:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:58:26.508419 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c4c16b14-5e71-4d42-bb45-bc0478c6d429 req-750629f2-476a-4fa0-8010-4b902bd6213a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169775 Sep 01 04:58:26.509452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1269/2565] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:26.804998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:26.805999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:26.815962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:26.816442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:26.816884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:26.817688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:26.818105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:26.818579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:26.998187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:26.999346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:27.022800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.023394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.024027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.025249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.026845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.027615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.320489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:27.333543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1eaec93-f487-44f1-bfc3-672a4d6eba9b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1529 microversion: 2.1 time: 0.533651 Sep 01 04:58:27.334166 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1297/2566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:26 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1529 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:27.350572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:27.350572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:27.368892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.369392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.369832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.370545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.371035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.371465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.715454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:27.734093 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e2d6c0a-2892-484b-9aa2-c2229832e91e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1508 microversion: 2.1 time: 0.738738 Sep 01 04:58:27.735647 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1270/2567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:26 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1508 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:27.752727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:27.756882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:27.771352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.772981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.776282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.777298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.780020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.780981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.850385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:27.866684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73ea1c8d-a711-44f6-96e3-8848c4db0270 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1323 microversion: 2.1 time: 0.531175 Sep 01 04:58:27.875608 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1298/2568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:27 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:27.886067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:27.888192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:27.905587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.912282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.913022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:27.914398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:27.915513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:27.918260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:28.313109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:28.326148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fadabe66-5b97-4f2c-abb1-a2d0cf32825b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1529 microversion: 2.1 time: 0.588432 Sep 01 04:58:28.339502 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1271/2569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:27 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1529 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:28.353844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-137eeb3e-ffba-4719-b356-c049525d223a tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:28.393284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-137eeb3e-ffba-4719-b356-c049525d223a tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a" status: 202 len: 0 microversion: 2.1 time: 0.043484 Sep 01 04:58:28.394350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1272/2570] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:58:28 2022] DELETE /compute/v2.1/flavors/9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:58:28.405864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54de8cf5-a838-4bdf-b07c-2f526da62f2f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:28.446327 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54de8cf5-a838-4bdf-b07c-2f526da62f2f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045886 Sep 01 04:58:28.461379 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1273/2571] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 04:58:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:28.470922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:28.473532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:28.482538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:28.483085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:28.484148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:28.484896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:28.485526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:28.485965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:28.567911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:28.579239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Old instance type tempest-test_resize_flavor_-115542011, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 04:58:28.596226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:28.597285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:28.598125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:28.599080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:28.599695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:28.680099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:28.692396 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf7667a1-8535-4a6b-b407-5e74e0ffa0fd tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1319 microversion: 2.1 time: 0.814965 Sep 01 04:58:28.694730 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1299/2572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:27 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1319 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:28.756152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a6923dd-df81-4968-95f5-2a062549e258 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b/action" status: 202 len: 0 microversion: 2.1 time: 0.292023 Sep 01 04:58:28.763595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1274/2573] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:58:28 2022] POST /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:58:28.768430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:28.775570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:28.777975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:28.780256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:28.794726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:28.795286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:28.795761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:28.796420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:28.796871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:28.797751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:28.802453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:28.802975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:28.803466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:28.807695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:28.808431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:28.809332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.568180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:29.582071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0d50c04-5e74-4d61-a549-78073bc3d2ef tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 200 len: 1508 microversion: 2.1 time: 0.821947 Sep 01 04:58:29.583008 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1300/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:28 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 1508 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:29.593511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:29.606257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:29.608143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:29.611852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc51b0a2-1268-4d38-b8d7-cef062445173 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1538 microversion: 2.1 time: 0.845971 Sep 01 04:58:29.614818 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1275/2575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:28 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1538 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:29.625885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.629249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.631393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c7ba21d5-1328-4b88-89d8-d87e741f2e60 req-d8ff9041-0908-4e49-b7eb-f6a98b12bb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc60faa4-394d-45cd-89a9-95818ecfb47b", "name": "network-vif-deleted", "tag": "df5841fd-df50-4f08-ab9e-6d4875a38f24"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:29.632719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.636018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.636584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.638218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.656942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c7ba21d5-1328-4b88-89d8-d87e741f2e60 req-d8ff9041-0908-4e49-b7eb-f6a98b12bb76 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.659135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c7ba21d5-1328-4b88-89d8-d87e741f2e60 req-d8ff9041-0908-4e49-b7eb-f6a98b12bb76 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.661947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c7ba21d5-1328-4b88-89d8-d87e741f2e60 req-d8ff9041-0908-4e49-b7eb-f6a98b12bb76 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.686428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:29.715745 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c7ba21d5-1328-4b88-89d8-d87e741f2e60 req-d8ff9041-0908-4e49-b7eb-f6a98b12bb76 service nova] Creating event network-vif-deleted:df5841fd-df50-4f08-ab9e-6d4875a38f24 for instance dc60faa4-394d-45cd-89a9-95818ecfb47b on n-h2-820368-37 Sep 01 04:58:29.723092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c7ba21d5-1328-4b88-89d8-d87e741f2e60 req-d8ff9041-0908-4e49-b7eb-f6a98b12bb76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104824 Sep 01 04:58:29.727018 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1276/2576] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:29.744768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:29.746251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:29.759792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.762168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.765420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.766846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.767896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.769247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.921223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:29.930263 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bd4a93c-7163-4f6e-84c9-94f8ca13a8ce tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1517 microversion: 2.1 time: 0.329216 Sep 01 04:58:29.938451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1301/2577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:29 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:29.955785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:29.958785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:29.966961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.967465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.967904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:29.968603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:29.969052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:29.974431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.008047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:30.019309 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58208596-5031-45d2-b12b-661787df9584 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1319 microversion: 2.1 time: 0.288455 Sep 01 04:58:30.026511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lazy-loading 'flavor' on Instance uuid 63096516-cfea-4370-ac5b-53c7c20f8bf1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:58:30.048193 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1277/2578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:29 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:30.128278 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbaa6b76-0056-4376-a34e-835d0d544ac0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action" status: 200 len: 32 microversion: 2.1 time: 0.177458 Sep 01 04:58:30.130326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1302/2579] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:58:29 2022] POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 04:58:30.139617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:30.140681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:30.147537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:30.148361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:30.149060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.149977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:30.150688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:30.151327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.493032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:30.510475 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-315a560d-0f60-45d2-b6b7-89676ec7d771 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.374768 Sep 01 04:58:30.512029 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1278/2580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:30 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:30.606162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:30.606858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:30.624241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:30.624742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:30.625185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.625904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:30.626365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:30.626795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.638035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:30.638739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:30.656312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:30.659969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:30.662805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.665665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:30.669842 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 04:58:30.670810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:30.672126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b HTTP/1.1 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'dc60faa4-394d-45cd-89a9-95818ecfb47b'} Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:30.683590 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:30.687747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:30.689088 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c625149d-8e56-48c2-9a99-953badca772b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 404 len: 111 microversion: 2.1 time: 0.087250 Sep 01 04:58:30.697085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1303/2581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:30 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:58:31.050294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:31.051236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:31.072641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:31.074629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:31.079120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:31.080284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:31.087311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:31.088305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:31.356634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:31.369919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-950c3322-3bf8-433f-8f9d-27a15d107abb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1538 microversion: 2.1 time: 0.737253 Sep 01 04:58:31.370525 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1279/2582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:30 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1538 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:31.380069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1234506761", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:31.486224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:31.650471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:31.660412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7736b80b-3415-4e88-86c5-3d2b25da56fa tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1319 microversion: 2.1 time: 0.623299 Sep 01 04:58:31.677557 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1304/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:31 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:31.695199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8e7f80fb-1e3b-4829-92a2-b8007eb31b46 req-91d54fd8-389e-41c1-8914-ee28723cd52c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "096b37b4-7006-4676-b094-31e1224afff1", "tag": "b817237e-b07a-4a41-aba5-ee87e32d195c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:31.717664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8e7f80fb-1e3b-4829-92a2-b8007eb31b46 req-91d54fd8-389e-41c1-8914-ee28723cd52c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:31.718150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8e7f80fb-1e3b-4829-92a2-b8007eb31b46 req-91d54fd8-389e-41c1-8914-ee28723cd52c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:31.729653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8e7f80fb-1e3b-4829-92a2-b8007eb31b46 req-91d54fd8-389e-41c1-8914-ee28723cd52c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:31.783232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8e7f80fb-1e3b-4829-92a2-b8007eb31b46 req-91d54fd8-389e-41c1-8914-ee28723cd52c service nova] Creating event network-changed:b817237e-b07a-4a41-aba5-ee87e32d195c for instance 096b37b4-7006-4676-b094-31e1224afff1 on n-h1-820368-37 Sep 01 04:58:31.790972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8e7f80fb-1e3b-4829-92a2-b8007eb31b46 req-91d54fd8-389e-41c1-8914-ee28723cd52c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107470 Sep 01 04:58:31.791596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1305/2584] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:31.797552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:31.798326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:31.806292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:31.806786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:31.807843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:31.808924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:31.809395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:31.810272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.282038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:32.309917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56e62d8a-87da-4561-9737-74b93d4fafc1 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.516697 Sep 01 04:58:32.310816 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1306/2585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:31 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:32.394561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:32.395947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:32.408902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:32.409804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:32.413403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.414555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:32.415433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:32.416780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.756795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:32.770007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:32.770597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:32.771761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:32.772329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:32.772871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:32.785893 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58ed91fe-dd35-4545-92ea-1a7a2af5f2a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1538 microversion: 2.1 time: 0.393008 Sep 01 04:58:32.786876 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1307/2586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:32 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1538 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:32.798580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:32.804133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:32.805246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:32.806234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.808226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:32.808696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:32.812096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:32.812941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.825150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:32.827329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:32.829183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.830229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:32.831625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:32.836533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:32.868475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:32.883620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:32.890695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:32.919513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:32.923564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:32.962927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:32.997531 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-770cabcb-f852-47c2-82ea-86500207f199 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625731 Sep 01 04:58:32.999107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1280/2587] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:33.027613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23b62341-0a2c-4689-9fbf-03ab5625d6d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:33.032294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23b62341-0a2c-4689-9fbf-03ab5625d6d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:33.181795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:33.197690 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-906de82f-a4c4-4fb7-a2d3-29627e5a456c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1319 microversion: 2.1 time: 0.400956 Sep 01 04:58:33.219855 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1308/2588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:32 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:33.293409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23b62341-0a2c-4689-9fbf-03ab5625d6d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:33.301234 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23b62341-0a2c-4689-9fbf-03ab5625d6d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1215 microversion: 2.1 time: 0.287956 Sep 01 04:58:33.304993 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1281/2589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:33 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:33.333585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:33.337313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:33.343796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:33.344388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:33.344968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:33.345907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:33.346555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:33.347624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:33.655533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:33.685556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:33.787633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:33.799053 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55f67dd3-07e4-489b-9e3d-280673521667 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.469576 Sep 01 04:58:33.800979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1309/2590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:33 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:33.807756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:33.808737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:33.827187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:33.828518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:33.830673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:33.831883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:33.833999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:33.834683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:34.221726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:34.223181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:34.252628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:34.257018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:34.261531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:34.272520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:34.275413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:34.279920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:34.917601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:34.930039 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0e45acf-c3d3-47a3-8baa-c75c81f8c883 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1538 microversion: 2.1 time: 1.126701 Sep 01 04:58:34.930644 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1282/2591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:33 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1538 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:34.939022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:34.939858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:34.950304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:34.950996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:34.951611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:34.953275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:34.954190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:34.954779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:35.149614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:35.161161 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ac5b0d4-a3fa-49eb-9da7-bdb4c78d5d2f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1285 microversion: 2.1 time: 0.229409 Sep 01 04:58:35.161795 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1283/2592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:34 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:35.167368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:35.168974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:35.187974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:35.188483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:35.188915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:35.191828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:35.196473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:35.197114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:35.326863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:35.336242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-660622cc-5c07-4f9e-bffe-82563524c783 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1319 microversion: 2.1 time: 1.118888 Sep 01 04:58:35.336830 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1310/2593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:34 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1319 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:35.831608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:35.862717 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37ca0bac-568f-45d2-b1a2-0c7c403205b0 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.692707 Sep 01 04:58:35.863867 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1284/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:35 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:35.953767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:35.955018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:35.969070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:35.970096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:35.970802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:35.971577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:35.972067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:35.972490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.140536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a8c5c6f1-58e9-429c-8ed8-85006feb7e56 req-db44b38d-2c4a-413e-a1c6-ad912499925e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096b37b4-7006-4676-b094-31e1224afff1", "name": "network-vif-plugged", "status": "completed", "tag": "b817237e-b07a-4a41-aba5-ee87e32d195c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:36.153190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8c5c6f1-58e9-429c-8ed8-85006feb7e56 req-db44b38d-2c4a-413e-a1c6-ad912499925e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.154171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8c5c6f1-58e9-429c-8ed8-85006feb7e56 req-db44b38d-2c4a-413e-a1c6-ad912499925e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.155794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a8c5c6f1-58e9-429c-8ed8-85006feb7e56 req-db44b38d-2c4a-413e-a1c6-ad912499925e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.170274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a8c5c6f1-58e9-429c-8ed8-85006feb7e56 req-db44b38d-2c4a-413e-a1c6-ad912499925e service nova] Creating event network-vif-plugged:b817237e-b07a-4a41-aba5-ee87e32d195c for instance 096b37b4-7006-4676-b094-31e1224afff1 on n-h1-820368-37 Sep 01 04:58:36.176708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a8c5c6f1-58e9-429c-8ed8-85006feb7e56 req-db44b38d-2c4a-413e-a1c6-ad912499925e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040120 Sep 01 04:58:36.178111 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1285/2595] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:58:36.185937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:36.186964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:36.196644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.197364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.198272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.199316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.200770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.201458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.383182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:36.401957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d92064d-03cd-4576-a8dd-dcb49a041d38 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1273 microversion: 2.1 time: 0.214988 Sep 01 04:58:36.403262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1286/2596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:36 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:36.415390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:36.418919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:36.436273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.438964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.439712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.443935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.445545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.446139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.476870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:36.491887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdcfb4ad-e713-4d44-85b8-4e4937233837 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.542581 Sep 01 04:58:36.493752 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1311/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:35 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:36.684913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0542c7af-6101-496f-9b06-5ac3126df46a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: .version_select at 0x7fa75b4eb4c0>, body: {"keypair": {"name": "tempest-keypair-1758477392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7sH8N/h6Pm4QOJSIo0uI4INM3EMrB5Qh1eM2MlAROKVV6fsW9neHSTYojB1AASz4HsQ9GUnTA9vG3TkD0vD3AY5Iqv6tMqj1aXlXGtp0Qrc5dipvwUWtMaA4orN0xkA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:36.715923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0542c7af-6101-496f-9b06-5ac3126df46a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:36.723807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0542c7af-6101-496f-9b06-5ac3126df46a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:36.761919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0542c7af-6101-496f-9b06-5ac3126df46a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.234208 Sep 01 04:58:36.764427 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1312/2598] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 04:58:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:36.867761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:36.884367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:36.885366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:36.893042 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca9aad66-4532-4040-b3be-bf3ed054f937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1319 microversion: 2.1 time: 0.488067 Sep 01 04:58:36.896017 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1287/2599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:36 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:36.897842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.904562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.905408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:36.906319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:36.906949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:36.907986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:37.349769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:37.363996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc273f43-0e04-4298-b6f8-82983bcaf4da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.483621 Sep 01 04:58:37.366180 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1313/2600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:36 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:37.435124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:37.437903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:37.450799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:37.451643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:37.452291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:37.453855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:37.455115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:37.456721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:37.528509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:37.533643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:37.552408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:37.553297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:37.553958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:37.555894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:37.556529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:37.557155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.252714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:38.261809 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bac272fd-3fd7-4b83-b5ce-ee547f4651b6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.836866 Sep 01 04:58:38.276190 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1288/2601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:37 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:38.282321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:38.283696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:38.290844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:38.291827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:38.292530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.293502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:38.294200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:38.294827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.437786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:38.455308 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-575b88f9-040c-4199-9bcc-071a385c0e2d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.934158 Sep 01 04:58:38.456925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1314/2602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:37 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:38.462972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:38.463851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:38.479528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:38.480567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:38.481247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.481911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:38.482789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:38.483723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.813936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:38.823820 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08a093fe-c383-4a98-8329-7f385ba15e25 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1469 microversion: 2.1 time: 0.546213 Sep 01 04:58:38.825716 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1289/2603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:38 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1469 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:38.850178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:38.855968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:38.869157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:38.870505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:38.871369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.873484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:38.874316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:38.878032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:38.910124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lazy-loading 'flavor' on Instance uuid 096b37b4-7006-4676-b094-31e1224afff1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:58:39.009011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0541d94a-512e-4794-8f83-2a5437dd411e tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1/action" status: 202 len: 0 microversion: 2.1 time: 0.164476 Sep 01 04:58:39.010276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1290/2604] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:58:38 2022] POST /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:58:39.022953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:39.023782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:39.033692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:39.034364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:39.035571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:39.037917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:39.038514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:39.039811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:39.383852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:39.395950 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4280efc0-69aa-4aab-b2be-748b172d7556 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.937607 Sep 01 04:58:39.397627 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1315/2605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:38 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:39.404622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:39.405381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:39.420123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:39.421207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:39.422025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:39.423028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:39.423646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:39.425352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:39.738147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:39.749107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4be8355-c0e8-4517-ae8e-36bc1ede7594 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1477 microversion: 2.1 time: 0.734600 Sep 01 04:58:39.750250 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1291/2606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:39 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1477 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:39.755308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:39.756158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:39.764066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:39.765200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:39.765848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:39.766732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:39.767355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:39.767921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:40.087395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:40.096205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8dc9023d-55c6-48ed-bfaa-ddd4693b0476 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.696861 Sep 01 04:58:40.098207 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1316/2607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:39 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:40.102932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00708548-7113-4d05-9ae1-55dbe3f8b12f req-00b5723e-bf9b-476a-b46a-627e8c0a58cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bb1e1a-a2d0-4bc3-8b90-de2de37726bd", "tag": "661e449d-6a01-4faf-b522-74565e46b90e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:40.114151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:40.117931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00708548-7113-4d05-9ae1-55dbe3f8b12f req-00b5723e-bf9b-476a-b46a-627e8c0a58cf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:40.118766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00708548-7113-4d05-9ae1-55dbe3f8b12f req-00b5723e-bf9b-476a-b46a-627e8c0a58cf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:40.119555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00708548-7113-4d05-9ae1-55dbe3f8b12f req-00b5723e-bf9b-476a-b46a-627e8c0a58cf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:40.136348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-00708548-7113-4d05-9ae1-55dbe3f8b12f req-00b5723e-bf9b-476a-b46a-627e8c0a58cf service nova] Creating event network-changed:661e449d-6a01-4faf-b522-74565e46b90e for instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd on n-h2-820368-37 Sep 01 04:58:40.142838 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00708548-7113-4d05-9ae1-55dbe3f8b12f req-00b5723e-bf9b-476a-b46a-627e8c0a58cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043168 Sep 01 04:58:40.143686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1317/2608] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:40.298705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:40.308365 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06162b2d-9368-4e98-a678-0a7a7a099d0f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.556803 Sep 01 04:58:40.309513 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1292/2609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:39 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:40.419420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:40.420610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:40.435726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:40.436516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:40.437297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:40.438330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:40.439015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:40.439955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:40.773697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:40.774561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:40.780882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:40.781626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:40.782207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:40.783417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:40.784127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:40.785100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:40.871774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:40.881324 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9b6def3-4ed6-4742-933f-6f94bfdcc880 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.467080 Sep 01 04:58:40.882331 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1318/2610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:40 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:41.118962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:41.120133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:41.127658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.128615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:41.128883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.129727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.130640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.131270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.131947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.152785 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c51b145-2380-4733-aabd-400ac8592b4d tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1460 microversion: 2.1 time: 0.383164 Sep 01 04:58:41.154660 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1293/2611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:40 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1460 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:41.180895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:41.182343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:41.194287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.195261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.196033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.197322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.198156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.199233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.207690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:41.436648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:41.446502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-247dd8ad-09cd-4a7b-a7c9-e1510dcdb6c9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.331852 Sep 01 04:58:41.448443 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1319/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:41 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:41.458582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:41.459533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:41.471671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.472454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.472945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.474193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.474713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.475357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.808122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69ef6cdb-9591-45a1-8dd9-03d63b4c6135 tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1613 microversion: 2.1 time: 0.636079 Sep 01 04:58:41.813391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:41.821581 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1294/2613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:41 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1613 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:41.823103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-378f864f-3e51-4736-b516-804712516222 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.372190 Sep 01 04:58:41.823453 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1320/2614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:41 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:41.834736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:41.839457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.845364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.845888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.846846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.847818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.848475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.874554 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f309757-bae5-4cbd-9041-1de7eb7e6a0a tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044920 Sep 01 04:58:41.875518 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1295/2615] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 04:58:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:41.889353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-820368-37", "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:41.892918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:41.902267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.903150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:41.903567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.904028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:41.905031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.906275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.906988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.908105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.915939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.916913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.917823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.919157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:41.920158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:41.921544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:41.955395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Lazy-loading 'flavor' on Instance uuid 096b37b4-7006-4676-b094-31e1224afff1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:58:41.970266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 096b37b4-7006-4676-b094-31e1224afff1 while it is in vm_state suspended Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Request method failure captured: Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1/action HTTP/1.1 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 98 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDva3y1a-RsCxTeOjCMYDDzBXYzVFT29BjUyl-UvR8IoWwO8G4AcxthMEWsT18cjCz2UoEXUAdSRbXimG7SCaOF83HerbrZ1LT9ibOYs8TrOsix30RC34ssG1mAaZ_tl5QA92opuVKn_cN23g-lzTU8mDEVwteGDGhSyKQco4V2jdNk Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b3a0fb4ef9f64c638799cd2e15cabeea Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationNegativeTest-1516714345 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3a0fb4ef9f64c638799cd2e15cabeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationNegativeTest-1516714345 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b3a0fb4ef9f64c638799cd2e15cabeea Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1516714345 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationNegativeTest-1516714345-project-admin Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 4afcebfb5e4e49c8a034164b43f45be7 Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationNegativeTest-1516714345-project-admin Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: {"os-migrateLive": {"host": "n-h2-820368-37", "block_migration": true, "disk_over_commit": false}} Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'os-migrateLive' instance 096b37b4-7006-4676-b094-31e1224afff1 while it is in vm_state suspended Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '096b37b4-7006-4676-b094-31e1224afff1', 'body': {'os-migrateLive': {'host': 'n-h2-820368-37', 'block_migration': True, 'disk_over_commit': False}}} Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 096b37b4-7006-4676-b094-31e1224afff1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:41.972541 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 096b37b4-7006-4676-b094-31e1224afff1 while it is in vm_state suspended Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 096b37b4-7006-4676-b094-31e1224afff1 while it is in vm_state suspended Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 096b37b4-7006-4676-b094-31e1224afff1 while it is in vm_state suspended {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d38bf8bf-0022-43b0-afbe-d58d9545685b tempest-LiveMigrationNegativeTest-1516714345 tempest-LiveMigrationNegativeTest-1516714345-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1/action" status: 409 len: 155 microversion: 2.1 time: 0.089259 Sep 01 04:58:41.976237 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1321/2616] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:58:41 2022] POST /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1/action => generated 155 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:58:41.986060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-966602115", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9642a39a-f472-4737-aec3-d2f3e852c183"}], "security_groups": [{"name": "tempest-securitygroup--1021631007"}], "key_name": "tempest-keypair-1758477392", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:42.137228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:42.142405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] validate_networks() for [('9642a39a-f472-4737-aec3-d2f3e852c183', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:58:42.151705 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b56d99b-149b-4ac3-8b15-73753a75e6d7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.252751 Sep 01 04:58:42.157171 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1296/2617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:41 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:42.170960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:42.170960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:42.173179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.173698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.174193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.174942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.175403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.175844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.204488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:58:42.295955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ce27276-2ad0-44e2-9d5b-c1b6182e5428 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "DELETE /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 204 len: 0 microversion: 2.1 time: 0.136808 Sep 01 04:58:42.296595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1297/2618] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:58:42 2022] DELETE /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:58:42.306132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:42.307095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:42.313860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.314437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.315324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.316181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.316816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.317242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.560719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:42.577799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42dcaa53-3b48-4690-907c-b8b1b1a19aff tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1466 microversion: 2.1 time: 0.276039 Sep 01 04:58:42.598382 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1298/2619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:42 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1466 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:42.609949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:42.610967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:42.620816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.621581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.622258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.623381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.624118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.624804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.694040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:58:42.694550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:58:42.695054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:58:42.695504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:58:42.696122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:58:42.705617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.706478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.707013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.707879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.708364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.708881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.727990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:58:42.734397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:58:42.748244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:58:42.750683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:58:42.784273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:42.793654 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6e7fd37-7854-4923-9e0b-7a112d0a50e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.193628 Sep 01 04:58:42.794383 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1299/2620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:42 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:42.817710 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-568c24b5-5d8a-4e5f-9caa-0bb9f38856f8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.841252 Sep 01 04:58:42.818386 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1322/2621] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:58:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:58:42.829809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93932f5f-843a-44bd-a037-8aeb412089c8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:42.830717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93932f5f-843a-44bd-a037-8aeb412089c8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:42.844821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:42.846215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:42.853471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.854022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.854758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.855596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:42.856355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:42.856943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:42.933720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93932f5f-843a-44bd-a037-8aeb412089c8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:42.948727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93932f5f-843a-44bd-a037-8aeb412089c8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1241 microversion: 2.1 time: 0.122776 Sep 01 04:58:42.949473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1300/2622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:42 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:43.181583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:43.182458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:43.193338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:43.194016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:43.194997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:43.196603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:43.198199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:43.199441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:43.459481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:43.469408 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c142472-5da0-48ce-9757-4e545511a8ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.628581 Sep 01 04:58:43.470003 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1323/2623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:42 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:43.487891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:43.496747 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e1f4538-f450-4f07-8ec8-d572eef47126 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.322682 Sep 01 04:58:43.497521 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1301/2624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:43 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:43.614643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:43.615354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:43.644876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:43.645794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:43.646236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:43.648140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:43.648776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:43.649331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:43.817355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:43.818378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:43.825820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:43.826747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:43.827425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:43.828480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:43.829149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:43.829758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.188187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:44.196768 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03ff3043-9ee8-4f32-b67b-1d78bb175b99 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1466 microversion: 2.1 time: 0.586881 Sep 01 04:58:44.198028 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1324/2625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:43 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1466 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:44.203546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:44.204621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:44.212823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:44.213339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:44.213763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.214461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:44.214925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:44.215381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.263582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:44.273831 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0969e5b7-9928-468e-8378-af41d85c6123 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.461467 Sep 01 04:58:44.274726 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1302/2626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:43 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:44.320249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:44.328363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9600347b-54b6-44c2-82b6-f6053c7f987b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1237 microversion: 2.1 time: 0.129044 Sep 01 04:58:44.328938 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1325/2627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:44 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:44.492295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:44.492912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:44.501276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:44.501753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:44.502180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.503236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:44.504671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:44.505398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.518263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:44.519118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:44.530928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:44.531473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:44.531867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.532988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:44.533452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:44.533963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:44.963521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:44.970549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:44.973695 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-496589ca-360e-4902-8eef-ac513887a8cf tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.485726 Sep 01 04:58:44.980607 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c601c61-eb73-4ef8-8fa7-92920e79d8e4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.466578 Sep 01 04:58:44.994925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1326/2628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:44 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:44.995159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1303/2629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:44 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:45.209614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-08bee217-a2cc-42c1-b942-e63ae570e22d req-53afd711-db68-4d11-818c-4e1c8ce0d628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096b37b4-7006-4676-b094-31e1224afff1", "name": "network-vif-deleted", "tag": "b817237e-b07a-4a41-aba5-ee87e32d195c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:45.220560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:45.222127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:45.223993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-08bee217-a2cc-42c1-b942-e63ae570e22d req-53afd711-db68-4d11-818c-4e1c8ce0d628 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.224777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-08bee217-a2cc-42c1-b942-e63ae570e22d req-53afd711-db68-4d11-818c-4e1c8ce0d628 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.226232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-08bee217-a2cc-42c1-b942-e63ae570e22d req-53afd711-db68-4d11-818c-4e1c8ce0d628 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.246157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.246641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.247187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.247915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.248366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.248785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.259962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-08bee217-a2cc-42c1-b942-e63ae570e22d req-53afd711-db68-4d11-818c-4e1c8ce0d628 service nova] Creating event network-vif-deleted:b817237e-b07a-4a41-aba5-ee87e32d195c for instance 096b37b4-7006-4676-b094-31e1224afff1 on n-h1-820368-37 Sep 01 04:58:45.268936 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-08bee217-a2cc-42c1-b942-e63ae570e22d req-53afd711-db68-4d11-818c-4e1c8ce0d628 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066948 Sep 01 04:58:45.273326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1327/2630] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:45.299899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:45.301179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:45.309904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.310680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.311763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.312921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.313668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.314307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.344320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:45.498722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:45.509610 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb077af8-ee98-40df-b458-0344b4e81937 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 200 len: 1295 microversion: 2.1 time: 0.295647 Sep 01 04:58:45.510982 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1304/2631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:45 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 1295 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:45.538375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:45.539170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:45.549323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.549952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.550393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.551597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:45.554238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:45.556111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:45.627571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:45.637364 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5638643-ea23-4445-97c3-2e3275ef253f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.343874 Sep 01 04:58:45.638370 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1328/2632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:45 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:45.687738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:45.697359 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75a04cbb-ce33-4079-baea-922e6bd24a04 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1311 microversion: 2.1 time: 0.184632 Sep 01 04:58:45.698162 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1305/2633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:45 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:45.995283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:45.996035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:46.005392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:46.006010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:46.018192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.019313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.030497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.031573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.032220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.033157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.034963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.035888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.036492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.037044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.037586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.038086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.421067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:46.431689 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6028bde5-6a65-4efe-a52f-c3152b82e997 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.432356 Sep 01 04:58:46.432450 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1306/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:45 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:46.463319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:46.472316 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d488975-22fe-4a27-af1e-44ee32a04cd0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.480877 Sep 01 04:58:46.473008 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1329/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:45 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:46.535938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:46.537295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 096b37b4-7006-4676-b094-31e1224afff1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:46.543862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.544336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.544772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.545492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.545985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.546364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.562154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] HTTP exception thrown: Instance 096b37b4-7006-4676-b094-31e1224afff1 could not be found. Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Request method failure captured: Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 HTTP/1.1 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvYkoNYgbf6xpslzhIPDP087xVYFUygCCwfM699b5e51qScLvOdd1dQkKxUZGh3yVYZrWBkgUQKznsqlGnkTrFbJ_Rn2qTvv5kf2otz9dOapEedNfdwLs_5oUAqZqetslpsN3Aq3qTiDm7D9UhnOt-OVsczJjGtyWyM7c7XD1hXeWY Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 53130c48226c4e438198545d730e4075 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationNegativeTest-1646479619 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53130c48226c4e438198545d730e4075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/53130c48226c4e438198545d730e4075"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_53130c48226c4e438198545d730e4075"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53130c48226c4e438198545d730e4075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationNegativeTest-1646479619 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 53130c48226c4e438198545d730e4075 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1646479619 Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationNegativeTest-1646479619-project Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d5743545749747bb960173ae115011cc Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationNegativeTest-1646479619-project Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 096b37b4-7006-4676-b094-31e1224afff1 could not be found. Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '096b37b4-7006-4676-b094-31e1224afff1'} Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096b37b4-7006-4676-b094-31e1224afff1 could not be found. Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096b37b4-7006-4676-b094-31e1224afff1 could not be found. Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:46.564112 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096b37b4-7006-4676-b094-31e1224afff1 could not be found. Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Returning 404 to user: Instance 096b37b4-7006-4676-b094-31e1224afff1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10cc9616-dbd9-4921-9eab-4802d82f3af5 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1" status: 404 len: 111 microversion: 2.1 time: 0.035895 Sep 01 04:58:46.569955 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1307/2636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:46 2022] GET /compute/v2.1/servers/096b37b4-7006-4676-b094-31e1224afff1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:58:46.577779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:46.578385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:46.586683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.587333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.587774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.588485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.590592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.591066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.630309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:58:46.660732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:46.661667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:46.671397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.672289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.672923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.674086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.674532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.675524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.757558 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a76586f5-a63d-4b4c-85d0-b74312534f7c tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 204 len: 0 microversion: 2.1 time: 0.184541 Sep 01 04:58:46.759917 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1330/2637] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:58:46 2022] DELETE /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:58:46.766826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:46.767944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:46.776183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.776834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.777727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:46.778560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:46.779243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:46.779969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.123607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:47.135436 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42721fdd-6635-4b4d-bb72-341c16ec53b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.479815 Sep 01 04:58:47.138301 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1308/2638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:46 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:47.146107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:47.148652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:47.156395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:47.157234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:47.158637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.159663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:47.160346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:47.160981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.204043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:47.217602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f729136-0da6-4d50-a2da-d5f57e6f220e tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.455965 Sep 01 04:58:47.220864 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1331/2639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:46 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:47.454285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:47.455310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:47.464487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:47.465799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:47.466240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.466646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:47.467146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:47.467606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:47.468028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.477166 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c764915f-f233-4078-b755-05cde58a48c4 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1474 microversion: 2.1 time: 0.336984 Sep 01 04:58:47.488227 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1309/2640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:47 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:47.495781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:47.496562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:47.505755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:47.506703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:47.507317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.508189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:47.508809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:47.509236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:47.829711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:47.837448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:47.839017 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf5bbd4c-7f51-4b21-89cf-00e0cd7fe065 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.388875 Sep 01 04:58:47.848006 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d54e3559-0074-4766-9632-114fd2713802 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.356152 Sep 01 04:58:47.855045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1310/2641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:47 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:47.866046 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1332/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:47 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:48.058461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6fa6d9da-871f-4086-b7da-800f5769b47e req-2bfada99-2b7a-4543-93c2-8032a33e0874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360af898-9d37-4f14-a30b-95e19c0d6e79", "tag": "76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:48.086170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6fa6d9da-871f-4086-b7da-800f5769b47e req-2bfada99-2b7a-4543-93c2-8032a33e0874 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:48.086741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6fa6d9da-871f-4086-b7da-800f5769b47e req-2bfada99-2b7a-4543-93c2-8032a33e0874 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:48.087424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6fa6d9da-871f-4086-b7da-800f5769b47e req-2bfada99-2b7a-4543-93c2-8032a33e0874 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:48.115614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6fa6d9da-871f-4086-b7da-800f5769b47e req-2bfada99-2b7a-4543-93c2-8032a33e0874 service nova] Creating event network-changed:76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd for instance 360af898-9d37-4f14-a30b-95e19c0d6e79 on n-h2-820368-37 Sep 01 04:58:48.121358 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6fa6d9da-871f-4086-b7da-800f5769b47e req-2bfada99-2b7a-4543-93c2-8032a33e0874 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068051 Sep 01 04:58:48.122549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1311/2643] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:48.162241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:48.162928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:48.176465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:48.177962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:48.178809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:48.179606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:48.180097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:48.180730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:48.250216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:48.250941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:48.258249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:48.258734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:48.259195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:48.259890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:48.260338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:48.260752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:48.265183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:49.084150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:49.096102 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cf303c1-7ed3-421c-b9e1-89cd919510a9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.939309 Sep 01 04:58:49.096993 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1333/2644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:48 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:49.105975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:49.106903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:49.114971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.118861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:49.123837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.124300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.125105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.125568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.125993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.129329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bace05a2-8660-464b-bc04-25ddec0f48b9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.882983 Sep 01 04:58:49.130098 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1312/2645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:48 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:49.135565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cbab9660-0043-4961-9ed6-1aa777efad00 req-018d1215-287f-4fb0-a047-bcbbc4d28173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bb1e1a-a2d0-4bc3-8b90-de2de37726bd", "name": "network-vif-plugged", "status": "completed", "tag": "661e449d-6a01-4faf-b522-74565e46b90e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:49.156866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cbab9660-0043-4961-9ed6-1aa777efad00 req-018d1215-287f-4fb0-a047-bcbbc4d28173 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.157351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cbab9660-0043-4961-9ed6-1aa777efad00 req-018d1215-287f-4fb0-a047-bcbbc4d28173 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.158130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cbab9660-0043-4961-9ed6-1aa777efad00 req-018d1215-287f-4fb0-a047-bcbbc4d28173 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.180916 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cbab9660-0043-4961-9ed6-1aa777efad00 req-018d1215-287f-4fb0-a047-bcbbc4d28173 service nova] Creating event network-vif-plugged:661e449d-6a01-4faf-b522-74565e46b90e for instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd on n-h2-820368-37 Sep 01 04:58:49.188576 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cbab9660-0043-4961-9ed6-1aa777efad00 req-018d1215-287f-4fb0-a047-bcbbc4d28173 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057017 Sep 01 04:58:49.189477 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1313/2646] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:49.197911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:49.198778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:49.207875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.208685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.209140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.209948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.210414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.210923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.695813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:49.704569 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96ffb5db-005e-4d55-b558-4de07e957b52 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1474 microversion: 2.1 time: 0.604000 Sep 01 04:58:49.705438 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1334/2647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:49 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1474 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:49.711231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:49.712109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:49.712610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:49.720550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.721322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.721822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.722977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:49.723623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:49.724162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6da1158c-d217-4a00-99e6-def28e96a919 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.531047 Sep 01 04:58:49.724388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:49.725320 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1314/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:49 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:49.990500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:49.999680 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25a34ccb-841d-4b6a-9fa3-12a06205f847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.292773 Sep 01 04:58:50.017548 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1335/2649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:49 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:50.120079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:50.120784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:50.127910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.128413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.128855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.129586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.130052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.130470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.149718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-234ad852-15c9-40e9-8b91-de02d7cfad2f req-c517994c-c4e9-44ee-8706-53f8496a9128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7919d9da-2ca6-4774-aaeb-c29e3b29c02f", "name": "network-vif-deleted", "tag": "61a454bd-5cff-407f-bd4f-ea9bb031aee3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:50.184173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-234ad852-15c9-40e9-8b91-de02d7cfad2f req-c517994c-c4e9-44ee-8706-53f8496a9128 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.184663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-234ad852-15c9-40e9-8b91-de02d7cfad2f req-c517994c-c4e9-44ee-8706-53f8496a9128 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.185319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-234ad852-15c9-40e9-8b91-de02d7cfad2f req-c517994c-c4e9-44ee-8706-53f8496a9128 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.212704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-234ad852-15c9-40e9-8b91-de02d7cfad2f req-c517994c-c4e9-44ee-8706-53f8496a9128 service nova] Creating event network-vif-deleted:61a454bd-5cff-407f-bd4f-ea9bb031aee3 for instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f on n-h1-820368-37 Sep 01 04:58:50.230951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-234ad852-15c9-40e9-8b91-de02d7cfad2f req-c517994c-c4e9-44ee-8706-53f8496a9128 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086229 Sep 01 04:58:50.231919 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1336/2650] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:58:50.238198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:50.239667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:50.247157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.247653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.248087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.248803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.249264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.249819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.534944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:50.546166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8f9eb3e-2496-4990-a648-b00ca136310c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.312769 Sep 01 04:58:50.546778 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1337/2651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:50 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:50.555110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:50.577685 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb46cdce-61e1-43d8-b6ef-fd5fa70b39dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.459929 Sep 01 04:58:50.578606 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1315/2652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:50 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:50.730513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:50.731541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:50.739039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.739901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.740616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.741520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.742185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.742790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.747177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:50.747955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:50.761330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.761918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.762466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.763539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.764183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.764816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.796184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:50.797309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:50.797911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:50.798545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lazy-loading 'fault' on Instance uuid 7919d9da-2ca6-4774-aaeb-c29e3b29c02f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:58:50.859784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5743545749747bb960173ae115011cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53130c48226c4e438198545d730e4075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:50.873012 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e81247ae-706b-4980-a718-f3401e674781 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 200 len: 1308 microversion: 2.1 time: 0.148045 Sep 01 04:58:50.876115 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1338/2653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:50 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:51.022629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:51.023610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:51.031014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.033147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.033901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.035062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.035601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.036148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.084415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:51.095447 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cda29fa-e7fc-4cb0-a0b5-ed8e1947ac23 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.352924 Sep 01 04:58:51.108277 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1316/2654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:50 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:51.213469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:51.221831 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ca8c489-402e-41ca-805c-566bc90316ba tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.204020 Sep 01 04:58:51.222489 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1339/2655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:51 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:51.568950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:51.569563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:51.576910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.578068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.578068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.578573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.579083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.579781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.602122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:51.603942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:51.612769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.613636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.614309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.615416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.616112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.617033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.812748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:51.823303 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d816e5cc-7198-4627-bba1-4589b0aaffab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.259192 Sep 01 04:58:51.824718 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1317/2656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:51 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:51.826508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:51.839060 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05d503b8-415e-4be7-9b25-3ed663c38aea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.243401 Sep 01 04:58:51.839659 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1340/2657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:51 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:51.899282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:51.899807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] [instance: 7919d9da-2ca6-4774-aaeb-c29e3b29c02f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:51.901870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:51.908129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.908616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.909137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.909842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:51.910289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:51.910697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:51.924899 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] HTTP exception thrown: Instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f could not be found. Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Request method failure captured: Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f HTTP/1.1 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvYkoNYgbf6xpslzhIPDP087xVYFUygCCwfM699b5e51qScLvOdd1dQkKxUZGh3yVYZrWBkgUQKznsqlGnkTrFbJ_Rn2qTvv5kf2otz9dOapEedNfdwLs_5oUAqZqetslpsN3Aq3qTiDm7D9UhnOt-OVsczJjGtyWyM7c7XD1hXeWY Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 53130c48226c4e438198545d730e4075 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-LiveMigrationNegativeTest-1646479619 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53130c48226c4e438198545d730e4075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/53130c48226c4e438198545d730e4075"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_53130c48226c4e438198545d730e4075"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/53130c48226c4e438198545d730e4075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-LiveMigrationNegativeTest-1646479619 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 53130c48226c4e438198545d730e4075 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1646479619 Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-LiveMigrationNegativeTest-1646479619-project Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d5743545749747bb960173ae115011cc Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-LiveMigrationNegativeTest-1646479619-project Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f could not be found. Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7919d9da-2ca6-4774-aaeb-c29e3b29c02f'} Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f could not be found. Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f could not be found. Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:58:51.926561 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f could not be found. Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] Returning 404 to user: Instance 7919d9da-2ca6-4774-aaeb-c29e3b29c02f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83d2331f-f4cc-48e9-aab2-c97aafa58f79 tempest-LiveMigrationNegativeTest-1646479619 tempest-LiveMigrationNegativeTest-1646479619-project] 10.222.0.26 "GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f" status: 404 len: 111 microversion: 2.1 time: 0.032842 Sep 01 04:58:51.930602 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1318/2658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:51 2022] GET /compute/v2.1/servers/7919d9da-2ca6-4774-aaeb-c29e3b29c02f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:58:52.119078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:52.120336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:52.128346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.129036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.129658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.130380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.130839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.131493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.243739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:52.244622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:52.251964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.252448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.252903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.253950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.254496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.254938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.340393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:52.352126 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a41b4426-40a2-41ec-8cf5-8b7a57125ac4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.238076 Sep 01 04:58:52.366166 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1341/2659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:52 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:52.432008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:52.449610 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85a1b23c-e9c0-435d-a5f7-f3ef98f4d6d6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1543 microversion: 2.1 time: 0.205956 Sep 01 04:58:52.450376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1319/2660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:52 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1543 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:52.847023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:52.847981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:52.850487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:52.851715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:52.859644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.860483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.861116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.861230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:52.862072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:52.863364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.864770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.865410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.873959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.874459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.874923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.875792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:52.876245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:52.877207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:52.941111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:53.305836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:53.314771 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15257266-85f9-45fc-a52a-65b5854eaad6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.473609 Sep 01 04:58:53.316712 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1342/2661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:52 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:53.335049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:53.343203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db6e535b-1b09-4690-8ba1-8e91133e2300 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1315 microversion: 2.1 time: 0.486331 Sep 01 04:58:53.343784 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1320/2662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:52 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:53.375962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:53.376744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:53.390295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:53.391122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:53.391965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:53.392846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:53.393461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:53.394059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:53.418093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:53.471086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:53.471922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:53.478612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:53.479038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:53.479479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:53.480980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:53.481601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:53.482337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:53.932726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:53.945345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa50424e-928c-4a79-9cef-9ef080e0e501 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.574786 Sep 01 04:58:53.946179 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1343/2663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:53 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:54.056310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:54.065185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20dbb7af-584b-4737-a824-c67768e90484 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1542 microversion: 2.1 time: 0.597949 Sep 01 04:58:54.066208 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1321/2664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:53 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1542 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:54.308910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "name": "network-vif-unplugged", "status": "completed", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:54.320193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:54.321106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:54.321770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:54.341928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:54.342556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:54.356700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] Creating event network-vif-unplugged:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h2-820368-37 Sep 01 04:58:54.364458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:54.365082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:54.365538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:54.366300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:54.372207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:54.372375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:58:54.372797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:54.398310 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-aac19a05-b233-4387-9d9b-e99c26e6ed75 req-be01ba3a-68ef-4dca-adac-dda8c7f61465 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093690 Sep 01 04:58:54.399653 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1344/2665] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:54.407148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:54.409431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:54.419773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:54.420472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:54.421205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:54.422198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:54.422973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:54.423666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:55.170364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:55.179440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:55.185416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2431deb9-1df1-4e42-a38b-f000451b6997 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.846364 Sep 01 04:58:55.188231 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1820dfa8-bf7d-40a8-9e3d-52c6c59ae173 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1502 microversion: 2.1 time: 0.787035 Sep 01 04:58:55.200231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1322/2666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:54 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:55.208181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:55.208558 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1345/2667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:54 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1502 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:55.210279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:55.219350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:55.219980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:55.235782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:55.238755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:55.239190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:55.239497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:55.240180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:55.241172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:55.241482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:55.241999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:55.242572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:55.247323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:55.248049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:55.248587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:55.671596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:55.686921 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa8eb35c-8cb8-460d-975a-e18e0c470569 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1542 microversion: 2.1 time: 0.476789 Sep 01 04:58:55.700342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1346/2668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:55 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1542 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:55.715774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:55.725903 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c692a70-974c-4083-92c6-af0e6b702d10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.524395 Sep 01 04:58:55.726727 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1323/2669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:55 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:55.916360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Action: 'update', calling method: .version_select at 0x7fa75b4308b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:55.998515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:55.999038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:55.999473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.000233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.000688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.001111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.105848 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fc23d96-fb54-440f-97ba-c323fd8f7e0b tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2" status: 200 len: 148 microversion: 2.57 time: 0.404060 Sep 01 04:58:56.113076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1347/2670] 10.222.0.26 () {62 vars in 1303 bytes} [Thu Sep 1 04:58:55 2022] PUT /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2 => generated 148 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:56.120702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Calling method '.version_select at 0x7fa75bbbb8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:56.207563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:56.214615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:56.215348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:56.215767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.216480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.217142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.218124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.218795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.219727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.228362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.228868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.229325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.230049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.230513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.238621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.249092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f143446-498b-4f6d-84b0-5f23947e32d3 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2/detail" status: 200 len: 463 microversion: 2.57 time: 0.135154 Sep 01 04:58:56.258942 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1324/2671] 10.222.0.26 () {60 vars in 1304 bytes} [Thu Sep 1 04:58:56 2022] GET /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2/detail => generated 463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 04:58:56.508366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Action: 'update', calling method: .version_select at 0x7fa75bcbc280>, body: {"quota_set": {"ram": "2048"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:56.517190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:56.544340 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e70aefbf-493e-42f3-badc-b270aff38c60 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.332461 Sep 01 04:58:56.555749 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1348/2672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:56 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:56.602067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.602831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.603518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.604514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.605153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.605745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.673689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.674230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.674696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.675799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.678685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.678685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.716401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:56.716877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:56.721079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:56.729971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.730465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.730920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.734540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.736627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.737222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.818839 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8f72a2b-08fe-42aa-8d2a-34dedc1b3b56 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2?user_id=1da95341a1894da79e95026d8a35e76c" status: 200 len: 148 microversion: 2.57 time: 0.312113 Sep 01 04:58:56.822803 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1325/2673] 10.222.0.26 () {62 vars in 1384 bytes} [Thu Sep 1 04:58:56 2022] PUT /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2?user_id=1da95341a1894da79e95026d8a35e76c => generated 148 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:56.838577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:56.839584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:56.853499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.856499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.859283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:56.861086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:56.861604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:56.862485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:57.020021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:57.028920 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7690fe4f-2b9a-4c90-9693-54739289c781 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1474 microversion: 2.1 time: 0.317815 Sep 01 04:58:57.035308 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1349/2674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:56 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:57.040692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:57.051158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:57.051659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:57.052093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:57.065838 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] Creating event network-changed:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h2-820368-37 Sep 01 04:58:57.072379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:58:57.084516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0ec3e920-1971-4df2-8d1c-e4b2c5c0ec61 req-5cc881c3-51a6-4417-a42a-d0e8f7552e5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047512 Sep 01 04:58:57.085371 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1350/2675] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:57.098877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-735f7097-4d76-44b0-838f-85eec3a990f7 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] Calling method '.version_select at 0x7fa75b4ebc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:57.136799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:57.148315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49c5a147-a73a-4a6c-a8af-d9b9cffc40ca tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.316075 Sep 01 04:58:57.148787 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1326/2676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:56 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:57.169693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-00c49949-e26b-41f5-be00-be508d920777 req-ff6085c4-1369-49cf-8755-9ad54e4c30ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360af898-9d37-4f14-a30b-95e19c0d6e79", "name": "network-vif-plugged", "status": "completed", "tag": "76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:57.183387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-00c49949-e26b-41f5-be00-be508d920777 req-ff6085c4-1369-49cf-8755-9ad54e4c30ec service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:57.183975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-00c49949-e26b-41f5-be00-be508d920777 req-ff6085c4-1369-49cf-8755-9ad54e4c30ec service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:57.184690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-00c49949-e26b-41f5-be00-be508d920777 req-ff6085c4-1369-49cf-8755-9ad54e4c30ec service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:57.198979 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-00c49949-e26b-41f5-be00-be508d920777 req-ff6085c4-1369-49cf-8755-9ad54e4c30ec service nova] Creating event network-vif-plugged:76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd for instance 360af898-9d37-4f14-a30b-95e19c0d6e79 on n-h2-820368-37 Sep 01 04:58:57.205229 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-00c49949-e26b-41f5-be00-be508d920777 req-ff6085c4-1369-49cf-8755-9ad54e4c30ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044543 Sep 01 04:58:57.206844 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1327/2677] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:58:57.215400 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-735f7097-4d76-44b0-838f-85eec3a990f7 tempest-QuotasAdminTestV257-792505066 tempest-QuotasAdminTestV257-792505066-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2?user_id=1da95341a1894da79e95026d8a35e76c" status: 200 len: 190 microversion: 2.57 time: 0.128458 Sep 01 04:58:57.216009 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1351/2678] 10.222.0.26 () {60 vars in 1364 bytes} [Thu Sep 1 04:58:57 2022] GET /compute/v2.1/os-quota-sets/b9f01642cb8c41429e1c0ab5cf9e29e2?user_id=1da95341a1894da79e95026d8a35e76c => generated 190 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:57.588523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:57.590143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:57.599115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:57.600007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:57.600673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:57.602124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:57.602808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:57.603534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:57.858317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:57.869110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bcc3e81b-e3a4-4b37-8c38-97694f56f285 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.286297 Sep 01 04:58:57.869707 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1328/2679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:57 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:57.962120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dd9f0f4-2ecf-4a17-862c-9980db4fdbab"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:58:57.964798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:57.973639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:57.974275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:57.974747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:57.975548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:57.976202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:57.976653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:58.052952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:58.053571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:58.063978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:58.064468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:58.065126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:58.066024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:58.066479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:58.066914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:58.225667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:58.234314 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b9a85d5-64da-49c6-9c2d-f3a9d6147f8a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1474 microversion: 2.1 time: 0.186076 Sep 01 04:58:58.247045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1329/2680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:58 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1474 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:58.247045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:58.247045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:58.247045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:58.247573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:58.247792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:58.248958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:58.249595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:58.250043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:58.483215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:58.491896 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21a0bdf8-ab8a-43c3-8dff-816ee818e9cb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.255553 Sep 01 04:58:58.503350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1330/2681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:58 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:58.894725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:58.895514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:58.903551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:58.904035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:58.904614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:58.905352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:58.905978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:58.906558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:59.081365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:59.084282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:59.092271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4226d703-2928-4ff7-b41d-52fbe78a9e73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.202422 Sep 01 04:58:59.093129 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1331/2682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:58 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:58:59.259655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:59.261371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:59.274537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:59.275590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:59.276232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:59.277316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:59.278002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:59.278680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:59.499773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:59.511707 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1797e79-8392-45d1-a5bd-e1638d88fd1c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1474 microversion: 2.1 time: 0.257638 Sep 01 04:58:59.512667 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1332/2683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:59 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1474 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:58:59.517321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:58:59.517932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:58:59.524602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:59.525538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:59.526433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:59.527496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:58:59.528126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:58:59.528605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:58:59.774861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:58:59.788404 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01d63c86-191e-464d-85d4-0307653a1d76 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.274676 Sep 01 04:58:59.789249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1333/2684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:58:59 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:00.114600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:00.115326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:00.128118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:00.128614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:00.129048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:00.132720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:00.133357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:00.133799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:00.497420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2419f140-bf76-4123-9f89-b7081d766365 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.539220 Sep 01 04:59:00.499197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1352/2685] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 04:58:57 2022] POST /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd/os-volume_attachments => generated 194 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:00.541022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:00.541788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:00.564244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:00.564755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:00.565389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:00.569750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:00.583462 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77fa9322-bbc1-4fba-8cc1-9d7ed8e53d55 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.473331 Sep 01 04:59:00.596040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:00.596645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:00.597091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:00.603359 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1334/2686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:00 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:00.810261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:00.811155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:00.831690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:00.836848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:00.837824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:00.839300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:00.840289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:00.841394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.039726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:01.048116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a866fbb6-0ae7-46a0-9c2b-1020c7ddf483 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1471 microversion: 2.1 time: 0.512722 Sep 01 04:59:01.055511 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1353/2687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:00 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:01.070190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:01.071082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:01.077261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.077998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.078692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.079674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.080205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.080735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.124502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.125498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.125830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.126623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.127594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.127952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.145668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:01.153671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:01.160248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for user 30b46ee5087145e6828acac49bee0b9b and project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:01.162873 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dfed4f97-1a8f-4084-ad51-10f3ef325e6b tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.354973 Sep 01 04:59:01.164066 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1335/2688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:00 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:01.302344 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f9d99b7-3e6b-4b69-b941-6510a436edfd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b/action" status: 202 len: 0 microversion: 2.1 time: 0.236633 Sep 01 04:59:01.303451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1354/2689] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:01 2022] POST /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:01.313558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.314468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:01.321993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.322608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.323134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.324119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.324777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.325399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.533602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:01.545108 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41876032-cd3d-45ae-9ecd-685a88881130 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1470 microversion: 2.1 time: 0.236265 Sep 01 04:59:01.546416 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1336/2690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:01.591068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Action: 'update', calling method: .version_select at 0x7fa75bf268b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:01.595884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.596371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.597203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.606198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.606687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.607163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.613242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.614048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:01.615110 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] HTTP exception thrown: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Request method failure captured: Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 HTTP/1.1 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 56 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDwVCdN1hZ_CAyqhwrNfEx4f9fza0tQ04ZSI31P8phmBqYcQfxTwERP1T8nXvL0-LpzcFk44NJSNY4MxVuUgkwwc75HtcQ-1HHfZKlMUVBVmZ7r4yG4MYI7dQ13O5TycBKPJsrtDHw_PR7bsi8OPO7vSbYMlibLwsWdLLaMAJkEeWpg Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.53 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b38b68bd7cb54073b99fd37e144ab241 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b38b68bd7cb54073b99fd37e144ab241 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b2c74c94856d4452b8517c4a3657a82e Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: exception: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:01.617304 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Returning 404 to user: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5364142-6292-45fc-8b9e-918a16a900e0 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3" status: 404 len: 110 microversion: 2.53 time: 0.173550 Sep 01 04:59:01.621965 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1355/2691] 10.222.0.26 () {62 vars in 1309 bytes} [Thu Sep 1 04:59:01 2022] PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 => generated 110 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:59:01.627827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.628485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.628935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.629565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Action: 'update', calling method: .version_select at 0x7fa75bf26c10>, body: {"status": "disabled"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:01.630576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.631092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.631797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.638188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.638188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.638188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.642702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.644095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.644762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.652366 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] HTTP exception thrown: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Request method failure captured: Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 HTTP/1.1 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 22 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDwVCdN1hZ_CAyqhwrNfEx4f9fza0tQ04ZSI31P8phmBqYcQfxTwERP1T8nXvL0-LpzcFk44NJSNY4MxVuUgkwwc75HtcQ-1HHfZKlMUVBVmZ7r4yG4MYI7dQ13O5TycBKPJsrtDHw_PR7bsi8OPO7vSbYMlibLwsWdLLaMAJkEeWpg Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.53 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b38b68bd7cb54073b99fd37e144ab241 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b38b68bd7cb54073b99fd37e144ab241 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b2c74c94856d4452b8517c4a3657a82e Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: {"status": "disabled"} Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: exception: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3', 'body': {'status': 'disabled'}} Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:01.654189 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.659395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Returning 404 to user: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:01.661256 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07ad5488-96fc-4e49-9c59-d845f2295256 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3" status: 404 len: 110 microversion: 2.53 time: 0.036146 Sep 01 04:59:01.662279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1356/2692] 10.222.0.26 () {62 vars in 1309 bytes} [Thu Sep 1 04:59:01 2022] PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:59:01.685760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Action: 'update', calling method: .version_select at 0x7fa75b4f4160>, body: {"status": "enabled"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:01.689859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.690441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.690878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.699535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.700169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.700709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.707958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] HTTP exception thrown: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Request method failure captured: Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 HTTP/1.1 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 21 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDwVCdN1hZ_CAyqhwrNfEx4f9fza0tQ04ZSI31P8phmBqYcQfxTwERP1T8nXvL0-LpzcFk44NJSNY4MxVuUgkwwc75HtcQ-1HHfZKlMUVBVmZ7r4yG4MYI7dQ13O5TycBKPJsrtDHw_PR7bsi8OPO7vSbYMlibLwsWdLLaMAJkEeWpg Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.53 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b38b68bd7cb54073b99fd37e144ab241 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b38b68bd7cb54073b99fd37e144ab241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b38b68bd7cb54073b99fd37e144ab241 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169 Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b2c74c94856d4452b8517c4a3657a82e Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: {"status": "enabled"} Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: exception: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3', 'body': {'status': 'enabled'}} Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:01.709796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Returning 404 to user: Service e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-049cc410-3d52-4fd8-89ee-d3880f50d8c7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3" status: 404 len: 110 microversion: 2.53 time: 0.031538 Sep 01 04:59:01.713960 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1357/2693] 10.222.0.26 () {62 vars in 1309 bytes} [Thu Sep 1 04:59:01 2022] PUT /compute/v2.1/os-services/e5363bcc-e1ce-4622-b8fa-6184eb2fbfd3 => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:59:01.720908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.724814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.725304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.725740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.727372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.727837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.728266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.753462 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7804f43-fc8d-41c2-87eb-5f4ed937d7af tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036262 Sep 01 04:59:01.762340 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1358/2694] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:01.767884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.772167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.772699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.773174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.774633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.775205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.775639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.802925 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d61a780d-5f18-4bb3-91d3-6ffaeec9c373 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039023 Sep 01 04:59:01.811029 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1359/2695] 10.222.0.26 () {60 vars in 1211 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:01.825433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.829720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.830181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.831066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.832031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.832496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.832923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.865791 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-406b674d-40e2-4f8c-bd52-6afd04a36d1d tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050669 Sep 01 04:59:01.866931 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1360/2696] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:01.879115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.883122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.883619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.884062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.884801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.885302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.885665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.887793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:01.900436 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9e0e0e3-19c9-48b4-a96b-e1c7992bc315 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.295097 Sep 01 04:59:01.910544 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1337/2697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:01.919651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a9dfcbe-819b-43ab-bdee-9b7c4b6e317c tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-820368-37&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.044765 Sep 01 04:59:01.920281 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1361/2698] 10.222.0.26 () {60 vars in 1237 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/os-services?host=n-d-820368-37&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:01.932624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.936616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.937187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.937687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.938488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.939292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.939781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.971610 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-815bdd5e-b90e-4914-8d98-cde58cb3c1a7 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.042743 Sep 01 04:59:01.972742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1338/2699] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:59:01.985097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:01.989094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.989831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.990273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:01.991188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:01.991803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:01.992414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.030139 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ebbc8b8-eebb-40fc-bc61-6c80403c4082 tempest-ServicesAdminNegativeV253TestJSON-1221638169 tempest-ServicesAdminNegativeV253TestJSON-1221638169-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.048770 Sep 01 04:59:02.031264 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1362/2700] 10.222.0.26 () {60 vars in 1239 bytes} [Thu Sep 1 04:59:01 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:02.187378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:02.188128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:02.202566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:02.204798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:02.206598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.208625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:02.210635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:02.211304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.223721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad755392-4c41-4189-95f9-3989979ba0a9 tempest-ServicesAdminNegativeV253TestJSON-529529123 tempest-ServicesAdminNegativeV253TestJSON-529529123-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:02.229434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad755392-4c41-4189-95f9-3989979ba0a9 tempest-ServicesAdminNegativeV253TestJSON-529529123 tempest-ServicesAdminNegativeV253TestJSON-529529123-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '115e9debc48e40f3aaf475380e208740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03d896722aa49beab345458092db68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad755392-4c41-4189-95f9-3989979ba0a9 tempest-ServicesAdminNegativeV253TestJSON-529529123 tempest-ServicesAdminNegativeV253TestJSON-529529123-project] Request method failure captured: Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDwUU3mqOrwNSMQs7h0Zk57tAawfDScI8fWKF4QNCcnlLSttr9UFT2rHN50RsYt9a4Hhm7bfCC-aKVg3sZPdR5pMCtB1QwkqAvVRdYxKcvHa-dMH9u0fphSX94hDQHWpJzaBWhVe_A7zi6DdHMHFjeu9An4Aw2pRv78W0WMIFPe8mPw Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.53 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c03d896722aa49beab345458092db68c Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-529529123 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c03d896722aa49beab345458092db68c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c03d896722aa49beab345458092db68c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c03d896722aa49beab345458092db68c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c03d896722aa49beab345458092db68c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-529529123 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c03d896722aa49beab345458092db68c Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-529529123 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServicesAdminNegativeV253TestJSON-529529123-project Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 115e9debc48e40f3aaf475380e208740 Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-529529123-project Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: action_args: {} Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise self.value Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 01 04:59:02.232220 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 01 04:59:02.238473 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:02.241116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:02.242482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad755392-4c41-4189-95f9-3989979ba0a9 tempest-ServicesAdminNegativeV253TestJSON-529529123 tempest-ServicesAdminNegativeV253TestJSON-529529123-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:02.245061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad755392-4c41-4189-95f9-3989979ba0a9 tempest-ServicesAdminNegativeV253TestJSON-529529123 tempest-ServicesAdminNegativeV253TestJSON-529529123-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.204056 Sep 01 04:59:02.246209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1339/2701] 10.222.0.26 () {60 vars in 1178 bytes} [Thu Sep 1 04:59:02 2022] GET /compute/v2.1/os-services => generated 112 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 01 04:59:02.532451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:02.545123 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-975f607c-bd15-464f-a16e-9780c85f0d2e tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.362327 Sep 01 04:59:02.548003 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1363/2702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:02 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:02.573956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:02.575283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:02.583065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:02.584050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:02.585124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.586037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:02.586686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:02.587449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.926131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:02.926757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:02.936650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:02.937151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:02.942289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.942988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:02.943642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:02.944261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:02.998406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:03.009081 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc3af3aa-d729-434c-9aa2-dc9faacc213c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1470 microversion: 2.1 time: 0.442616 Sep 01 04:59:03.010319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1340/2703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:02 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1470 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:03.243447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:03.252560 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f410deae-d86d-44db-a403-660f0d6b7e32 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1367 microversion: 2.1 time: 0.330601 Sep 01 04:59:03.264625 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1364/2704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:02 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:03.573892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:03.575262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:03.607671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:03.609069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:03.609616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:03.610447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:03.611040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:03.611725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:03.839971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "name": "network-vif-plugged", "status": "completed", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:03.868667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:03.869836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:03.870682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:03.912810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] Creating event network-vif-plugged:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h2-820368-37 Sep 01 04:59:03.936239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:59:03.965085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-df936bae-908b-4b1f-adcc-9c3cdc196e2e req-2e86cdb8-505f-44b8-930c-e606b7975407 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137038 Sep 01 04:59:03.968532 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1365/2705] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:59:04.043099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:04.043934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:04.063236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.070228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.071089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.072001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.072626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.075733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.157381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:04.181878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d34dbe19-cda6-42de-866e-2d80951c74f7 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.610333 Sep 01 04:59:04.184230 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1341/2706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:03 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:04.262212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:04.275100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:04.275557 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c161473d-e264-4f11-9dd3-51380381cfb3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1470 microversion: 2.1 time: 0.245130 Sep 01 04:59:04.276493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1366/2707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:04 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:04.290545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:04.301728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.302469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.303170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.304034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.304659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.305241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.542293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:04.555376 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18a88119-6dcb-453b-a3fb-273f7ad9ca07 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1558 microversion: 2.1 time: 0.285238 Sep 01 04:59:04.556229 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1342/2708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:04 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1558 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:04.578211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:04.579045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:04.587373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.588123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.588739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.590234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.591157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.591599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.694971 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45a8714f-75b4-4023-92e5-96d53a5d1409 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121462 Sep 01 04:59:04.703431 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1367/2709] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 04:59:04 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:04.772192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f463e7b4-623a-4890-9d9a-0471dced8af9"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:04.778211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:04.788841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.789689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.790384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:04.791328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:04.791989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:04.792626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:05.211672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:05.214304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:05.224682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:05.227972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:05.229596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:05.231885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:05.233521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:05.235267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:05.259106 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f1f010b-ab6a-4204-a667-42ad292e03a2 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "POST /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491549 Sep 01 04:59:05.260190 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1343/2710] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 04:59:04 2022] POST /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:05.300088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:05.309766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:05.344042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:05.344817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:05.345470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:05.347767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:05.348530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:05.349272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:05.974731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:05.990591 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40fe9660-63eb-4ffb-bdad-9b464ca7a121 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1523 microversion: 2.1 time: 0.784368 Sep 01 04:59:05.991588 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1368/2711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:05 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1523 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:06.129219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:06.143337 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02e27bb2-5170-4711-9a27-794b479149ee tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1470 microversion: 2.1 time: 0.847571 Sep 01 04:59:06.148277 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1344/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:05 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1470 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:07.019902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:07.021524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:07.043969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:07.045133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:07.045891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:07.047055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:07.047988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:07.049519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:07.167346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:07.168794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:07.172123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:07.180273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:07.181326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:07.182128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:07.183888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:07.184650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:07.185356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:07.206426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:07.546792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:07.559550 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2417bdf2-b1c3-4369-a34a-19a8f37d3afb tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1503 microversion: 2.1 time: 0.545889 Sep 01 04:59:07.564153 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1369/2713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:07 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:07.588845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d02def2-c29b-4475-9e20-ebea18d1878d tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'create', calling method: .version_select at 0x7fa760442550>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-617622779", "description": "tempest-description-193493412"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:07.903418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:07.927549 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18189f99-cda1-4137-94de-a9c050ab1125 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1470 microversion: 2.1 time: 0.764907 Sep 01 04:59:07.934444 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1345/2714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:07 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1470 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:07.951555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-769acc40-cdd2-4165-ad92-dfeb00065a95 req-c508c768-b419-449c-b63a-28398c525051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360af898-9d37-4f14-a30b-95e19c0d6e79", "tag": "76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:07.982051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-769acc40-cdd2-4165-ad92-dfeb00065a95 req-c508c768-b419-449c-b63a-28398c525051 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:07.982544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-769acc40-cdd2-4165-ad92-dfeb00065a95 req-c508c768-b419-449c-b63a-28398c525051 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:07.983053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-769acc40-cdd2-4165-ad92-dfeb00065a95 req-c508c768-b419-449c-b63a-28398c525051 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:08.016009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-769acc40-cdd2-4165-ad92-dfeb00065a95 req-c508c768-b419-449c-b63a-28398c525051 service nova] Creating event network-changed:76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd for instance 360af898-9d37-4f14-a30b-95e19c0d6e79 on n-h2-820368-37 Sep 01 04:59:08.037011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-769acc40-cdd2-4165-ad92-dfeb00065a95 req-c508c768-b419-449c-b63a-28398c525051 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098475 Sep 01 04:59:08.042572 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1346/2715] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:08.476548 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d02def2-c29b-4475-9e20-ebea18d1878d tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.891865 Sep 01 04:59:08.477753 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1370/2716] 10.222.0.26 () {60 vars in 1180 bytes} [Thu Sep 1 04:59:07 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:08.496646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-617622779"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:08.497441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:08.519839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:08.522156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:08.522780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:08.523646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:08.526235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:08.526794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:08.955785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:08.956518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:08.969551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:08.970301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:08.972229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:08.973212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:08.974024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:08.974651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:09.063389 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Adding security group 3164e81b-6c95-45ae-b85a-4ee2df6313ee to port 74b704f7-4995-40e3-993c-f1e5dfa2c156 Sep 01 04:59:09.739723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:09.755719 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19eb332e-8a75-430a-8d81-f57096fe0ec6 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1470 microversion: 2.1 time: 0.804651 Sep 01 04:59:09.756663 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1371/2717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:08 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:10.777834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:10.778674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:10.796535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:10.797410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:10.797934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:10.802952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:10.803548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:10.804357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:11.217362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:11.229119 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e75e295b-b91c-45c4-b56c-33aec038a3c7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1536 microversion: 2.1 time: 0.455535 Sep 01 04:59:11.230452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1372/2718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:10 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1536 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:11.476434 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57147aa3-2490-4e16-8cfe-676e68dcf825 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action" status: 202 len: 0 microversion: 2.1 time: 2.987583 Sep 01 04:59:11.477775 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1347/2719] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:08 2022] POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action => generated 0 bytes in 2992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:11.486389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-617622779"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:11.487677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:11.502956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:11.504774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:11.508766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:11.511488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:11.512187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:11.516301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:11.524573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ee09760d-a34e-4ace-89ec-29e5552cc7fa req-7e6251e5-f379-475c-ae06-ae2fc5d6a855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:11.552200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ee09760d-a34e-4ace-89ec-29e5552cc7fa req-7e6251e5-f379-475c-ae06-ae2fc5d6a855 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:11.553128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ee09760d-a34e-4ace-89ec-29e5552cc7fa req-7e6251e5-f379-475c-ae06-ae2fc5d6a855 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:11.553903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ee09760d-a34e-4ace-89ec-29e5552cc7fa req-7e6251e5-f379-475c-ae06-ae2fc5d6a855 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:11.589324 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ee09760d-a34e-4ace-89ec-29e5552cc7fa req-7e6251e5-f379-475c-ae06-ae2fc5d6a855 service nova] Creating event network-changed:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:59:11.602053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ee09760d-a34e-4ace-89ec-29e5552cc7fa req-7e6251e5-f379-475c-ae06-ae2fc5d6a855 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088258 Sep 01 04:59:11.604539 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1348/2720] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:12.019945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=21 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:12.187289 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Removing security group 3164e81b-6c95-45ae-b85a-4ee2df6313ee from port 74b704f7-4995-40e3-993c-f1e5dfa2c156 Sep 01 04:59:12.257132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:12.258975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:12.263857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:12.271884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:12.272776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:12.273767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:12.274731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:12.275648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:12.276278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:12.709920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:12.719856 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8136bde-ceb9-4d49-8e77-5fa8b81b5792 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1536 microversion: 2.1 time: 0.471367 Sep 01 04:59:12.733930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1349/2721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:12 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1536 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:13.495596 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10f59cd9-500f-401d-afa2-6c3a6262854a tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action" status: 202 len: 0 microversion: 2.1 time: 2.011905 Sep 01 04:59:13.498405 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1373/2722] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:11 2022] POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action => generated 0 bytes in 2017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:13.509883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12534dac-254d-4c66-ac62-3e2453f3b2da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'create', calling method: .version_select at 0x7fa75bcbb820>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:13.666678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "name": "network-vif-unplugged", "status": "completed", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}, {"name": "network-changed", "server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}, {"name": "network-changed", "server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:13.689273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:13.690154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:13.690740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:13.730841 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Creating event network-vif-unplugged:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h1-820368-37 Sep 01 04:59:13.733158 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Creating event network-changed:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h1-820368-37 Sep 01 04:59:13.733869 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Creating event network-changed:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:59:13.761152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 04:59:13.791064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d2c86ecf-4743-4584-86e7-5250e60d8f97 req-f1c13006-8b07-47ad-bdc3-a9fe2e689e51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.128325 Sep 01 04:59:13.798029 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1374/2723] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:59:13.806307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:13.807049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:13.828214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:13.828692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:13.829125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:13.833608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:13.834128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:13.834575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:14.334981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:14.363471 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9dc7aff-3710-43be-98dc-dbe493706e34 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1536 microversion: 2.1 time: 0.562187 Sep 01 04:59:14.373021 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1375/2724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:13 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1536 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:15.395876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:15.397354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:15.418921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:15.419453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:15.419902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:15.420637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:15.421107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:15.433033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:16.347982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:16.358276 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f79de34e-7d64-48d5-a328-8d8627d2c385 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1536 microversion: 2.1 time: 0.968081 Sep 01 04:59:16.358935 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1376/2725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:15 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1536 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:17.381951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:17.383305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:17.398792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:17.399401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:17.399855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:17.403107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:17.403613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:17.404059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:17.978372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:17.990369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d13139e-d9f0-42b9-910a-a00c5e7e3a66 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1536 microversion: 2.1 time: 0.613236 Sep 01 04:59:18.017267 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1377/2726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:17 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1536 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:18.963544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-800200641", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "c3a179e7-3876-4dab-a2ca-c167a98c272d"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:19.076819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] validate_networks() for [('c3a179e7-3876-4dab-a2ca-c167a98c272d', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:59:20.076955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12534dac-254d-4c66-ac62-3e2453f3b2da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.570857 Sep 01 04:59:20.078459 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1350/2727] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 04:59:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:20.084186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:20.085551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:20.107149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:20.107960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:20.109189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:20.110188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:20.110861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:20.111658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:20.134790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:20.390376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:20.414170 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9d68cbb-0bf0-4576-bc58-af8ae762dc21 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1529 microversion: 2.1 time: 0.334235 Sep 01 04:59:20.416336 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1351/2728] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:20 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1529 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:20.436781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.176"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:20.440063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:20.448050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:20.448564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:20.449015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:20.449971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:20.450426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:20.451137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:20.481852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "refresh_cache-63096516-cfea-4370-ac5b-53c7c20f8bf1" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:59:20.482401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquired lock "refresh_cache-63096516-cfea-4370-ac5b-53c7c20f8bf1" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:59:20.888283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:20.888844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:20.889189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:20.889627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:20.890275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:20.901782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:20.902439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:20.902928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:20.904087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:20.904871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:20.905323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:20.928408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Getting quotas for project b869765e62cb4bdf98e0630c3dd5b070. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:20.935232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Getting quotas for user b7db64b92d4e4aab9f9349e3010825fb and project b869765e62cb4bdf98e0630c3dd5b070. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:20.951282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:59:20.954158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:59:21.013435 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91dc4d6a-4ae4-4295-81eb-af673c3f1d94 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.206270 Sep 01 04:59:21.014070 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1378/2729] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 04:59:21.019306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:21.020298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:21.027180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:21.027984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:21.029349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:21.030286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:21.030990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:21.032154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:21.522614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:21.540359 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0790fd74-0f7a-4729-9f66-4a2e777f4f97 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1529 microversion: 2.1 time: 0.524541 Sep 01 04:59:21.541671 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1379/2730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:21 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1529 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:21.547353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c6295a6f-6c7f-4747-8008-6358d4827bb6 req-710f2eff-70c6-4e50-a8dc-6826249a7fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "name": "network-vif-plugged", "status": "completed", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:21.561948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6295a6f-6c7f-4747-8008-6358d4827bb6 req-710f2eff-70c6-4e50-a8dc-6826249a7fa1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:21.562915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6295a6f-6c7f-4747-8008-6358d4827bb6 req-710f2eff-70c6-4e50-a8dc-6826249a7fa1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:21.563594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6295a6f-6c7f-4747-8008-6358d4827bb6 req-710f2eff-70c6-4e50-a8dc-6826249a7fa1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:21.581817 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c6295a6f-6c7f-4747-8008-6358d4827bb6 req-710f2eff-70c6-4e50-a8dc-6826249a7fa1 service nova] Creating event network-vif-plugged:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h1-820368-37 Sep 01 04:59:21.591984 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c6295a6f-6c7f-4747-8008-6358d4827bb6 req-710f2eff-70c6-4e50-a8dc-6826249a7fa1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048013 Sep 01 04:59:21.593253 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1380/2731] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:21.606698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f28d44c-5de4-4c16-8113-4a8e322077ab tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:21.607930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f28d44c-5de4-4c16-8113-4a8e322077ab tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:21.612233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:21.736200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f28d44c-5de4-4c16-8113-4a8e322077ab tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:21.760088 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f28d44c-5de4-4c16-8113-4a8e322077ab tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1215 microversion: 2.1 time: 0.163554 Sep 01 04:59:21.761459 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1381/2732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:21 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:21.766604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1c8a8a9-da00-4613-a8cb-c4535086fd06 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:21.775775 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d1c8a8a9-da00-4613-a8cb-c4535086fd06 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] HTTP exception thrown: Flavor 9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a could not be found. Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1c8a8a9-da00-4613-a8cb-c4535086fd06 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Request method failure captured: Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/flavors/9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a HTTP/1.1 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDspzBuarlXYe3Ne9rOBUphHfR7JX5CYUHNa__dn_4LEtG4TYIZCv1i4fjunwz3BirobfLdIIb4MP4IrJdEzJ9ucq3-ROr-MWaf6LB12YNnvfPTG7aTKHNrJO8LDFOOpnhERQus9kY3rKot-3AU4_tSt_rWR4DBtucHu-6-Z-hDVJX0 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 74170ca5a3fb4cc4a75eacf71a959f12 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-MigrationsAdminTest-1106408533 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74170ca5a3fb4cc4a75eacf71a959f12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/74170ca5a3fb4cc4a75eacf71a959f12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_74170ca5a3fb4cc4a75eacf71a959f12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/74170ca5a3fb4cc4a75eacf71a959f12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-MigrationsAdminTest-1106408533 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 74170ca5a3fb4cc4a75eacf71a959f12 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MigrationsAdminTest-1106408533 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-MigrationsAdminTest-1106408533-project-admin Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 91aa0ad569df44b6a2c89bc623f45f94 Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-MigrationsAdminTest-1106408533-project-admin Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: exception: Flavor 9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a could not be found. Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a'} Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a could not be found. Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a could not be found. Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:21.785430 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a could not be found. Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1c8a8a9-da00-4613-a8cb-c4535086fd06 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Returning 404 to user: Flavor 9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1c8a8a9-da00-4613-a8cb-c4535086fd06 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a" status: 404 len: 109 microversion: 2.1 time: 0.026013 Sep 01 04:59:21.792135 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1382/2733] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:59:21 2022] DELETE /compute/v2.1/flavors/9c9d4255-95c7-4d39-b2a7-ea845bfb6d0a => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:21.975868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-291173344", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:22.153513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:59:23.099969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:23.101206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:23.101662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:23.102223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:23.103413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:23.122914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:23.123420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:23.123859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:23.124607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:23.125064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:23.125491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:23.154026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:23.161636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Getting quotas for user 30b46ee5087145e6828acac49bee0b9b and project 7df1df24b4a84c2a9008685936212a05. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:23.191421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:59:23.194221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:59:23.271203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f4b0956-b7e4-4fe0-8e9d-fc25d6635302 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.299294 Sep 01 04:59:23.272444 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1383/2734] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:59:23.288509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:23.289270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:23.306449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:23.307660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:23.308449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:23.309479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:23.309852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:23.310388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:23.562418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:23.587966 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c61fcb35-46af-4661-87ac-5ecb5465e88c tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1273 microversion: 2.1 time: 0.312862 Sep 01 04:59:23.590554 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1384/2735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:23 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:23.612302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e713f1dc-62d5-4649-82e0-1c3e0b8ad95a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:23.613316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e713f1dc-62d5-4649-82e0-1c3e0b8ad95a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:23.855166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e713f1dc-62d5-4649-82e0-1c3e0b8ad95a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:23.866736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Building network info cache for instance {{(pid=128862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:59:23.896248 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e713f1dc-62d5-4649-82e0-1c3e0b8ad95a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1212 microversion: 2.1 time: 0.295844 Sep 01 04:59:23.904312 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1385/2736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:23 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1212 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:23.926695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:23.928242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:23.944698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:23.945781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:23.946443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:23.948945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:23.949670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:23.950922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:24.024352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:59:24.136585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:24.336575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69e6deee-019b-409c-8002-467e58c5c0f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 204 len: 0 microversion: 2.1 time: 0.424577 Sep 01 04:59:24.340729 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1386/2737] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:59:23 2022] DELETE /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:59:24.347938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3ead6139-53c6-44d7-9acf-26ed1a6d3ef7 req-d2ac5671-8554-4470-98c8-4695589bd50f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:24.373300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ead6139-53c6-44d7-9acf-26ed1a6d3ef7 req-d2ac5671-8554-4470-98c8-4695589bd50f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:24.374109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ead6139-53c6-44d7-9acf-26ed1a6d3ef7 req-d2ac5671-8554-4470-98c8-4695589bd50f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:24.375296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ead6139-53c6-44d7-9acf-26ed1a6d3ef7 req-d2ac5671-8554-4470-98c8-4695589bd50f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:24.405743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3ead6139-53c6-44d7-9acf-26ed1a6d3ef7 req-d2ac5671-8554-4470-98c8-4695589bd50f service nova] Creating event network-changed:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:59:24.415236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3ead6139-53c6-44d7-9acf-26ed1a6d3ef7 req-d2ac5671-8554-4470-98c8-4695589bd50f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072814 Sep 01 04:59:24.420462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1387/2738] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:24.439161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:24.440310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:24.451052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:24.451899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:24.455175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:24.456172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:24.456906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:24.459547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:25.254627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:25.265417 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72c6dd14-b67b-4678-b005-f570558838ed tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1554 microversion: 2.1 time: 0.843324 Sep 01 04:59:25.280689 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1388/2739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:24 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1554 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:25.286534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:25.287235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:25.294008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:25.294538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:25.295082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:25.295886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:25.296354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:25.296825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:25.473479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:25.498116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6aac1a6-117a-434a-8212-6b52575fb3e3 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1273 microversion: 2.1 time: 0.215889 Sep 01 04:59:25.520683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1389/2740] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:25 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:25.534819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:25.535555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:25.551838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:25.552417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:25.552939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:25.553745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:25.554276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:25.554775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:25.751143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:25.774610 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b354c90b-e022-42ea-ba2a-f551349f7821 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1264 microversion: 2.1 time: 0.252466 Sep 01 04:59:25.775272 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1390/2741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:25 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:26.328286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "391a7365-4bb9-492a-923f-8ffd230d8ff8"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:26.333794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:26.344036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:26.346012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:26.346800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:26.349140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:26.349879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:26.350566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:26.360786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Updating instance_info_cache with network_info: [{"id": "74b704f7-4995-40e3-993c-f1e5dfa2c156", "address": "fa:16:3e:69:51:c4", "network": {"id": "0be044a0-8aa4-48c9-8459-e6f6f8a634c1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-128116186-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9437b75278bf49d1823a0cdc21e989e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74b704f7-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:59:26.375580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Releasing lock "refresh_cache-63096516-cfea-4370-ac5b-53c7c20f8bf1" {{(pid=128862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:59:26.376653 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58bb1f59-fdf1-4e26-9c5a-404a85d8f6da tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action" status: 202 len: 0 microversion: 2.1 time: 5.958447 Sep 01 04:59:26.378633 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1352/2742] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:20 2022] POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action => generated 0 bytes in 5961 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:59:26.395482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:26.396740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:26.399345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:26.425132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:26.425769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:26.437157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:26.440022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:26.441741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:26.442497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:26.611518 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] HTTP exception thrown: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Request method failure captured: Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments/f463e7b4-623a-4890-9d9a-0471dced8af9 HTTP/1.1 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 74 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvP1uZcK-QQKEubPIT4WcrUgvNCvqfhYnzorQbZWKKgEKT6ffCLujWO1xxT1age41vD7noTXKajHrt14FikK4ScQklskePW3lH-p5UFg3afxxmirN8bblgQbCK4-oDrmGiLUIel6DkIWka-AEVo3e8pgdTrrWqxPWsk9v0cPa6hPSI Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 290d461a5bdf40e092b99ad78ba0befa Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesAdminNegativeTest-1795441396 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesAdminNegativeTest-1795441396 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 290d461a5bdf40e092b99ad78ba0befa Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1795441396 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesAdminNegativeTest-1795441396-project-admin Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 09da29b7231040f39ef29255e92f1c49 Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesAdminNegativeTest-1795441396-project-admin Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "391a7365-4bb9-492a-923f-8ffd230d8ff8"}} Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: exception: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'server_id': 'a734084d-4986-49c0-a6f6-3e8d6a493831', 'id': 'f463e7b4-623a-4890-9d9a-0471dced8af9', 'body': {'volumeAttachment': {'volumeId': '391a7365-4bb9-492a-923f-8ffd230d8ff8'}}} Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. (HTTP 404) (Request-ID: req-4f8397da-a961-4b95-949d-15430fbb7a40) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 04:59:26.640686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. Sep 01 04:59:26.645609 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:26.650509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Returning 400 to user: Volume 391a7365-4bb9-492a-923f-8ffd230d8ff8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:26.654622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc3c3360-879a-4835-81d9-471bc2acb553 tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments/f463e7b4-623a-4890-9d9a-0471dced8af9" status: 400 len: 107 microversion: 2.1 time: 0.523854 Sep 01 04:59:26.655513 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1391/2743] 10.222.0.26 () {60 vars in 1433 bytes} [Thu Sep 1 04:59:26 2022] PUT /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments/f463e7b4-623a-4890-9d9a-0471dced8af9 => generated 107 bytes in 528 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 04:59:26.666401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.176"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:27.127103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:27.134474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:27.135682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:27.136373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:27.136967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:27.138109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:27.139133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:27.140809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:27.173334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59844941-5329-4046-879e-348512bb4718 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1554 microversion: 2.1 time: 0.792977 Sep 01 04:59:27.174682 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1353/2744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:26 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1554 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:27.192596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:27.193765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:27.217468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:27.218352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:27.221120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:27.224973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:27.225810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:27.230466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:27.716188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:27.734269 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7eab4ff-a139-4bec-a56b-014b72e97fee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.557389 Sep 01 04:59:27.736260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1354/2745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:27 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:27.754782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:27.755927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:27.764899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:27.767151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:27.768037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:27.769137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:27.774332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:27.775671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:27.864882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "refresh_cache-63096516-cfea-4370-ac5b-53c7c20f8bf1" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 04:59:27.866621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquired lock "refresh_cache-63096516-cfea-4370-ac5b-53c7c20f8bf1" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 04:59:27.912641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lazy-loading 'services' on Instance uuid a734084d-4986-49c0-a6f6-3e8d6a493831 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:59:28.097062 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e8ff291-467c-4857-a8c9-f85cd70898a5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments/f463e7b4-623a-4890-9d9a-0471dced8af9" status: 202 len: 0 microversion: 2.1 time: 0.357667 Sep 01 04:59:28.102813 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1355/2746] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 04:59:27 2022] DELETE /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments/f463e7b4-623a-4890-9d9a-0471dced8af9 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:28.114557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:28.116353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:28.136242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.137618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.140626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:28.141674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.148515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.149251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:28.666711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:28.680413 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91d48428-1b56-4447-ac8b-df908f949046 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.575189 Sep 01 04:59:28.682037 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1356/2747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:28 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:28.690595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:28.700046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:28.712504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.714816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.721949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:28.723669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.724337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.725002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:28.771943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b98c6bc8-dc2d-470e-8808-abd23990b104 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088427 Sep 01 04:59:28.773118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1357/2748] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:28 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:28.778323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:28.779283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:28.787926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.788856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.789593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:28.790517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.791193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.791865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:28.933998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:28.947364 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad9c9dee-21d8-4c99-a42b-c2307b08112b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1346 microversion: 2.1 time: 0.172771 Sep 01 04:59:28.949206 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1358/2749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:28 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:28.955206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1ec95652-b050-4823-ae10-558d1e60fb2a req-cdeba31c-d60a-4fe5-9f94-5f317d6bf098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bb1e1a-a2d0-4bc3-8b90-de2de37726bd", "name": "network-vif-deleted", "tag": "661e449d-6a01-4faf-b522-74565e46b90e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:28.968883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ec95652-b050-4823-ae10-558d1e60fb2a req-cdeba31c-d60a-4fe5-9f94-5f317d6bf098 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:28.969606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ec95652-b050-4823-ae10-558d1e60fb2a req-cdeba31c-d60a-4fe5-9f94-5f317d6bf098 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:28.970245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1ec95652-b050-4823-ae10-558d1e60fb2a req-cdeba31c-d60a-4fe5-9f94-5f317d6bf098 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:29.000247 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1ec95652-b050-4823-ae10-558d1e60fb2a req-cdeba31c-d60a-4fe5-9f94-5f317d6bf098 service nova] Creating event network-vif-deleted:661e449d-6a01-4faf-b522-74565e46b90e for instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd on n-h2-820368-37 Sep 01 04:59:29.019037 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1ec95652-b050-4823-ae10-558d1e60fb2a req-cdeba31c-d60a-4fe5-9f94-5f317d6bf098 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067879 Sep 01 04:59:29.022584 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1359/2750] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:29.028819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:29.029783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:29.049652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:29.052165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:29.053250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:29.054791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:29.058234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:29.059096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:29.980639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:29.998227 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8273cf3-8a40-4042-a163-b59eb1c7be83 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.973650 Sep 01 04:59:30.001966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1360/2751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:29 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:30.012685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:30.013312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:30.028706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.029564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.038184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.039201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.039855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.040474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.604750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:30.622510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9f41e34-9c00-47df-9a75-6627ed9788be tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.619169 Sep 01 04:59:30.635522 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1361/2752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:30 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:30.635522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-64120326-910a-4913-bae1-b787ccd76f82 req-1b8057fe-b094-4f68-89ea-af7169e2fc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71729b57-79f8-40a5-9bc1-86f0707e199f", "tag": "e9792d39-b889-4223-bee4-45a5070bdbc6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:30.659149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64120326-910a-4913-bae1-b787ccd76f82 req-1b8057fe-b094-4f68-89ea-af7169e2fc17 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.659659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64120326-910a-4913-bae1-b787ccd76f82 req-1b8057fe-b094-4f68-89ea-af7169e2fc17 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.660103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64120326-910a-4913-bae1-b787ccd76f82 req-1b8057fe-b094-4f68-89ea-af7169e2fc17 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.702256 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-64120326-910a-4913-bae1-b787ccd76f82 req-1b8057fe-b094-4f68-89ea-af7169e2fc17 service nova] Creating event network-changed:e9792d39-b889-4223-bee4-45a5070bdbc6 for instance 71729b57-79f8-40a5-9bc1-86f0707e199f on n-h1-820368-37 Sep 01 04:59:30.719023 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-64120326-910a-4913-bae1-b787ccd76f82 req-1b8057fe-b094-4f68-89ea-af7169e2fc17 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094065 Sep 01 04:59:30.719966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1362/2753] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:30.726003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:30.728704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:30.735626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.736602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.737292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.738242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.738993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.739648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.781256 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f947f4b0-0777-459d-8e39-71947f7aeeaf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059682 Sep 01 04:59:30.782268 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1363/2754] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:30 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:30.787999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:30.788935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:30.796066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.796985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.797644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.798760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:30.799471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:30.800113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:30.891249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:30.893289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Sep 01 04:59:30.914207 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f874d6f0-87e0-4610-984b-d641f72608f1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1346 microversion: 2.1 time: 0.129927 Sep 01 04:59:30.931794 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1364/2755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:30 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:31.021855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:31.023306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:31.034728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:31.038945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:31.039992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:31.041091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:31.041752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:31.042684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:31.461354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:31.471775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cfbb613-1315-44cc-b286-e629f43022b8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.454069 Sep 01 04:59:31.491457 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1365/2756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:31 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:31.496501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-18671f06-d231-4745-bfec-39e81b1d603e req-391c3ccf-6128-4e1f-96fc-302f7c12ab2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:31.520845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-18671f06-d231-4745-bfec-39e81b1d603e req-391c3ccf-6128-4e1f-96fc-302f7c12ab2c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:31.521331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-18671f06-d231-4745-bfec-39e81b1d603e req-391c3ccf-6128-4e1f-96fc-302f7c12ab2c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:31.521753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-18671f06-d231-4745-bfec-39e81b1d603e req-391c3ccf-6128-4e1f-96fc-302f7c12ab2c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:31.561743 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-18671f06-d231-4745-bfec-39e81b1d603e req-391c3ccf-6128-4e1f-96fc-302f7c12ab2c service nova] Creating event network-changed:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h1-820368-37 Sep 01 04:59:31.576408 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-18671f06-d231-4745-bfec-39e81b1d603e req-391c3ccf-6128-4e1f-96fc-302f7c12ab2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083481 Sep 01 04:59:31.577039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1366/2757] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:31.649976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:31.650949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:31.671672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:31.672349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:31.678997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:31.679918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:31.680403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:31.684778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:31.710267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Updating instance_info_cache with network_info: [{"id": "74b704f7-4995-40e3-993c-f1e5dfa2c156", "address": "fa:16:3e:69:51:c4", "network": {"id": "0be044a0-8aa4-48c9-8459-e6f6f8a634c1", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-128116186-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9437b75278bf49d1823a0cdc21e989e1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap74b704f7-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 04:59:31.733743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Releasing lock "refresh_cache-63096516-cfea-4370-ac5b-53c7c20f8bf1" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 04:59:31.734638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75e33097-3c19-4b2b-84d9-6ea5e3d031f5 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action" status: 202 len: 0 microversion: 2.1 time: 5.078058 Sep 01 04:59:31.735302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1392/2758] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:26 2022] POST /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1/action => generated 0 bytes in 5079 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 01 04:59:31.746050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb445024-f9bc-4e7e-a5cb-58691ec7708c tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '.version_select at 0x7fa760217ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:32.100462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:32.136612 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fc5cec3-8dcf-4035-ab4d-4932564d9dae tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.484933 Sep 01 04:59:32.141587 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1367/2759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:31 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:32.159124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:32.164813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:32.182956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.183677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.184265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.185121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.185718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.186636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.234035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:32.263734 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e64e3b90-5814-4ef1-8eaa-24922af9f41b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119956 Sep 01 04:59:32.265458 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1368/2760] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:32 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:32.288509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:32.292571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:32.315946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.318440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.318912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.319663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.323248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.324047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.464458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:32.474433 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-909b03bd-fcf9-4995-81eb-ffb4b143ade5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1346 microversion: 2.1 time: 0.199485 Sep 01 04:59:32.485908 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1369/2761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:32 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1346 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:32.497486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:32.498147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:32.509533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.510041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.510475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.511244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.511705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.512135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.819032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:32.829434 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b12beea8-ba7a-48eb-a979-c5b9fb8c237d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.336027 Sep 01 04:59:32.834544 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1370/2762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:32 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:32.845835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6b9be99d-9428-4ba7-a3bd-1cdefe2a60eb req-f67fff24-90b8-4abb-b46e-11130a1d62aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:32.872066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6b9be99d-9428-4ba7-a3bd-1cdefe2a60eb req-f67fff24-90b8-4abb-b46e-11130a1d62aa service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:32.873802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6b9be99d-9428-4ba7-a3bd-1cdefe2a60eb req-f67fff24-90b8-4abb-b46e-11130a1d62aa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:32.878176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6b9be99d-9428-4ba7-a3bd-1cdefe2a60eb req-f67fff24-90b8-4abb-b46e-11130a1d62aa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:32.891854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6b9be99d-9428-4ba7-a3bd-1cdefe2a60eb req-f67fff24-90b8-4abb-b46e-11130a1d62aa service nova] Creating event network-changed:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:59:32.911816 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6b9be99d-9428-4ba7-a3bd-1cdefe2a60eb req-f67fff24-90b8-4abb-b46e-11130a1d62aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074441 Sep 01 04:59:32.913580 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1371/2763] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:33.140452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:33.168034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:33.169613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:33.178142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.179091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.179798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.180777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.181439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.183138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.358477 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb445024-f9bc-4e7e-a5cb-58691ec7708c tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/950540c3-b5f0-41f7-960b-4f83536d0138" status: 202 len: 0 microversion: 2.1 time: 1.616214 Sep 01 04:59:33.359480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1393/2764] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 04:59:31 2022] DELETE /compute/v2.1/os-floating-ips/950540c3-b5f0-41f7-960b-4f83536d0138 => generated 0 bytes in 1618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:33.365545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:33.371289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:33.388073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.390303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.392400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.394213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.397942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.398690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.481404 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a76cc23d-4885-463d-9022-ddaabd5ba86e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118461 Sep 01 04:59:33.486373 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1394/2765] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:33 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:33.493473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-714c4867-71d5-4368-b6c3-386438e9fc10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '.version_select at 0x7fa7605fedc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:33.820479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:33.829013 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ceb9a0ba-1ccb-4a61-a61f-56f6642d6322 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.668596 Sep 01 04:59:33.830472 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1372/2766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:33 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:33.836775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:33.837466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:33.844369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.845202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.846265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.847154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.847915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.848543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.887470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:33.939267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:33.960315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af7ae87f-572f-4535-8e7e-e40357c1b0c7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1346 microversion: 2.1 time: 0.127559 Sep 01 04:59:33.973988 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1373/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:33 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:33.973988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:33.973988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:33.984112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.984704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.985398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:33.987205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:33.987893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:33.988530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:34.470380 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-714c4867-71d5-4368-b6c3-386438e9fc10 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3164e81b-6c95-45ae-b85a-4ee2df6313ee" status: 202 len: 0 microversion: 2.1 time: 0.983080 Sep 01 04:59:34.476817 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1395/2768] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 04:59:33 2022] DELETE /compute/v2.1/os-security-groups/3164e81b-6c95-45ae-b85a-4ee2df6313ee => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:34.483596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:34.484128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:34.496035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:34.496541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:34.507904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:34.508713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:34.509206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:34.510253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:34.567308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:59:34.779794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf8c1428-784a-42f1-be4f-68a2c56615b3 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "DELETE /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 204 len: 0 microversion: 2.1 time: 0.301504 Sep 01 04:59:34.780669 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1396/2769] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:59:34 2022] DELETE /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:59:34.789600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:34.791957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:34.813612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:34.822821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:34.823571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:34.824818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:34.825466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:34.826073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:34.901568 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-761d1156-3178-4afb-a16a-dddf43d62517 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119232 Sep 01 04:59:34.904223 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1397/2770] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:34 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:34.926094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:34.927180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:34.947580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:34.948626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:34.949657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:34.952321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:34.953402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:34.955879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.036497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:35.048562 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5332fe4d-f906-4d35-bfb3-3f92c2b6da50 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 1.081096 Sep 01 04:59:35.049454 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1374/2771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:33 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:35.061795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:35.062715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:35.075768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:35.079054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:35.079790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.080856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:35.082574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:35.086759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.421661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:35.432605 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31d9fd07-aabb-4f35-b64e-9877b1473bfa tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1509 microversion: 2.1 time: 0.526896 Sep 01 04:59:35.443584 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1398/2772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:34 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:35.463369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:35.465569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:35.482869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:35.483446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:35.495754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.496567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:35.497061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:35.497527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.543599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:35.556457 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c85c666-6ddc-4f17-a435-467d14e88384 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.502013 Sep 01 04:59:35.563732 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1375/2773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:35 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:35.626751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:35.636693 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6e1a96c-c3fe-4c91-9cb3-a784bd74c4be tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1346 microversion: 2.1 time: 0.188667 Sep 01 04:59:35.638095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1399/2774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:35 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:35.915571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:35.918269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:35.935599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:35.937573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:35.938244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.940797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:35.943295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:35.943750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:35.990168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1e191e6-7f08-4d6f-afb4-9ed7d501eae7 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079157 Sep 01 04:59:35.991279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1376/2775] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:35 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:36.082993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:36.084005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:36.092270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:36.093215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:36.093898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:36.094843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:36.095656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:36.096921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:36.336427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:36.346106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06e633f7-9720-497d-8336-a9521247c078 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.267988 Sep 01 04:59:36.348114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1400/2776] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:36 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:36.466359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:36.467228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:36.475342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:36.476677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:36.477547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:36.478551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:36.479568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:36.480862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:36.586333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:36.587948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:36.601071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:36.601888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:36.602491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:36.603660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:36.604388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:36.604984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.364657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:37.373606 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0434f4ee-7b81-4794-a70c-d210517292b4 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1509 microversion: 2.1 time: 0.912454 Sep 01 04:59:37.374225 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1377/2777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:36 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1509 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:37.381778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:37.382813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:37.390671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.391529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.392066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.392967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.393648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.394169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.420113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:37.428900 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fa484ac-35a5-44f2-ade6-eda1970d8be0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.846580 Sep 01 04:59:37.442600 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1401/2778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:36 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:37.442736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.442736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.442736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.442736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lazy-loading 'fault' on Instance uuid 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:59:37.443233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:37.443233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:37.457570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.459152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.463921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.465322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.465848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.466361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.493810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:37.512710 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-989a957d-b3ac-426b-83d3-7ffc4ccd1886 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 200 len: 1351 microversion: 2.1 time: 0.133241 Sep 01 04:59:37.516149 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1378/2779] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:37 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:37.527251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:37.528327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:37.528442 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4cb83c0-2e52-493d-904e-c7ae73cc1b9b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094886 Sep 01 04:59:37.537283 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1402/2780] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:37 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:37.542590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.553927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.588456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:37.593983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:37.599106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:37.604835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.090431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:38.106323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1620393-6cae-4d54-9671-5dc20aabbf03 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.588594 Sep 01 04:59:38.107519 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1379/2781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:37 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:38.397474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:38.398390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:38.414486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.415237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.416075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.417644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.418674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.429117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.432294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-64b3db76-96ae-4319-8735-db93a0e4390b req-82f85153-0791-4ebd-b11d-862bfac2827d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63096516-cfea-4370-ac5b-53c7c20f8bf1", "name": "network-vif-deleted", "tag": "74b704f7-4995-40e3-993c-f1e5dfa2c156"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:38.447620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64b3db76-96ae-4319-8735-db93a0e4390b req-82f85153-0791-4ebd-b11d-862bfac2827d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.448525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64b3db76-96ae-4319-8735-db93a0e4390b req-82f85153-0791-4ebd-b11d-862bfac2827d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.449492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-64b3db76-96ae-4319-8735-db93a0e4390b req-82f85153-0791-4ebd-b11d-862bfac2827d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.498649 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-64b3db76-96ae-4319-8735-db93a0e4390b req-82f85153-0791-4ebd-b11d-862bfac2827d service nova] Creating event network-vif-deleted:74b704f7-4995-40e3-993c-f1e5dfa2c156 for instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 on n-h2-820368-37 Sep 01 04:59:38.505526 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-64b3db76-96ae-4319-8735-db93a0e4390b req-82f85153-0791-4ebd-b11d-862bfac2827d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079504 Sep 01 04:59:38.506737 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1380/2782] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:38.513654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:38.514647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:38.522876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.527555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.528233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.535082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:38.540969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.545943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.546699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.621387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187dbd75fe7f4ad48af7e2e39cdd3a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9437b75278bf49d1823a0cdc21e989e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:38.633739 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8585149-1f75-40bb-8d9b-36e20d008866 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 200 len: 1467 microversion: 2.1 time: 0.241365 Sep 01 04:59:38.647573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1403/2783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:38 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 1467 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:38.660251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-79c51d08-75ab-4dcb-a67b-08580320c3f8 req-a421f16b-a683-4e64-83c6-69d1cd4b2673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71729b57-79f8-40a5-9bc1-86f0707e199f", "name": "network-vif-plugged", "status": "completed", "tag": "e9792d39-b889-4223-bee4-45a5070bdbc6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:38.675227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-79c51d08-75ab-4dcb-a67b-08580320c3f8 req-a421f16b-a683-4e64-83c6-69d1cd4b2673 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.676153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-79c51d08-75ab-4dcb-a67b-08580320c3f8 req-a421f16b-a683-4e64-83c6-69d1cd4b2673 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.676815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-79c51d08-75ab-4dcb-a67b-08580320c3f8 req-a421f16b-a683-4e64-83c6-69d1cd4b2673 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.701705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-79c51d08-75ab-4dcb-a67b-08580320c3f8 req-a421f16b-a683-4e64-83c6-69d1cd4b2673 service nova] Creating event network-vif-plugged:e9792d39-b889-4223-bee4-45a5070bdbc6 for instance 71729b57-79f8-40a5-9bc1-86f0707e199f on n-h1-820368-37 Sep 01 04:59:38.716844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-79c51d08-75ab-4dcb-a67b-08580320c3f8 req-a421f16b-a683-4e64-83c6-69d1cd4b2673 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061476 Sep 01 04:59:38.719838 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1404/2784] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:38.736479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:38.742482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:38.763306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.764737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.765863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.768494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.770901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.778737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.895894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91e79676-613a-48e8-9a79-bf633296bcac tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170279 Sep 01 04:59:38.899488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1405/2785] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:38 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:38.914442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:38.918404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:38.937618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.942787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.946903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:38.950575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:38.952874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:38.953612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.021442 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd HTTP/1.1 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '88bb1e1a-a2d0-4bc3-8b90-de2de37726bd'} Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:39.027539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:39.034421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b655488-44a6-47ec-a27a-1228cb24ffe4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 404 len: 111 microversion: 2.1 time: 0.128790 Sep 01 04:59:39.038844 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1406/2786] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:38 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:39.039565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:39.052077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1b8f8db-d608-4333-8a55-a03df99d905e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.543578 Sep 01 04:59:39.052705 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1381/2787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:38 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:39.138562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:39.139259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:39.150667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.151286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.152602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.153422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.155561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.157230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.206423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:39.208842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:39.215402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.216012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.216513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.217293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.217814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.218305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.234015 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd/os-volume_attachments HTTP/1.1 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '88bb1e1a-a2d0-4bc3-8b90-de2de37726bd'} Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:39.244589 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 04:59:39.248528 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.255456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:39.256698 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b25b184d-3767-434b-b83d-909f82463fa4 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054414 Sep 01 04:59:39.261022 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1382/2788] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:39 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:39.414156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:39.430458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1ec8ec4-1e09-4845-a37a-3bad278a31d8 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1315 microversion: 2.1 time: 0.296106 Sep 01 04:59:39.432757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1407/2789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:39 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:39.583582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-399738813", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:39.666038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:39.667620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] [instance: 63096516-cfea-4370-ac5b-53c7c20f8bf1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:39.672898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:59:39.682849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.702952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.704247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.705502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.706441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.708298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.742929 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] HTTP exception thrown: Instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 could not be found. Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Request method failure captured: Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 HTTP/1.1 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZX2sgcuTULBdkYZlzyK5roHTEc0CNq1HpgU9jPuFC6_EmQiCNqchYJJgH6T9Sw5lSfRAxTL-mjSAxlrR51DnVRekG5K39SAlXCxa3gOLf-PWwTSwiwQ4QAI3mNMt0ZBNldum1LvSYytB_E6mMp46z5Qjbk8NkpWKNzm_0iONKdVA Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9437b75278bf49d1823a0cdc21e989e1 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-342970888 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9437b75278bf49d1823a0cdc21e989e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9437b75278bf49d1823a0cdc21e989e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9437b75278bf49d1823a0cdc21e989e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9437b75278bf49d1823a0cdc21e989e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-342970888 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9437b75278bf49d1823a0cdc21e989e1 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-342970888 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerRescueTestJSONUnderV235-342970888-project Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 187dbd75fe7f4ad48af7e2e39cdd3a40 Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-342970888-project Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 could not be found. Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '63096516-cfea-4370-ac5b-53c7c20f8bf1'} Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 could not be found. Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 could not be found. Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.751099 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 could not be found. Sep 01 04:59:39.755994 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:39.757863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] Returning 404 to user: Instance 63096516-cfea-4370-ac5b-53c7c20f8bf1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:39.764575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ee583bd-3b19-4800-9add-421cd12c6737 tempest-ServerRescueTestJSONUnderV235-342970888 tempest-ServerRescueTestJSONUnderV235-342970888-project] 10.222.0.26 "GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1" status: 404 len: 111 microversion: 2.1 time: 0.109984 Sep 01 04:59:39.765861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1408/2790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:39 2022] GET /compute/v2.1/servers/63096516-cfea-4370-ac5b-53c7c20f8bf1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 04:59:39.911260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:39.913952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:39.928719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.929301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.929759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.930915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:39.931491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:39.932302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:39.974785 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6908e9fa-7ae2-4554-a778-ec772368d2ba tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068580 Sep 01 04:59:39.975652 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1409/2791] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:39 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:59:40.077227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:40.078014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:40.086928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.087492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.087930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.088652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.089106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.089551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.260144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:40.261034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:40.262755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:40.264064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:40.264758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:40.284201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.284764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.285243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.286159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.286775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.287518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.309487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:40.316060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:40.331884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:59:40.334847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:59:40.355175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:40.365909 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-732053a9-f581-4c07-aa1c-e15620027bf8 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.295854 Sep 01 04:59:40.369038 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1410/2792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:40 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:40.414077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-171d7ba5-806d-4b7b-8a7f-c587555bf4c8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835646 Sep 01 04:59:40.421780 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1383/2793] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:59:40.432400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db49d156-fe2b-40a6-b7dc-ecf439f47dfa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:40.433021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db49d156-fe2b-40a6-b7dc-ecf439f47dfa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:40.457469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:40.458166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:40.467000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.467585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.468124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.470482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.471156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.471868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.527209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db49d156-fe2b-40a6-b7dc-ecf439f47dfa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:40.545945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db49d156-fe2b-40a6-b7dc-ecf439f47dfa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a" status: 200 len: 1214 microversion: 2.1 time: 0.123038 Sep 01 04:59:40.546567 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1411/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:40 2022] GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:40.575984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff08efcf-81a9-4685-a9f7-70edcb672aad tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:40.576812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff08efcf-81a9-4685-a9f7-70edcb672aad tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:40.614597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff08efcf-81a9-4685-a9f7-70edcb672aad tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:59:40.791899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:40.804813 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8c4acdf-b96a-4214-9c1e-e45544f46b4e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1503 microversion: 2.1 time: 0.353185 Sep 01 04:59:40.824641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1384/2795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:40 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:40.836879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-541c631d-3bd3-4534-8ecd-d58cb9d9c603 req-9ffebd01-df85-44e6-8301-d0bc667638b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "name": "network-vif-plugged", "status": "completed", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:40.839687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:40.850364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-541c631d-3bd3-4534-8ecd-d58cb9d9c603 req-9ffebd01-df85-44e6-8301-d0bc667638b2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.851246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-541c631d-3bd3-4534-8ecd-d58cb9d9c603 req-9ffebd01-df85-44e6-8301-d0bc667638b2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.851861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-541c631d-3bd3-4534-8ecd-d58cb9d9c603 req-9ffebd01-df85-44e6-8301-d0bc667638b2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.874420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff08efcf-81a9-4685-a9f7-70edcb672aad tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a" status: 204 len: 0 microversion: 2.1 time: 0.312011 Sep 01 04:59:40.875092 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1412/2796] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:59:40 2022] DELETE /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 04:59:40.880262 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-541c631d-3bd3-4534-8ecd-d58cb9d9c603 req-9ffebd01-df85-44e6-8301-d0bc667638b2 service nova] Creating event network-vif-plugged:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h1-820368-37 Sep 01 04:59:40.882074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:40.882597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:40.887708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-541c631d-3bd3-4534-8ecd-d58cb9d9c603 req-9ffebd01-df85-44e6-8301-d0bc667638b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061674 Sep 01 04:59:40.888964 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1385/2797] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:40.899037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.899629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.900349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.901361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:40.902030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:40.902486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:40.936491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ee00740-bff2-4391-89c2-e0b3d3993267 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:40.939786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ee00740-bff2-4391-89c2-e0b3d3993267 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:40.944909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 04:59:40.994669 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3ee00740-bff2-4391-89c2-e0b3d3993267 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ee00740-bff2-4391-89c2-e0b3d3993267 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a HTTP/1.1 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '4ca0e454-303a-4b6e-8e10-f83c36fd9a0a'} Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:41.023004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ee00740-bff2-4391-89c2-e0b3d3993267 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ee00740-bff2-4391-89c2-e0b3d3993267 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a" status: 404 len: 111 microversion: 2.1 time: 0.133870 Sep 01 04:59:41.029881 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1386/2798] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:40 2022] GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:41.034246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:41.044231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:41.068256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:41.068863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:41.069301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:41.070082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:41.070847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:41.071472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:41.131544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2c7b4ce-70a3-4bbe-96b3-bffafbdfbafb tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 204 len: 0 microversion: 2.1 time: 0.254907 Sep 01 04:59:41.140009 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1413/2799] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:59:40 2022] DELETE /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 04:59:41.151883 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8dbe553d-3d77-45bb-bb0c-d3a1bc84d60d tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125110 Sep 01 04:59:41.152484 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1387/2800] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:41 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:41.160055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:41.164587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:41.182463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:41.183032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:41.185188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:41.187143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:41.187377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-390639488", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:41.187661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:41.188830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:41.295291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:59:41.553634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:41.565510 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-527900d7-f78d-4bbe-bc7b-b26afadd1742 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1509 microversion: 2.1 time: 0.424901 Sep 01 04:59:41.579154 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1414/2801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:41 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:41.579154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:41.579154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:41.588604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:41.589099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:41.589528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:41.590491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:41.591378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:41.591992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:41.978503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:41.993550 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfadcc7d-205d-4e3b-92f7-9aa0cd83aa73 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.426182 Sep 01 04:59:41.994755 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1415/2802] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:41 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:42.165496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:42.167962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:42.204307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:42.205245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:42.206461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:42.206989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:42.207383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:42.207794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:42.208207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:42.208327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:42.211411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:42.214718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:42.215195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:42.225184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:42.225684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:42.226123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:42.226858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:42.227338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:42.227763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:42.256217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:42.262610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:42.273961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:42.279960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:59:42.281332 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93d606ad-3b02-406b-a961-e79faca08af6 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120300 Sep 01 04:59:42.282265 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1416/2803] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:42 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:42.285977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:59:42.357109 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4911e1a9-a4e8-4e9e-8ca1-c2f03f4aa5cf tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188962 Sep 01 04:59:42.358226 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1388/2804] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:59:42.372016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d41151e-f9f4-41a0-a907-6fec91a178c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:42.372661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d41151e-f9f4-41a0-a907-6fec91a178c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:42.462235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d41151e-f9f4-41a0-a907-6fec91a178c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:42.471052 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d41151e-f9f4-41a0-a907-6fec91a178c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1214 microversion: 2.1 time: 0.105086 Sep 01 04:59:42.475881 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1417/2805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:42 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:42.586910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:42.587538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:42.604134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:42.604721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:42.605164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:42.605917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:42.606378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:42.606803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:42.986498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:42.990352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:43.007599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16851a72-0ca7-4cb9-a43d-e02b4a405e70 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1509 microversion: 2.1 time: 0.412826 Sep 01 04:59:43.008610 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1389/2806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:42 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:43.028241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:43.034043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:43.053427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:43.055039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:43.056360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:43.057860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:43.058506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:43.064055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:43.294544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:43.297600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:43.305833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:43.316690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:43.317898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:43.318843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:43.319494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:43.320086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:43.377095 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87d28d63-d150-43ca-8629-c4508b601685 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086413 Sep 01 04:59:43.378263 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1390/2807] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 04:59:43 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 04:59:43.501434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:43.506330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:43.520796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:43.525183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:43.527961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:43.529040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:43.531074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:43.531711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:43.796705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:43.806060 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6799ac36-48f0-4dd2-9cda-6287a39e8c6f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1266 microversion: 2.1 time: 0.312745 Sep 01 04:59:43.823168 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1391/2808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:43 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:43.825452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:43.830738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-140141221", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "adda0cd8-ce6e-4ac8-85ef-57a9baf59531"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:43.835589 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5fb5c2a-829c-4c59-8d94-fe86f91f2289 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1312 microversion: 2.1 time: 0.816585 Sep 01 04:59:43.836398 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1418/2809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:43 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1312 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:43.896600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] validate_networks() for [('adda0cd8-ce6e-4ac8-85ef-57a9baf59531', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 04:59:44.029107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:44.029791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:44.043009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:44.043412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:44.044078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:44.044801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:44.045241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:44.045681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:44.848517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:44.860137 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1da4bd0c-1528-4bbb-9a5c-63e5d9c5818a tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1509 microversion: 2.1 time: 0.834866 Sep 01 04:59:44.875320 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1419/2810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:44 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:44.881748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:44.882613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:44.890533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:44.891436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:44.892368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:44.893363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:44.894039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:44.895136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:45.524559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:45.539697 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed2550a7-9c36-4feb-bd56-c44758853307 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.662415 Sep 01 04:59:45.541150 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1420/2811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:44 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:45.550155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:45.551726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:45.564964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:45.566608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:45.583002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:45.584620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:45.585493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:45.590864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:45.608413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:45.610148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:45.613693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:45.614336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:45.614762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:45.652834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:45.653349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:45.653805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:45.654588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:45.655070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:45.660240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:45.699755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Getting quotas for project 87e07a7391724191b70b4599382a6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:45.711147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Getting quotas for user dbbad474a30e456d8249d35dc3787468 and project 87e07a7391724191b70b4599382a6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:45.741454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:59:45.744472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:59:45.868525 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28b4db62-1363-4f5a-97c8-7dd4a5c64012 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.042514 Sep 01 04:59:45.870319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1392/2812] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 04:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 04:59:45.901795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-58bb76a2-c3fb-455e-a307-b07464686d21 req-85f871ba-8af4-45aa-927a-a0e2710f5064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71729b57-79f8-40a5-9bc1-86f0707e199f", "name": "network-vif-deleted", "tag": "e9792d39-b889-4223-bee4-45a5070bdbc6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:45.945214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-58bb76a2-c3fb-455e-a307-b07464686d21 req-85f871ba-8af4-45aa-927a-a0e2710f5064 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:45.945765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-58bb76a2-c3fb-455e-a307-b07464686d21 req-85f871ba-8af4-45aa-927a-a0e2710f5064 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:45.946103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-58bb76a2-c3fb-455e-a307-b07464686d21 req-85f871ba-8af4-45aa-927a-a0e2710f5064 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:45.966976 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-58bb76a2-c3fb-455e-a307-b07464686d21 req-85f871ba-8af4-45aa-927a-a0e2710f5064 service nova] Creating event network-vif-deleted:e9792d39-b889-4223-bee4-45a5070bdbc6 for instance 71729b57-79f8-40a5-9bc1-86f0707e199f on n-h1-820368-37 Sep 01 04:59:45.977186 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-58bb76a2-c3fb-455e-a307-b07464686d21 req-85f871ba-8af4-45aa-927a-a0e2710f5064 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087799 Sep 01 04:59:45.987246 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1393/2813] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:45.992770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7fb1807-d382-4d37-ace9-6ba713fce463 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:45.993471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7fb1807-d382-4d37-ace9-6ba713fce463 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:46.125767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:46.139917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83ac74fd-2e91-4abd-98bd-ed4a9f2aa600 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1462 microversion: 2.1 time: 0.597039 Sep 01 04:59:46.147329 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1421/2814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:45 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1462 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:46.153337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:46.154025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:46.171859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.172392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.172785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.175788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.176280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.177215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.188201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7fb1807-d382-4d37-ace9-6ba713fce463 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:46.221934 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7fb1807-d382-4d37-ace9-6ba713fce463 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1217 microversion: 2.1 time: 0.233288 Sep 01 04:59:46.231091 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1394/2815] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:45 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:46.247564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.251665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.252453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.253114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lazy-loading 'fault' on Instance uuid 71729b57-79f8-40a5-9bc1-86f0707e199f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 04:59:46.262494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:46.282860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:46.305901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.308202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.308834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.315043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.317075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.319046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.330482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7db64b92d4e4aab9f9349e3010825fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869765e62cb4bdf98e0630c3dd5b070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:46.337410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:46.344689 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56f40f1d-d7be-4550-a75e-a96f3685eb56 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 200 len: 1305 microversion: 2.1 time: 0.196103 Sep 01 04:59:46.347110 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1422/2816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:46 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:46.567498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:46.568146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:46.586697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.587245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.587684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.592515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.594717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.595271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.677566 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b67de662-db6d-41d6-8ad7-90efdec6b81f tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1615 microversion: 2.1 time: 0.443926 Sep 01 04:59:46.679907 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1395/2817] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:46 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1615 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:46.704043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:46.707757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:46.715422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.716177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.716922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.717670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:46.718350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:46.719071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:46.777838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '91aa0ad569df44b6a2c89bc623f45f94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74170ca5a3fb4cc4a75eacf71a959f12', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:46.778669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] flavor_id is None. Assuming migration. {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4194}} Sep 01 04:59:46.779209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 04:59:46.943332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:46.973106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55b334c7-bb0e-49e3-9d81-afca91518fd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.409373 Sep 01 04:59:46.974969 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1423/2818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:46 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:47.018983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5c1d49aa-be94-4f77-b393-b1092be4035a req-c1a5db1e-9e45-4533-9d23-4691761a1ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c", "tag": "5aa2c823-02fd-414d-91ea-4e0a83ea8e61"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:47.042424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5c1d49aa-be94-4f77-b393-b1092be4035a req-c1a5db1e-9e45-4533-9d23-4691761a1ab4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.042929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5c1d49aa-be94-4f77-b393-b1092be4035a req-c1a5db1e-9e45-4533-9d23-4691761a1ab4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.043385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5c1d49aa-be94-4f77-b393-b1092be4035a req-c1a5db1e-9e45-4533-9d23-4691761a1ab4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.070107 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5c1d49aa-be94-4f77-b393-b1092be4035a req-c1a5db1e-9e45-4533-9d23-4691761a1ab4 service nova] Creating event network-changed:5aa2c823-02fd-414d-91ea-4e0a83ea8e61 for instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c on n-h2-820368-37 Sep 01 04:59:47.094855 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5c1d49aa-be94-4f77-b393-b1092be4035a req-c1a5db1e-9e45-4533-9d23-4691761a1ab4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097702 Sep 01 04:59:47.096077 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1424/2819] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:47.193278 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f7cdb9a-f579-48f4-8517-bf4c01f24d11 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226/action" status: 202 len: 0 microversion: 2.1 time: 0.493600 Sep 01 04:59:47.194465 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1396/2820] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:46 2022] POST /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 04:59:47.203038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:47.203883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:47.224788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.225285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.225726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.226472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.236606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.238548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.250635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:47.251646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:47.270677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.271269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.271785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.272544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.273270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.273864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.413568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:47.427109 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0176d3a4-cbf1-4d78-bc0e-80326d35b6f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1269 microversion: 2.1 time: 0.179321 Sep 01 04:59:47.428650 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1397/2821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:47 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:47.450411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:47.451404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:47.475407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.476283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.476859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.477661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.478122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.478544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.507211 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f HTTP/1.1 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '71729b57-79f8-40a5-9bc1-86f0707e199f'} Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.509213 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.513201 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e91095a-945a-4233-b5ca-57ff57edb0ee tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 404 len: 111 microversion: 2.1 time: 0.080426 Sep 01 04:59:47.518653 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1398/2822] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:47 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:47.528082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1490402301", "metadata": {"image_type": "test"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:47.531641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:47.533617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:47.541456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.542099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.542635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.543670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.544246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.544760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.548226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81fa2090-a4aa-4bd4-8b67-aeb178cebf14 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1471 microversion: 2.1 time: 0.348680 Sep 01 04:59:47.562002 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f/action HTTP/1.1 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 112 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1490402301", "metadata": {"image_type": "test"}}} Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '71729b57-79f8-40a5-9bc1-86f0707e199f', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1490402301', 'metadata': {'image_type': 'test'}}}} Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Sep 01 04:59:47.570586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.575452 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-919f5429-922b-4805-99a6-3fb6002d9506 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "POST /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f/action" status: 404 len: 111 microversion: 2.1 time: 0.053841 Sep 01 04:59:47.576605 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1399/2823] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Sep 1 04:59:47 2022] POST /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:47.583011 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1425/2824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:47 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:47.588966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e2882e4-f30d-481d-bdbd-af2c164a3165 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-310331068", "metadata": {"image_type": "test"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:47.592550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e2882e4-f30d-481d-bdbd-af2c164a3165 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Failed to fetch instance by id tempest-invalid-26809705 {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 04:59:47.593213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6e2882e4-f30d-481d-bdbd-af2c164a3165 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance tempest-invalid-26809705 could not be found. Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e2882e4-f30d-481d-bdbd-af2c164a3165 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/tempest-invalid-26809705/action HTTP/1.1 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 111 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-310331068", "metadata": {"image_type": "test"}}} Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance tempest-invalid-26809705 could not be found. Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'tempest-invalid-26809705', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-310331068', 'metadata': {'image_type': 'test'}}}} Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-26809705 could not be found. Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.594991 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-26809705 could not be found. Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-26809705 could not be found. Sep 01 04:59:47.599294 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.602060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e2882e4-f30d-481d-bdbd-af2c164a3165 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance tempest-invalid-26809705 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.603169 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e2882e4-f30d-481d-bdbd-af2c164a3165 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "POST /compute/v2.1/servers/tempest-invalid-26809705/action" status: 404 len: 99 microversion: 2.1 time: 0.018447 Sep 01 04:59:47.604201 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1400/2825] 10.222.0.26 () {60 vars in 1243 bytes} [Thu Sep 1 04:59:47 2022] POST /compute/v2.1/servers/tempest-invalid-26809705/action => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 04:59:47.620241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fe80c66-da7e-4209-b632-2f4a15f61b46 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1922015515"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:47.623371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0fe80c66-da7e-4209-b632-2f4a15f61b46 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 04:59:47.624071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0fe80c66-da7e-4209-b632-2f4a15f61b46 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fe80c66-da7e-4209-b632-2f4a15f61b46 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 57 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: {"createImage": {"name": "tempest-test-snap-1922015515"}} Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1922015515'}}} Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.625909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.631098 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.632798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fe80c66-da7e-4209-b632-2f4a15f61b46 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.633806 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fe80c66-da7e-4209-b632-2f4a15f61b46 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024605 Sep 01 04:59:47.634939 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1426/2826] 10.222.0.26 () {60 vars in 1275 bytes} [Thu Sep 1 04:59:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:47.646743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13dd5590-e8b9-4611-a9f3-cb6b8f0ab55d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-78047265"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:47.660191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13dd5590-e8b9-4611-a9f3-cb6b8f0ab55d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 04:59:47.662980 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-13dd5590-e8b9-4611-a9f3-cb6b8f0ab55d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13dd5590-e8b9-4611-a9f3-cb6b8f0ab55d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 55 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: {"createImage": {"name": "tempest-test-snap-78047265"}} Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-78047265'}}} Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.671717 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13dd5590-e8b9-4611-a9f3-cb6b8f0ab55d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13dd5590-e8b9-4611-a9f3-cb6b8f0ab55d tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032978 Sep 01 04:59:47.683269 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1401/2827] 10.222.0.26 () {60 vars in 1281 bytes} [Thu Sep 1 04:59:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:47.691401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:47.691998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:47.707481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.707861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.708626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.709541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.710045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.710736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.732040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f HTTP/1.1 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '71729b57-79f8-40a5-9bc1-86f0707e199f'} Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.734008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.738910 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.745673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.747466 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e80fa22a-1473-4e9e-9c7e-a7d6b66f4c6e tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 404 len: 111 microversion: 2.1 time: 0.061728 Sep 01 04:59:47.753621 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1427/2828] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 04:59:47 2022] DELETE /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:47.760327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:47.761305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] [instance: 71729b57-79f8-40a5-9bc1-86f0707e199f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:47.772848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.777267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.777921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.778739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:47.779975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:47.780717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:47.805373 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] HTTP exception thrown: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Request method failure captured: Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f HTTP/1.1 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDwmcP7bAQvmrTHKux0b-Z8drH0hcANlW28-WETreJoQk6nd-9FUuS-kOqcxlM9-Vw-zZlQf0jNM0JnQigp81Q-YSrcBhB5DJIik4XpTlvWnf8Rwfo6zwKOapQO5u9PLXIHNY3yGhJV2LVlaOSUwDl_xpypyCHatdcvBDErImlT5HAQ Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b869765e62cb4bdf98e0630c3dd5b070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: b869765e62cb4bdf98e0630c3dd5b070 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1032090090 Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b7db64b92d4e4aab9f9349e3010825fb Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesNegativeTestJSON-1032090090-project Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '71729b57-79f8-40a5-9bc1-86f0707e199f'} Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 04:59:47.806960 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] Returning 404 to user: Instance 71729b57-79f8-40a5-9bc1-86f0707e199f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 04:59:47.812451 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-517be7af-f1c6-414f-88a5-1cb4eb013ac6 tempest-ImagesNegativeTestJSON-1032090090 tempest-ImagesNegativeTestJSON-1032090090-project] 10.222.0.26 "GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f" status: 404 len: 111 microversion: 2.1 time: 0.054511 Sep 01 04:59:47.816647 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1402/2829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:47 2022] GET /compute/v2.1/servers/71729b57-79f8-40a5-9bc1-86f0707e199f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 04:59:48.006022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:48.006949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:48.022301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:48.023282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:48.023928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:48.025205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:48.025964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:48.026928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:48.451581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:48.452831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:48.473728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:48.476497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:48.477411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:48.478347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:48.480455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:48.481748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:48.516726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:48.537395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9a8a1a2-1ee5-4129-b336-7daf2f2e4002 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.535931 Sep 01 04:59:48.538472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1428/2830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:47 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:48.575554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:48.576474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:48.587054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:48.587967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:48.588118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:48.588831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:48.589342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:48.589771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:48.772377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:48.792910 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af94b853-29ff-4c28-ae39-4ebfb215e8f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1275 microversion: 2.1 time: 0.336672 Sep 01 04:59:48.794203 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1403/2831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:48 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1275 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:48.952218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:48.982037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88b9d802-f182-4a70-ac5f-22f7efe29472 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1471 microversion: 2.1 time: 0.410518 Sep 01 04:59:48.987986 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1429/2832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:48 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:49.568999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:49.569651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:49.578257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:49.578757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:49.579224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:49.580611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:49.580611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:49.580882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:49.977450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2029614560", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:50.022692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:50.039174 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b803471-2057-4b2d-a7c9-f8c8b7772059 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.474318 Sep 01 04:59:50.039762 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1404/2833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:49 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:50.054317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:50.064071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:50.076665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:50.077490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:50.078635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:50.079974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:50.081122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:50.081857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:50.090590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:50.091051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:50.091759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:50.092952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:50.093702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:50.121913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:50.122717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:50.123335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:50.127686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:50.128497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:50.129042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:50.152199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Getting quotas for project 8f78f3b4d9e94bbf8511b10e5d4a5f2f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 04:59:50.160000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Getting quotas for user bd0d6dedc7ff4f55bc1eacf5cc8082c7 and project 8f78f3b4d9e94bbf8511b10e5d4a5f2f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 04:59:50.178405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 04:59:50.182700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 04:59:50.242307 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c79f5eb-d0ec-431b-a28b-44d7aed8a000 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.455788 Sep 01 04:59:50.243741 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1430/2834] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 04:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 04:59:50.249180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:50.250210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:50.258510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:50.259337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:50.259933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:50.260871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:50.261487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:50.264605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:50.660179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:50.676306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ed647fa-d6a1-4fc4-930d-c50e75a5566e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.633411 Sep 01 04:59:50.678373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1405/2835] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:50 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:50.691123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fecb56d-7c9e-40d9-81d1-51542e6ef4b2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:50.694471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fecb56d-7c9e-40d9-81d1-51542e6ef4b2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:50.870800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:50.882084 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a2406d8-bf53-450a-9415-42276d2ac16c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1471 microversion: 2.1 time: 0.636702 Sep 01 04:59:50.882675 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1431/2836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:50 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1471 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:50.895243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fecb56d-7c9e-40d9-81d1-51542e6ef4b2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:50.909068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fecb56d-7c9e-40d9-81d1-51542e6ef4b2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:50.911287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fecb56d-7c9e-40d9-81d1-51542e6ef4b2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:50.912947 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fecb56d-7c9e-40d9-81d1-51542e6ef4b2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1278 microversion: 2.57 time: 0.231715 Sep 01 04:59:50.913749 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1406/2837] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:50 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:51.071532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:51.072136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:51.086200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:51.087237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:51.089546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:51.091171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:51.091873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:51.092616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:51.528193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:51.539646 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6262ba97-eaea-4e73-a010-9909026620f7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.480887 Sep 01 04:59:51.541029 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1432/2838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:51 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:51.703103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:51.705493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:51.714143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:51.715481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:51.716208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:51.718217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:51.718841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:51.719922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:51.903973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:51.904997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:51.922279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:51.925486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:51.926181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:51.927735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:51.931524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:51.932462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:52.296604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:52.349217 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59a6907f-4e1d-440f-a7b4-5c1435d67078 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.650712 Sep 01 04:59:52.350738 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1407/2839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:51 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:52.362838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:52.364823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:52.406247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:52.409343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:52.411169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:52.412362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:52.413112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:52.413778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:52.434044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:52.458972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88281573-9b19-478d-984d-3e6222e5d335 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1471 microversion: 2.1 time: 0.556548 Sep 01 04:59:52.460504 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1433/2840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:51 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1471 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:52.568342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:52.568973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:52.578644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:52.579304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:52.579862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:52.588467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:52.589038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:52.591231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:52.657751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:52.670419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:52.673486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:52.675530 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cfdf6fac-4488-4402-bb32-8c7d2601a62f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1330 microversion: 2.57 time: 0.323099 Sep 01 04:59:52.676366 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1408/2841] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:52 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1330 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:52.907801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-830ad7a0-d520-423a-a294-5f37f129c084 req-bd0099e2-abd8-43ee-8aeb-e33b1f70c0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb48627-3b4d-4b69-ba9b-d6d2ab073c50", "tag": "736932e4-b998-44ad-b817-60e64701dac6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:52.934341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-830ad7a0-d520-423a-a294-5f37f129c084 req-bd0099e2-abd8-43ee-8aeb-e33b1f70c0b7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:52.934834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-830ad7a0-d520-423a-a294-5f37f129c084 req-bd0099e2-abd8-43ee-8aeb-e33b1f70c0b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:52.935292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-830ad7a0-d520-423a-a294-5f37f129c084 req-bd0099e2-abd8-43ee-8aeb-e33b1f70c0b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:52.952040 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-830ad7a0-d520-423a-a294-5f37f129c084 req-bd0099e2-abd8-43ee-8aeb-e33b1f70c0b7 service nova] Creating event network-changed:736932e4-b998-44ad-b817-60e64701dac6 for instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 on n-h1-820368-37 Sep 01 04:59:52.958792 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-830ad7a0-d520-423a-a294-5f37f129c084 req-bd0099e2-abd8-43ee-8aeb-e33b1f70c0b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055222 Sep 01 04:59:52.960199 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1409/2842] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 04:59:52.965146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:52.974808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f38ddabc-578b-42d9-b4c1-78fb38f5acb6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.410378 Sep 01 04:59:52.975930 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1434/2843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:52 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:53.372445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:53.373428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:53.386286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:53.388543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:53.389987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:53.392001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:53.392737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:53.393320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:53.483574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:53.485167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:53.493359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:53.494126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:53.494749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:53.495655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:53.496271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:53.496856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:54.171336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:54.171883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:54.211485 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d9ff5de-42d6-483f-bf5a-1483889722b1 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.843085 Sep 01 04:59:54.211713 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8844ac04-6256-4525-ab0d-cf2be535a481 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.733579 Sep 01 04:59:54.235395 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1435/2844] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:53 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:54.235395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:54.235395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:54.236254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:54.236415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:54.236775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:54.237698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:54.238312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:54.240060 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1410/2845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:53 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:54.244340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:54.255930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:54.256684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:54.265594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:54.266291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:54.266909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:54.267781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:54.268341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:54.268864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:54.487492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:54.510964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:54.525661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:54.533311 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a0931b6-7d59-4334-b03f-9e401cce687e tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1336 microversion: 2.57 time: 0.309427 Sep 01 04:59:54.534456 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1436/2846] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:54 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1336 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:54.638866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:54.650123 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5184ac16-81e1-4ccc-886c-8ec485c92492 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.408081 Sep 01 04:59:54.650762 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1411/2847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:54 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:54.669574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9c40c086-d4e4-44e3-98c2-c5b85f7ce3b3 req-a74584fd-6a61-49e3-82af-1d92d5ac6e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c", "name": "network-vif-plugged", "status": "completed", "tag": "5aa2c823-02fd-414d-91ea-4e0a83ea8e61"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:54.684573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c40c086-d4e4-44e3-98c2-c5b85f7ce3b3 req-a74584fd-6a61-49e3-82af-1d92d5ac6e27 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:54.688306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c40c086-d4e4-44e3-98c2-c5b85f7ce3b3 req-a74584fd-6a61-49e3-82af-1d92d5ac6e27 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:54.689847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c40c086-d4e4-44e3-98c2-c5b85f7ce3b3 req-a74584fd-6a61-49e3-82af-1d92d5ac6e27 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:54.723723 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9c40c086-d4e4-44e3-98c2-c5b85f7ce3b3 req-a74584fd-6a61-49e3-82af-1d92d5ac6e27 service nova] Creating event network-vif-plugged:5aa2c823-02fd-414d-91ea-4e0a83ea8e61 for instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c on n-h2-820368-37 Sep 01 04:59:54.737245 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9c40c086-d4e4-44e3-98c2-c5b85f7ce3b3 req-a74584fd-6a61-49e3-82af-1d92d5ac6e27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083196 Sep 01 04:59:54.738606 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1437/2848] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:55.262341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:55.266286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:55.268674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:55.269158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:55.294263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:55.294775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:55.295239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:55.295970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:55.296938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:55.297465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:55.297940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:55.298828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:55.299315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:55.310504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:55.311548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:55.315361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:55.685866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:55.852684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:55.918430 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43c6ec3e-9ec9-489a-b907-0c67f7d76e1e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.661713 Sep 01 04:59:55.921199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:55.933767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:55.939835 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1438/2849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:55 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:55.947306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:55.949064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:55.963529 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23d83909-4708-4ade-ac9d-66efa019935a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.697078 Sep 01 04:59:55.964486 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1412/2850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:55 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:55.969473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:55.980806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:56.003974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:56.005169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:56.007506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:56.009247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:56.009247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:56.010036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:56.010984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:56.012620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:56.013328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:56.014016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:56.014621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:56.017523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:56.227508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:56.238670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:56.240609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:56.241958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10e6629a-2b02-42e3-80d9-76bbc006a6be tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1336 microversion: 2.57 time: 0.300186 Sep 01 04:59:56.242691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1439/2851] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:55 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1336 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:56.540773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:56.558304 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c31e3621-4f89-4cfb-9624-d62f8a8a866a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.592511 Sep 01 04:59:56.562227 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1413/2852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:55 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:56.959905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:56.960541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:56.967985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:56.968487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:56.968928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:56.969640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:56.970159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:56.970914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:56.988430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:56.989030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:57.016515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.016996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.017644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.018624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.019122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.019549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.322626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:57.333227 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78f3a120-44d3-4602-8117-dce5d080f69a tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.377348 Sep 01 04:59:57.338511 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1440/2853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:56 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:57.344265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:57.345378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:57.357008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.357763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.358374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.358948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:57.359502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.360122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.360738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.370291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a30e9716-30c0-4f1c-9674-08b5af375af1 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.386205 Sep 01 04:59:57.384980 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1414/2854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:56 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:57.440339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:57.449742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:57.451640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:57.453109 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-041494b3-ddd5-46de-b03d-8d5819ba9ce9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1357 microversion: 2.57 time: 0.114179 Sep 01 04:59:57.453902 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1441/2855] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:57 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1357 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:57.482518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:57.487951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:57.497713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.498573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.499297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.500253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.500917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.501592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.589145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:57.594370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:57.611815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.620282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.621134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.624419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.624930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.630292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.633079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 04:59:57.633651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 04:59:57.636822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 04:59:57.639174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 04:59:57.640540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 04:59:57.799421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:57.815052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.815548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.815985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.816714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.817161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.823437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.915766 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a176aa96-7bf8-467f-9e23-912c662f6c62 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "POST /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639/action" status: 202 len: 1138 microversion: 2.57 time: 0.438583 Sep 01 04:59:57.938226 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1415/2856] 10.222.0.26 () {62 vars in 1320 bytes} [Thu Sep 1 04:59:57 2022] POST /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639/action => generated 1138 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 01 04:59:57.948591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:57.949220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:57.961691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:57.968577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.969293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.969799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:57.970593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:57.972108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1368d09b-ef8a-4a32-ac18-37828f5adbd0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1314 microversion: 2.1 time: 0.393204 Sep 01 04:59:57.972711 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1442/2857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:57 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:57.974244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:57.974504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:58.072207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:58.083453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:58.085031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:58.086540 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20624695-6966-4be9-9186-4e7902aea80d tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.142991 Sep 01 04:59:58.087739 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1416/2858] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:57 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 04:59:58.370261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:58.371646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:58.389988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:58.392619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:58.394200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:58.400480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:58.402130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:58.404044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:58.404564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:58.415139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:58.418724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:58.419588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:58.420503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:58.421188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:58.422358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:58.424959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:58.425582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:58.640515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:58.655138 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f99f968-693a-48d1-a8a6-b85c82d16cd5 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.286976 Sep 01 04:59:58.655816 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1443/2859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:58 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:58.718150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:58.727532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98150371-83b6-4728-89c8-bc67ec935915 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.331658 Sep 01 04:59:58.742101 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1417/2860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:58 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 04:59:58.993430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:58.994050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:59.008305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.008799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.009449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.010170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.010628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.011153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.112691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:59.113323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:59.122764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.123528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.124162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.125387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.126386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.127838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.278735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:59.291142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:59.295862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:59.299712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40df7406-8564-40b5-a3bb-b4fd7a72a936 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.191608 Sep 01 04:59:59.303558 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1418/2861] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 04:59:59 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 04:59:59.310538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fbaa6373-272d-4985-af2f-0a302a5f36fd req-2ebf1112-512f-4271-a124-835e06ffe893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb48627-3b4d-4b69-ba9b-d6d2ab073c50", "name": "network-vif-plugged", "status": "completed", "tag": "736932e4-b998-44ad-b817-60e64701dac6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:59.330283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fbaa6373-272d-4985-af2f-0a302a5f36fd req-2ebf1112-512f-4271-a124-835e06ffe893 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.330692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fbaa6373-272d-4985-af2f-0a302a5f36fd req-2ebf1112-512f-4271-a124-835e06ffe893 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.331214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fbaa6373-272d-4985-af2f-0a302a5f36fd req-2ebf1112-512f-4271-a124-835e06ffe893 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.343974 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fbaa6373-272d-4985-af2f-0a302a5f36fd req-2ebf1112-512f-4271-a124-835e06ffe893 service nova] Creating event network-vif-plugged:736932e4-b998-44ad-b817-60e64701dac6 for instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 on n-h1-820368-37 Sep 01 04:59:59.355173 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fbaa6373-272d-4985-af2f-0a302a5f36fd req-2ebf1112-512f-4271-a124-835e06ffe893 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048741 Sep 01 04:59:59.357509 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1419/2862] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 04:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 04:59:59.513837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 04:59:59.526281 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3555abf6-d750-4619-9577-78022c1b2394 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1501 microversion: 2.1 time: 0.536620 Sep 01 04:59:59.527087 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1444/2863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:58 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 04:59:59.548149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 04:59:59.549120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:59.556508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.557277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.557874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.558761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.559247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.559672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.681033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:59.682220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:59.698331 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cf60376-511e-400a-afa3-355b7b2b81a5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c/action" status: 202 len: 0 microversion: 2.1 time: 0.154322 Sep 01 04:59:59.702809 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1420/2864] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 04:59:59 2022] POST /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 04:59:59.715322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 04:59:59.717379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.718368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.718720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 04:59:59.721591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.723041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.724436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.725925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.735386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.737387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.737846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 04:59:59.739916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 04:59:59.740401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 04:59:59.740835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:00.083401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:00.097692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ceaa078-4462-4026-a3b9-24628c8951d7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1506 microversion: 2.1 time: 0.390085 Sep 01 05:00:00.098337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1421/2865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:59 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:00.105355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:00.105963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:00.121414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:00.122807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:00.123684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:00.124631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:00.125049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:00.126235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:00.127483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:00.137218 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5b7b7be-ced9-44ca-9b7b-e13fc2ae0063 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1317 microversion: 2.1 time: 0.461840 Sep 01 05:00:00.138167 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1445/2866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 04:59:59 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:00.327988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:00.328929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:00.335596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:00.336698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:00.338763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:00.339590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:00.340501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:00.341488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:00.342156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:00.343037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:00.750010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:00.769133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:00.771878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:00.775204 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eca9c570-6107-4e88-989b-371e90964606 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.451178 Sep 01 05:00:00.788871 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1446/2867] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:00 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:00.900463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:00.995398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:01.014901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75422a5d-76dc-4580-aab4-d97cda35fc37 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.914830 Sep 01 05:00:01.017300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1422/2868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:00 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:01.132223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:01.133220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:01.150014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.150513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.151036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.152069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.152532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.157038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.192625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:01.193533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:01.211663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.216204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.218081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.222053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.222861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.224345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.281455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:01.421377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:01.442282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2f1282d-2b6c-4dde-ac4e-4eaa0e6aa50d tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 204 len: 0 microversion: 2.32 time: 0.651268 Sep 01 05:00:01.446187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1447/2869] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:00:00 2022] DELETE /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:00:01.478619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:01.479941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:01.500970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.503049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.505225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.507030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.515615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.518226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.527490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:01.541305 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be7aec2a-e300-4828-84a2-0e2a1ad99e5b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1486 microversion: 2.1 time: 0.424075 Sep 01 05:00:01.561948 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1423/2870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:01 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1486 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:01.588009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:01.588632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:01.605043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.608645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.611779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.617726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.618479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.619141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.951514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:01.963499 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23b7dea7-76cb-4da9-8d21-be59276b9672 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1507 microversion: 2.1 time: 0.518651 Sep 01 05:00:01.965199 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1448/2871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:01 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:01.970763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:01.971615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:01.995343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.996574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.997338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:01.998302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:01.999270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:01.999782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.065791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:02.069903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.079687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.081091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.082378 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9206fc34-b9a9-4830-bd00-d486a11bc943 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2959 microversion: 2.32 time: 0.519167 Sep 01 05:00:02.100372 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1424/2872] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:01 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2959 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:02.108383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:02.108991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:02.132153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:02.132650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:02.140595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.141903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:02.142545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:02.143158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.246010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d63c82fe-45e7-4c47-95c3-726a9a185883 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 204 len: 0 microversion: 2.1 time: 0.278628 Sep 01 05:00:02.247474 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1449/2873] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:00:01 2022] DELETE /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:00:02.261716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:02.263130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:02.284648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:02.286782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:02.288879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.289873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:02.291580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:02.293635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.377636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.388098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.394611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.398752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dedcac88-daaa-4152-8617-56dfc333a77b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.297286 Sep 01 05:00:02.402834 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1425/2874] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:02 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:02.422038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:02.422650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:02.424939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:02.456499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:02.457004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:02.458759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.461076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:02.461748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:02.463414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:02.787397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.803051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4588e1de-a504-4e12-bfef-990d13a33d5a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.553434 Sep 01 05:00:02.804157 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1450/2875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:02 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:02.847593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:02.874531 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38412d4d-9cad-4875-b767-3b757bf00c40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1492 microversion: 2.1 time: 0.468386 Sep 01 05:00:02.877866 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1426/2876] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:02 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1492 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:03.128731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:03.128731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:03.141463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.142266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.142717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.143480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.143952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.144383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.428648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:03.429653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:03.443820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.446055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.446576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.448233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.448989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.449926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.455777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:03.594369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:03.606394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:03.607143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:03.609466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:03.612350 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2720d3c1-235c-49d8-a784-d935cc35b90b tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.188547 Sep 01 05:00:03.613186 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1427/2877] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:03 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:03.620473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:03.621946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:03.632671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5c6579d-bde6-4559-bc5c-533800d70a7a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2959 microversion: 2.32 time: 0.511015 Sep 01 05:00:03.633282 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1451/2878] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:03 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2959 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:03.835268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:03.837036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:03.846284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.847045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.848002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.848962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.849583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.850161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.902255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:03.903223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:03.912543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.919515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.920248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:03.921526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:03.922163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:03.927375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:04.191046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:04.200207 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92574503-acf2-40e8-8a99-db9e324f13c3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.379002 Sep 01 05:00:04.201805 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1428/2879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:03 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:04.324633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:04.334817 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a91f4ff-04e7-4be9-95c5-5584a09afea0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1492 microversion: 2.1 time: 0.437040 Sep 01 05:00:04.344319 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1452/2880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:03 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1492 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:04.636565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:04.638434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:04.649227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:04.658848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:04.659435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:04.662227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:04.662227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:04.662227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:04.668333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:04.669225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:04.680858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:04.684888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:04.689823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:04.691088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:04.691811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:04.695331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:04.881052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:04.890039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:04.896797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:04.901185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc4709a7-857d-4675-afed-77f9b1a90cba tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.268752 Sep 01 05:00:04.903405 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1429/2881] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:04 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:04.929032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5ec000ed-ae7f-4813-861d-e67ab435fecf"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:04.931839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:04.942848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:04.943532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:04.945980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:04.947082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:04.947657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:04.949224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:05.050713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] HTTP exception thrown: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Request method failure captured: Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50/os-volume_attachments/19e0aa7e-e841-47d0-9bc2-0557a7c877a9 HTTP/1.1 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 74 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvP1uZcK-QQKEubPIT4WcrUgvNCvqfhYnzorQbZWKKgEKT6ffCLujWO1xxT1age41vD7noTXKajHrt14FikK4ScQklskePW3lH-p5UFg3afxxmirN8bblgQbCK4-oDrmGiLUIel6DkIWka-AEVo3e8pgdTrrWqxPWsk9v0cPa6hPSI Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 290d461a5bdf40e092b99ad78ba0befa Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesAdminNegativeTest-1795441396 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/290d461a5bdf40e092b99ad78ba0befa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesAdminNegativeTest-1795441396 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 290d461a5bdf40e092b99ad78ba0befa Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1795441396 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesAdminNegativeTest-1795441396-project-admin Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 09da29b7231040f39ef29255e92f1c49 Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesAdminNegativeTest-1795441396-project-admin Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: {"volumeAttachment": {"volumeId": "5ec000ed-ae7f-4813-861d-e67ab435fecf"}} Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: exception: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '4cb48627-3b4d-4b69-ba9b-d6d2ab073c50', 'id': '19e0aa7e-e841-47d0-9bc2-0557a7c877a9', 'body': {'volumeAttachment': {'volumeId': '5ec000ed-ae7f-4813-861d-e67ab435fecf'}}} Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. (HTTP 404) (Request-ID: req-cfe69b3b-60ec-472d-9073-4cfdf4598b65) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:00:05.054238 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] Returning 404 to user: Volume 19e0aa7e-e841-47d0-9bc2-0557a7c877a9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12d3f2dc-3371-4121-8786-00c38eef6f6b tempest-VolumesAdminNegativeTest-1795441396 tempest-VolumesAdminNegativeTest-1795441396-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50/os-volume_attachments/19e0aa7e-e841-47d0-9bc2-0557a7c877a9" status: 404 len: 109 microversion: 2.1 time: 0.138171 Sep 01 05:00:05.058184 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1430/2882] 10.222.0.26 () {60 vars in 1433 bytes} [Thu Sep 1 05:00:04 2022] PUT /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50/os-volume_attachments/19e0aa7e-e841-47d0-9bc2-0557a7c877a9 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:05.223280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:05.224047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:05.246455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:05.249735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:05.251305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:05.252088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:05.255840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:05.257898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:05.413374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:05.441111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:05.446379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:05.461591 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f84beee-e8bb-4b3b-bb6d-4663c0199a53 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2959 microversion: 2.32 time: 0.797075 Sep 01 05:00:05.477344 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1453/2883] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:04 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2959 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:05.500212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:05.501548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:05.517970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:05.539381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:05.543578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:05.544523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:05.548216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:05.553047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:06.086210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:06.097552 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d8ec410-3792-425a-8787-716611848a46 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.879497 Sep 01 05:00:06.113160 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1431/2884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:05 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:06.118475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:06.124726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:06.138985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:06.139772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:06.140990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:06.142088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:06.142740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:06.143390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:06.191391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:06.206706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-043c607a-65c8-4728-8c45-eedb49184b4c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1492 microversion: 2.1 time: 0.723945 Sep 01 05:00:06.207961 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1454/2885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:05 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1492 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:06.493106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:06.494075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:06.517037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:06.520586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:06.521160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:06.527814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:06.528422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:06.528947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:07.087650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:07.103879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:07.107044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:07.111780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d3c6d77-4d9b-4f45-804e-0ce6e8e306fc tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.997115 Sep 01 05:00:07.119722 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1432/2886] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:06 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:07.348382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:07.349425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:07.362219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:07.363208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:07.363926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:07.365061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:07.365775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:07.366580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:07.491088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:07.518293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:07.525155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:07.528747 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88dd5e59-a859-45cc-a45f-c44e34fcf0eb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2959 microversion: 2.32 time: 1.037961 Sep 01 05:00:07.532672 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1455/2887] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:06 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2959 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:07.560745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:07.566812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:07.583710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:07.589085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:07.589266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:07.590855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:07.591355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:07.592533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:07.629343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:08.194150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:08.207391 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8146be3-69ae-49fc-ba8e-fcec4b84895b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 1.085962 Sep 01 05:00:08.222566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1433/2888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:07 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:08.228461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:08.229431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:08.237657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:08.238730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:08.239799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:08.240814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:08.241482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:08.242757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:08.261839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:08.274446 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-449ba854-43bf-48ea-8f67-333d73feb49e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1492 microversion: 2.1 time: 0.737205 Sep 01 05:00:08.296452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1456/2889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:07 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1492 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:08.395558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:08.413399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:08.420617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:08.421895 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-508c18bf-94a7-4009-a66f-4a4ba34e831a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.197730 Sep 01 05:00:08.429370 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1434/2890] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:08 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:08.554989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:08.555508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:08.566449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:08.566787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:08.567261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:08.579099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:08.579998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:08.581524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:08.672194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-00430399-7335-4f31-bb55-31489ee3761f req-e88a4d57-7554-4653-a074-3dd7ad97456e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-unplugged", "status": "completed", "tag": "cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:08.706782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-00430399-7335-4f31-bb55-31489ee3761f req-e88a4d57-7554-4653-a074-3dd7ad97456e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:08.708238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-00430399-7335-4f31-bb55-31489ee3761f req-e88a4d57-7554-4653-a074-3dd7ad97456e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:08.710345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-00430399-7335-4f31-bb55-31489ee3761f req-e88a4d57-7554-4653-a074-3dd7ad97456e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:08.749414 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-00430399-7335-4f31-bb55-31489ee3761f req-e88a4d57-7554-4653-a074-3dd7ad97456e service nova] Creating event network-vif-unplugged:cd6e30a2-dc22-4ecc-89ad-d10e3709c8b6 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:08.760341 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-00430399-7335-4f31-bb55-31489ee3761f req-e88a4d57-7554-4653-a074-3dd7ad97456e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094487 Sep 01 05:00:08.762221 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1435/2891] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:09.096900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fa23b164-db9b-4c2e-b76b-2788daeca038 req-6de33bfd-9f44-4db7-9d8c-de83aed5ffbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c", "name": "network-vif-deleted", "tag": "5aa2c823-02fd-414d-91ea-4e0a83ea8e61"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:09.121072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fa23b164-db9b-4c2e-b76b-2788daeca038 req-6de33bfd-9f44-4db7-9d8c-de83aed5ffbe service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.121560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fa23b164-db9b-4c2e-b76b-2788daeca038 req-6de33bfd-9f44-4db7-9d8c-de83aed5ffbe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.121993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fa23b164-db9b-4c2e-b76b-2788daeca038 req-6de33bfd-9f44-4db7-9d8c-de83aed5ffbe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.152774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fa23b164-db9b-4c2e-b76b-2788daeca038 req-6de33bfd-9f44-4db7-9d8c-de83aed5ffbe service nova] Creating event network-vif-deleted:5aa2c823-02fd-414d-91ea-4e0a83ea8e61 for instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c on n-h2-820368-37 Sep 01 05:00:09.166591 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fa23b164-db9b-4c2e-b76b-2788daeca038 req-6de33bfd-9f44-4db7-9d8c-de83aed5ffbe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074221 Sep 01 05:00:09.168445 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1436/2892] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:09.207843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:09.218036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:09.230532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:09.232010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:09.246278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:09.252294 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6124f7c3-5f2f-4b0c-8132-917358ac5961 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2938 microversion: 2.32 time: 0.700708 Sep 01 05:00:09.255084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.255840 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1457/2893] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:08 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2938 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:09.256550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.258658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.259617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.264977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.265608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.305109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:09.305858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:09.320904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.324618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.327999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.336204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.338714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.339710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.478994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.479513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.482412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.482788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lazy-loading 'fault' on Instance uuid 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:00:09.717046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:09.755120 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f5d0f33-8ae1-4d66-b3d8-17f39953fd66 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 200 len: 1304 microversion: 2.1 time: 0.454542 Sep 01 05:00:09.757920 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1458/2894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:09 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 1304 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:09.793408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:09.794934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:09.827611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.828301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.832718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.833543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.834038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.840480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.873567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:09.888845 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4695d331-b942-4642-b4b3-90b0053c159b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.662870 Sep 01 05:00:09.908680 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1437/2895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:09 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:09.915223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:09.916090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:09.926564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.927540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.928206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.929168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:09.929825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:09.930492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:09.973060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:10.081606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:10.098255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:10.104343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:10.105972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1abaeb6-63a5-4fe7-978a-915defa3fc73 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.345478 Sep 01 05:00:10.128013 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1459/2896] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:09 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:10.141238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cc99421-b6fe-4fdf-ae0b-a7a22e7d58bf tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 204 len: 0 microversion: 2.1 time: 0.230629 Sep 01 05:00:10.142811 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1438/2897] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:00:09 2022] DELETE /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:00:10.155718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:10.158948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:10.168388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:10.169804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:10.170910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:10.173044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:10.173793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:10.174458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:10.283326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:10.284462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:10.306761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:10.307313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:10.307753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:10.313545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:10.317938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:10.318579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:10.879187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:10.894928 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64864f6b-9f30-4c84-a815-1ab9eba18844 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1513 microversion: 2.1 time: 0.744414 Sep 01 05:00:10.909478 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1460/2898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:10 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1513 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:10.912521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:10.914318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:10.932853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:10.936587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:10.937171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:10.939277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:10.941712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:10.942222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:10.964187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:10.979474 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c HTTP/1.1 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c'} Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:10.983571 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:10.988085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bec09af-7e1d-4214-a052-9ea62836ca93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 404 len: 111 microversion: 2.1 time: 0.086087 Sep 01 05:00:10.995238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:10.996997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:11.004351 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c40f9ff4-4c92-442a-b947-0a476050c0b5 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2917 microversion: 2.32 time: 0.726679 Sep 01 05:00:11.005832 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1439/2899] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:10 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2917 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:11.013918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-unplugged", "status": "completed", "tag": "fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-unplugged", "status": "completed", "tag": "fb9959fe-6d22-4449-b3ec-6dbc63f6f116"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-unplugged", "status": "completed", "tag": "c48ec7dc-e437-426b-bbc6-6eee0e32594f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:11.024843 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1461/2900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:10 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:11.037948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:11.040136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.044008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:11.044823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.046048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.055984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.063724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.064280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Creating event network-vif-unplugged:fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:11.064763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.065239 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Creating event network-vif-unplugged:fb9959fe-6d22-4449-b3ec-6dbc63f6f116 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:11.065535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.066019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.066452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.066986 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] Creating event network-vif-unplugged:c48ec7dc-e437-426b-bbc6-6eee0e32594f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:11.073386 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-257d0b1b-0318-4d15-aec5-a4d88e1cc425 req-89bc1c9b-01f4-4fe7-8a86-117de86488c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.066079 Sep 01 05:00:11.075542 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1440/2901] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:11.144277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:11.145392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:11.164171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.165718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.169885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.171220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.171897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.172619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.317801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:11.333979 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96c6a9b2-961e-4fb6-ac6b-fc7131f6a4e7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 0.307426 Sep 01 05:00:11.334616 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1462/2902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:11 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:11.367095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1838514405", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:11.411344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:11.427137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:11.432584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:11.437695 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a356f9a-bc25-4a7b-95c7-14b3665400e7 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.300752 Sep 01 05:00:11.453468 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1441/2903] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:11 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:11.455310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:00:11.592035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b6cf995b-2ec7-4531-adb7-390ceed17c72 req-71c530cf-df82-4eb6-8bba-72b3ff1f4b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-deleted", "tag": "fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:11.624047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6cf995b-2ec7-4531-adb7-390ceed17c72 req-71c530cf-df82-4eb6-8bba-72b3ff1f4b97 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.627709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6cf995b-2ec7-4531-adb7-390ceed17c72 req-71c530cf-df82-4eb6-8bba-72b3ff1f4b97 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.628663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6cf995b-2ec7-4531-adb7-390ceed17c72 req-71c530cf-df82-4eb6-8bba-72b3ff1f4b97 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.672509 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6cf995b-2ec7-4531-adb7-390ceed17c72 req-71c530cf-df82-4eb6-8bba-72b3ff1f4b97 service nova] Creating event network-vif-deleted:fec3d18c-4b27-4b17-a7a4-c4a31a4d5e55 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:11.681085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b6cf995b-2ec7-4531-adb7-390ceed17c72 req-71c530cf-df82-4eb6-8bba-72b3ff1f4b97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092566 Sep 01 05:00:11.682761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1442/2904] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:11.919155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:11.920425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:11.938024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.945996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.946752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:11.947776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:11.952946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:11.954326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:12.768569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:12.777671 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a1397dc-c5f2-4b29-9b45-027c4933262c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1513 microversion: 2.1 time: 0.864662 Sep 01 05:00:12.783930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1443/2905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:11 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1513 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:12.788935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:12.795894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:12.814679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:12.815369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:12.815936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:12.816769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:12.817333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:12.817860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:13.681422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:13.696357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:13.716581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:13.721856 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e90a7de-8138-4451-8aa6-0e31a255c99b tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2756 microversion: 2.32 time: 0.934632 Sep 01 05:00:13.755494 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1444/2906] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:12 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2756 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:13.760596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:13.761214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:13.781684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:13.782769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:13.783209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:13.783958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:13.784405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:13.784819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:13.789701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:14.377341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:00:14.377939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:00:14.378739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:00:14.379395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:00:14.379913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:00:14.401544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.402154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.405049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:14.406057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.409207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.409874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:14.466243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:00:14.473096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:00:14.492856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:00:14.495251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:00:14.583991 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-419c3310-28d0-47d7-8374-ae116ade2ec8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.229693 Sep 01 05:00:14.584716 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1463/2907] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:00:14.600250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:14.600877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:14.616802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.617379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.617831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:14.618583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.619085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.619505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:14.791767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:14.810840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:14.820332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:14.821594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cebf172a-28d2-4be3-9aa8-65b339918483 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.235989 Sep 01 05:00:14.822154 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1464/2908] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:14 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:14.849245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-unplugged", "status": "completed", "tag": "739c6b63-c324-4919-91d7-6b309360928d"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-unplugged", "status": "completed", "tag": "544e2bf0-4b9c-43c6-8255-e002a4396e1f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:14.883676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.884213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.884671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:14.916212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] Creating event network-vif-unplugged:739c6b63-c324-4919-91d7-6b309360928d for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:14.920570 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] Creating event network-vif-unplugged:544e2bf0-4b9c-43c6-8255-e002a4396e1f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:14.946550 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f3695011-c522-404d-b01b-206e48fdf89b req-a1b4f7b5-dd4e-4cf7-a195-243b6703fae0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.097279 Sep 01 05:00:14.948498 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1465/2909] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:14.961894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:14.965405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:14.978858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.985838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.986298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:14.994151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:14.994743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:14.995227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:15.032882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:15.041590 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6866525-2d90-4749-ad0e-bb6a0deb48a3 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1476 microversion: 2.1 time: 1.284834 Sep 01 05:00:15.059806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1445/2910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:13 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1476 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:15.066570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-74bd9f50-907f-47fe-8b73-01dc300f715a req-94959854-5696-43ae-ade1-08660bceb9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-deleted", "tag": "c48ec7dc-e437-426b-bbc6-6eee0e32594f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:15.106198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-74bd9f50-907f-47fe-8b73-01dc300f715a req-94959854-5696-43ae-ade1-08660bceb9cc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:15.111636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-74bd9f50-907f-47fe-8b73-01dc300f715a req-94959854-5696-43ae-ade1-08660bceb9cc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:15.112522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-74bd9f50-907f-47fe-8b73-01dc300f715a req-94959854-5696-43ae-ade1-08660bceb9cc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:15.136241 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-74bd9f50-907f-47fe-8b73-01dc300f715a req-94959854-5696-43ae-ade1-08660bceb9cc service nova] Creating event network-vif-deleted:c48ec7dc-e437-426b-bbc6-6eee0e32594f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:15.148094 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-74bd9f50-907f-47fe-8b73-01dc300f715a req-94959854-5696-43ae-ade1-08660bceb9cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085400 Sep 01 05:00:15.151350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1446/2911] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:15.166336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4afe73c4-d0f1-4da6-9b42-bf3889e4226c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:15.167090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4afe73c4-d0f1-4da6-9b42-bf3889e4226c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:15.399802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:15.409414 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3de4ec7f-d3b4-4186-bb46-963c74a4b17b tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1471 microversion: 2.1 time: 0.459419 Sep 01 05:00:15.415004 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1466/2912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:14 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:15.427281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:15.427908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:15.457933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:15.459651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:15.460107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:15.460987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:15.462470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:15.463377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:15.601932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4afe73c4-d0f1-4da6-9b42-bf3889e4226c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:15.612933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4afe73c4-d0f1-4da6-9b42-bf3889e4226c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1215 microversion: 2.1 time: 0.456819 Sep 01 05:00:15.628908 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1447/2913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:15 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1215 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:15.728934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b33e3b91-841b-4afa-aef9-c3d436ac606b req-d3fabc00-5e60-4cf9-bcb0-1a2eff9b04c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb48627-3b4d-4b69-ba9b-d6d2ab073c50", "name": "network-vif-deleted", "tag": "736932e4-b998-44ad-b817-60e64701dac6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:15.754670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b33e3b91-841b-4afa-aef9-c3d436ac606b req-d3fabc00-5e60-4cf9-bcb0-1a2eff9b04c9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:15.755192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b33e3b91-841b-4afa-aef9-c3d436ac606b req-d3fabc00-5e60-4cf9-bcb0-1a2eff9b04c9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:15.755640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b33e3b91-841b-4afa-aef9-c3d436ac606b req-d3fabc00-5e60-4cf9-bcb0-1a2eff9b04c9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:15.795685 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b33e3b91-841b-4afa-aef9-c3d436ac606b req-d3fabc00-5e60-4cf9-bcb0-1a2eff9b04c9 service nova] Creating event network-vif-deleted:736932e4-b998-44ad-b817-60e64701dac6 for instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 on n-h1-820368-37 Sep 01 05:00:15.819916 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b33e3b91-841b-4afa-aef9-c3d436ac606b req-d3fabc00-5e60-4cf9-bcb0-1a2eff9b04c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096356 Sep 01 05:00:15.823092 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1448/2914] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:00:15.852575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:15.853309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:15.864170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:15.864665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:15.865104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:15.865822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:15.870303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:15.878646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.173153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.188891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.190349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.192000 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-015d0673-7c65-4b79-8491-cf9b2018311f tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.344861 Sep 01 05:00:16.193844 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1449/2915] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:15 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:16.198758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:16.213290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:16.220797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.221292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.221717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.230180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.231654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.234172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.366370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.382213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.387042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.391097 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a5c9640-2c9f-4ede-a8a2-6d763068172a tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 2327 microversion: 2.32 time: 0.974884 Sep 01 05:00:16.392640 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1467/2916] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:15 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 2327 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:16.437506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:16.438530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:16.448148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.451517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.456147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.457190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.457765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.458370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.513181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.513945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.514711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.515451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lazy-loading 'fault' on Instance uuid 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:00:16.729442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:16.745737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4298741d-8014-42b0-a3b0-bf12238bd36e tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 200 len: 1307 microversion: 2.1 time: 0.314295 Sep 01 05:00:16.748555 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1468/2917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:16 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:16.764246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:16.767988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:16.793055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.794195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.795458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:16.796476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:16.797157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:16.797971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.212174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.224052 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9cc93d80-613b-4f6e-8ea6-0664f7c0a70c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1475 microversion: 2.1 time: 1.028842 Sep 01 05:00:17.228369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.229806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1450/2918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:16 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1475 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:17.236874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c200c71e-5ca6-4218-9121-38aa4c329073 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1267 microversion: 2.1 time: 0.485801 Sep 01 05:00:17.240211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-deleted", "tag": "544e2bf0-4b9c-43c6-8255-e002a4396e1f"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-deleted", "tag": "fb9959fe-6d22-4449-b3ec-6dbc63f6f116"}, {"server_uuid": "ad778fc7-2f87-42ed-863a-cb8874b8acd1", "name": "network-vif-deleted", "tag": "739c6b63-c324-4919-91d7-6b309360928d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:17.259288 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1469/2919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:16 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1267 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:17.265119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:17.265731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:17.267972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.268484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.268925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.284075 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Creating event network-vif-deleted:544e2bf0-4b9c-43c6-8255-e002a4396e1f for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:17.285092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Creating event network-vif-deleted:fb9959fe-6d22-4449-b3ec-6dbc63f6f116 for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:17.285855 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] Creating event network-vif-deleted:739c6b63-c324-4919-91d7-6b309360928d for instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 on n-h2-820368-37 Sep 01 05:00:17.286583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.287270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.287812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.288637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.289280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.289810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.293329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8d68af2b-d9f8-4a35-85d7-8ed09d04407d req-19064564-f588-464b-baa7-88e40d3d6fdb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.061127 Sep 01 05:00:17.294437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1451/2920] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:17.423894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:17.425296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:17.434251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.436179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.437597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.440529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.442972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.444289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.525462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.538070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.542951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.557069 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59f02d31-9dfa-4973-b384-8360c1e39685 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.285424 Sep 01 05:00:17.557778 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1470/2921] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:17 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:17.650381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.672261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.675198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:17.677832 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5dc67927-c457-46b8-853d-2b5a048bd6b4 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.262074 Sep 01 05:00:17.679567 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1452/2922] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:17 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:17.767958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:17.768847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:17.779981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.780685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.789141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.795267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:17.795957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:17.796554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:17.817328 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] HTTP exception thrown: Instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 could not be found. Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Request method failure captured: Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 HTTP/1.1 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDu7ytbkDNv1AyVj__tAV96qdW4LMp6NRqBlE4AN9wvUXEevL5rT3yrAU8RmsWAELby5OEvUPrfbpgcExpb4zeaWIMqQjHDFtqkqI73BZ9R399a2EBs7EQtKbBudlEjMFa6w2DtPzYX0LgugaRdsrjdvR2x6CPw-S1WnvjWFHwFsfoc Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 87e07a7391724191b70b4599382a6d91 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesAdminNegativeTest-1262875435 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87e07a7391724191b70b4599382a6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87e07a7391724191b70b4599382a6d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87e07a7391724191b70b4599382a6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87e07a7391724191b70b4599382a6d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesAdminNegativeTest-1262875435 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 87e07a7391724191b70b4599382a6d91 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1262875435 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesAdminNegativeTest-1262875435-project Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dbbad474a30e456d8249d35dc3787468 Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesAdminNegativeTest-1262875435-project Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 could not be found. Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4cb48627-3b4d-4b69-ba9b-d6d2ab073c50'} Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 could not be found. Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 could not be found. Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:17.819393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 could not be found. Sep 01 05:00:17.823340 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:17.825748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Returning 404 to user: Instance 4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:17.826877 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2af1883-ae76-41b7-8925-463d88ba3b59 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50" status: 404 len: 111 microversion: 2.1 time: 0.063177 Sep 01 05:00:17.827914 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1471/2923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:17 2022] GET /compute/v2.1/servers/4cb48627-3b4d-4b69-ba9b-d6d2ab073c50 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:18.251211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:18.251987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:18.257783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:18.258681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:18.264329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:18.265522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:18.267581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:18.270924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:18.272659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:18.273380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:18.274372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:18.274876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:18.275344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:18.276071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:18.276529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:18.277022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.230761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.241871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd785e78-b792-4b0a-b4c7-d0f8f21205b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.987835 Sep 01 05:00:19.254977 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1472/2924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:18 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:19.270012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:19.270964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:19.291519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:19.292543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:19.293949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.296194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:19.296824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:19.297808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.404815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.415356 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2fe1a02-20c7-405d-8936-028b56c0ff88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1475 microversion: 2.1 time: 1.168997 Sep 01 05:00:19.418857 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1453/2925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:18 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1475 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:19.427299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:19.428283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:19.442317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:19.443292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:19.444123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.445137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:19.445796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:19.447594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.632108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.643104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.653763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.655263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.676505 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a88bf676-a595-4770-a15f-0ec934d656f8 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.416350 Sep 01 05:00:19.678785 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1473/2926] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:19 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:19.680708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.686950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:19.706920 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-953c1a8e-0f62-4717-b059-bc3ebeb47327 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.271044 Sep 01 05:00:19.709188 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1454/2927] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:19 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:19.716560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "name": "network-vif-unplugged", "status": "completed", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:19.724955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7566f97c-8127-447b-84ee-2edf42e65fa2 req-173a4396-7613-477a-a999-f17cbbf7188a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47bce25e-f4e3-4ca2-82db-63be8850fdf9", "tag": "dbd40e34-4566-4bd8-9313-303b52ef5b9a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:19.753931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:19.755876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:19.756470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.766982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7566f97c-8127-447b-84ee-2edf42e65fa2 req-173a4396-7613-477a-a999-f17cbbf7188a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:19.772474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7566f97c-8127-447b-84ee-2edf42e65fa2 req-173a4396-7613-477a-a999-f17cbbf7188a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:19.775163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7566f97c-8127-447b-84ee-2edf42e65fa2 req-173a4396-7613-477a-a999-f17cbbf7188a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:19.810873 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] Creating event network-vif-unplugged:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h2-820368-37 Sep 01 05:00:19.826072 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7566f97c-8127-447b-84ee-2edf42e65fa2 req-173a4396-7613-477a-a999-f17cbbf7188a service nova] Creating event network-changed:dbd40e34-4566-4bd8-9313-303b52ef5b9a for instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 on n-h2-820368-37 Sep 01 05:00:19.827887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] Instance b544a47a-b8a6-4179-bb85-2758aad1a226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:00:19.848690 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ad9cf4c5-148a-4e09-9f10-e38947dec0b1 req-8f8889af-8d82-401c-9fa0-b82f5e9629fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168541 Sep 01 05:00:19.848942 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7566f97c-8127-447b-84ee-2edf42e65fa2 req-173a4396-7613-477a-a999-f17cbbf7188a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136770 Sep 01 05:00:19.849615 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1455/2928] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:19.850489 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1474/2929] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:20.267344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:20.268309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:20.275861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:20.276753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:20.277342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:20.278208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:20.278853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:20.279451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:20.441667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:20.442534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:20.455416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:20.456233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:20.456834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:20.457754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:20.458400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:20.459019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:20.507933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:20.859934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:20.874336 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a57c935-cc0a-4b15-af5d-7d35b48155b2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.613223 Sep 01 05:00:20.875737 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1456/2930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:20 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:20.882114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:20.883388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:20.891887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:20.892740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:20.893696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:20.894688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:20.896647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:20.898003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:20.987720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.014984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.015668 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a3be825-80e3-46ea-a973-dac46e38f716 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1475 microversion: 2.1 time: 0.579021 Sep 01 05:00:21.017259 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1475/2931] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:20 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1475 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:21.024378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:21.025773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:21.041385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.044993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.046489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.048830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.050138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.050383 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd26ed6f-77a2-438b-9a52-0994c622b804 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.173152 Sep 01 05:00:21.051634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.052470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.053230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.057631 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1457/2932] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:20 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:21.174495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.186024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.188437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:21.190058 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35288d28-3b27-4ff0-af97-2a3134907112 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.171013 Sep 01 05:00:21.190566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1476/2933] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:21 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:21.639431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:21.640140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:21.648664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.650833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.651520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.652504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.653110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.653708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.695150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de3e5fbc-05b0-4070-a416-f46adb3cba2c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/ips" status: 200 len: 151 microversion: 2.1 time: 0.059687 Sep 01 05:00:21.695746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1458/2934] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:00:21 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/ips => generated 151 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:21.887992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:21.900648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:21.901895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:21.914228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.916656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.917162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.917594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.918439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.920417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.925500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:21.925998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:21.926430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:21.951654 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] Creating event network-changed:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h2-820368-37 Sep 01 05:00:21.966629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] Instance b544a47a-b8a6-4179-bb85-2758aad1a226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:00:22.052733 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1613501f-d269-467c-af9e-e8a64998c2a2 req-58fab341-ba05-488c-b928-d11624f1c246 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169276 Sep 01 05:00:22.055147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1477/2935] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:22.060924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:22.061645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:22.104199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:22.105319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:22.106044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:22.107393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:22.108934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:22.109751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:23.684035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:23.699002 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23bfe957-b79e-4016-8fb1-c4d5d82fcd95 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1475 microversion: 2.1 time: 1.642277 Sep 01 05:00:23.707891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1478/2936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:22 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1475 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:23.728973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:23.729676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:23.754820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:23.759032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:23.759646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:23.760281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:23.761221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:23.761873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:23.763783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:23.774021 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15a1a6ff-9e8f-493e-a0dc-b2649329b4a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 1.876212 Sep 01 05:00:23.790273 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1459/2937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:21 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:23.797615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:23.798673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:23.815981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:23.816480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:23.824719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:23.825927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:23.826423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:23.826907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:24.079031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:24.080177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:24.094327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:24.097080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:24.098171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:24.098981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4b05438-f529-4008-ae64-3c3670426c14 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.320178 Sep 01 05:00:24.099869 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1460/2938] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:23 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:24.100163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:24.101491 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3ebfa8d-d210-4852-b487-bcd853431aa9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.391338 Sep 01 05:00:24.102063 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1479/2939] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:23 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:24.416184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "362e5a1b-73f8-445e-bc91-b83b2e3aa8ee"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:24.420769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:24.431383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:24.432256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:24.432933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:24.434373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:24.435095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:24.435935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:24.728815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:24.729933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:24.733137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:24.734158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:24.752646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:24.753339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:24.753929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:24.754777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:24.755392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:24.755926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:25.253690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:25.262496 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16fb2a87-adab-4bd8-9035-314d58ee2117 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1473 microversion: 2.1 time: 0.537874 Sep 01 05:00:25.266123 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1480/2940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:24 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1473 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:25.283424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:25.284432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:25.299544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:25.300248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:25.300874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:25.301810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:25.302454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:25.303102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:25.613063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:25.819518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:25.836791 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8de654f1-accf-4be7-8a71-40299631c296 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.569262 Sep 01 05:00:25.864080 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1481/2941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:25 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:25.878099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:25.880502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:25.912052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:25.913179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:25.913790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:25.914644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:25.918427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:25.919053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:26.167361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:26.193714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:26.199533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:26.202062 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8f5dce7-0126-48d6-8f7a-d0c1d307d4fb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.334399 Sep 01 05:00:26.212968 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1482/2942] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:25 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:26.218603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:26.220318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:26.247922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:26.248747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:26.250573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:26.253800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:26.254604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:26.259904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:26.407801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:26.416938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:26.418462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:26.419870 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71ba61eb-2806-43a3-9c37-4f1e6e7e8dc9 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.205357 Sep 01 05:00:26.436148 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1483/2943] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:26 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:26.445242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:26.446149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:26.463840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:26.467793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:26.468540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:26.469569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:26.470218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:26.480152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:27.519526 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fe96157-927b-4c5e-af64-ff369b682d25 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.107239 Sep 01 05:00:27.523027 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1461/2944] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:00:24 2022] POST /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 194 bytes in 3113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:27.538450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:27.540867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:27.562511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:27.564757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:27.565377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:27.567163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:27.568504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:27.570180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:28.158580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.171139 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4dd5d066-8f5c-4ed0-a224-1ff9921465e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1473 microversion: 2.1 time: 1.733477 Sep 01 05:00:28.171745 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1484/2945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:26 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1473 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:28.186916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5215ea5e-b0e4-41b3-a9cf-77ce54053292 req-7b3713e7-e5bc-4502-a16b-6e96fc8c31d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bce25e-f4e3-4ca2-82db-63be8850fdf9", "name": "network-vif-plugged", "status": "completed", "tag": "dbd40e34-4566-4bd8-9313-303b52ef5b9a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:28.222009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:28.224215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5215ea5e-b0e4-41b3-a9cf-77ce54053292 req-7b3713e7-e5bc-4502-a16b-6e96fc8c31d9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:28.224696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5215ea5e-b0e4-41b3-a9cf-77ce54053292 req-7b3713e7-e5bc-4502-a16b-6e96fc8c31d9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:28.225157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5215ea5e-b0e4-41b3-a9cf-77ce54053292 req-7b3713e7-e5bc-4502-a16b-6e96fc8c31d9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:28.274797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5215ea5e-b0e4-41b3-a9cf-77ce54053292 req-7b3713e7-e5bc-4502-a16b-6e96fc8c31d9 service nova] Creating event network-vif-plugged:dbd40e34-4566-4bd8-9313-303b52ef5b9a for instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 on n-h2-820368-37 Sep 01 05:00:28.289271 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5215ea5e-b0e4-41b3-a9cf-77ce54053292 req-7b3713e7-e5bc-4502-a16b-6e96fc8c31d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108829 Sep 01 05:00:28.291680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1485/2946] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:28.304662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:28.306700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:28.320171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:28.322603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:28.327101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:28.328075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:28.329194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:28.329833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:28.684122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.694282 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b3b348b-a7e7-444a-b1a3-a6290fa342c2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 1.169453 Sep 01 05:00:28.706473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1462/2947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:27 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:28.718304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:28.723749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:28.737458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:28.740589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:28.741952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:28.743038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:28.744906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:28.747185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:28.795922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.817335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.818712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.819985 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae1ccb29-713e-4577-9f19-b0d8ed6f0f85 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.524485 Sep 01 05:00:28.820560 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1486/2948] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:28 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:28.967949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.977300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.987785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:28.989458 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a09e9797-a08d-4e6d-9871-379e7bf6a42c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.281325 Sep 01 05:00:28.991081 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1463/2949] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:28 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:29.193102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:29.194415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:29.209525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:29.212146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:29.212786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:29.214680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:29.216662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:29.219150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:29.625926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:29.636270 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bee241d-ac17-48e0-992c-998ce7e39c08 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1470 microversion: 2.1 time: 0.447480 Sep 01 05:00:29.661754 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1487/2950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:29 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1470 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:29.688344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:29.689674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:29.711887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:29.712558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:29.713007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:29.717276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:29.717758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:29.718192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:29.727531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:29.728400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:29.747476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:29.752328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:29.753496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:29.761858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:29.763591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:29.768045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:29.862833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:30.144773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.162648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08d16ce9-e0ad-49a9-8ec2-142745bf9640 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "POST /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226/action" status: 202 len: 0 microversion: 2.1 time: 0.474849 Sep 01 05:00:30.164241 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1464/2951] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:00:29 2022] POST /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:00:30.167429 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6f7b93e-501a-49bf-9e65-22eb22b5b99d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.445089 Sep 01 05:00:30.179612 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1488/2952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:29 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:30.185011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:30.191250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:30.197428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:30.200086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:30.217419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:30.219768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:30.221442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:30.224282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:30.227202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:30.228134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:30.231394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:30.232274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:30.236595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:30.238078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:30.245165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:30.247736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:30.499887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.510979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.523307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.525940 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cdcbaea5-b9b7-4a8d-9a34-41716f8b684e tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.356812 Sep 01 05:00:30.526760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1465/2953] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:30 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:30.533405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.534718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:30.538796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:30.550540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.552592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.553388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:30.554439 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77ab5181-1223-4aa7-ab87-64b85ff17e04 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1366 microversion: 2.57 time: 0.373608 Sep 01 05:00:30.555252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:30.555869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:30.556624 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1489/2954] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:30 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:30.557675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:30.558141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:30.558565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:30.942590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:30.955865 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b46bf3e-d018-4756-ac20-715ae68c3ee7 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.427559 Sep 01 05:00:30.956434 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1466/2955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:30 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:31.228712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:31.230206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:31.254674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:31.255481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:31.256082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:31.256966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:31.258397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:31.259069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:31.550927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:31.551561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:31.569049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:31.569553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:31.569994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:31.570720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:31.571213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:31.571649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:31.977301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:31.999871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.005698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.007300 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5fd6923e-075c-4b68-a2d1-e217a28f2853 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.461179 Sep 01 05:00:32.008901 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1467/2956] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:31 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:32.018816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:32.019698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:32.029999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.030393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.030844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.040103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.044801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.047397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.048291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.052023 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a23215e0-f62a-4d9f-b36c-07f4d8eb61ea tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1315 microversion: 2.1 time: 0.857095 Sep 01 05:00:32.054603 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1490/2957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:31 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:32.064684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:32.065685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:32.073406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.076354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.078286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.079664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.081758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.082831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.367460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.410348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.412275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.413774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f40df5a1-f41d-4875-907a-85f4ee8604eb tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1372 microversion: 2.57 time: 0.403420 Sep 01 05:00:32.416420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1468/2958] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:32 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1372 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:32.439219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:32.439855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:32.446379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.446911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.447367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.448139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.448629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.449044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.497147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:32.514498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:32.530174 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98ecf431-e40f-4422-9b1b-4ce2e1458817 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.473933 Sep 01 05:00:32.531731 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1491/2959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:32 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:32.657503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:32.688599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-579c4aa5-7070-4f9f-baf5-db9e9c0141f8 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 204 len: 0 microversion: 2.1 time: 0.259656 Sep 01 05:00:32.694843 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1469/2960] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:00:32 2022] DELETE /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:00:32.705813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:32.710929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:32.730759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.731533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.732169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:32.738211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:32.739279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:32.739929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.032873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:33.035162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:33.045761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.046688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.047452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.048365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.049100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.050320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.123131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.142764 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03cc8293-4f64-4797-9bb8-ca352abb7d56 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1681 microversion: 2.1 time: 0.440719 Sep 01 05:00:33.144510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1492/2961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:32 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1681 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:33.154488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:33.154720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:33.163183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.173435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.173969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.174447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.175292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.175755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.176192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.177377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.178982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.180474 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48450ee1-4249-4727-994d-070fb18356ae tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.152729 Sep 01 05:00:33.181787 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1470/2962] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:33 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:33.209966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:33.444509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:33.445396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:33.458230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.458776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.460377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.462467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.463004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.465543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.564180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.575748 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a7f5ece-6398-4db7-b47e-81d6e96fe9e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1502 microversion: 2.1 time: 0.429851 Sep 01 05:00:33.582656 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1493/2963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:33 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1502 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:33.591256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:33.592679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:33.619396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.624532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.625633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.635494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.636760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.637669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.685596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.704731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.726521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:33.728228 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a093e76-0139-45b8-b27c-4a32a71acfde tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1372 microversion: 2.57 time: 0.288177 Sep 01 05:00:33.747829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1471/2964] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:33 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:33.754461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:33.756317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:33.764317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.765199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.765923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.769331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:33.771454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:33.772139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:33.819399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lazy-loading 'flavor' on Instance uuid 47bce25e-f4e3-4ca2-82db-63be8850fdf9 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:00:34.285124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:34.299800 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68e7df91-d325-4384-9a0d-8f198b5bbd0e tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.715052 Sep 01 05:00:34.303573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1494/2965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:33 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:34.322066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "name": "network-vif-plugged", "status": "completed", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:34.336488 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e5b4891-7c13-4563-8814-8af4850a7cd7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.584568 Sep 01 05:00:34.338177 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1472/2966] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:00:33 2022] POST /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:00:34.353681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:34.366224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.369610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.370467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:34.371492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.396798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.398806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.399530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.401139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.403882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.404634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.411381 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] Creating event network-vif-plugged:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h2-820368-37 Sep 01 05:00:34.424424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] Instance b544a47a-b8a6-4179-bb85-2758aad1a226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:00:34.451049 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-711deede-8516-48f0-bfdb-d75b2d85df45 req-b12a0c7a-ece0-48ee-876d-b346573a69f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142864 Sep 01 05:00:34.452434 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1495/2967] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:34.463830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:34.465042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:34.484741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.485574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.487911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.491328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.496423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.497211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.891300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:34.911780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:34.917760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:34.920945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a636be40-4595-4579-8ef0-e474e1c44a7f tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.465122 Sep 01 05:00:34.921585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1496/2968] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:34 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:34.933247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:34.933838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:34.949470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.951556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.955093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.956376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:34.957075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:34.959934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:34.980566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:34.994504 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d809c609-cc96-4ef2-b22a-e5d41020b6f3 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1681 microversion: 2.1 time: 0.653636 Sep 01 05:00:34.999734 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1473/2969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:34 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1681 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:35.031251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:35.034599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:35.049510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:35.052001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:35.053845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:35.060067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:35.060987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:35.064081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:35.805461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:35.815850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:35.820223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:35.821453 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-747d518d-7042-4cc7-9bbb-a4085b192953 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1372 microversion: 2.57 time: 0.806916 Sep 01 05:00:35.834914 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1474/2970] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:35 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1372 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:35.836949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:35.840616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:35.860344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:35.863742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:35.865103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:35.868651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:35.869560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:35.871639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:36.580163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:36.596105 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eef43b2b-987d-4940-9cea-2369fa23b84b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 1.669146 Sep 01 05:00:36.599161 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1497/2971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:34 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:36.610701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:36.613083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:36.628438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:36.632428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:36.633436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:36.634599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:36.635569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:36.636702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:36.866803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:36.891960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:36.893648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:36.900794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f68bfa7-76f1-4052-9200-adbe7e0bd400 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.297942 Sep 01 05:00:36.901433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1498/2972] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:36 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:36.908144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:36.916109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:36.922469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:36.923396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:36.925375 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7378d475-dc40-4573-9352-a9bc08f2512d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 1.097064 Sep 01 05:00:36.931341 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1475/2973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:35 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:36.938046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:36.939810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:36.943573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:36.944578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:36.945451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:36.947079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:36.955121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:36.960384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:36.984843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:36.985811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:36.986478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:36.987523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:36.988240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:36.988897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:37.240601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:37.257847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:37.264875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:37.267501 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e78c7295-2b47-4524-8b1b-e9f449cb0a0c tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1372 microversion: 2.57 time: 0.328706 Sep 01 05:00:37.269554 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1476/2974] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:36 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:37.348859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e0f758d1-a5ab-47df-9f50-29c4d43e172f req-a769473a-1c58-4b44-9882-af16b392eb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a734084d-4986-49c0-a6f6-3e8d6a493831", "name": "network-vif-unplugged", "status": "completed", "tag": "4e04edaf-5c78-4536-8947-fefcfeefeadb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:37.366427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e0f758d1-a5ab-47df-9f50-29c4d43e172f req-a769473a-1c58-4b44-9882-af16b392eb73 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:37.367037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e0f758d1-a5ab-47df-9f50-29c4d43e172f req-a769473a-1c58-4b44-9882-af16b392eb73 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:37.367474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e0f758d1-a5ab-47df-9f50-29c4d43e172f req-a769473a-1c58-4b44-9882-af16b392eb73 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:37.404340 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e0f758d1-a5ab-47df-9f50-29c4d43e172f req-a769473a-1c58-4b44-9882-af16b392eb73 service nova] Creating event network-vif-unplugged:4e04edaf-5c78-4536-8947-fefcfeefeadb for instance a734084d-4986-49c0-a6f6-3e8d6a493831 on n-h1-820368-37 Sep 01 05:00:37.419923 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e0f758d1-a5ab-47df-9f50-29c4d43e172f req-a769473a-1c58-4b44-9882-af16b392eb73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076700 Sep 01 05:00:37.423812 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1477/2975] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:00:37.621160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:37.622244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:37.639325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:37.640165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:37.641731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:37.647578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:37.648316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:37.650687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:37.729517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:37.760161 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e32534c4-b75c-408d-883e-76383b820d20 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1681 microversion: 2.1 time: 0.857495 Sep 01 05:00:37.764628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1499/2976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:36 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1681 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:37.932763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:37.934524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:37.966703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:37.967238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:37.976163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:37.977207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:37.978813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:37.979472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:38.158458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.178228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.180025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.181482 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e599ce22-f8cc-49d0-beac-3c2388329ceb tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.256779 Sep 01 05:00:38.182556 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1500/2977] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:37 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:38.189924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:38.197399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:38.213722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:38.214822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:38.215443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:38.219451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:38.220187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:38.220817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:38.261315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.276395 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a011ee6a-13b8-40ef-8de2-f0bf7e2c7f42 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.659728 Sep 01 05:00:38.278942 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1478/2978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:37 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:38.299298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:38.299928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:38.323969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:38.324470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:38.324908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:38.325621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:38.326073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:38.334698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:38.767626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.790177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.792079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:38.793489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-790d2252-6b57-43db-8c8c-edf753762cc2 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1357 microversion: 2.57 time: 0.498506 Sep 01 05:00:38.815589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1479/2979] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:38 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1357 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:38.832077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:38.833053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:38.840504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:38.841299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:38.841903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:38.842794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:38.843422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:38.844790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.087618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:39.106055 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27defd3c-3de3-46eb-b37a-5dd95b4d21bd tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.921837 Sep 01 05:00:39.107521 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1501/2980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:38 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:39.127997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:39.132053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:39.142275 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa8bf127-0105-4c8b-83ee-09bddef1a165 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1614 microversion: 2.1 time: 0.324463 Sep 01 05:00:39.142837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:39.167272 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1480/2981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:38 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1614 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:39.177746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.178352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.179120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.180122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.180804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.181458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.207360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:39.208234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:39.218211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.222123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.222654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.223553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.225797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.227300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.240610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:39.471512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bb0c96b-c5fc-4914-98a7-ef4344f34382 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 204 len: 0 microversion: 2.57 time: 0.362234 Sep 01 05:00:39.476054 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1502/2982] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:00:39 2022] DELETE /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:00:39.501668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:39.503927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:39.504870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:39.517594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:39.521451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.523129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.524438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.525581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:39.526771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.528977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e481498-2e87-48cd-8167-0a5bac154731 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.327515 Sep 01 05:00:39.531039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.542924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.545385 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1481/2983] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:39 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:00:39.569673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:39.570579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:39.587372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.588212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.603863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:39.606356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:39.608954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:39.611581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.051228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:40.071004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:40.077278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:40.078708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7682b4ef-c6dd-4373-a74b-d1507cae4a67 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1363 microversion: 2.57 time: 0.524659 Sep 01 05:00:40.082638 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1482/2984] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:39 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1363 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:40.133513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:40.134469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:40.161882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.162306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.162745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.163497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.166057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.166693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.750366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:40.762583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:40.766074 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-453dc738-14b5-4494-b02d-a203656bc178 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 1.288085 Sep 01 05:00:40.766686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1503/2985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:39 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:40.785690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:40.786318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:40.793936 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d508e933-4a95-4c0b-9572-19e2cd9a624f tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.665603 Sep 01 05:00:40.807307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.807307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.807307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.807307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.810022 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1483/2986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:40 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:40.811285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.812803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.828012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:40.828641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:40.852039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.852859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.855658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.856721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.857542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.862850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.957490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:40.960196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:40.962699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:40.963947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lazy-loading 'fault' on Instance uuid a734084d-4986-49c0-a6f6-3e8d6a493831 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:00:41.137075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.155916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.160745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.161754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbad474a30e456d8249d35dc3787468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e07a7391724191b70b4599382a6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.163925 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c26b599-a44e-47e3-8b86-cc21fb776db8 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.352510 Sep 01 05:00:41.176884 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6be849a5-0184-4397-96e0-add81a13d499 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 200 len: 1332 microversion: 2.1 time: 0.408806 Sep 01 05:00:41.179187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1504/2987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:40 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 1332 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:41.179688 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1484/2988] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:40 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:41.191231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:41.193403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-246b28ca-fb9c-4c43-9661-5832c8718e47 req-bbd71f6f-7407-4260-a1df-8f5c24489c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a734084d-4986-49c0-a6f6-3e8d6a493831", "name": "network-vif-deleted", "tag": "4e04edaf-5c78-4536-8947-fefcfeefeadb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:41.195344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:41.209481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.210763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.213064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.214029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.214740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.215336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.229012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-246b28ca-fb9c-4c43-9661-5832c8718e47 req-bbd71f6f-7407-4260-a1df-8f5c24489c70 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.237136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-246b28ca-fb9c-4c43-9661-5832c8718e47 req-bbd71f6f-7407-4260-a1df-8f5c24489c70 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.237881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-246b28ca-fb9c-4c43-9661-5832c8718e47 req-bbd71f6f-7407-4260-a1df-8f5c24489c70 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.270769 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-246b28ca-fb9c-4c43-9661-5832c8718e47 req-bbd71f6f-7407-4260-a1df-8f5c24489c70 service nova] Creating event network-vif-deleted:4e04edaf-5c78-4536-8947-fefcfeefeadb for instance a734084d-4986-49c0-a6f6-3e8d6a493831 on n-h1-820368-37 Sep 01 05:00:41.298326 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-246b28ca-fb9c-4c43-9661-5832c8718e47 req-bbd71f6f-7407-4260-a1df-8f5c24489c70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115464 Sep 01 05:00:41.303230 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1505/2989] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:41.320721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "name": "network-vif-unplugged", "status": "completed", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:41.336208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.336784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.337679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.341883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.357388 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] Creating event network-vif-unplugged:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h1-820368-37 Sep 01 05:00:41.359123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.368280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:41.369830 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-544d4425-b434-410a-9ea9-cdd7b13ec85a tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1363 microversion: 2.57 time: 0.187727 Sep 01 05:00:41.371448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] Instance b544a47a-b8a6-4179-bb85-2758aad1a226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:00:41.386260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1485/2990] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:41 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:41.395624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5a60a723-f355-4f8c-b54d-35bf959fc753 req-01fd0a65-be44-473d-926e-3f230aa2f01a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079299 Sep 01 05:00:41.397115 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1506/2991] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:41.788453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:41.789680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:41.803487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.809732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.814822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.815840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.816323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.816757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.824291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:41.825127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:41.841478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.842137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.842693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:41.843550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:41.844098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:41.844614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.480951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:42.497319 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b736e6c6-f089-428c-b49e-80c46afe88e5 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.713421 Sep 01 05:00:42.499185 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1486/2992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:41 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:42.506008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:42.506848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:42.522708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:42.531380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:42.533172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.534246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:42.535622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:42.536916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.701476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:42.712883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:42.714848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:42.715566 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28f6466f-8118-49d4-8b3b-42f2bb8bc567 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.214543 Sep 01 05:00:42.716371 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1487/2993] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:42 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:42.734404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:42.735859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] [instance: a734084d-4986-49c0-a6f6-3e8d6a493831] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:42.756321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:42.757242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:42.757730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:42.758156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.758914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:42.759505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:42.759919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.766345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b25bd45-d6e1-44c0-ad66-ab030c95b845 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.949914 Sep 01 05:00:42.771811 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1507/2994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:41 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:42.781278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:42.786798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:42.796362 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] HTTP exception thrown: Instance a734084d-4986-49c0-a6f6-3e8d6a493831 could not be found. Sep 01 05:00:42.802585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:42.804578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Request method failure captured: Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 HTTP/1.1 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDu7ytbkDNv1AyVj__tAV96qdW4LMp6NRqBlE4AN9wvUXEevL5rT3yrAU8RmsWAELby5OEvUPrfbpgcExpb4zeaWIMqQjHDFtqkqI73BZ9R399a2EBs7EQtKbBudlEjMFa6w2DtPzYX0LgugaRdsrjdvR2x6CPw-S1WnvjWFHwFsfoc Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 87e07a7391724191b70b4599382a6d91 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesAdminNegativeTest-1262875435 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87e07a7391724191b70b4599382a6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/87e07a7391724191b70b4599382a6d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_87e07a7391724191b70b4599382a6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/87e07a7391724191b70b4599382a6d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesAdminNegativeTest-1262875435 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 87e07a7391724191b70b4599382a6d91 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1262875435 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesAdminNegativeTest-1262875435-project Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dbbad474a30e456d8249d35dc3787468 Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesAdminNegativeTest-1262875435-project Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a734084d-4986-49c0-a6f6-3e8d6a493831 could not be found. Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a734084d-4986-49c0-a6f6-3e8d6a493831'} Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a734084d-4986-49c0-a6f6-3e8d6a493831 could not be found. Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a734084d-4986-49c0-a6f6-3e8d6a493831 could not be found. Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:42.804790 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a734084d-4986-49c0-a6f6-3e8d6a493831 could not be found. Sep 01 05:00:42.809474 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:42.811389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Returning 404 to user: Instance a734084d-4986-49c0-a6f6-3e8d6a493831 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:42.811546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.812352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:42.812951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:42.813085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-746f40be-94a4-4491-97b3-02fa4fe4b66c tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831" status: 404 len: 111 microversion: 2.1 time: 0.095402 Sep 01 05:00:42.813434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:42.814389 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1488/2995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:42 2022] GET /compute/v2.1/servers/a734084d-4986-49c0-a6f6-3e8d6a493831 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:42.830745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52e2c851-d29a-4dcc-a129-3d89bedd5372 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] Calling method '.version_select at 0x7fa75b0a61f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:42.874079 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52e2c851-d29a-4dcc-a129-3d89bedd5372 tempest-VolumesAdminNegativeTest-1262875435 tempest-VolumesAdminNegativeTest-1262875435-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329962189" status: 202 len: 0 microversion: 2.1 time: 0.055539 Sep 01 05:00:42.879356 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1489/2996] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329962189 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:00:42.987977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:43.004431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:43.022222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd0d6dedc7ff4f55bc1eacf5cc8082c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f78f3b4d9e94bbf8511b10e5d4a5f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:43.023906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f6ea9da-2a75-462f-88a8-7a550e650576 tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 200 len: 1363 microversion: 2.57 time: 0.250938 Sep 01 05:00:43.036478 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1508/2997] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:42 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:43.389634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:43.413036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:43.414220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:43.415460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:43.437335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] Creating event network-changed:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h1-820368-37 Sep 01 05:00:43.448109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] Instance b544a47a-b8a6-4179-bb85-2758aad1a226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:00:43.483805 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9f394537-ebd9-49ac-98e5-9b824c761735 req-3f0690a3-83d2-49d2-a1ed-10bafe339f39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100015 Sep 01 05:00:43.495192 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1490/2998] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:43.525417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:43.526181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:43.538673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:43.539198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:43.546145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:43.547201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:43.547767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:43.548325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:43.551574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:43.760948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:43.762277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:43.779779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:43.782097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:43.782928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:43.788704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:43.791674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:43.795827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:44.121174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:44.140990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:44.145214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:44.149871 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6092801-04e9-4cdc-b3c5-36af9e259f27 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.409241 Sep 01 05:00:44.153648 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1491/2999] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:43 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:44.161971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:44.167164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:44.185596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:44.189509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:44.190271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:44.194426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:44.195288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:44.195980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:44.568196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:44.585831 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8d68283-a073-45c5-8e1e-e329b0e95216 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 1.064703 Sep 01 05:00:44.587974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1509/3000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:43 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:44.608496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:44.609157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] [instance: 3946f8b0-f35a-410c-91e0-306f2e746639] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:44.631004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:44.638929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:44.645564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:44.647984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:44.656319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:44.658823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:44.694066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] HTTP exception thrown: Instance 3946f8b0-f35a-410c-91e0-306f2e746639 could not be found. Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Request method failure captured: Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 HTTP/1.1 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDxFymmkM-FUrc3eAK2yq198DSuSGGYatsDe-3Whiy-GgPCqDR-tFVH_DX5FQwO-2bH5cLo2rJMZGMS0j5I2oMHpQD-Diak2NNkypvDGMJaIYL0gtzTPKO7r5mysu7dAg3d_dSjgEcRypkJS3QvIcBgc4vmz7roC8vpigT01VYyrqDo Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.57 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 8f78f3b4d9e94bbf8511b10e5d4a5f2f Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerShowV257Test-28827994 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f78f3b4d9e94bbf8511b10e5d4a5f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f78f3b4d9e94bbf8511b10e5d4a5f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f78f3b4d9e94bbf8511b10e5d4a5f2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f78f3b4d9e94bbf8511b10e5d4a5f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerShowV257Test-28827994 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 8f78f3b4d9e94bbf8511b10e5d4a5f2f Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerShowV257Test-28827994 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerShowV257Test-28827994-project Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: bd0d6dedc7ff4f55bc1eacf5cc8082c7 Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerShowV257Test-28827994-project Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 3946f8b0-f35a-410c-91e0-306f2e746639 could not be found. Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '3946f8b0-f35a-410c-91e0-306f2e746639'} Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3946f8b0-f35a-410c-91e0-306f2e746639 could not be found. Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3946f8b0-f35a-410c-91e0-306f2e746639 could not be found. Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:44.696786 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3946f8b0-f35a-410c-91e0-306f2e746639 could not be found. Sep 01 05:00:44.701096 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:44.704934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] Returning 404 to user: Instance 3946f8b0-f35a-410c-91e0-306f2e746639 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:44.706349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e14defbd-9caf-4e25-926c-c415c65dabce tempest-ServerShowV257Test-28827994 tempest-ServerShowV257Test-28827994-project] 10.222.0.26 "GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639" status: 404 len: 111 microversion: 2.57 time: 0.112719 Sep 01 05:00:44.707760 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1510/3001] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:44 2022] GET /compute/v2.1/servers/3946f8b0-f35a-410c-91e0-306f2e746639 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:00:45.180060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:45.180730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:45.199970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:45.201470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:45.202795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:45.207976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:45.208720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:45.210956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:45.322536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:45.344616 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4d7067e-2a24-47ca-9a49-7c300c7e97ed tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 1.188645 Sep 01 05:00:45.345271 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1492/3002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:44 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:45.609346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:45.619804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:45.620672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:45.634625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:45.637958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:45.638809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:45.639780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:45.640474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:45.644164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:45.648411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:45.650208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a863fc04a5974165881e104ff252a62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b08b6c59934cb3adc869529add8bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:45.652919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f392e84c-ffa0-41a0-8b47-1df410869116 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 200 len: 1605 microversion: 2.32 time: 0.479017 Sep 01 05:00:45.659524 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1511/3003] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:45 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 1605 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:00:46.340448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:46.357810 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4c4fea8-9267-4d92-aba3-4892f065526f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.743718 Sep 01 05:00:46.367732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:46.368598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:46.382484 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1493/3004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:45 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:46.390657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:46.391517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:46.392569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:46.395286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:46.396289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:46.399114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:46.686778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:46.688455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:46.708195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:46.709704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:46.710484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:46.712946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:46.713984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:46.716206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:46.768845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:46.783037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cd55167-d490-46fe-84b6-d58be0ef2e5c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.419436 Sep 01 05:00:46.790287 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1512/3005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:46 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:46.816761 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] HTTP exception thrown: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Request method failure captured: Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 HTTP/1.1 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrQcUTxhkCUYGSwpwYf57_aPvYfhR11FNRn5ushtpoo4I4uo7qGTApxtCrW1tsQPvdvs6juhn7uhOBQvGnnSQeXtEhQw1wUaPLtoxrOHvMnyw-5n61KwWJbLeuzy5ZuDUiUug8QRifckawdr4xdiV1gUqLs3pM2wuMn0D2ayEt1JxQ Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.32 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 10b08b6c59934cb3adc869529add8bc6 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 10b08b6c59934cb3adc869529add8bc6 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest-2144522831-project Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a863fc04a5974165881e104ff252a62d Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest-2144522831-project Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ad778fc7-2f87-42ed-863a-cb8874b8acd1'} Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:46.819251 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:46.824248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Returning 404 to user: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:46.825212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4263af94-077a-4be1-927d-b7ea63099cbe tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 404 len: 111 microversion: 2.32 time: 0.147546 Sep 01 05:00:46.825994 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1494/3006] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:00:46 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:00:46.834842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55fe7c4a-cedc-42c0-94ce-b6db7157e181 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '.version_select at 0x7fa75b3a9670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:46.902995 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55fe7c4a-cedc-42c0-94ce-b6db7157e181 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041043943" status: 204 len: 0 microversion: 2.32 time: 0.072063 Sep 01 05:00:46.903606 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1513/3007] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 05:00:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041043943 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 05:00:47.389712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:47.390861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:47.400113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:47.400611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:47.401079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:47.401885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:47.404470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:47.411375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:47.810333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:47.811971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:47.871073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:47.874027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:47.878984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:47.899875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:47.899875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:47.901422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:48.011783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:48.014645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:48.037435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51a79fe5-5611-4e22-af19-c109861ed3f9 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.651516 Sep 01 05:00:48.043529 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1495/3008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:47 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:48.280828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:48.301066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4984b83-9c7e-43b6-a3e9-b933fe5fbbaa tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1469 microversion: 2.1 time: 0.485585 Sep 01 05:00:48.302268 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1514/3009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:47 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1469 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:49.072100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:49.080691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:49.101901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:49.104411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:49.105637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:49.109977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:49.113001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:49.115322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:49.321568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:49.322345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:49.334090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:49.339382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:49.340975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:49.344980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:49.346847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:49.347698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:49.762026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:49.770576 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.707325 Sep 01 05:00:49.771576 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1496/3010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:49.772613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:49.773506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001067 Sep 01 05:00:49.778725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1497/3011] 10.222.0.26 () {56 vars in 886 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 01 05:00:49.795220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:49.796817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002191 Sep 01 05:00:49.797748 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1498/3012] 10.222.0.26 () {54 vars in 1035 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 01 05:00:49.806171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:49.808181 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002431 Sep 01 05:00:49.808837 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1499/3013] 10.222.0.26 () {54 vars in 1041 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:00:49.817764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:49.819053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c065ed-f4d2-4124-a9bc-52b35e4d068d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001612 Sep 01 05:00:49.819768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1500/3014] 10.222.0.26 () {56 vars in 886 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 01 05:00:49.840455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:49.862175 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-309bb458-ece0-4b93-9460-a026f12de095 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1462 microversion: 2.1 time: 0.543825 Sep 01 05:00:49.871487 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1515/3015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1462 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:50.387624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:50.388651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:50.401731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:50.408498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:50.409072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:50.411904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:50.413696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:50.414596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:50.807172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:50.807934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:50.827241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:50.831921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:50.832697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:50.833692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:50.834389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:50.835096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:51.020102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-608aa597-eb32-4688-8ccd-5b92f2ea4ec7 tempest-MigrationsAdminTest-1106408533 tempest-MigrationsAdminTest-1106408533-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1615 microversion: 2.1 time: 1.137361 Sep 01 05:00:51.025105 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1501/3016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:49 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1615 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:51.054660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:51.055207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:51.068873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:51.069744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:51.071958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:51.074417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:51.075149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:51.075757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:51.152730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:51.332275 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c83246e-d2cf-4bc2-adad-6ba71f444fb9 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 204 len: 0 microversion: 2.1 time: 0.283401 Sep 01 05:00:51.336676 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1502/3017] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:00:51 2022] DELETE /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:00:51.342489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:51.348093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:51.359890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:51.364896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:51.370102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:51.374286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b46d9eef-44ab-44e3-bb8d-bbcd8986461b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.571152 Sep 01 05:00:51.375934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:51.377842 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1516/3018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:50 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:51.387886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:51.388696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:51.389849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:52.400527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:52.401989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:52.410791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:52.417844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:52.418828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:52.419210 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-187b4485-bf64-4ede-9d3e-0093d09e1574 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1468 microversion: 2.1 time: 1.080926 Sep 01 05:00:52.420527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:52.423904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:52.424502 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1503/3019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:51 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1468 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:52.438199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:52.439049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:52.909734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:52.941190 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e33700e6-275a-4967-bbfc-fd161f1fe2bd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.544441 Sep 01 05:00:52.941820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1517/3020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:52 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:00:53.445975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:53.447314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:53.470958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:53.474197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:53.475094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:53.479680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:53.482116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:53.483737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:53.938438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:53.965770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ccbff8e-f281-42b8-8939-371d799cb7de tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 200 len: 1468 microversion: 2.1 time: 0.524810 Sep 01 05:00:53.970185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:53.972160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:53.972305 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1504/3021] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:53 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 1468 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:53.990197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:53.991925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:53.992430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:53.995192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:53.996247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:53.997514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:54.503827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:54.528551 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-128d0e6c-837f-4b8a-8323-978a8a6f8803 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.569183 Sep 01 05:00:54.530230 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1518/3022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:53 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:54.546074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f6a79782-274b-46a7-87bc-38a2191bfa2e req-7896e43e-724a-42d6-842c-301396364125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b544a47a-b8a6-4179-bb85-2758aad1a226", "name": "network-vif-deleted", "tag": "5055dd0a-006b-4eca-9e23-e17e35e9cc9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:54.573157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f6a79782-274b-46a7-87bc-38a2191bfa2e req-7896e43e-724a-42d6-842c-301396364125 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:54.573992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f6a79782-274b-46a7-87bc-38a2191bfa2e req-7896e43e-724a-42d6-842c-301396364125 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:54.574650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f6a79782-274b-46a7-87bc-38a2191bfa2e req-7896e43e-724a-42d6-842c-301396364125 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:54.631634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f6a79782-274b-46a7-87bc-38a2191bfa2e req-7896e43e-724a-42d6-842c-301396364125 service nova] Creating event network-vif-deleted:5055dd0a-006b-4eca-9e23-e17e35e9cc9f for instance b544a47a-b8a6-4179-bb85-2758aad1a226 on n-h1-820368-37 Sep 01 05:00:54.647997 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f6a79782-274b-46a7-87bc-38a2191bfa2e req-7896e43e-724a-42d6-842c-301396364125 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112815 Sep 01 05:00:54.652203 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1519/3023] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:54.839298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4dd08db-2e24-4e5a-b06d-89dad6304a49 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Action: 'create', calling method: .version_select at 0x7fa75b0a6820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-865886289", "metadata": {"Type": "work"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4dd08db-2e24-4e5a-b06d-89dad6304a49 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Request method failure captured: Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 121 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDyGeCPk7qOXsTqiyMDCJuEYdhNahM_PP3gjbIOfoMfiRXzxzhoIVs-VCdAhapGZ_vcgiILXgS-lBDibn-xvF-eltHXKVC8OgW84VJZmciYD8NU4BiByav2ser5GPdbGZCLYaXdTbA86JBYBqTGaa1CCHXpZc2N2pFA0Tf2M-dCvHCY Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ae8b649a494459895136b361b275cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ae8b649a494459895136b361b275cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ec537c185b3542bcb075e3735ff392c8 Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-865886289", "metadata": {"Type": "work"}}} Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-865886289', 'metadata': {'Type': 'work'}}}} Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:00:54.845290 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4dd08db-2e24-4e5a-b06d-89dad6304a49 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4dd08db-2e24-4e5a-b06d-89dad6304a49 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.378453 Sep 01 05:00:54.867243 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1505/3024] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 1 05:00:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:00:54.875596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a17bf1f-3584-4211-bd2c-1c6d46bb8805 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Action: 'create', calling method: .version_select at 0x7fa764153310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-887962519", "metadata": {"Type": "work"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a17bf1f-3584-4211-bd2c-1c6d46bb8805 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Request method failure captured: Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 119 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDyGeCPk7qOXsTqiyMDCJuEYdhNahM_PP3gjbIOfoMfiRXzxzhoIVs-VCdAhapGZ_vcgiILXgS-lBDibn-xvF-eltHXKVC8OgW84VJZmciYD8NU4BiByav2ser5GPdbGZCLYaXdTbA86JBYBqTGaa1CCHXpZc2N2pFA0Tf2M-dCvHCY Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ae8b649a494459895136b361b275cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ae8b649a494459895136b361b275cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ec537c185b3542bcb075e3735ff392c8 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-887962519", "metadata": {"Type": "work"}}} Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-887962519', 'metadata': {'Type': 'work'}}}} Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '0' Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:00:54.887333 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.895835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a17bf1f-3584-4211-bd2c-1c6d46bb8805 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:54.900551 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a17bf1f-3584-4211-bd2c-1c6d46bb8805 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034542 Sep 01 05:00:54.916347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1520/3025] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 1 05:00:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:00:54.926063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb3b546c-5bd4-4994-84e0-f39647ee49dd tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Action: 'create', calling method: .version_select at 0x7fa75b0c7dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-832465763", "metadata": {"Type": "work"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb3b546c-5bd4-4994-84e0-f39647ee49dd tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Request method failure captured: Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 118 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDyGeCPk7qOXsTqiyMDCJuEYdhNahM_PP3gjbIOfoMfiRXzxzhoIVs-VCdAhapGZ_vcgiILXgS-lBDibn-xvF-eltHXKVC8OgW84VJZmciYD8NU4BiByav2ser5GPdbGZCLYaXdTbA86JBYBqTGaa1CCHXpZc2N2pFA0Tf2M-dCvHCY Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ae8b649a494459895136b361b275cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ae8b649a494459895136b361b275cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ec537c185b3542bcb075e3735ff392c8 Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-832465763", "metadata": {"Type": "work"}}} Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-832465763', 'metadata': {'Type': 'work'}}}} Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:00:54.930626 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:54.935656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb3b546c-5bd4-4994-84e0-f39647ee49dd tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:54.936543 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb3b546c-5bd4-4994-84e0-f39647ee49dd tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014097 Sep 01 05:00:54.937336 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1506/3026] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 1 05:00:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:00:54.954741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ce3269f-0f9e-4c04-8abf-3acac77d227d tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Calling method '.version_select at 0x7fa75b3a9f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:54.991602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:54.992213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: b544a47a-b8a6-4179-bb85-2758aad1a226] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:55.023173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.027636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.028308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.029243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.032085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.033080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.054817 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2ce3269f-0f9e-4c04-8abf-3acac77d227d tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] HTTP exception thrown: Volume tempest-invalid-1029407469 could not be found. Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ce3269f-0f9e-4c04-8abf-3acac77d227d tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Request method failure captured: Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1029407469 HTTP/1.1 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDyGeCPk7qOXsTqiyMDCJuEYdhNahM_PP3gjbIOfoMfiRXzxzhoIVs-VCdAhapGZ_vcgiILXgS-lBDibn-xvF-eltHXKVC8OgW84VJZmciYD8NU4BiByav2ser5GPdbGZCLYaXdTbA86JBYBqTGaa1CCHXpZc2N2pFA0Tf2M-dCvHCY Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ae8b649a494459895136b361b275cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ae8b649a494459895136b361b275cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ec537c185b3542bcb075e3735ff392c8 Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: exception: Volume tempest-invalid-1029407469 could not be found. Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'tempest-invalid-1029407469'} Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1029407469 could not be found. (HTTP 404) (Request-ID: req-13f4c412-6cb4-4af1-817a-f87d780bb413) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:00:55.058027 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1029407469 could not be found. Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1029407469 could not be found. Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1029407469 could not be found. Sep 01 05:00:55.063841 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] HTTP exception thrown: Instance b544a47a-b8a6-4179-bb85-2758aad1a226 could not be found. Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Request method failure captured: Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 HTTP/1.1 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDsnTTxZkjahwTq6wTTDKmNQ-aH_0rSlBvHLBCkNRaHDMX9EGwjZ_eQpQ2WL6Xc3ynz1XrY62B1ZgYmSQv193YrW4D71e7GyBHubIwOZjDXIGt5Rfmn_VYqZr0Ak-RDbMFnJ6MHFNF3QalWtyEER6WjCNeAgH4EEqqcpmL9ZT7KTTL4 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7df1df24b4a84c2a9008685936212a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-158275404 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-158275404-project Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 30b46ee5087145e6828acac49bee0b9b Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-158275404-project Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b544a47a-b8a6-4179-bb85-2758aad1a226 could not be found. Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b544a47a-b8a6-4179-bb85-2758aad1a226'} Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b544a47a-b8a6-4179-bb85-2758aad1a226 could not be found. Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:00:55.069400 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b544a47a-b8a6-4179-bb85-2758aad1a226 could not be found. Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b544a47a-b8a6-4179-bb85-2758aad1a226 could not be found. Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.076733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Returning 404 to user: Instance b544a47a-b8a6-4179-bb85-2758aad1a226 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:55.079376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ce3269f-0f9e-4c04-8abf-3acac77d227d tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Returning 404 to user: Volume tempest-invalid-1029407469 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:55.079527 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53c8567d-4e57-48fa-a1dc-d83ce7e4831a tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226" status: 404 len: 111 microversion: 2.1 time: 0.083123 Sep 01 05:00:55.079625 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ce3269f-0f9e-4c04-8abf-3acac77d227d tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1029407469" status: 404 len: 99 microversion: 2.1 time: 0.124825 Sep 01 05:00:55.079625 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1521/3027] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:00:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1029407469 => generated 99 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:00:55.079782 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1507/3028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:54 2022] GET /compute/v2.1/servers/b544a47a-b8a6-4179-bb85-2758aad1a226 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:55.085253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:55.086163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:55.086331 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69b41ffa-642b-4e49-8208-2f58e3fa66af tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003766 Sep 01 05:00:55.096785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1508/3029] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 1 05:00:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:00:55.097145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.097954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.099597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.100947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.101570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.102216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.121723 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa640426-43ca-45a1-a3a2-0182bb9b4be6 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.023693 Sep 01 05:00:55.122341 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1509/3030] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 05:00:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:00:55.136654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eecf5748-1b67-46ba-9fc5-0ed01a665751 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Calling method '.version_select at 0x7fa75b0c70d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:55.143865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:00:55.176313 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-eecf5748-1b67-46ba-9fc5-0ed01a665751 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] HTTP exception thrown: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eecf5748-1b67-46ba-9fc5-0ed01a665751 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Request method failure captured: Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-volumes/29d73074-bf91-435c-bf7d-d1112e3b889b HTTP/1.1 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDyGeCPk7qOXsTqiyMDCJuEYdhNahM_PP3gjbIOfoMfiRXzxzhoIVs-VCdAhapGZ_vcgiILXgS-lBDibn-xvF-eltHXKVC8OgW84VJZmciYD8NU4BiByav2ser5GPdbGZCLYaXdTbA86JBYBqTGaa1CCHXpZc2N2pFA0Tf2M-dCvHCY Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ae8b649a494459895136b361b275cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ae8b649a494459895136b361b275cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ec537c185b3542bcb075e3735ff392c8 Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: exception: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '29d73074-bf91-435c-bf7d-d1112e3b889b'} Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. (HTTP 404) (Request-ID: req-18ab61ad-b623-4ad6-a8e5-cd94bb2b8ae3) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:00:55.178316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eecf5748-1b67-46ba-9fc5-0ed01a665751 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Returning 404 to user: Volume 29d73074-bf91-435c-bf7d-d1112e3b889b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eecf5748-1b67-46ba-9fc5-0ed01a665751 tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/29d73074-bf91-435c-bf7d-d1112e3b889b" status: 404 len: 109 microversion: 2.1 time: 0.047637 Sep 01 05:00:55.183291 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1510/3031] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:00:55 2022] DELETE /compute/v2.1/os-volumes/29d73074-bf91-435c-bf7d-d1112e3b889b => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:55.190527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7726d23-2365-48f1-9030-d81ecac4f82f tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Calling method '.version_select at 0x7fa75b084160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:55.225355 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c7726d23-2365-48f1-9030-d81ecac4f82f tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] HTTP exception thrown: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7726d23-2365-48f1-9030-d81ecac4f82f tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Request method failure captured: Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-volumes/30f1e39f-ab95-43a2-890a-74c5e9705021 HTTP/1.1 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDyGeCPk7qOXsTqiyMDCJuEYdhNahM_PP3gjbIOfoMfiRXzxzhoIVs-VCdAhapGZ_vcgiILXgS-lBDibn-xvF-eltHXKVC8OgW84VJZmciYD8NU4BiByav2ser5GPdbGZCLYaXdTbA86JBYBqTGaa1CCHXpZc2N2pFA0Tf2M-dCvHCY Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ae8b649a494459895136b361b275cdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ae8b649a494459895136b361b275cdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ae8b649a494459895136b361b275cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9ae8b649a494459895136b361b275cdd Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesNegativeTest-690433864 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ec537c185b3542bcb075e3735ff392c8 Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesNegativeTest-690433864-project Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: exception: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '30f1e39f-ab95-43a2-890a-74c5e9705021'} Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. (HTTP 404) (Request-ID: req-0b962d27-73e7-4558-a7bd-5a35c277057b) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:00:55.227403 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7726d23-2365-48f1-9030-d81ecac4f82f tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] Returning 404 to user: Volume 30f1e39f-ab95-43a2-890a-74c5e9705021 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:00:55.232462 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7726d23-2365-48f1-9030-d81ecac4f82f tempest-VolumesNegativeTest-690433864 tempest-VolumesNegativeTest-690433864-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/30f1e39f-ab95-43a2-890a-74c5e9705021" status: 404 len: 109 microversion: 2.1 time: 0.043388 Sep 01 05:00:55.236731 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1511/3032] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:00:55 2022] GET /compute/v2.1/os-volumes/30f1e39f-ab95-43a2-890a-74c5e9705021 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:00:55.370837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ca78b9b-cee4-44fe-b293-096bcbb0774b tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 204 len: 0 microversion: 2.1 time: 0.288600 Sep 01 05:00:55.371766 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1522/3033] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:00:55 2022] DELETE /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:00:55.380445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:55.381337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:55.396323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.397086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.398115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.399058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.399698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.400283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.554353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:55.557682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:55.591132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.591914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.592492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.593490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:55.595171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:55.598397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:55.916195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:55.935993 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2adde06-4293-4315-8d01-b7c456c6943d tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1535 microversion: 2.1 time: 0.559705 Sep 01 05:00:55.937376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1512/3034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:55 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1535 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:56.150724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:56.185675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4257ffc3-bea3-4b80-a73f-f09e1730bf3e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 0.638139 Sep 01 05:00:56.198403 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1523/3035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:55 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:56.421488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35d42cd4-243b-45a5-a29a-f2215f4b4bfd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: .version_select at 0x7fa75b0c7f70>, body: {"keypair": {"name": "tempest-keypair-1325995022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFj4jc+spH01l37N9v/IOAkJbam2N7HfiHu4AEg8YZFJ3TYj/63Os+YIADxcLkck6b9pBZmeMCpunQliO/cMLpTlKONMjGhvqhKAXJ5plMC9U/oHfUJnNQlwqPnCWyYUA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:00:56.491728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-35d42cd4-243b-45a5-a29a-f2215f4b4bfd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:00:56.510008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-35d42cd4-243b-45a5-a29a-f2215f4b4bfd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:00:56.580835 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35d42cd4-243b-45a5-a29a-f2215f4b4bfd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164694 Sep 01 05:00:56.581735 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1513/3036] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:00:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:00:56.966406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:56.967714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:56.985984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:56.987437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:56.988604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:56.990215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:56.991035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:56.991660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:57.234499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:57.235919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:57.245250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:57.246077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:57.247309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:57.248288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:57.248900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:57.249555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:58.293579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:58.305815 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-891cd448-3999-4669-9562-8ec38847d0ac tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1535 microversion: 2.1 time: 1.351314 Sep 01 05:00:58.314479 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1524/3037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:56 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1535 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:58.541259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:58.554484 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55c2f1c7-3c40-4d5e-b23f-9fa09ec1c892 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 1.337824 Sep 01 05:00:58.557742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1514/3038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:57 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:00:59.336057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:59.337372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:59.344404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:59.354706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:59.355232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:59.355672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:59.360576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:59.361068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:59.361503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:59.578579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:00:59.579744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:00:59.598971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:59.599476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:59.604780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:59.605929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:00:59.606412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:00:59.606844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:00:59.733011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:00:59.742143 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecf5b82c-2786-40f3-920c-233d70a2d3f5 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 200 len: 1493 microversion: 2.1 time: 0.412243 Sep 01 05:00:59.742743 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1525/3039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:59 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 1493 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:00.010102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2136285945", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9642a39a-f472-4737-aec3-d2f3e852c183"}], "security_groups": [{"name": "tempest-securitygroup--438108113"}], "key_name": "tempest-keypair-1325995022", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:00.503954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] validate_networks() for [('9642a39a-f472-4737-aec3-d2f3e852c183', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:01:00.726729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:00.736366 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba4579b9-ddc6-496f-aeed-144147454450 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1508 microversion: 2.1 time: 1.162729 Sep 01 05:01:00.755833 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1515/3040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:00:59 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1508 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:00.761047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e8c6461f-4b15-4ad3-a032-f438a46b1d3c req-f30c578a-16be-4736-b8df-4c57bc3e37c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc86f8d-1377-4f82-9212-3a5a7a25576b", "name": "network-vif-deleted", "tag": "948a026c-1478-4126-bfa5-d7bdf85cb7e1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:00.796565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e8c6461f-4b15-4ad3-a032-f438a46b1d3c req-f30c578a-16be-4736-b8df-4c57bc3e37c7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:00.797416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e8c6461f-4b15-4ad3-a032-f438a46b1d3c req-f30c578a-16be-4736-b8df-4c57bc3e37c7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:00.798339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e8c6461f-4b15-4ad3-a032-f438a46b1d3c req-f30c578a-16be-4736-b8df-4c57bc3e37c7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:00.833265 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e8c6461f-4b15-4ad3-a032-f438a46b1d3c req-f30c578a-16be-4736-b8df-4c57bc3e37c7 service nova] Creating event network-vif-deleted:948a026c-1478-4126-bfa5-d7bdf85cb7e1 for instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b on n-h1-820368-37 Sep 01 05:01:00.841242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e8c6461f-4b15-4ad3-a032-f438a46b1d3c req-f30c578a-16be-4736-b8df-4c57bc3e37c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083769 Sep 01 05:01:00.842181 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1516/3041] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:00.872068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:00.876588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:00.895942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:00.900549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:00.901630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:00.905230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:00.907598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:00.909453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:00.951322 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] HTTP exception thrown: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Request method failure captured: Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 HTTP/1.1 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrQcUTxhkCUYGSwpwYf57_aPvYfhR11FNRn5ushtpoo4I4uo7qGTApxtCrW1tsQPvdvs6juhn7uhOBQvGnnSQeXtEhQw1wUaPLtoxrOHvMnyw-5n61KwWJbLeuzy5ZuDUiUug8QRifckawdr4xdiV1gUqLs3pM2wuMn0D2ayEt1JxQ Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.32 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 10b08b6c59934cb3adc869529add8bc6 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 10b08b6c59934cb3adc869529add8bc6 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest-2144522831-project Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a863fc04a5974165881e104ff252a62d Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest-2144522831-project Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ad778fc7-2f87-42ed-863a-cb8874b8acd1'} Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:01:00.966023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:00.971303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:00.973780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Returning 404 to user: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:00.976207 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6749f3d5-867b-470e-a985-8fea774b89f0 tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 404 len: 111 microversion: 2.32 time: 0.116085 Sep 01 05:01:00.977840 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1517/3042] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:01:00 2022] DELETE /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:01:01.024258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:01.029342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 7cc86f8d-1377-4f82-9212-3a5a7a25576b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:01.050126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:01.052796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:01.053821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:01.057270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:01.059970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:01.060733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:01.061313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:01.105116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] HTTP exception thrown: Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b could not be found. Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Request method failure captured: Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b HTTP/1.1 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDsnTTxZkjahwTq6wTTDKmNQ-aH_0rSlBvHLBCkNRaHDMX9EGwjZ_eQpQ2WL6Xc3ynz1XrY62B1ZgYmSQv193YrW4D71e7GyBHubIwOZjDXIGt5Rfmn_VYqZr0Ak-RDbMFnJ6MHFNF3QalWtyEER6WjCNeAgH4EEqqcpmL9ZT7KTTL4 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7df1df24b4a84c2a9008685936212a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-158275404-project Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 30b46ee5087145e6828acac49bee0b9b Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-158275404-project Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b could not be found. Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7cc86f8d-1377-4f82-9212-3a5a7a25576b'} Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b could not be found. Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b could not be found. Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:01.109505 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b could not be found. Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Returning 404 to user: Instance 7cc86f8d-1377-4f82-9212-3a5a7a25576b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72b601dc-6f08-4b64-9eec-80138ed51700 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b" status: 404 len: 111 microversion: 2.1 time: 0.131379 Sep 01 05:01:01.119429 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1518/3043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:00 2022] GET /compute/v2.1/servers/7cc86f8d-1377-4f82-9212-3a5a7a25576b => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:01:01.127628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:01.135868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] [instance: ad778fc7-2f87-42ed-863a-cb8874b8acd1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:01.149804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:01.150303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:01.151025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:01.151916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:01.157749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:01.158473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:01.200216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] HTTP exception thrown: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Request method failure captured: Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 HTTP/1.1 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDrQcUTxhkCUYGSwpwYf57_aPvYfhR11FNRn5ushtpoo4I4uo7qGTApxtCrW1tsQPvdvs6juhn7uhOBQvGnnSQeXtEhQw1wUaPLtoxrOHvMnyw-5n61KwWJbLeuzy5ZuDUiUug8QRifckawdr4xdiV1gUqLs3pM2wuMn0D2ayEt1JxQ Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.32 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 10b08b6c59934cb3adc869529add8bc6 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/10b08b6c59934cb3adc869529add8bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 10b08b6c59934cb3adc869529add8bc6 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2144522831 Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest-2144522831-project Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a863fc04a5974165881e104ff252a62d Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest-2144522831-project Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ad778fc7-2f87-42ed-863a-cb8874b8acd1'} Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.201794 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:01.206562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] Returning 404 to user: Instance ad778fc7-2f87-42ed-863a-cb8874b8acd1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:01.208302 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-405739e7-0ab8-4e1b-8ddb-69cfe6a42fda tempest-TaggedBootDevicesTest-2144522831 tempest-TaggedBootDevicesTest-2144522831-project] 10.222.0.26 "GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1" status: 404 len: 111 microversion: 2.32 time: 0.091449 Sep 01 05:01:01.208898 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1519/3044] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:01 2022] GET /compute/v2.1/servers/ad778fc7-2f87-42ed-863a-cb8874b8acd1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:01:01.247836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ea6544a-4b0c-4509-b891-817fb8d53994 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '.version_select at 0x7fa75b084ca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:01.302941 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ea6544a-4b0c-4509-b891-817fb8d53994 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963110847" status: 202 len: 0 microversion: 2.1 time: 0.092867 Sep 01 05:01:01.310262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1520/3045] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963110847 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:01:01.762793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:01.766117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:01.789785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:01.793074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:01.794839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:01.798033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:01.802488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:01.803360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:02.708863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:01:02.709991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:01:02.710686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:01:02.711327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:01:02.711946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:01:02.734502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:02.741270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:02.741270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:02.741270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:02.741270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:02.748841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:02.795401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:01:02.802544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:01:02.819421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:01:02.822334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:01:02.890938 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8845421-972b-4c11-9e6d-5ae822a67207 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.886366 Sep 01 05:01:02.892800 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1526/3046] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:01:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:01:02.906271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea50ff9d-787c-4c06-be00-488096ca6972 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:02.907643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea50ff9d-787c-4c06-be00-488096ca6972 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:03.167640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:03.180339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea50ff9d-787c-4c06-be00-488096ca6972 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:03.184211 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7cdddd8-ea09-4305-8943-65cd9b3513d0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1529 microversion: 2.1 time: 1.425158 Sep 01 05:01:03.184820 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1521/3047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:01 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1529 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:03.192913 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea50ff9d-787c-4c06-be00-488096ca6972 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1242 microversion: 2.1 time: 0.288718 Sep 01 05:01:03.195705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1527/3048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:02 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1242 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:04.211870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:04.213222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:04.215386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:04.216015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:04.227798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:04.228638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:04.228790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:04.229346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:04.229795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:04.230562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:04.231062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:04.231368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:04.232367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:04.232854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:04.233286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:04.241027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:04.429753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:04.461997 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb804f77-b1b7-42e2-b5da-24dbf9bcd3c0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1238 microversion: 2.1 time: 0.251754 Sep 01 05:01:04.474755 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1528/3049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:04 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1238 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:04.958723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:04.967719 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e1f8fb4-0598-4ab0-89e8-3e51abcbaa2e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1529 microversion: 2.1 time: 0.765868 Sep 01 05:01:04.968597 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1522/3050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:04 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1529 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:05.190187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:05.191569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:05.208123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.208925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.209749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.210636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.211320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.211909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.280004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:01:05.354007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:05.484928 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6beeb6ae-bd6c-429d-9338-c66ceaaba847 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 204 len: 0 microversion: 2.1 time: 0.297494 Sep 01 05:01:05.486531 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1529/3051] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:01:05 2022] DELETE /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:01:05.499803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:05.502177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:05.519548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:05.520230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.521251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.521778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:05.522786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.523903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.525218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.526094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.537333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.537829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.538265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.539012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.539465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.543525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.707171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:05.727812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79288da0-e2b3-43ce-a2b8-0c91ab4a027c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1300 microversion: 2.1 time: 0.223584 Sep 01 05:01:05.730626 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1530/3052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:05 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:05.875073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c81e95fa-b012-4d3b-bfb1-1e92fb429c35 req-ca750b20-b82d-4251-ac8f-1ec311ea898c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bce25e-f4e3-4ca2-82db-63be8850fdf9", "name": "network-vif-plugged", "status": "completed", "tag": "dbd40e34-4566-4bd8-9313-303b52ef5b9a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:05.900801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c81e95fa-b012-4d3b-bfb1-1e92fb429c35 req-ca750b20-b82d-4251-ac8f-1ec311ea898c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:05.901493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c81e95fa-b012-4d3b-bfb1-1e92fb429c35 req-ca750b20-b82d-4251-ac8f-1ec311ea898c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:05.901931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c81e95fa-b012-4d3b-bfb1-1e92fb429c35 req-ca750b20-b82d-4251-ac8f-1ec311ea898c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:05.931541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c81e95fa-b012-4d3b-bfb1-1e92fb429c35 req-ca750b20-b82d-4251-ac8f-1ec311ea898c service nova] Creating event network-vif-plugged:dbd40e34-4566-4bd8-9313-303b52ef5b9a for instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 on n-h2-820368-37 Sep 01 05:01:05.944596 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c81e95fa-b012-4d3b-bfb1-1e92fb429c35 req-ca750b20-b82d-4251-ac8f-1ec311ea898c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075090 Sep 01 05:01:05.950114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1531/3053] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:06.005841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:06.006713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:06.024400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:06.025118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:06.025330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:06.043474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:06.043978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:06.044457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:06.337547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:06.367855 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fdf753d-e574-481e-9180-0f17a90f276c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1468 microversion: 2.1 time: 0.876732 Sep 01 05:01:06.368459 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1523/3054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:05 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1468 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:06.507089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:06.516217 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c43b5e17-2444-42de-abcd-86be1aa0736c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1529 microversion: 2.1 time: 0.529653 Sep 01 05:01:06.525974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1532/3055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:05 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1529 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:06.751312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:06.751930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:06.763437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:06.765297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:06.766420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:06.769305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:06.770291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:06.770782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:06.771214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:06.995659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:07.008936 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27bbb993-24b4-4d66-8206-781adced7648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1300 microversion: 2.1 time: 0.261546 Sep 01 05:01:07.010757 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1524/3056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:06 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1300 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:07.393833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:07.394703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:07.412858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:07.413477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:07.419756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:07.420896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:07.421643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:07.422560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:07.551294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:07.552080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:07.562879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:07.567068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:07.567663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:07.569955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:07.572637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:07.573185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:09.224493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:09.240213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ad29f2d-0fbf-4e25-8129-3b4cc00ceae7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.689012 Sep 01 05:01:09.241564 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1525/3057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:07 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:09.252747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:09.256275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:09.272281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:09.274441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:09.275176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:09.278962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:09.279664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:09.280571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:09.346378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:09.542692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:09.575910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6071b48-cc04-4740-82e2-017c0bd7e5a4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1468 microversion: 2.1 time: 2.186200 Sep 01 05:01:09.581031 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1533/3058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:07 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1468 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:09.737803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:09.749704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1635b16d-b39b-4be6-9216-401d92e00c64 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1300 microversion: 2.1 time: 0.506729 Sep 01 05:01:09.754045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1526/3059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:09 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1300 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:10.262981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:10.264045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:10.278029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:10.278530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:10.289339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:10.293394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:10.300031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:10.300795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:10.599364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:10.602922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:10.628203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:10.629100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:10.629652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:10.631356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:10.632391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:10.634621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:11.172856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:11.207205 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5168cc1-64a2-4485-b3d7-a6f8b849973c tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 200 len: 1426 microversion: 2.1 time: 0.612727 Sep 01 05:01:11.220093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1527/3060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:10 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 1426 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:11.255185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:11.255185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:11.290772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:11.305116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:11.309155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:11.318348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:11.319185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:11.325071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:11.597979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:11.625057 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1802f62b-cfa8-412a-b1d6-f8807529eae3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1300 microversion: 2.1 time: 0.403321 Sep 01 05:01:11.629675 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1528/3061] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:11 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1300 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:11.646580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f2308f40-eeb9-4483-bc35-abeb3bef6896 req-d31f0970-432d-4db9-8034-2aaac8225e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d490dd8-5b01-4820-9370-37d90a24a24c", "name": "network-vif-deleted", "tag": "283c5331-2b11-4256-8c18-a3648fa570e4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:11.689216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2308f40-eeb9-4483-bc35-abeb3bef6896 req-d31f0970-432d-4db9-8034-2aaac8225e14 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:11.697785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2308f40-eeb9-4483-bc35-abeb3bef6896 req-d31f0970-432d-4db9-8034-2aaac8225e14 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:11.698517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2308f40-eeb9-4483-bc35-abeb3bef6896 req-d31f0970-432d-4db9-8034-2aaac8225e14 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:11.744790 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f2308f40-eeb9-4483-bc35-abeb3bef6896 req-d31f0970-432d-4db9-8034-2aaac8225e14 service nova] Creating event network-vif-deleted:283c5331-2b11-4256-8c18-a3648fa570e4 for instance 0d490dd8-5b01-4820-9370-37d90a24a24c on n-h1-820368-37 Sep 01 05:01:11.756762 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f2308f40-eeb9-4483-bc35-abeb3bef6896 req-d31f0970-432d-4db9-8034-2aaac8225e14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119743 Sep 01 05:01:11.757436 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1529/3062] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:11.765153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:11.803946 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86b9a7cf-f9de-46f2-b2f7-2ea868949ba2 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.530871 Sep 01 05:01:11.807033 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1534/3063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:10 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:12.245534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:12.246699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 0d490dd8-5b01-4820-9370-37d90a24a24c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:12.261771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.284713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.285489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.288727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.292085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.294844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.361846 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] HTTP exception thrown: Instance 0d490dd8-5b01-4820-9370-37d90a24a24c could not be found. Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Request method failure captured: Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c HTTP/1.1 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDsnTTxZkjahwTq6wTTDKmNQ-aH_0rSlBvHLBCkNRaHDMX9EGwjZ_eQpQ2WL6Xc3ynz1XrY62B1ZgYmSQv193YrW4D71e7GyBHubIwOZjDXIGt5Rfmn_VYqZr0Ak-RDbMFnJ6MHFNF3QalWtyEER6WjCNeAgH4EEqqcpmL9ZT7KTTL4 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7df1df24b4a84c2a9008685936212a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-158275404-project Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 30b46ee5087145e6828acac49bee0b9b Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-158275404-project Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 0d490dd8-5b01-4820-9370-37d90a24a24c could not be found. Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '0d490dd8-5b01-4820-9370-37d90a24a24c'} Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d490dd8-5b01-4820-9370-37d90a24a24c could not be found. Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d490dd8-5b01-4820-9370-37d90a24a24c could not be found. Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:12.364233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d490dd8-5b01-4820-9370-37d90a24a24c could not be found. Sep 01 05:01:12.369336 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:12.371587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Returning 404 to user: Instance 0d490dd8-5b01-4820-9370-37d90a24a24c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:12.382316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b9592ba-eade-4794-9e15-1925a85221e4 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c" status: 404 len: 111 microversion: 2.1 time: 0.134258 Sep 01 05:01:12.383956 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1530/3064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:12 2022] GET /compute/v2.1/servers/0d490dd8-5b01-4820-9370-37d90a24a24c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:01:12.392615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:12.393977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:12.410481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.411564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.413003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.416856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.417740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.418750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.502640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:01:12.654035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:12.656694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:12.695995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.700729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.701341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.703268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.704462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.707987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.747439 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b10b2110-f718-4227-a6c6-e2e96d686d88 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 204 len: 0 microversion: 2.1 time: 0.359170 Sep 01 05:01:12.748362 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1535/3065] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:01:12 2022] DELETE /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:01:12.764373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:12.765626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:12.779601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:12.801814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.820612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.821885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:12.827656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:12.828862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:12.829446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:13.190609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:13.886075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:13.900724 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cb02fb9-9758-469b-a0f9-93298d057acc tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1468 microversion: 2.1 time: 1.145607 Sep 01 05:01:13.903275 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1536/3066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:12 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1468 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:13.932454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:13.933094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:13.967243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:13.973836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:13.975818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:13.986760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:14.018645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:14.021610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:14.202272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:14.223482 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27a2d25d-e279-4279-b69e-3a1356224758 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.576048 Sep 01 05:01:14.227746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1531/3067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:12 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:14.927486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:14.928500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:14.955098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:14.957595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:14.959437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:14.962448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:14.963266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:14.966833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:15.939461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:15.948669 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-513c9ee9-a963-4a57-97ca-6f7fb1d78564 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 2.044232 Sep 01 05:01:15.959953 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1537/3068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:13 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:15.986456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:15.988065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:16.029484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:16.029995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:16.031189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:16.041859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:16.042561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:16.044010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:17.307068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:17.316613 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-259b1fed-1a85-4296-a050-14eef1a05c92 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.355425 Sep 01 05:01:17.330876 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1538/3069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:15 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:17.353136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:17.354005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:17.373038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:17.373774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:17.374699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:17.377122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:17.385229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:17.386315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:17.483591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:17.504258 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63a82a59-c7cb-47cf-9224-987f3286c6bb tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1468 microversion: 2.1 time: 2.582046 Sep 01 05:01:17.519595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1532/3070] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:14 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1468 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:17.535927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7017cc38-1586-416b-8d56-bccfa7de072b req-0ae334d4-cc03-435b-8433-bec0cca4fc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3095e123-35d4-450a-adc3-48b604173b6b", "name": "network-vif-deleted", "tag": "f036356c-d9db-46a2-b7a9-6ee990be7c92"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:17.585642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7017cc38-1586-416b-8d56-bccfa7de072b req-0ae334d4-cc03-435b-8433-bec0cca4fc46 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:17.587111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7017cc38-1586-416b-8d56-bccfa7de072b req-0ae334d4-cc03-435b-8433-bec0cca4fc46 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:17.591983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7017cc38-1586-416b-8d56-bccfa7de072b req-0ae334d4-cc03-435b-8433-bec0cca4fc46 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:17.632588 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7017cc38-1586-416b-8d56-bccfa7de072b req-0ae334d4-cc03-435b-8433-bec0cca4fc46 service nova] Creating event network-vif-deleted:f036356c-d9db-46a2-b7a9-6ee990be7c92 for instance 3095e123-35d4-450a-adc3-48b604173b6b on n-h2-820368-37 Sep 01 05:01:17.738223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7017cc38-1586-416b-8d56-bccfa7de072b req-0ae334d4-cc03-435b-8433-bec0cca4fc46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223426 Sep 01 05:01:17.740674 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1533/3071] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:18.311040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:18.333367 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe64ee26-d78d-43dc-83ed-3fb0293dcdda tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.001200 Sep 01 05:01:18.338998 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1539/3072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:17 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:18.348167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:18.349119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:18.358012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:18.359192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:18.359932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:18.360881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:18.361852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:18.362460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:18.533464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:18.534486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:18.553525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:18.560364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:18.562740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:18.565243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:18.568195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:18.569592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:18.737206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:18.740989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:18.765959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:18.768002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lazy-loading 'fault' on Instance uuid 3095e123-35d4-450a-adc3-48b604173b6b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:01:19.302585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b46ee5087145e6828acac49bee0b9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df1df24b4a84c2a9008685936212a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:19.311742 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcf8d120-2428-4856-9281-56bc74f4dee0 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 200 len: 1302 microversion: 2.1 time: 0.782982 Sep 01 05:01:19.321688 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1540/3073] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:18 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 1302 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:19.358092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:19.358909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:19.371757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:19.376053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:19.379276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:19.380352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:19.383540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:19.399212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:19.461141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:19.486718 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b63c6acf-41e7-4aba-94ff-7d47f26b5738 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.137293 Sep 01 05:01:19.501863 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1534/3074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:18 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:20.342000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:20.343393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] [instance: 3095e123-35d4-450a-adc3-48b604173b6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:20.400754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:20.401307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:20.412369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:20.422793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:20.428530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:20.433029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:20.494543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:20.505819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d70bdea-a24e-4d4d-bb24-044e0a140684 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.152679 Sep 01 05:01:20.510488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1541/3075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:19 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:20.528075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c0e1204d-892c-4677-80ba-6c3d6cd3b226 req-11d8abb6-f1ac-4936-87dd-38f6805297eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d57bc8-cbe9-4354-96a3-83553379e4b4", "tag": "a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:20.549149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c0e1204d-892c-4677-80ba-6c3d6cd3b226 req-11d8abb6-f1ac-4936-87dd-38f6805297eb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:20.551840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c0e1204d-892c-4677-80ba-6c3d6cd3b226 req-11d8abb6-f1ac-4936-87dd-38f6805297eb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:20.554312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c0e1204d-892c-4677-80ba-6c3d6cd3b226 req-11d8abb6-f1ac-4936-87dd-38f6805297eb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:20.556219 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] HTTP exception thrown: Instance 3095e123-35d4-450a-adc3-48b604173b6b could not be found. Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Request method failure captured: Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b HTTP/1.1 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDsnTTxZkjahwTq6wTTDKmNQ-aH_0rSlBvHLBCkNRaHDMX9EGwjZ_eQpQ2WL6Xc3ynz1XrY62B1ZgYmSQv193YrW4D71e7GyBHubIwOZjDXIGt5Rfmn_VYqZr0Ak-RDbMFnJ6MHFNF3QalWtyEER6WjCNeAgH4EEqqcpmL9ZT7KTTL4 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7df1df24b4a84c2a9008685936212a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7df1df24b4a84c2a9008685936212a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 7df1df24b4a84c2a9008685936212a05 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MigrationsAdminTest-158275404 Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MigrationsAdminTest-158275404-project Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 30b46ee5087145e6828acac49bee0b9b Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MigrationsAdminTest-158275404-project Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 3095e123-35d4-450a-adc3-48b604173b6b could not be found. Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3095e123-35d4-450a-adc3-48b604173b6b'} Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3095e123-35d4-450a-adc3-48b604173b6b could not be found. Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3095e123-35d4-450a-adc3-48b604173b6b could not be found. Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:20.571755 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3095e123-35d4-450a-adc3-48b604173b6b could not be found. Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] Returning 404 to user: Instance 3095e123-35d4-450a-adc3-48b604173b6b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:20.576193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73a1ea54-3576-4f0c-806a-cd9ba3e4c442 tempest-MigrationsAdminTest-158275404 tempest-MigrationsAdminTest-158275404-project] 10.222.0.26 "GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b" status: 404 len: 111 microversion: 2.1 time: 0.237971 Sep 01 05:01:20.587514 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1535/3076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:20 2022] GET /compute/v2.1/servers/3095e123-35d4-450a-adc3-48b604173b6b => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:01:20.614558 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c0e1204d-892c-4677-80ba-6c3d6cd3b226 req-11d8abb6-f1ac-4936-87dd-38f6805297eb service nova] Creating event network-changed:a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce for instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 on n-h1-820368-37 Sep 01 05:01:20.625111 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c0e1204d-892c-4677-80ba-6c3d6cd3b226 req-11d8abb6-f1ac-4936-87dd-38f6805297eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111255 Sep 01 05:01:20.629241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:20.632149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1542/3077] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:20.634586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:20.656693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:20.659706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:20.661302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:20.662171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:20.664477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:20.668714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:21.537542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:21.539287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:21.571712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:21.574979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:21.579779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:21.582203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:21.587374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:21.590834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:22.197408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:22.211689 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ea190fd-c24c-4604-8151-40328ee664b0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.619966 Sep 01 05:01:22.219390 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1536/3078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:20 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:22.597671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:22.621518 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-964ff19d-e3a0-424b-8f1d-83ddb661e303 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.089704 Sep 01 05:01:22.622154 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1543/3079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:21 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:23.233064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:23.234647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:23.283903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:23.286713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:23.290936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:23.295523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:23.297164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:23.299323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:23.643267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:23.646796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:23.665097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:23.665945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:23.667257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:23.673879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:23.676069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:23.676712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:23.837020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:24.648962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:24.685292 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd39335a-81f3-497d-9aec-92ee1ec8e4ba tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.447023 Sep 01 05:01:24.699902 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1537/3080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:23 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:25.456143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:25.480574 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80608049-e854-4395-8a63-7fde0205576a tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.840900 Sep 01 05:01:25.481249 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1544/3081] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:23 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:25.707732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:25.708411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:25.725061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:25.725572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:25.726016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:25.726742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:25.727244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:25.737653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:26.514779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:26.516795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:26.537934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:26.538440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:26.540708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:26.542833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:26.543679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:26.547387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:27.715395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:27.725525 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2a32211-8a06-4ec4-bb31-090c61ca4847 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 2.022969 Sep 01 05:01:27.742779 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1538/3082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:25 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:27.970856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:27.986458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d06c356-b8a1-4483-9c2b-c394632399dd tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.487005 Sep 01 05:01:28.010669 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1545/3083] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:26 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:28.773558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:28.774555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:28.833596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:28.843332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:28.847015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:28.856077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:28.856668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:28.857115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:29.016575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:29.018146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:29.031867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:29.034311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:29.037786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:29.038928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:29.040853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:29.041591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:29.771968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:29.797476 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a67d560-4488-475a-892f-0149aa74f20b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.032945 Sep 01 05:01:29.812707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:29.825461 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1539/3084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:28 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:29.832602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77600b53-d410-4289-b157-32958562af47 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 0.820409 Sep 01 05:01:29.854563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1546/3085] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:29 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:30.836462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:30.837870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:30.850491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:30.880254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:30.883745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:30.884539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:30.897794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:30.898736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:30.899471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:31.428661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-904217261", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:31.457613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:31.603839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:01:31.604528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:01:31.611198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:01:31.611757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:01:31.612234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:01:31.637151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:31.640231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:31.644103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:31.645684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:31.649277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:31.650416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:31.771704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Getting quotas for project 7fb1c35dc691425cb6112b162132bddf. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:01:31.802064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Getting quotas for user b926c8e9b57e4025a64203fc624cffc1 and project 7fb1c35dc691425cb6112b162132bddf. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:01:31.872411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:01:31.883385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:01:32.165932 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-557968c1-0d2d-4f33-8b2a-2dbd15d95b90 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.712535 Sep 01 05:01:32.189706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1540/3086] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:01:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 05:01:32.209271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:32.237167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:32.244798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:32.248818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:32.253549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:32.257432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:32.263003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:32.265908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:33.451528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:33.466363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-378cd3b3-c62f-454d-9fe3-6b9174d78410 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 2.637414 Sep 01 05:01:33.488545 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1547/3087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:30 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:33.506218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:33.535033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:33.566677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:33.567737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:33.579833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:33.587684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:33.588359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:33.588942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:33.757867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:33.779508 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dda2a5ea-2b3e-415b-aa6d-b9413471ba80 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.575154 Sep 01 05:01:33.780287 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1541/3088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:32 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:34.113957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d763d74-49c0-4e8d-9366-a904146ce4d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Action: 'create', calling method: .version_select at 0x7fa75b0a6550>, body: {"keypair": {"name": "tempest-keypair-918565657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUhUEt2q0rybJHDT5lvuk854BqUgiX8Fj7VuqNvKjzOTCDAzTDLALxH/nzHS1MmIrOsLgX00dMHnxww0D8GPe1lGzLAvwFK/9Z7VXPT2+Mkz+vGUCAxqw1CCUvm8tbmiw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:34.159105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:34.189089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:34.191053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:34.191202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6d763d74-49c0-4e8d-9366-a904146ce4d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Getting quotas for project dc1a1ce370a1484f8d08ba54910e4d53. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:01:34.214863 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11016009-0757-4f5c-8cd0-16306c5f46a2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "PUT /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1362 microversion: 2.75 time: 0.724897 Sep 01 05:01:34.215441 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1548/3089] 10.222.0.26 () {62 vars in 1297 bytes} [Thu Sep 1 05:01:33 2022] PUT /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1362 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:34.239623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-6d763d74-49c0-4e8d-9366-a904146ce4d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Getting quotas for user 498c97de06ca4ba4b4f4c3f129d17c3f and project dc1a1ce370a1484f8d08ba54910e4d53. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:01:34.240716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:34.241342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:34.285153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:34.285566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:34.290828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:34.296861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:34.298287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:34.301244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d763d74-49c0-4e8d-9366-a904146ce4d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.190672 Sep 01 05:01:34.301820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:34.307810 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1542/3090] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 05:01:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:01:34.495719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:34.496450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:34.513363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:34.518003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:34.518641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:34.519697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:34.521402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:34.523931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:35.493783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:35.542450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:35.552167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:35.591236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9055846d-9e51-43fc-a6dd-8a16a971dbc5 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1410 microversion: 2.75 time: 1.356180 Sep 01 05:01:35.595421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1549/3091] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:34 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1410 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:35.611191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:35.611825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:35.630187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:35.631027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:35.631628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:35.632526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:35.633145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:35.633749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:35.808303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:35.818109 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e69d9d8-f194-43a9-95a1-204e462157dc tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.326188 Sep 01 05:01:35.839655 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1543/3092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:34 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:01:36.050823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f2112ad2-37cc-4025-ba96-e7f3ad721738 req-cc54d333-3b7f-45bf-b3b5-65318e2e6eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d57bc8-cbe9-4354-96a3-83553379e4b4", "name": "network-vif-plugged", "status": "completed", "tag": "a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:36.068785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2112ad2-37cc-4025-ba96-e7f3ad721738 req-cc54d333-3b7f-45bf-b3b5-65318e2e6eb4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:36.080679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2112ad2-37cc-4025-ba96-e7f3ad721738 req-cc54d333-3b7f-45bf-b3b5-65318e2e6eb4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:36.082109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2112ad2-37cc-4025-ba96-e7f3ad721738 req-cc54d333-3b7f-45bf-b3b5-65318e2e6eb4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:36.131735 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f2112ad2-37cc-4025-ba96-e7f3ad721738 req-cc54d333-3b7f-45bf-b3b5-65318e2e6eb4 service nova] Creating event network-vif-plugged:a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce for instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 on n-h1-820368-37 Sep 01 05:01:36.146307 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f2112ad2-37cc-4025-ba96-e7f3ad721738 req-cc54d333-3b7f-45bf-b3b5-65318e2e6eb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099602 Sep 01 05:01:36.149631 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1544/3093] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:01:36.624605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:36.625687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:36.655834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:36.661792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:36.664168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:36.675339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:36.678223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:36.680390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:37.464920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:37.513421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:37.531055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:37.563840 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b3e65d9-f4ff-420d-8f91-e50da4e26f0c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1416 microversion: 2.75 time: 0.945796 Sep 01 05:01:37.575670 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1545/3094] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:36 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1416 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:01:37.591826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:37.600755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:37.627012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:37.632550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:37.638073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:37.639425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:37.643448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:37.644206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:37.865997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:37.875710 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb821844-3e8c-479b-9985-da4154c23b98 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 2.277200 Sep 01 05:01:37.897334 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1550/3095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:35 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:38.605521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:38.606546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:38.617207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:38.618030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:38.618750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:38.619976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:38.624819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:38.625613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:39.231779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:39.249469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:39.254969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:39.298350 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7bacb2e-1c3a-4fb7-90f9-df507b8b4f39 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1416 microversion: 2.75 time: 0.694498 Sep 01 05:01:39.300899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1551/3096] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:38 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1416 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:01:39.313121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:39.315907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:39.331473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:39.335159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:39.336079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:39.337176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:39.338269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:39.340449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:39.402490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:39.408433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:39.428320 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-65ead043-1905-4237-b48f-599e2736e181 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1367 microversion: 2.1 time: 1.851045 Sep 01 05:01:39.435219 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1546/3097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:37 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1367 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:39.783047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:39.795412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba4d6768-0509-4249-809d-d72c848a6011 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 0.491870 Sep 01 05:01:39.800534 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1552/3098] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:39 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:40.326983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:40.329705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:40.360719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:40.361648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:40.362315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:40.364366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:40.366322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:40.367014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:40.468774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:40.469473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:40.505106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:40.506232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:40.514439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:40.517432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:40.519544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:40.520054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:40.666138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:40.683925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:40.687852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:40.702558 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af667e8b-f8af-47ae-83a3-1d95d7425628 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1416 microversion: 2.75 time: 0.379102 Sep 01 05:01:40.722945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1547/3099] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:40 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1416 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:40.867902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:40.871164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:40.884726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:40.886019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:40.887430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:40.889140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:40.890608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:40.892789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:40.969941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:40.981549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-decbe769-d5e5-4cae-b368-c827daf3d5f1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1558 microversion: 2.1 time: 0.523669 Sep 01 05:01:40.982040 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1553/3100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:40 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1558 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:41.023976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:41.024753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:41.033634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:41.035182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:41.035781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:41.036698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:41.037360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:41.037941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:41.192770 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27bd40a5-3a5c-4580-8e39-30fa6d7c93b3 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186676 Sep 01 05:01:41.193383 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1554/3101] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:01:41 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:41.702123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:41.816107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:41.826209 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ecc4ea7-7016-4315-acd5-a99e93611e01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 0.968770 Sep 01 05:01:41.837926 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1548/3102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:40 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:41.861879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:41.872741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:41.896943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:41.897433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:41.897865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:41.898571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:41.904637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:41.915619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:42.154852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:42.173323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:42.175787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:42.206336 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d84e9831-a694-453c-a118-73f193d8f906 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1437 microversion: 2.75 time: 0.361170 Sep 01 05:01:42.209262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1549/3103] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:41 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1437 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:42.236617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:42.239524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:42.268573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:42.270954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:42.273245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:42.274063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:42.274532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:42.283115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:42.509110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-867cca61-1877-4f79-863c-ee1f2149e42e tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Calling method '.version_select at 0x7fa75b3df670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:42.549772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:01:42.550199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:01:42.550682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:01:42.551124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:01:42.551532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:01:42.765948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-867cca61-1877-4f79-863c-ee1f2149e42e tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.158229 Sep 01 05:01:42.767317 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1555/3104] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 05:01:41 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:01:42.781315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2055e5e7-23d8-4086-a890-ea8d87873dcf tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Action: 'create', calling method: .version_select at 0x7fa75b3b3550>, body: {"pool": "non_exist_pool"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:42.803435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:42.819266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:42.820539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:42.820539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:42.821078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:42.823686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:42.824126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:42.997891 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2055e5e7-23d8-4086-a890-ea8d87873dcf tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] HTTP exception thrown: Floating IP pool not found. Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2055e5e7-23d8-4086-a890-ea8d87873dcf tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Request method failure captured: Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 26 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDy17A4Vrd0s8njyS9_Xk9vWfwQRqcgG4tNZjPLR9qv8ADfegJ45nX_t5ekElGLCNjf3EQJItA-Eb0T9eeR25SxI5MUPJXKrShu0tcdR-Yu9UeeUnSY0nAJSM_J2StGtk1puHuE3HvFEJ_MhfUBm5gdjRKptRH9pwVWPpc1-vjwb8_s Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: ad2a3abe134b4d2ab9b7d9da9d6c51b2 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-297675685 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-297675685 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: ad2a3abe134b4d2ab9b7d9da9d6c51b2 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-297675685 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsNegativeTestJSON-297675685-project Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 06b812d7109d484d931dff4697902004 Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-297675685-project Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: {"pool": "non_exist_pool"} Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: exception: Floating IP pool not found. Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:43.000389 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:43.005311 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 01 05:01:43.005311 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.007044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2055e5e7-23d8-4086-a890-ea8d87873dcf tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Returning 404 to user: Floating IP pool not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:43.008755 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2055e5e7-23d8-4086-a890-ea8d87873dcf tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.232417 Sep 01 05:01:43.013304 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1556/3105] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 05:01:42 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:01:43.024716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:43.025405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:43.046478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:43.048939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:43.049659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:43.050848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:43.053465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:43.053915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:43.397761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:43.413254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:43.417752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:43.458038 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a5b3650-459d-4b83-aec9-30cd86db19e3 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "POST /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908/action" status: 202 len: 1494 microversion: 2.75 time: 1.226024 Sep 01 05:01:43.461282 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1550/3106] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:01:42 2022] POST /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908/action => generated 1494 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 01 05:01:43.469154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78d5b079-2485-4fe1-9add-8fc316e64c59 tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Calling method '.version_select at 0x7fa75b0c7310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:43.710659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG neutronclient.v2_0.client [None req-78d5b079-2485-4fe1-9add-8fc316e64c59 tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d7c9875b-76cc-42c9-9896-6940443a4822 could not be found", "detail": ""}} {{(pid=128862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 05:01:43.711648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-78d5b079-2485-4fe1-9add-8fc316e64c59 tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] HTTP exception thrown: Floating IP not found for ID d7c9875b-76cc-42c9-9896-6940443a4822 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78d5b079-2485-4fe1-9add-8fc316e64c59 tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Request method failure captured: Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-floating-ips/d7c9875b-76cc-42c9-9896-6940443a4822 HTTP/1.1 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDy17A4Vrd0s8njyS9_Xk9vWfwQRqcgG4tNZjPLR9qv8ADfegJ45nX_t5ekElGLCNjf3EQJItA-Eb0T9eeR25SxI5MUPJXKrShu0tcdR-Yu9UeeUnSY0nAJSM_J2StGtk1puHuE3HvFEJ_MhfUBm5gdjRKptRH9pwVWPpc1-vjwb8_s Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ad2a3abe134b4d2ab9b7d9da9d6c51b2 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-297675685 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad2a3abe134b4d2ab9b7d9da9d6c51b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-297675685 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ad2a3abe134b4d2ab9b7d9da9d6c51b2 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-297675685 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-FloatingIPsNegativeTestJSON-297675685-project Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 06b812d7109d484d931dff4697902004 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-297675685-project Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: exception: Floating IP not found for ID d7c9875b-76cc-42c9-9896-6940443a4822 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd7c9875b-76cc-42c9-9896-6940443a4822'} Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d7c9875b-76cc-42c9-9896-6940443a4822 could not be found Sep 01 05:01:43.713772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-282903c4-9334-4420-97a9-34d3b94809b8'] Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d7c9875b-76cc-42c9-9896-6940443a4822. Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d7c9875b-76cc-42c9-9896-6940443a4822 Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d7c9875b-76cc-42c9-9896-6940443a4822 Sep 01 05:01:43.718566 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:43.722054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78d5b079-2485-4fe1-9add-8fc316e64c59 tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] Returning 404 to user: Floating IP not found for ID d7c9875b-76cc-42c9-9896-6940443a4822 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:43.723100 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78d5b079-2485-4fe1-9add-8fc316e64c59 tempest-FloatingIPsNegativeTestJSON-297675685 tempest-FloatingIPsNegativeTestJSON-297675685-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/d7c9875b-76cc-42c9-9896-6940443a4822" status: 404 len: 111 microversion: 2.1 time: 0.259519 Sep 01 05:01:43.728140 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1551/3107] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:01:43 2022] DELETE /compute/v2.1/os-floating-ips/d7c9875b-76cc-42c9-9896-6940443a4822 => generated 111 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:01:43.735740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:43.750189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:44.387197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:44.394206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:44.394731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:44.395201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:44.396107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:44.396563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:44.397202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:44.461831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:44.476126 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24a5d004-8e91-497f-a819-021367c8c640 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1524 microversion: 2.1 time: 1.462945 Sep 01 05:01:44.478383 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1557/3108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:43 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1524 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:44.615229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:44.631875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:44.635428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:44.643393 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edc4370b-a656-4811-a16b-8bd7db4e8ad4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.913097 Sep 01 05:01:44.645140 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1552/3109] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:43 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:45.502186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:45.502991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:45.523042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:45.523537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:45.524208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:45.525066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:45.525518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:45.527337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:45.675260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:45.679903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:45.710905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:45.718965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:45.722393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:45.728441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:45.730673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:45.735454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:45.997889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:46.016955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:46.022151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:46.036608 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab3392bd-b85d-45e6-814e-93f2ef6f4281 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.368428 Sep 01 05:01:46.059780 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1553/3110] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:45 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:46.064926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:46.074600 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca91f497-c6b0-476b-a222-fb142d714ffe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1506 microversion: 2.1 time: 0.580956 Sep 01 05:01:46.083037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1558/3111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:45 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:46.519365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-15dbfb11-8bec-436a-aed5-d5938e1da2fa req-2ba01bd0-3d3d-41aa-9d32-a40ed26992af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d57bc8-cbe9-4354-96a3-83553379e4b4", "tag": "a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:46.547204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15dbfb11-8bec-436a-aed5-d5938e1da2fa req-2ba01bd0-3d3d-41aa-9d32-a40ed26992af service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:46.547831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15dbfb11-8bec-436a-aed5-d5938e1da2fa req-2ba01bd0-3d3d-41aa-9d32-a40ed26992af service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:46.548289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15dbfb11-8bec-436a-aed5-d5938e1da2fa req-2ba01bd0-3d3d-41aa-9d32-a40ed26992af service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:46.583092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-15dbfb11-8bec-436a-aed5-d5938e1da2fa req-2ba01bd0-3d3d-41aa-9d32-a40ed26992af service nova] Creating event network-changed:a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce for instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 on n-h1-820368-37 Sep 01 05:01:46.597128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-15dbfb11-8bec-436a-aed5-d5938e1da2fa req-2ba01bd0-3d3d-41aa-9d32-a40ed26992af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.333609 Sep 01 05:01:46.600072 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1554/3112] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:46.733472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-303155119", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "40f14740-fe64-4ec1-8a19-e0d1852a091a"}, {"port": "a4bac124-45b5-4944-b285-6c67626879ea", "tag": "port-1"}, {"port": "8ef9bc71-9cca-402d-bd69-f3f06cc051ec", "tag": "port-2"}, {"uuid": "222dcab0-560e-414b-b69e-8e2b8464b74f", "tag": "net-1"}, {"uuid": "222dcab0-560e-414b-b69e-8e2b8464b74f"}, {"uuid": "28657e89-3ae3-44b9-9e5f-1696021aca88", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "28657e89-3ae3-44b9-9e5f-1696021aca88", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e41e45bc-ef8e-4ebb-8bbd-fd1aae08ed72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "227affba-7a3b-4b6b-b880-165782566caf", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "813bf3a4-79a8-4ea2-8731-880c6e8099e9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1525961062"}], "key_name": "tempest-keypair-918565657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:47.039825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] validate_networks() for [('40f14740-fe64-4ec1-8a19-e0d1852a091a', None, None, None, None, None), (None, None, 'a4bac124-45b5-4944-b285-6c67626879ea', None, None, None), (None, None, '8ef9bc71-9cca-402d-bd69-f3f06cc051ec', None, None, None), ('222dcab0-560e-414b-b69e-8e2b8464b74f', None, None, None, None, None), ('222dcab0-560e-414b-b69e-8e2b8464b74f', None, None, None, None, None), ('28657e89-3ae3-44b9-9e5f-1696021aca88', '10.2.2.100', None, None, None, None), ('28657e89-3ae3-44b9-9e5f-1696021aca88', '10.2.2.200', None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:01:47.066162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:47.067566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:47.087733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:47.088314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:47.088766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:47.089496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:47.089951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:47.090370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:47.277821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:47.295234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:47.296930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:47.305508 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71ffef52-b981-4435-b4fe-f9919fb590c7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.244055 Sep 01 05:01:47.315721 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1555/3113] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:47 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:47.332092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:47.334704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:47.345754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:47.349399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:47.350127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:47.351324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:47.352011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:47.355363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:48.135205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:48.146022 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eaff138b-877b-4e1e-a817-157ca6e86395 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1506 microversion: 2.1 time: 0.824739 Sep 01 05:01:48.155978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1556/3114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:47 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1506 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:48.301786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-21ccb018-f409-42f1-918f-897d045c2982 req-79fb7ff7-2eed-4cb5-a23c-704a8b6a87c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bce25e-f4e3-4ca2-82db-63be8850fdf9", "name": "network-vif-unplugged", "status": "completed", "tag": "dbd40e34-4566-4bd8-9313-303b52ef5b9a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:48.329747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-21ccb018-f409-42f1-918f-897d045c2982 req-79fb7ff7-2eed-4cb5-a23c-704a8b6a87c5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:48.331838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-21ccb018-f409-42f1-918f-897d045c2982 req-79fb7ff7-2eed-4cb5-a23c-704a8b6a87c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:48.332499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-21ccb018-f409-42f1-918f-897d045c2982 req-79fb7ff7-2eed-4cb5-a23c-704a8b6a87c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:48.376007 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-21ccb018-f409-42f1-918f-897d045c2982 req-79fb7ff7-2eed-4cb5-a23c-704a8b6a87c5 service nova] Creating event network-vif-unplugged:dbd40e34-4566-4bd8-9313-303b52ef5b9a for instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 on n-h2-820368-37 Sep 01 05:01:48.411747 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-21ccb018-f409-42f1-918f-897d045c2982 req-79fb7ff7-2eed-4cb5-a23c-704a8b6a87c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103400 Sep 01 05:01:48.417260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1557/3115] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:01:48.427179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:48.431146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:48.439248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:48.440253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:48.441646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:48.442762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:48.443600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:48.444374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:48.562570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:48.580839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:48.583169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:48.596983 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1bf28848-c1b8-4c07-9a43-90ce44abab9f tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.174998 Sep 01 05:01:48.611371 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1558/3116] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:48 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:49.183065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:49.183685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:49.205817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:49.211108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:49.213000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:49.214430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:49.215553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:49.216216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:49.596316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:49.608903 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc5a6218-a55d-44f0-9e14-c481f1276702 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 200 len: 1449 microversion: 2.1 time: 0.435916 Sep 01 05:01:49.631124 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1559/3117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:49 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 1449 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:49.639686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:49.646003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:49.672120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:49.672739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:49.674425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:49.677811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:49.679741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:49.689754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:49.874689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:49.886728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:49.888491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:49.897517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8dc3e8e-63bd-4881-b143-c881c647f108 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.265050 Sep 01 05:01:49.915920 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1560/3118] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:49 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:49.928608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:49.929150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:49.944338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:49.944833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:49.953720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:49.955312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:49.955801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:49.956237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:50.026350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:01:50.034050 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Working on deleting snapshot e71e9c7c-eed9-4786-9e2e-b8badbbdd8c3 from shelved instance... Sep 01 05:01:51.336466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Doing local delete in cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=128862) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 01 05:01:51.338418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:51.340887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:51.342631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:51.343217 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 01 05:01:51.351658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] deallocate_for_instance() {{(pid=128862) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Sep 01 05:01:53.816906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Updating instance_info_cache with network_info: [] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 05:01:53.831044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:54.302696 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bcee61ce-ace4-4d75-a264-fd477114240c tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 204 len: 0 microversion: 2.1 time: 4.391267 Sep 01 05:01:54.308664 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1561/3119] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:01:49 2022] DELETE /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 0 bytes in 4393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:01:54.314814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:54.315668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:54.322736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.323609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.324214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.325093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.325703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.326426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.439116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:54.463482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:54.464999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:01:54.465539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:01:54.466325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:01:54.467048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:01:54.467364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:54.467691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:01:54.475957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-245b50a5-8dac-40d2-ab5a-12f22af5a5bf tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.165688 Sep 01 05:01:54.477113 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1562/3120] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:54 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:54.483192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4329ce4b-a7e0-420e-a27b-d75639eb570b req-d27abf90-3e64-4f6f-9997-053907aafadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47bce25e-f4e3-4ca2-82db-63be8850fdf9", "name": "network-vif-deleted", "tag": "dbd40e34-4566-4bd8-9313-303b52ef5b9a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:54.488419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.491567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.492315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.493328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.494054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.494556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:54.497084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.509848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4329ce4b-a7e0-420e-a27b-d75639eb570b req-d27abf90-3e64-4f6f-9997-053907aafadc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.510804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4329ce4b-a7e0-420e-a27b-d75639eb570b req-d27abf90-3e64-4f6f-9997-053907aafadc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.511477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4329ce4b-a7e0-420e-a27b-d75639eb570b req-d27abf90-3e64-4f6f-9997-053907aafadc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.524672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=74 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:54.530209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-4329ce4b-a7e0-420e-a27b-d75639eb570b req-d27abf90-3e64-4f6f-9997-053907aafadc service nova] Unable to find a host for instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9. Dropping event network-vif-deleted {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:01:54.531499 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4329ce4b-a7e0-420e-a27b-d75639eb570b req-d27abf90-3e64-4f6f-9997-053907aafadc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053267 Sep 01 05:01:54.533561 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1563/3121] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:01:54.540756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:54.548588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:54.555308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Getting quotas for project dc1a1ce370a1484f8d08ba54910e4d53. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:01:54.557083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.557579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.558405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.559378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:54.560041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:54.560778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:54.563366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Getting quotas for user 498c97de06ca4ba4b4f4c3f129d17c3f and project dc1a1ce370a1484f8d08ba54910e4d53. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:01:54.614126 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 HTTP/1.1 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '47bce25e-f4e3-4ca2-82db-63be8850fdf9'} Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:01:54.620346 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:01:54.624941 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:01:54.627096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:01:54.628237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76cfd8f9-3b44-47b9-9ff5-f3980975ef92 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 404 len: 111 microversion: 2.1 time: 0.093390 Sep 01 05:01:54.630973 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1564/3122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:54 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:01:54.816129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1617069730", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:01:54.818724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:01:54.822251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e41e45bc-ef8e-4ebb-8bbd-fd1aae08ed72',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='227affba-7a3b-4b6b-b880-165782566caf',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='813bf3a4-79a8-4ea2-8731-880c6e8099e9',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:01:54.908405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:01:55.483794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6d2808f-9562-4ee1-b797-0e7b5145de10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.758550 Sep 01 05:01:55.485374 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1559/3123] 10.222.0.26 () {62 vars in 1189 bytes} [Thu Sep 1 05:01:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 8760 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:01:55.530204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0a9cbde-db59-4800-915f-405d2c45399f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:55.531423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0a9cbde-db59-4800-915f-405d2c45399f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:55.823134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0a9cbde-db59-4800-915f-405d2c45399f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:55.832816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0a9cbde-db59-4800-915f-405d2c45399f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:55.834400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0a9cbde-db59-4800-915f-405d2c45399f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:55.844106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0a9cbde-db59-4800-915f-405d2c45399f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1284 microversion: 2.42 time: 0.352045 Sep 01 05:01:55.848504 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1560/3124] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:55 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:01:55.853867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:55.868757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:55.881385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:55.882162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:55.882783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:55.883692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:55.884149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:55.884576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:56.235651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:56.252419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:56.262986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:56.276844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee4ef22f-e6cc-40a6-ab8f-c868fd82038c tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.426293 Sep 01 05:01:56.286991 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1561/3125] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:55 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:56.490006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:01:56.491845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:01:56.492826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:01:56.493462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:01:56.494185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:01:56.509006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:56.509573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:56.510478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:56.511803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:56.512550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:56.513136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:56.561412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:01:56.571618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:01:56.588305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:01:56.591404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:01:56.723077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6c555b9-a9cf-45bb-9735-4c60d9e23151 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911170 Sep 01 05:01:56.727753 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1565/3126] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:01:56.736791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5db67a6f-4fa8-4944-8b29-e7c7c67ce2a3 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:56.737424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5db67a6f-4fa8-4944-8b29-e7c7c67ce2a3 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:56.868563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1009a7a-39e9-4d33-93ac-030036b922a7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:56.869185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1009a7a-39e9-4d33-93ac-030036b922a7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:56.993435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5db67a6f-4fa8-4944-8b29-e7c7c67ce2a3 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.023653 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5db67a6f-4fa8-4944-8b29-e7c7c67ce2a3 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1215 microversion: 2.1 time: 0.291080 Sep 01 05:01:57.041095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1562/3127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:56 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1215 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:57.227216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1009a7a-39e9-4d33-93ac-030036b922a7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.242054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1009a7a-39e9-4d33-93ac-030036b922a7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.251506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1009a7a-39e9-4d33-93ac-030036b922a7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.267879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1009a7a-39e9-4d33-93ac-030036b922a7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1284 microversion: 2.42 time: 0.397896 Sep 01 05:01:57.272055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1566/3128] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:56 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:01:57.309342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:57.310107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:57.326976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:57.328149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:57.328635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:57.330855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:57.334077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:57.334277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:57.609668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.669847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.679521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:57.700818 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38137545-279d-448b-bc29-f248196747c4 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.397190 Sep 01 05:01:57.705514 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1563/3129] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:57 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:58.045767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:58.047581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:58.060992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:58.061873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:58.062497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:58.063413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:58.064308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:58.065049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:58.218169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.238421 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4c7afc1-8ba2-4b75-a1f0-b5a4500fc486 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1211 microversion: 2.1 time: 0.194311 Sep 01 05:01:58.241580 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1567/3130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:58 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1211 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:58.298540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:58.299373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:58.313288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:58.313846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:58.314295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:58.316886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:58.319141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:58.319751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:58.509095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.535289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.546055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.547638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f95ea4dd-8fc1-4971-b347-5a0ca016ad18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1518 microversion: 2.42 time: 0.253950 Sep 01 05:01:58.552619 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1564/3131] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:58 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1518 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:58.728269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:58.729121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:58.739091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:58.740544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:58.741411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:58.742775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:58.743613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:58.744397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:58.926402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.940186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.943692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:58.958742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35418816-1ba3-4582-8396-95ff6f848753 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.233680 Sep 01 05:01:58.959856 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1568/3132] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:58 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:59.261863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:59.262771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:59.282684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:59.283212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:59.289512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:59.291412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:59.292956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:59.300178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:59.545303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:59.567516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba952a72-cb4a-4eb8-a647-eda3e23eaddc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1275 microversion: 2.1 time: 0.309332 Sep 01 05:01:59.568424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1565/3133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:01:59 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:01:59.577958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:59.579292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:01:59.597816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:59.598320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:59.598756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:59.599510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:01:59.612788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:01:59.613424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:01:59.883529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:59.909786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:59.912282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:01:59.913396 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5254fe80-7c11-48fe-bbfc-f6122c79ff10 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1582 microversion: 2.42 time: 0.340422 Sep 01 05:01:59.929795 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1569/3134] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:59 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1582 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:01:59.987711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:01:59.988335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:00.020377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:00.028882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:00.029472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:00.030541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:00.030796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:00.031266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:00.592340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:00.593303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:00.611999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:00.612513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:00.612958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:00.613693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:00.614157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:00.614587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:00.677294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:00.691486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:00.704940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:00.744961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41ca558a-73e9-44e4-aeb4-ce6fb0251b19 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.762473 Sep 01 05:02:00.752126 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1566/3135] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:01:59 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:00.843257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:00.855628 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ef00b71-699f-4a48-86b9-e4d92a7e93f6 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1273 microversion: 2.1 time: 0.268637 Sep 01 05:02:00.856417 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1570/3136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:00 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:00.944062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:00.944985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:00.954203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:00.962950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:00.971707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:00.972180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:00.973003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:00.973469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:00.974108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:01.182382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:01.199970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:01.204621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:01.208377 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a858f5fb-21b1-476a-9d29-6105398ee0dd tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1592 microversion: 2.42 time: 0.266057 Sep 01 05:02:01.214131 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1567/3137] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:00 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1592 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:01.776889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:01.777513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:01.802523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:01.803317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:01.803919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:01.804826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:01.805453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:01.806064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:01.878564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:01.879209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:01.893475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:01.893984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:01.894416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:01.895155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:01.895617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:01.896045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:02.195042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.205335 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5da048b-e357-49fd-85f5-f83d23810007 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1273 microversion: 2.1 time: 0.330323 Sep 01 05:02:02.210843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.212141 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1568/3138] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:01 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:02.233847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.239841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.243645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:02.244271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:02.250130 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76069ad4-6039-4aff-9371-3032473a54dc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.477453 Sep 01 05:02:02.261470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:02.261977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:02.262419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:02.263167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:02.263716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:02.264148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:02.271306 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1571/3139] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:01 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:02.480869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.496679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.498235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:02.509700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bbc2be5-feb9-4195-b270-8c329053cded tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1592 microversion: 2.42 time: 0.269395 Sep 01 05:02:02.519971 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1569/3140] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:02 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1592 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:03.236988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:03.237611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:03.247886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:03.250605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:03.251110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:03.251858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:03.252321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:03.252742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:03.277820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:03.278441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:03.298063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:03.305707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:03.306540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:03.312024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:03.317710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:03.318547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:03.659173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:03.687008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:03.691670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:03.725773 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-529090ab-e5e8-4604-b793-f7e161d0a322 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.452043 Sep 01 05:02:03.726730 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1570/3141] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:03 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:03.736026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:03.736658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:03.757302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:03.758121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:03.758750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:03.759681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:03.760306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:03.760896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:04.080332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:04.099679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:04.102462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:04.104806 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee9600df-6e70-469a-9c9e-a523f1dc2230 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1592 microversion: 2.42 time: 0.376343 Sep 01 05:02:04.130238 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1571/3142] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:03 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1592 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:04.142258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:04.162638 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7a49500-dc54-4f33-8e52-80498ef0ca17 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 0.925856 Sep 01 05:02:04.174944 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1572/3143] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:03 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:04.758033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:04.758655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:04.772838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:04.777859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:04.778384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:04.778834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:04.781446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:04.786416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:04.786954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:04.958573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:04.988327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:04.995488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:05.009703 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca9b1f62-ede7-4251-a958-6a7cb4e16d67 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.258357 Sep 01 05:02:05.013705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1572/3144] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:04 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:05.136337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:05.137618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:05.152016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:05.152731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:05.154737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:05.157653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:05.159835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:05.161136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:05.189767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:05.191430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:05.205039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:05.205897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:05.206442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:05.207310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:05.210517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:05.211138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:06.409339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.420724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.427586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.437573 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e75d34b6-89c6-4580-8660-739b1d620cd8 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 1.253196 Sep 01 05:02:06.439867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.445180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7e37197-f1bd-47a4-9848-262d93e40ba9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1660 microversion: 2.42 time: 1.313978 Sep 01 05:02:06.445742 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1573/3145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:05 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:06.461423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:06.463391 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1573/3146] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:05 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1660 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:06.464356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:06.470968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:06.483121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:06.483828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:06.484810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:06.485516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:06.486166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:06.611574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.621310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.631193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:06.637245 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93ceab57-f46b-4f02-8087-9bcda76ca843 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.190171 Sep 01 05:02:06.651338 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1574/3147] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:06 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:07.010498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-42c5e0d4-e9dc-4846-90ed-0229ff320a59 req-163f689c-f2c3-4b95-ba5e-acfae46933fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de0f57df-c4be-4fe7-aef3-2bf23bb3000e", "tag": "e311eac6-6d26-4a3b-bbfe-83331c55499b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:07.047098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:07.068835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-42c5e0d4-e9dc-4846-90ed-0229ff320a59 req-163f689c-f2c3-4b95-ba5e-acfae46933fa service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:07.070304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-42c5e0d4-e9dc-4846-90ed-0229ff320a59 req-163f689c-f2c3-4b95-ba5e-acfae46933fa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:07.070752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-42c5e0d4-e9dc-4846-90ed-0229ff320a59 req-163f689c-f2c3-4b95-ba5e-acfae46933fa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:07.117688 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-42c5e0d4-e9dc-4846-90ed-0229ff320a59 req-163f689c-f2c3-4b95-ba5e-acfae46933fa service nova] Creating event network-changed:e311eac6-6d26-4a3b-bbfe-83331c55499b for instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e on n-h1-820368-37 Sep 01 05:02:07.135730 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-42c5e0d4-e9dc-4846-90ed-0229ff320a59 req-163f689c-f2c3-4b95-ba5e-acfae46933fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138926 Sep 01 05:02:07.138846 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1574/3148] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:07.464625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:07.465786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:07.469682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:07.481665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:07.494431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:07.495854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:07.498936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:07.501934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:07.505338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:07.512901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:07.515074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:07.521304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:07.528775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:07.529553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:07.530191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:07.532298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:07.535708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:07.536491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:08.615614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:08.641500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:08.643473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:08.644981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04b62530-3348-438b-8df1-45d9b0eb14f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1707 microversion: 2.42 time: 1.157449 Sep 01 05:02:08.645768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1575/3149] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:07 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1707 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:08.663505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:08.664345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:08.675337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:08.676130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:08.682350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:08.683653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:08.684316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:08.684937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:08.784246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:08.809668 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fdb6e3e-f6d7-423c-a4e9-32759b61ff03 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 1.347672 Sep 01 05:02:08.824332 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1575/3150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:07 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:08.959718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:08.973393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:08.979075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:09.007131 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-136a2ba6-eb65-4dbf-88f9-ef5a9fba9a7b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1446 microversion: 2.75 time: 0.359321 Sep 01 05:02:09.008831 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1576/3151] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:08 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1446 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:09.673079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:09.673692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:09.686549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:09.687084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:09.696030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:09.702372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:09.702994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:09.703454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:09.844433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:09.844433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:09.857814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:09.858455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:09.859459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:09.860225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:09.860693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:09.861125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:09.931652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=14,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:11.062539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.088053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.090015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.095578 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a83e544-80d6-476f-abdd-441ed8b6fbfc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1707 microversion: 2.42 time: 1.426674 Sep 01 05:02:11.112955 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1576/3152] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:09 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1707 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:11.118348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:11.137287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:11.152775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:11.155615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:11.157803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:11.159436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:11.160199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:11.160915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:11.699696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.709670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.711145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.734090 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f87e2fb7-3e1f-4c5d-88d3-c66f63df85f2 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1452 microversion: 2.75 time: 0.619678 Sep 01 05:02:11.735007 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1577/3153] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:11 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1452 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:11.817662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:11.833942 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ae180ff-8c73-4c34-ba65-a133fe012f28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 2.000437 Sep 01 05:02:11.837054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1577/3154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:09 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:02:12.140381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:12.141191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:12.152819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:12.153320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:12.153756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:12.154563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:12.155274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:12.155636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:12.207985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:12.764275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:12.764905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:12.783264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:12.783757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:12.784190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:12.784907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:12.785359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:12.785781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:13.290193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:13.311269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:13.312901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:13.327966 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf5abde2-0a95-45b0-a5a9-db8cfb78aef7 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1452 microversion: 2.75 time: 0.567857 Sep 01 05:02:13.331335 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1578/3155] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:12 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1452 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:13.344294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:13.345369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:13.358618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:13.361902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:13.362536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:13.364270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:13.365819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:13.367211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:13.378582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:13.405516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:13.414767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:13.416459 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8561a557-4002-4251-88eb-f6ecd8c40aaf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1754 microversion: 2.42 time: 1.280195 Sep 01 05:02:13.420223 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1578/3156] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:12 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1754 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:14.127605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:14.144447 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b05fde9-1dc2-40ba-a77d-e4db07d23305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 0.808091 Sep 01 05:02:14.159396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1579/3157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:13 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:14.358205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:14.358940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:14.374992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:14.376911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:14.377387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:14.381376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:14.382017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:14.382465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:14.444955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:14.446347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:14.463900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:14.464504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:14.465949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:14.467851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:14.474168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:14.475389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:14.611217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:14.625192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:14.626635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:14.650683 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3912a8bc-52fe-4943-8263-83346dda8d80 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1452 microversion: 2.75 time: 0.297011 Sep 01 05:02:14.653658 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1579/3158] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:14 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1452 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:15.114975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfc4dd60-8a8b-4bfb-8df1-ea2ae1681581 tempest-FloatingIPDetailsNegativeTestJSON-107022457 tempest-FloatingIPDetailsNegativeTestJSON-107022457-project] Calling method '.version_select at 0x7fa75b311700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:15.322869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-bfc4dd60-8a8b-4bfb-8df1-ea2ae1681581 tempest-FloatingIPDetailsNegativeTestJSON-107022457 tempest-FloatingIPDetailsNegativeTestJSON-107022457-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8401c3b9-2133-458a-8bfe-33e4bd4bf29e could not be found", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 05:02:15.324866 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bfc4dd60-8a8b-4bfb-8df1-ea2ae1681581 tempest-FloatingIPDetailsNegativeTestJSON-107022457 tempest-FloatingIPDetailsNegativeTestJSON-107022457-project] HTTP exception thrown: Floating IP not found for ID 8401c3b9-2133-458a-8bfe-33e4bd4bf29e Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfc4dd60-8a8b-4bfb-8df1-ea2ae1681581 tempest-FloatingIPDetailsNegativeTestJSON-107022457 tempest-FloatingIPDetailsNegativeTestJSON-107022457-project] Request method failure captured: Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-floating-ips/8401c3b9-2133-458a-8bfe-33e4bd4bf29e HTTP/1.1 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDzWjYyTEU7-cqvyWVPv643foX65LBhPfeO2dCgYKjTVLR8aYxWVblsoHFGEIwgrc-CRvTl7iAmr0cUudd8zUU2jCr2yEJKeDCYaSfuHCa4u2A9S83C137TqUPxRw9on61Xbnlh_76hMELTew60s0F6BDpuiKe1fm0dg6igATSHt6fk Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c8d00116f3cb46248af877be6440781d Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-107022457 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d00116f3cb46248af877be6440781d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8d00116f3cb46248af877be6440781d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8d00116f3cb46248af877be6440781d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8d00116f3cb46248af877be6440781d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-107022457 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c8d00116f3cb46248af877be6440781d Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-107022457 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-107022457-project Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: a484c611c1d343789654505b55773b6c Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-107022457-project Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: exception: Floating IP not found for ID 8401c3b9-2133-458a-8bfe-33e4bd4bf29e Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '8401c3b9-2133-458a-8bfe-33e4bd4bf29e'} Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8401c3b9-2133-458a-8bfe-33e4bd4bf29e could not be found Sep 01 05:02:15.334143 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48191092-fb82-46c9-bc18-f0e965c99a8b'] Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8401c3b9-2133-458a-8bfe-33e4bd4bf29e. Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8401c3b9-2133-458a-8bfe-33e4bd4bf29e Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8401c3b9-2133-458a-8bfe-33e4bd4bf29e Sep 01 05:02:15.341444 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:15.351892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfc4dd60-8a8b-4bfb-8df1-ea2ae1681581 tempest-FloatingIPDetailsNegativeTestJSON-107022457 tempest-FloatingIPDetailsNegativeTestJSON-107022457-project] Returning 404 to user: Floating IP not found for ID 8401c3b9-2133-458a-8bfe-33e4bd4bf29e {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:02:15.353037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfc4dd60-8a8b-4bfb-8df1-ea2ae1681581 tempest-FloatingIPDetailsNegativeTestJSON-107022457 tempest-FloatingIPDetailsNegativeTestJSON-107022457-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/8401c3b9-2133-458a-8bfe-33e4bd4bf29e" status: 404 len: 111 microversion: 2.1 time: 0.543179 Sep 01 05:02:15.354488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1580/3159] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 05:02:14 2022] GET /compute/v2.1/os-floating-ips/8401c3b9-2133-458a-8bfe-33e4bd4bf29e => generated 111 bytes in 545 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:02:15.366327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:15.371750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:15.396183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:15.399508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:15.400354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:15.403285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:15.406366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:15.407779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:16.296319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.318653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.326234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.330571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-877b6a6e-f356-401c-8791-b67e51ea5b9e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1754 microversion: 2.42 time: 1.889902 Sep 01 05:02:16.337129 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1580/3160] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:14 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1754 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:16.351734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:16.359864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:16.378603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:16.383511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:16.385032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:16.386103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:16.386814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:16.387632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:16.651264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.674848 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-989640cc-1390-4fff-add0-b75e015b95fa tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 1.318790 Sep 01 05:02:16.686284 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1581/3161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:15 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:16.796997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.799948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:16.801153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:16.814412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:16.814973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:16.816293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.819115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:16.820184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:16.823869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:16.824661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:16.825323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:16.861673 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7601ec03-c97b-4069-9daf-fd808fadab1b tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1437 microversion: 2.75 time: 0.521490 Sep 01 05:02:16.872839 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1581/3162] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:16 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1437 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:16.925824 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b503f6a-90b6-4726-97ee-30ac97f8e739 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/ips" status: 200 len: 151 microversion: 2.1 time: 0.130791 Sep 01 05:02:16.939817 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1582/3163] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:02:16 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/ips => generated 151 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:02:16.959986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "362e5a1b-73f8-445e-bc91-b83b2e3aa8ee"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:16.970871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:16.991115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.008900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.011144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.020651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.028847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.031626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.348004 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Invalid volume: volume 362e5a1b-73f8-445e-bc91-b83b2e3aa8ee is already attached to instances: 360af898-9d37-4f14-a30b-95e19c0d6e79 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/os-volume_attachments HTTP/1.1 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 74 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "362e5a1b-73f8-445e-bc91-b83b2e3aa8ee"}} Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid volume: volume 362e5a1b-73f8-445e-bc91-b83b2e3aa8ee is already attached to instances: 360af898-9d37-4f14-a30b-95e19c0d6e79 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'server_id': '45d57bc8-cbe9-4354-96a3-83553379e4b4', 'body': {'volumeAttachment': {'volumeId': '362e5a1b-73f8-445e-bc91-b83b2e3aa8ee'}}} Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 362e5a1b-73f8-445e-bc91-b83b2e3aa8ee is already attached to instances: 360af898-9d37-4f14-a30b-95e19c0d6e79 Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:02:17.351890 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 362e5a1b-73f8-445e-bc91-b83b2e3aa8ee is already attached to instances: 360af898-9d37-4f14-a30b-95e19c0d6e79 Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 362e5a1b-73f8-445e-bc91-b83b2e3aa8ee is already attached to instances: 360af898-9d37-4f14-a30b-95e19c0d6e79 Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 400 to user: Invalid volume: volume 362e5a1b-73f8-445e-bc91-b83b2e3aa8ee is already attached to instances: 360af898-9d37-4f14-a30b-95e19c0d6e79 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:02:17.358607 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c40315c-f277-4beb-b753-4a6f792127ca tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.412094 Sep 01 05:02:17.361724 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1583/3164] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:02:16 2022] POST /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4/os-volume_attachments => generated 174 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:02:17.517271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:17.520967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:17.534003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.534758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.535408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.536613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.537421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.542707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.571195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dd3e3d0c-9520-4b5a-babf-e02d30988afe req-370b1cfe-95c2-43f0-83bc-3d2e219d7a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f57df-c4be-4fe7-aef3-2bf23bb3000e", "name": "network-vif-plugged", "status": "completed", "tag": "e311eac6-6d26-4a3b-bbfe-83331c55499b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:17.620143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dd3e3d0c-9520-4b5a-babf-e02d30988afe req-370b1cfe-95c2-43f0-83bc-3d2e219d7a5c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.620850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dd3e3d0c-9520-4b5a-babf-e02d30988afe req-370b1cfe-95c2-43f0-83bc-3d2e219d7a5c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.621314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dd3e3d0c-9520-4b5a-babf-e02d30988afe req-370b1cfe-95c2-43f0-83bc-3d2e219d7a5c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.655585 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dd3e3d0c-9520-4b5a-babf-e02d30988afe req-370b1cfe-95c2-43f0-83bc-3d2e219d7a5c service nova] Creating event network-vif-plugged:e311eac6-6d26-4a3b-bbfe-83331c55499b for instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e on n-h1-820368-37 Sep 01 05:02:17.667347 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dd3e3d0c-9520-4b5a-babf-e02d30988afe req-370b1cfe-95c2-43f0-83bc-3d2e219d7a5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304205 Sep 01 05:02:17.668490 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1584/3165] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:17.683325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:02:17.685852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:02:17.686989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:02:17.687835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:02:17.696226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:02:17.701823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:17.703779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:17.724405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.730823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.733155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.734290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.735220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.735872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.924381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:17.941707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.943794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.944625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:17.947771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:17.949589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:17.950341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:18.607205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:18.682869 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dec68cc5-64b8-40c8-887b-819c5f0daa0a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908/action" status: 202 len: 1942 microversion: 2.75 time: 1.796091 Sep 01 05:02:18.683255 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1582/3166] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:02:16 2022] POST /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908/action => generated 1942 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 01 05:02:18.707168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:18.708074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:18.717036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:18.718041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:18.718743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:18.719702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:18.721108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:18.721760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:18.786195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:02:19.035396 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60f7e1e5-1808-4aca-8f4f-823a0639e4e6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 204 len: 0 microversion: 2.1 time: 0.334774 Sep 01 05:02:19.044507 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1583/3167] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:02:18 2022] DELETE /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:02:19.052538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:19.055479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:19.070835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:19.071382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:19.071822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:19.072538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:19.072991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:19.073418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:19.151449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:19.173295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:19.181277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:19.182523 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66507120-aa26-42bc-8c8e-80f681ed3526 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1801 microversion: 2.42 time: 1.513136 Sep 01 05:02:19.195228 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1585/3168] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:17 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1801 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:19.211853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:19.212372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:19.233657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:19.239254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:19.240993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:19.243852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:19.249243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:19.249712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:19.652514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:19.707046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7626b29b-c865-4271-9a49-b4847502a70d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.516485 Sep 01 05:02:19.710307 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1586/3169] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:19 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:19.723332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:19.725213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:19.739450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:19.741451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:19.742176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:19.743397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:19.745491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:19.748437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:19.837180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:19.852481 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c18b88f-2b7b-4d6e-ae2f-8d749996d975 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 0.806431 Sep 01 05:02:19.856960 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1584/3170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:19 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:20.212206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:20.212913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:20.225973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:20.236658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:20.241352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:20.242073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:20.244851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:20.247925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:20.251565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:20.260012 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66bb45dc-e150-4eb1-a377-4d993a28d583 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1683 microversion: 2.1 time: 0.547940 Sep 01 05:02:20.263788 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1587/3171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:19 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1683 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:20.737231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:20.737853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:20.756850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:20.757095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:20.757345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:20.760337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:20.763411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:20.766154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:20.766818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:20.777259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:20.786709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:20.804310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d890480d-bf98-40c9-a9eb-e63301a280b1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1801 microversion: 2.42 time: 0.588191 Sep 01 05:02:20.808059 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1585/3172] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:20 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1801 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:20.883116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:20.883818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:20.896643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:20.897149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:20.899472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:20.903032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:20.904024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:20.907506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:21.062709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:21.134105 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfefc017-50ce-4506-83a8-4b4851d84cda tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.389553 Sep 01 05:02:21.134796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1588/3173] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:20 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:21.287610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:21.288450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:21.304951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:21.307222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:21.307686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:21.308435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:21.308904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:21.309334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:21.716708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:21.726844 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29be0ec9-d9d7-4c76-a597-e1198d3e8d10 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1315 microversion: 2.1 time: 0.847381 Sep 01 05:02:21.738017 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1586/3174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:20 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:21.834005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:21.835176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:21.845394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:21.849287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:21.851487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:21.852473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:21.854809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:21.859014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:22.667919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:22.684289 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4189ab5e-10ce-4146-936a-8f1425818140 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1683 microversion: 2.1 time: 1.402217 Sep 01 05:02:22.702577 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1589/3175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:21 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1683 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:02:22.713674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:22.714794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:22.729504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:22.730592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:22.731270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:22.733407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:22.734248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:22.734874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:22.933204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:23.003252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a27662f7-b6d6-4cae-b868-8b670b5a690d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.293921 Sep 01 05:02:23.005351 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1590/3176] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:22 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:23.023971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:23.025763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:23.047420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:23.048240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:23.050223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:23.050762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:23.056821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:23.058106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:23.058587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:23.061561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:23.063050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:23.075312 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b96e710a-14e7-447a-8a9f-510623e39e3f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1801 microversion: 2.42 time: 1.235459 Sep 01 05:02:23.079649 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1587/3177] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:21 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1801 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:23.713321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:23.714068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:23.733448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:23.739666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:23.740364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:23.742799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:23.743489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:23.746954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:24.464215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:24.475937 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-672bfc8d-4327-49fb-b8ce-1e3c825340e1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1501 microversion: 2.1 time: 1.466578 Sep 01 05:02:24.494548 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1591/3178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:23 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1501 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:24.502867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:24.503572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:24.528960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:24.529479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:24.534454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:24.535450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:24.535944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:24.536382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:24.707795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:24.751311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:24.760743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7956006-0fb4-41f3-b375-149b13f0224d tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.264608 Sep 01 05:02:24.764668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1592/3179] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:24 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:24.767803 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9fa33ca-890a-4741-a4e8-13a4291f6b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1683 microversion: 2.1 time: 1.065398 Sep 01 05:02:24.776543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:24.778316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:24.795701 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1588/3180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:23 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1683 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:24.807110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-785eb254-cda9-4ad1-bdce-fe047eba2e08 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:24.814396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:24.815459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:24.815974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:24.816731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785eb254-cda9-4ad1-bdce-fe047eba2e08 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:24.817372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:24.817781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785eb254-cda9-4ad1-bdce-fe047eba2e08 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:24.818102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:24.818564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:24.819018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:24.819813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-785eb254-cda9-4ad1-bdce-fe047eba2e08 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:24.873917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-785eb254-cda9-4ad1-bdce-fe047eba2e08 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:02:24.879537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:24.996780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-785eb254-cda9-4ad1-bdce-fe047eba2e08 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e/action" status: 202 len: 0 microversion: 2.1 time: 0.199382 Sep 01 05:02:24.999713 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1589/3181] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:02:24 2022] POST /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:02:25.015342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a47f1169-1b4c-4db9-b76f-5c641b0a3988 req-688bb2c2-a255-4f36-ab46-203f08414a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d57bc8-cbe9-4354-96a3-83553379e4b4", "name": "network-vif-unplugged", "status": "completed", "tag": "a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:25.058531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a47f1169-1b4c-4db9-b76f-5c641b0a3988 req-688bb2c2-a255-4f36-ab46-203f08414a66 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:25.059145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a47f1169-1b4c-4db9-b76f-5c641b0a3988 req-688bb2c2-a255-4f36-ab46-203f08414a66 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:25.060291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a47f1169-1b4c-4db9-b76f-5c641b0a3988 req-688bb2c2-a255-4f36-ab46-203f08414a66 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:25.088498 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a47f1169-1b4c-4db9-b76f-5c641b0a3988 req-688bb2c2-a255-4f36-ab46-203f08414a66 service nova] Creating event network-vif-unplugged:a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce for instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 on n-h1-820368-37 Sep 01 05:02:25.117209 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a47f1169-1b4c-4db9-b76f-5c641b0a3988 req-688bb2c2-a255-4f36-ab46-203f08414a66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110964 Sep 01 05:02:25.120960 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1590/3182] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:25.145723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:25.146508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:25.170328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:25.170821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:25.171282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:25.171996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:25.182592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:25.183325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:26.974169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:26.985217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:26.997582 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44bccd45-c7d1-4bd8-b7eb-72feb7dbbe1f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.874146 Sep 01 05:02:27.016673 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1591/3183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:25 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:27.022408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:27.024007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:27.025241 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a4b52d8-c3cd-411c-9ca8-1e97eca085d1 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1848 microversion: 2.42 time: 2.258335 Sep 01 05:02:27.031460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1593/3184] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:24 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1848 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:27.040540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:27.041164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:27.065999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:27.066509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:27.075136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:27.076281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:27.076783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:27.077234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:27.454417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:27.493125 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c588517-32a8-4413-9b0b-0e50ea8198f0 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.459429 Sep 01 05:02:27.495729 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1594/3185] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:27 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:27.508778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:27.509637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:27.526457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:27.529122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:27.534052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:27.535085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:27.535738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:27.536549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:27.574948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:27.673626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:27.682145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e70a680c-1952-45e7-9b01-07e080a61275 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1616 microversion: 2.1 time: 0.184944 Sep 01 05:02:27.693699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1595/3186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:27 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1616 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:27.857802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-113983ec-f4f3-432a-9872-b8df0dba133a tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Action: 'create', calling method: .version_select at 0x7fa75bba24c0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:27.951706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-113983ec-f4f3-432a-9872-b8df0dba133a tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Getting quotas for project faccf2ca014c4974bf6e78d5e5951391. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:02:27.992390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-113983ec-f4f3-432a-9872-b8df0dba133a tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Getting quotas for user fd532eee94e145ee92b37dc543b13226 and project faccf2ca014c4974bf6e78d5e5951391. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:02:28.048533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:28.049153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:28.068735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:28.073349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:28.074010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:28.074771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:28.075320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:28.075942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:28.163673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-113983ec-f4f3-432a-9872-b8df0dba133a tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Getting quotas for project faccf2ca014c4974bf6e78d5e5951391. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:02:28.179456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-113983ec-f4f3-432a-9872-b8df0dba133a tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Getting quotas for user fd532eee94e145ee92b37dc543b13226 and project faccf2ca014c4974bf6e78d5e5951391. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:02:28.239904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-113983ec-f4f3-432a-9872-b8df0dba133a tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.205710 Sep 01 05:02:28.241549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1592/3187] 10.222.0.26 () {62 vars in 1214 bytes} [Thu Sep 1 05:02:27 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:02:28.263369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:28.264420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:28.284026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:28.284721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:28.285311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:28.286215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:28.286830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:28.287432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.056437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:29.082817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:29.086067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:29.136071 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-357e87a6-5d6c-45e7-848f-91b1c8c47b23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1848 microversion: 2.42 time: 0.879800 Sep 01 05:02:29.137106 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1593/3188] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:28 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1848 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:29.162256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b8dd0ab-1449-4d1b-824f-2121564263db tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:29.232637 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b8dd0ab-1449-4d1b-824f-2121564263db tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.094124 Sep 01 05:02:29.233224 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1594/3189] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 1 05:02:29 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:02:29.263608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:29.271860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:29.312351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:29.312844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:29.313276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.313991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:29.338516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:29.339065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.356593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:29.373885 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f982283-a96a-4ab3-a2a9-a8d5f3698d8d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.331336 Sep 01 05:02:29.374493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1596/3190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:28 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:02:29.402863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:29.407622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:29.430321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:29.430836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:29.431313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.432231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:29.432877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:29.433304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.533368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:29.538263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:29.538720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.539244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lazy-loading 'fault' on Instance uuid 45d57bc8-cbe9-4354-96a3-83553379e4b4 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:29.777038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:29.786594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47e84e03-22d7-43aa-83a1-f60955b119ae tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 200 len: 1332 microversion: 2.1 time: 0.402377 Sep 01 05:02:29.796863 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1597/3191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:29 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 1332 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:29.817746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fdfdc2e7-8b5d-4e31-b2ee-6206d4f1b483 req-a76f798c-6d40-45e2-9a1d-ef0797209a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d57bc8-cbe9-4354-96a3-83553379e4b4", "name": "network-vif-deleted", "tag": "a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:29.845629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fdfdc2e7-8b5d-4e31-b2ee-6206d4f1b483 req-a76f798c-6d40-45e2-9a1d-ef0797209a1f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:29.846144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fdfdc2e7-8b5d-4e31-b2ee-6206d4f1b483 req-a76f798c-6d40-45e2-9a1d-ef0797209a1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:29.846575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fdfdc2e7-8b5d-4e31-b2ee-6206d4f1b483 req-a76f798c-6d40-45e2-9a1d-ef0797209a1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:29.849164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:29.872601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fdfdc2e7-8b5d-4e31-b2ee-6206d4f1b483 req-a76f798c-6d40-45e2-9a1d-ef0797209a1f service nova] Creating event network-vif-deleted:a97a12a8-3e0f-4f67-b5ee-e25bd0d43fce for instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 on n-h1-820368-37 Sep 01 05:02:29.890503 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fdfdc2e7-8b5d-4e31-b2ee-6206d4f1b483 req-a76f798c-6d40-45e2-9a1d-ef0797209a1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090478 Sep 01 05:02:29.893698 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1598/3192] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:29.919792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce4372e8-5668-4282-a773-69d5ae433008 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:29.940171 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e6b3038-e167-49f4-b653-c0edbf7c6cd9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.689166 Sep 01 05:02:29.943242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce4372e8-5668-4282-a773-69d5ae433008 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b" status: 200 len: 235 microversion: 2.64 time: 0.034630 Sep 01 05:02:29.944842 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1595/3193] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:29 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:29.945584 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1599/3194] 10.222.0.26 () {60 vars in 1304 bytes} [Thu Sep 1 05:02:29 2022] GET /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b => generated 235 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:02:29.971087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d089bd8-6ed0-425b-8d28-b110a90ee3e9 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:30.063773 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d089bd8-6ed0-425b-8d28-b110a90ee3e9 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b" status: 204 len: 0 microversion: 2.64 time: 0.109993 Sep 01 05:02:30.070834 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1596/3195] 10.222.0.26 () {60 vars in 1307 bytes} [Thu Sep 1 05:02:29 2022] DELETE /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:02:30.077738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba5714c0-d8c8-4581-ab89-e708fd78c224 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:30.092419 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ba5714c0-d8c8-4581-ab89-e708fd78c224 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] HTTP exception thrown: Instance group 6d10166b-dd8f-46fa-8f5c-2866f160f50b could not be found. Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba5714c0-d8c8-4581-ab89-e708fd78c224 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Request method failure captured: Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b HTTP/1.1 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDzgUWFHCPEZr8ARmaViQ4Mp_IXHyyGLlABK2xZ_KTgWYTEmdhUAkmUpcVKrk-sQuxlf_SP07uPI9IblZsc_SDT3g9KcZdAL-N3UWDm1GNlo1zsguBlaJZnxUOtajbiEDwb6tFsD6bHOU4FmEHHQLZyyMXP-nNnMKIc_0FUR1qyZHBk Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.64 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: faccf2ca014c4974bf6e78d5e5951391 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroup264TestJSON-1708144489 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/faccf2ca014c4974bf6e78d5e5951391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/faccf2ca014c4974bf6e78d5e5951391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_faccf2ca014c4974bf6e78d5e5951391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/faccf2ca014c4974bf6e78d5e5951391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroup264TestJSON-1708144489 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: faccf2ca014c4974bf6e78d5e5951391 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1708144489 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerGroup264TestJSON-1708144489-project Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: fd532eee94e145ee92b37dc543b13226 Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroup264TestJSON-1708144489-project Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance group 6d10166b-dd8f-46fa-8f5c-2866f160f50b could not be found. Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '6d10166b-dd8f-46fa-8f5c-2866f160f50b'} Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6d10166b-dd8f-46fa-8f5c-2866f160f50b could not be found. Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6d10166b-dd8f-46fa-8f5c-2866f160f50b could not be found. Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:30.115519 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6d10166b-dd8f-46fa-8f5c-2866f160f50b could not be found. Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba5714c0-d8c8-4581-ab89-e708fd78c224 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] Returning 404 to user: Instance group 6d10166b-dd8f-46fa-8f5c-2866f160f50b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba5714c0-d8c8-4581-ab89-e708fd78c224 tempest-ServerGroup264TestJSON-1708144489 tempest-ServerGroup264TestJSON-1708144489-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b" status: 404 len: 117 microversion: 2.64 time: 0.044780 Sep 01 05:02:30.121433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1600/3196] 10.222.0.26 () {60 vars in 1307 bytes} [Thu Sep 1 05:02:30 2022] DELETE /compute/v2.1/os-server-groups/6d10166b-dd8f-46fa-8f5c-2866f160f50b => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:02:30.164387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:30.171261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:30.204488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:30.207775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:30.214251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:30.217503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:30.222112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:30.225304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:30.405012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:30.405769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:30.434475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:30.436892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:30.437389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:30.438168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:30.441287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:30.441747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:31.310213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:31.342712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:31.354498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:31.356373 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b51529b8-03bd-4563-90cf-8866b9cfdc4b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1848 microversion: 2.42 time: 1.198408 Sep 01 05:02:31.358129 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1597/3197] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:30 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1848 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:31.375494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:31.376397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:31.385712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:31.386614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:31.387588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:31.388672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:31.389346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:31.389984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:31.438022 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 HTTP/1.1 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '45d57bc8-cbe9-4354-96a3-83553379e4b4'} Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:31.440477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:02:31.445850 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:02:31.447913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:02:31.449158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4dacb01f-78f0-41bd-9b3e-19b1b2f75f73 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 404 len: 111 microversion: 2.1 time: 0.089559 Sep 01 05:02:31.450488 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1598/3198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:31 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:02:31.458951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:31.460341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:31.469454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:31.470417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:31.471049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:31.472008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:31.472638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:31.473229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:32.148228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:32.199369 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14ca4065-f39b-4f19-a420-e3b871ffd8df tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.746705 Sep 01 05:02:32.200625 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1599/3199] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:31 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:32.208866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a48b75a2-b425-4c9f-8906-7720267d73b8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '.version_select at 0x7fa75b9438b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:32.271494 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a48b75a2-b425-4c9f-8906-7720267d73b8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325995022" status: 202 len: 0 microversion: 2.1 time: 0.067333 Sep 01 05:02:32.274644 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1600/3200] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325995022 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:02:32.283075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-02d3cdfe-9f60-4fbc-a0c4-66a55f45ff6c req-05a31a90-3868-47eb-a9ba-01f0ea12bffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "02b6b504-6c18-4e13-9d47-992ebe76b188"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:32.303534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:32.310852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02d3cdfe-9f60-4fbc-a0c4-66a55f45ff6c req-05a31a90-3868-47eb-a9ba-01f0ea12bffa service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:32.312050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02d3cdfe-9f60-4fbc-a0c4-66a55f45ff6c req-05a31a90-3868-47eb-a9ba-01f0ea12bffa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:32.313984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02d3cdfe-9f60-4fbc-a0c4-66a55f45ff6c req-05a31a90-3868-47eb-a9ba-01f0ea12bffa service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:32.329415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f95d5809-1a35-4fb2-be7e-3a9be8c08074 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.929294 Sep 01 05:02:32.330032 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1601/3201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:30 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:32.342709 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-02d3cdfe-9f60-4fbc-a0c4-66a55f45ff6c req-05a31a90-3868-47eb-a9ba-01f0ea12bffa service nova] Creating event network-changed:02b6b504-6c18-4e13-9d47-992ebe76b188 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:02:32.353877 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-02d3cdfe-9f60-4fbc-a0c4-66a55f45ff6c req-05a31a90-3868-47eb-a9ba-01f0ea12bffa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076964 Sep 01 05:02:32.360671 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1601/3202] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:32.389234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:32.391181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:32.402530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:32.409987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:32.411684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:32.414103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:32.415102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:32.415668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:32.418817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:33.225464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:33.227793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:33.241283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:33.242049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:33.242649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:33.243623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:33.244246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:33.244839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:33.579290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:33.604981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ec64ebf-f45d-4d3b-8c98-472dc64103ae tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.383790 Sep 01 05:02:33.606276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1602/3203] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:33 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:33.612441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:33.613437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:33.631290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:33.631706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:33.632152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:33.636888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:33.637380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:33.638110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:33.673545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:33.701648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:33.703414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:33.704652 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f58ae4a-24af-4765-8f93-598bf1403e0b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1848 microversion: 2.42 time: 1.322201 Sep 01 05:02:33.705231 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1602/3204] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:32 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1848 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:34.611279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:34.624518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b20f95c-b451-4671-92b0-1e353d4c0cab tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.015038 Sep 01 05:02:34.633397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:34.634342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:34.640600 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1603/3205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:33 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:34.653986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:34.657455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:34.658161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:34.659810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:34.661406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:34.662214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:34.732162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:34.733089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:34.752886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:34.760063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:34.762273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:34.765657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:34.766445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:34.768416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:35.048579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:35.079867 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c35e4d7f-a2ab-41b5-b496-037faa3af15f tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.450019 Sep 01 05:02:35.081099 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1603/3206] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:34 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:35.478672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:35.497651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:35.499206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:35.500995 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f82414a-35b2-47c7-a78d-955d504cb761 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1857 microversion: 2.42 time: 0.774456 Sep 01 05:02:35.504412 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1604/3207] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:34 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1857 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:35.652659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:35.653401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:35.673636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:35.674650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:35.676713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:35.683807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:35.685886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:35.688881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:36.110783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:36.111730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:36.126083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:36.137462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:36.140553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:36.142944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:36.145796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:36.148401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:36.545879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:36.567387 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a909a2ee-d144-4abb-9c44-edfccd0e4b7a tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.461418 Sep 01 05:02:36.580550 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1605/3208] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:36 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:36.595089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:36.595722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:36.603137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:36.603461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:36.604103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:36.604997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:36.605484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:36.606293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:37.021974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:37.038475 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75829c4b-6295-4d7c-bf20-83bb56833ea7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.395468 Sep 01 05:02:37.039660 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1604/3209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:35 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:37.045807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6ed2ec13-60a2-4126-8874-f89115ecb0ef req-0b93ba19-cad0-4928-97f4-66bb98a134ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "a4bac124-45b5-4944-b285-6c67626879ea"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:37.057949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ed2ec13-60a2-4126-8874-f89115ecb0ef req-0b93ba19-cad0-4928-97f4-66bb98a134ef service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:37.058746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ed2ec13-60a2-4126-8874-f89115ecb0ef req-0b93ba19-cad0-4928-97f4-66bb98a134ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:37.059687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ed2ec13-60a2-4126-8874-f89115ecb0ef req-0b93ba19-cad0-4928-97f4-66bb98a134ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:37.093092 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6ed2ec13-60a2-4126-8874-f89115ecb0ef req-0b93ba19-cad0-4928-97f4-66bb98a134ef service nova] Creating event network-changed:a4bac124-45b5-4944-b285-6c67626879ea for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:02:37.110184 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6ed2ec13-60a2-4126-8874-f89115ecb0ef req-0b93ba19-cad0-4928-97f4-66bb98a134ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059772 Sep 01 05:02:37.110924 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1605/3210] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:37.411697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:37.427907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:37.430027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:37.432198 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a59938ae-aea9-4c43-89d9-9d9cacd79161 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1857 microversion: 2.42 time: 0.849756 Sep 01 05:02:37.434276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1606/3211] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:36 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1857 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:37.597982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:37.598690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:37.614968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:37.615682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:37.616125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:37.616959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:37.617301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:37.617730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:37.894286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:37.936777 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6cea154a-ed0f-4106-9c3c-c5a5794c84f8 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.343031 Sep 01 05:02:37.954748 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1606/3212] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:37 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:38.062482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:38.063226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:38.073941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:38.077807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:38.081096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:38.084322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:38.084322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:38.088272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:38.211430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:38.224718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:38.225333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:38.252502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:38.253490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:38.254612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:38.257736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:38.262463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:38.265539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:38.436957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lazy-loading 'services' on Instance uuid 360af898-9d37-4f14-a30b-95e19c0d6e79 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:38.576894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6be6766-ef8c-450f-a431-c31c7c39dae0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments/362e5a1b-73f8-445e-bc91-b83b2e3aa8ee" status: 202 len: 0 microversion: 2.1 time: 0.356201 Sep 01 05:02:38.578300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1607/3213] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:02:38 2022] DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments/362e5a1b-73f8-445e-bc91-b83b2e3aa8ee => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:02:38.585660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:38.590145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:38.599302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:38.599801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:38.600234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:38.601110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:38.601560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:38.602717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:39.089235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:39.110430 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95329490-3b2a-4ffe-86d1-63b62907850b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.053276 Sep 01 05:02:39.111862 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1607/3214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:38 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:39.117493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:39.121699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:39.147605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:39.151187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:39.152103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:39.153392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:39.155481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:39.156157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:39.262594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40619e15-15b0-49fc-bc55-f06a23b88830 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140905 Sep 01 05:02:39.266826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:39.269489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1608/3215] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:39 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:39.276545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:39.277243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:39.285648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:39.286150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:39.287685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:39.288891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:39.289547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:39.290293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:39.296377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:39.299043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:39.301224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-efa1de80-6f0f-4bc9-a796-3a9d3e433610 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1857 microversion: 2.42 time: 0.721164 Sep 01 05:02:39.302997 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1608/3216] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:38 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1857 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:39.570606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:39.583009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:39.634385 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2aeb7dbe-1947-467c-9218-66b945c58071 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.362814 Sep 01 05:02:39.637704 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1609/3217] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:39 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:39.908069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0b2f79da-0caf-4723-a981-533dc6ca9504 req-812eed47-075b-4007-bb42-52c7e5b34cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "8ef9bc71-9cca-402d-bd69-f3f06cc051ec"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:39.938394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0b2f79da-0caf-4723-a981-533dc6ca9504 req-812eed47-075b-4007-bb42-52c7e5b34cd5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:39.939498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0b2f79da-0caf-4723-a981-533dc6ca9504 req-812eed47-075b-4007-bb42-52c7e5b34cd5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:39.940903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0b2f79da-0caf-4723-a981-533dc6ca9504 req-812eed47-075b-4007-bb42-52c7e5b34cd5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:39.992541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0b2f79da-0caf-4723-a981-533dc6ca9504 req-812eed47-075b-4007-bb42-52c7e5b34cd5 service nova] Creating event network-changed:8ef9bc71-9cca-402d-bd69-f3f06cc051ec for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:02:40.039464 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0b2f79da-0caf-4723-a981-533dc6ca9504 req-812eed47-075b-4007-bb42-52c7e5b34cd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137803 Sep 01 05:02:40.042029 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1609/3218] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:40.133096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:40.134221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:40.151780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:40.152596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:40.153061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:40.161049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:40.161884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:40.162540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:40.277373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:40.279960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:40.293229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:40.293971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:40.294419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:40.295178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:40.295643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:40.296072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:40.401492 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e2a3620-64ac-4f5e-8bc8-20119ce89d16 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128839 Sep 01 05:02:40.413737 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1610/3219] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:40 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:40.433070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:40.436760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:40.459110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:40.460055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:40.462947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:40.464674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:40.467604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:40.470568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:41.293277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:41.331213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80bcfc34-e179-45b1-a539-54a2a0be5e45 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.202385 Sep 01 05:02:41.338182 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1610/3220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:40 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:41.346605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:41.351550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:41.366002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:41.366554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:41.367021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:41.367873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:41.370683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:41.372316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:41.603144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:41.612066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:41.644848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6754eb9-7253-4278-afd0-9e2623a47a15 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.299593 Sep 01 05:02:41.645758 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1611/3221] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:41 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:41.657340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:41.666594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:41.670206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:41.672069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:41.674080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:41.674422 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4358441-3aad-4cbe-8699-b47d72552ed6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.259336 Sep 01 05:02:41.676038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:41.676847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:41.677279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1611/3222] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:40 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:41.678049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:41.678533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:41.679062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:41.733944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26a775f1-233b-43c9-9ddc-9f63f7d4dec7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085303 Sep 01 05:02:41.741488 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1612/3223] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:41 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:42.361629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:42.362240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:42.377686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:42.378041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:42.378480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:42.379227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:42.379686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:42.390260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:42.675292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:42.675914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:42.693917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:42.694415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:42.694850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:42.696821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:42.697552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:42.698192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:42.896230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:42.926754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-910ec2d6-e72f-49c4-8666-7b40c8224de9 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.254569 Sep 01 05:02:42.943103 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1613/3224] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:42 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:42.953871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:42.954778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:42.961816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:42.962566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:42.963251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:42.964161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:42.965308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:42.966660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:43.031695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:43.041076 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5d0680f-d5c4-40a9-8d50-76fa32c89990 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 0.683201 Sep 01 05:02:43.042261 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1612/3225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:42 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:43.047819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:43.050335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:43.068485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:43.069833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:43.070448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:43.071366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:43.072013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:43.072599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:43.118598 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c0d7ec2-1dfd-467b-a823-6cf852090b7c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074584 Sep 01 05:02:43.121521 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1613/3226] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:43 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:43.432521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:43.442711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:43.455172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:43.456768 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-662918e9-d790-4999-b2f3-76048508d0d5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.512249 Sep 01 05:02:43.457849 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1614/3227] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:42 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:43.808064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cc3b200a-cceb-460d-ab51-220e57c0c7ff req-efc86d40-e0fe-41e1-ba63-10a46bee178a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "fcbe2c69-ec2d-45ac-afa8-4f81e1107b90"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:43.825345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cc3b200a-cceb-460d-ab51-220e57c0c7ff req-efc86d40-e0fe-41e1-ba63-10a46bee178a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:43.828104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cc3b200a-cceb-460d-ab51-220e57c0c7ff req-efc86d40-e0fe-41e1-ba63-10a46bee178a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:43.831314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cc3b200a-cceb-460d-ab51-220e57c0c7ff req-efc86d40-e0fe-41e1-ba63-10a46bee178a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:43.856894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cc3b200a-cceb-460d-ab51-220e57c0c7ff req-efc86d40-e0fe-41e1-ba63-10a46bee178a service nova] Creating event network-changed:fcbe2c69-ec2d-45ac-afa8-4f81e1107b90 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:02:43.868543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cc3b200a-cceb-460d-ab51-220e57c0c7ff req-efc86d40-e0fe-41e1-ba63-10a46bee178a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065132 Sep 01 05:02:43.872699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1614/3228] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:43.957785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:43.959150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:43.978765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:43.989896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:43.990561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:43.991303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:43.994103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:43.996006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:43.996691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:44.063826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:44.064798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:44.081488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:44.082308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:44.082959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:44.087439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:44.088168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:44.090367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:44.095453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:44.255943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:44.309024 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f4bc186-3477-48fb-a22e-be214e7a70ac tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1929 microversion: 2.75 time: 0.355907 Sep 01 05:02:44.328489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1615/3229] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:43 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1929 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:44.338166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:44.340883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:44.348298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:44.349084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:44.349525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:44.350251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:44.350699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:44.351394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:44.388249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cad96ce6-7a47-41da-b852-3f75e6800fc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058292 Sep 01 05:02:44.394104 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1616/3230] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:44 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:44.482482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:44.483632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:44.494381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:44.495212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:44.495842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:44.496740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:44.497472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:44.498272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:45.913324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:45.930308 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ef7cfac-9133-4fb8-801c-d96c25e1e1ba tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.869212 Sep 01 05:02:45.932332 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1615/3231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:44 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:45.937133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:45.937753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:45.969953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:45.970460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:45.970460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:45.971639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:45.972652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:45.979446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:46.242117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:46.292768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:46.306951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ed1cf72-6171-45b5-8dd5-d015211a3d62 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1935 microversion: 2.75 time: 0.373430 Sep 01 05:02:46.309535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1616/3232] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:45 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1935 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:46.317189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:46.319874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:46.326072 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fc8eb80-a39f-43bd-88a7-990133eda8d3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.843739 Sep 01 05:02:46.328513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:46.333903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:46.348086 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1617/3233] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:44 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:46.349120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:46.349879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:46.351812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:46.353925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:46.354778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:46.355516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:46.398363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ece73a64-3cd9-4a32-8828-6616bf50c6f6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085367 Sep 01 05:02:46.399204 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1617/3234] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:46 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:46.958317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:46.959075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:46.970151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:46.974801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:46.976032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:46.976919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:46.979501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:46.980056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.338731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:47.339517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:47.351465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.358525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.359187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.360567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.361056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.364085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.480096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:47.497544 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03681b18-25e4-4ebd-b547-43e62e453c5d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 0.544046 Sep 01 05:02:47.513327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1618/3235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:46 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:47.543397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:47.545731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:47.551089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:47.578790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.579227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.579639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.580548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.581169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.581755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.596278 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60acc8ab-48c2-4334-8ced-6e1f8549a390 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1935 microversion: 2.75 time: 0.262405 Sep 01 05:02:47.600479 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1618/3236] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:47 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1935 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:02:47.615103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:47.618634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:47.633051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.634487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.635671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.637833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.638552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.640636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.736219 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d42225e5-7c8d-4fc5-affa-a7067af4253b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133389 Sep 01 05:02:47.737556 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1619/3237] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:02:47 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:02:47.814734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ae341e69-2c33-41b3-bcd2-da76d235ffe4 req-e3270c9a-f368-4772-a7d6-ed33263a27ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "c07a473c-435b-4a82-9cec-ed1e4ee32c70"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:47.844354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ae341e69-2c33-41b3-bcd2-da76d235ffe4 req-e3270c9a-f368-4772-a7d6-ed33263a27ea service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.846873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ae341e69-2c33-41b3-bcd2-da76d235ffe4 req-e3270c9a-f368-4772-a7d6-ed33263a27ea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.847472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ae341e69-2c33-41b3-bcd2-da76d235ffe4 req-e3270c9a-f368-4772-a7d6-ed33263a27ea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.875220 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ae341e69-2c33-41b3-bcd2-da76d235ffe4 req-e3270c9a-f368-4772-a7d6-ed33263a27ea service nova] Creating event network-changed:c07a473c-435b-4a82-9cec-ed1e4ee32c70 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:02:47.897830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ae341e69-2c33-41b3-bcd2-da76d235ffe4 req-e3270c9a-f368-4772-a7d6-ed33263a27ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117044 Sep 01 05:02:47.898457 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1620/3238] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:47.906851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:47.907818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:47.932343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.933132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.933577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.934328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:47.934806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:47.943784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:47.982432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:02:48.251205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16d55740-7cea-453e-ba5e-ed67d757af9c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 204 len: 0 microversion: 2.1 time: 0.348114 Sep 01 05:02:48.255857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1621/3239] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:02:47 2022] DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:02:48.273150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:48.275958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:48.300063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:48.303246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:48.304403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:48.306510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:48.307145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:48.309262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:48.594427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:48.620857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:48.625567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:48.626849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5c5bb07-ff6f-4d90-82bc-6133f11fa58d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.110997 Sep 01 05:02:48.632378 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1619/3240] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:47 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:48.656489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:48.656489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:48.666683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:48.667696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:48.667696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:48.673556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:48.674018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:48.674485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:49.160186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:49.177058 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32395d08-132f-40d8-9a85-f1744dd5eee9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1683 microversion: 2.1 time: 0.918230 Sep 01 05:02:49.178418 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1622/3241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:48 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1683 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:49.187553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:49.189820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:49.208314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:49.208606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:49.208944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:49.209653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:49.210113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:49.210528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:49.504591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:49.546986 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e3280c6-8110-4c67-b067-8c82f73bcf40 tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1935 microversion: 2.75 time: 0.367111 Sep 01 05:02:49.548540 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1623/3242] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:49 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1935 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:49.658990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:49.661118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:49.680677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:49.681542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:49.683450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:49.684726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:49.687585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:49.688430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:49.801309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:49.810122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-000164bf-2cb9-4af9-8ebb-b2f348fa872d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 1.175042 Sep 01 05:02:49.812107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1620/3243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:48 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:50.207227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:50.207227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:50.212417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:50.212915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:50.213356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:50.214088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:50.214551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:50.217581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:50.953366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:50.968307 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93209d3c-c751-430c-9cdd-6bc511c2dc4a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1683 microversion: 2.1 time: 0.769227 Sep 01 05:02:50.970155 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1621/3244] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:50 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1683 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:02:51.013684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:51.038904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:51.043985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:51.047813 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52882773-ddb3-4447-b54a-501fe03b67b4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.395077 Sep 01 05:02:51.050946 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1624/3245] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:49 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:51.077849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:51.083444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:51.095974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:51.099476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:51.101237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:51.102955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:51.105364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:51.107059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:51.407798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] Lazy-loading 'services' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:51.448364 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96523327-03cc-4757-b6cc-aeacd06868ca tempest-ServersAdmin275Test-597273752 tempest-ServersAdmin275Test-597273752-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1920 microversion: 2.75 time: 0.396017 Sep 01 05:02:51.448959 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1625/3246] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:51 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1920 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:51.459446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:51.460488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:51.478347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:51.480775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:51.485192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:51.486151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:51.486715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:51.487320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:51.581770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1899707667", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:51.666216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] validate_networks() for [('b759c36e-f7d8-44ac-a2b7-b10948466f71', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:02:52.120569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:52.128744 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1906cd70-ad92-4038-ae2a-ebbdada1ae52 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1511 microversion: 2.1 time: 0.678484 Sep 01 05:02:52.146726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1626/3247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:51 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1511 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:52.158294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:52.158795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:52.171657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:52.172152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:52.172687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:52.176542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:52.177076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:52.177530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:52.225626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:02:52.339843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:52.457519 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d112f4d2-106a-4cb7-9e47-0d2bef655916 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 204 len: 0 microversion: 2.75 time: 0.309544 Sep 01 05:02:52.458125 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1627/3248] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:02:52 2022] DELETE /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:02:52.463357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:52.464065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:52.492415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:52.493419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:52.505654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:52.509258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:52.510960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:52.511896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:53.390800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:53.399691 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-765fc698-80b6-4244-a7ff-9097ceca45cd tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1683 microversion: 2.1 time: 0.940342 Sep 01 05:02:53.406806 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1628/3249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:52 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1683 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:53.412676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:53.431660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:53.458654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:53.462596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:53.466140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:53.470321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:53.470845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:53.472692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:55.264251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:55.303921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:55.307143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:55.325807 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8097c153-999d-42a6-893c-2ba84ddc8e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.916535 Sep 01 05:02:55.326651 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1629/3250] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:53 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:55.348443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:55.349125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:55.413091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:55.413937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:55.414692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:55.415864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:55.416659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:55.417345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:55.526641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:02:55.527973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:02:55.530241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:02:55.530828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:02:55.531647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:02:55.550537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:55.551106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:55.551906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:55.553014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:55.553516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:55.554176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:55.639559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:02:55.640327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:55.641138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:55.641844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:55.655500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lazy-loading 'fault' on Instance uuid 57d2d75f-7429-4ef7-8322-c17137111908 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:02:55.661958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for user 3908868db8e340f2b24025c148fd3d40 and project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:02:55.732725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:02:55.754962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:02:55.920019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:55.961232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49f4beec-716c-435a-b46b-fe01457a2bed tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.989937 Sep 01 05:02:55.963222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1622/3251] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:02:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 4992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:02:55.970046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-63f0b63f-3bdb-448d-8391-ec42d8dc630e req-93512139-0fc8-4183-b5d5-9a9a3d968c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "fee31787-083d-4363-9ccf-f1cca229253f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:55.977398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:55.979602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b926c8e9b57e4025a64203fc624cffc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fb1c35dc691425cb6112b162132bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:55.987984 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29aa2f13-97ab-4740-ac76-f5dfb4dfea57 tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 200 len: 1448 microversion: 2.75 time: 0.659786 Sep 01 05:02:55.990440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-63f0b63f-3bdb-448d-8391-ec42d8dc630e req-93512139-0fc8-4183-b5d5-9a9a3d968c0e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:55.991151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-63f0b63f-3bdb-448d-8391-ec42d8dc630e req-93512139-0fc8-4183-b5d5-9a9a3d968c0e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:55.991879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-63f0b63f-3bdb-448d-8391-ec42d8dc630e req-93512139-0fc8-4183-b5d5-9a9a3d968c0e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:56.004907 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1630/3252] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:55 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 1448 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:56.015213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:56.016214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:56.025787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-63f0b63f-3bdb-448d-8391-ec42d8dc630e req-93512139-0fc8-4183-b5d5-9a9a3d968c0e service nova] Creating event network-changed:fee31787-083d-4363-9ccf-f1cca229253f for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:02:56.026616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:56.027460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:56.028131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:56.029273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:56.030106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:56.031122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:56.036737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-63f0b63f-3bdb-448d-8391-ec42d8dc630e req-93512139-0fc8-4183-b5d5-9a9a3d968c0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071195 Sep 01 05:02:56.038145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1623/3253] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:56.061771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:56.068340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:56.079326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:56.080431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:56.081222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:56.082322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:56.083122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:56.083798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:56.464974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:56.484749 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05f7b63d-a346-4516-bac0-6d84f665d44a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1615 microversion: 2.1 time: 0.443334 Sep 01 05:02:56.487973 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1624/3254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:56 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1615 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:56.504116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13451c96-ae49-4fa8-8810-72dc3d2b2e60 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:56.508814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13451c96-ae49-4fa8-8810-72dc3d2b2e60 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:56.691610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13451c96-ae49-4fa8-8810-72dc3d2b2e60 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:56.722094 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13451c96-ae49-4fa8-8810-72dc3d2b2e60 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1222 microversion: 2.1 time: 0.231224 Sep 01 05:02:56.726771 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1625/3255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:56 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:56.740626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:56.743921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:56.798831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:56.799734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:56.801270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:56.803946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:56.805431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:56.807217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:57.683435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:57.729484 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a347125d-2bae-46e7-b567-90a624332d67 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1488 microversion: 2.1 time: 1.723519 Sep 01 05:02:57.732962 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1631/3256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:56 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1488 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:57.745222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:57.745954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] [instance: 57d2d75f-7429-4ef7-8322-c17137111908] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:57.755001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:57.755780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:57.756460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:57.757382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:57.758042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:57.758737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:57.782483 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] HTTP exception thrown: Instance 57d2d75f-7429-4ef7-8322-c17137111908 could not be found. Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Request method failure captured: Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 HTTP/1.1 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDyoonXi4S91wivNRAr8AXqWWutARyubccF0wuvrHw5Tq4olsa9mna6h0MMoYh6ix-NutcNj1VxKToMyubgsmEsO9EBbkBBB1QctnwvXA4CPsgpUYps6V5Y2bElM32FZ2awOvFUlaew7M8Ta-RUdpYMDd6S8ALjPA1Y0uSaevvfzSeA Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.75 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 7fb1c35dc691425cb6112b162132bddf Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdmin275Test-1577200165 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fb1c35dc691425cb6112b162132bddf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7fb1c35dc691425cb6112b162132bddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7fb1c35dc691425cb6112b162132bddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7fb1c35dc691425cb6112b162132bddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdmin275Test-1577200165 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 7fb1c35dc691425cb6112b162132bddf Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdmin275Test-1577200165 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdmin275Test-1577200165-project Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b926c8e9b57e4025a64203fc624cffc1 Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdmin275Test-1577200165-project Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 57d2d75f-7429-4ef7-8322-c17137111908 could not be found. Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '57d2d75f-7429-4ef7-8322-c17137111908'} Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d2d75f-7429-4ef7-8322-c17137111908 could not be found. Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d2d75f-7429-4ef7-8322-c17137111908 could not be found. Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:02:57.784813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d2d75f-7429-4ef7-8322-c17137111908 could not be found. Sep 01 05:02:57.790867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:02:57.793009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] Returning 404 to user: Instance 57d2d75f-7429-4ef7-8322-c17137111908 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:02:57.794726 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05ad8b73-a503-495d-8da8-021944cc54cc tempest-ServersAdmin275Test-1577200165 tempest-ServersAdmin275Test-1577200165-project] 10.222.0.26 "GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908" status: 404 len: 111 microversion: 2.75 time: 0.059328 Sep 01 05:02:57.795695 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1632/3257] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:57 2022] GET /compute/v2.1/servers/57d2d75f-7429-4ef7-8322-c17137111908 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:02:57.799904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:57.808632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-769910421", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:57.816341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:57.820849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:57.822100 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df2757c4-4e6e-409b-846c-feac627e5855 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.093819 Sep 01 05:02:57.825922 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1626/3258] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:56 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:02:57.838856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:57.841791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:57.858986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:57.861164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:57.862443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:57.864298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:57.869524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:57.870699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:57.944774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] validate_networks() for [('b759c36e-f7d8-44ac-a2b7-b10948466f71', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:02:58.177575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:58.187670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:58.193215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1911b083-a5f8-43df-943c-f6925330e2e5 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 200 len: 1615 microversion: 2.1 time: 0.366136 Sep 01 05:02:58.196758 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1627/3259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:57 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 1615 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:58.211735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:58.212568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:58.233902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:58.238023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:58.238471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:58.239759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:58.239759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:58.242194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:58.338173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:02:58.466028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0656cfa-d493-4d99-941d-1a05b0112435 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 204 len: 0 microversion: 2.1 time: 0.265533 Sep 01 05:02:58.469217 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1628/3260] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:02:58 2022] DELETE /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:02:58.481456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-abd7ec38-ccae-4c30-965e-4512fa8f4c95 req-2de79d85-7e59-49a1-87e4-8e960835a013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360af898-9d37-4f14-a30b-95e19c0d6e79", "name": "network-vif-deleted", "tag": "76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:02:58.496219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-abd7ec38-ccae-4c30-965e-4512fa8f4c95 req-2de79d85-7e59-49a1-87e4-8e960835a013 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:58.497499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-abd7ec38-ccae-4c30-965e-4512fa8f4c95 req-2de79d85-7e59-49a1-87e4-8e960835a013 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:58.498125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-abd7ec38-ccae-4c30-965e-4512fa8f4c95 req-2de79d85-7e59-49a1-87e4-8e960835a013 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:58.513293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-abd7ec38-ccae-4c30-965e-4512fa8f4c95 req-2de79d85-7e59-49a1-87e4-8e960835a013 service nova] Creating event network-vif-deleted:76f5903c-8c5b-4d9d-aba9-0f8ea8af55cd for instance 360af898-9d37-4f14-a30b-95e19c0d6e79 on n-h2-820368-37 Sep 01 05:02:58.519900 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-abd7ec38-ccae-4c30-965e-4512fa8f4c95 req-2de79d85-7e59-49a1-87e4-8e960835a013 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047925 Sep 01 05:02:58.520939 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1629/3261] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:02:58.530130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:58.531288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:58.542289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:58.543068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:58.544016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:58.545731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:58.547646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:58.548383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:59.220323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:02:59.233837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0edaf1e-ef87-42dd-b8ea-5f447f8b85a0 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1494 microversion: 2.1 time: 0.710832 Sep 01 05:02:59.234984 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1630/3262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:02:58 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1494 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:02:59.253242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:02:59.254136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:02:59.265942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:59.266913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:59.267796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:02:59.269044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:02:59.269875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:02:59.270784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.053015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:01.068496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:01.078168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:01.079860 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6dd45df-9b68-4c1f-8351-06951194678a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.843494 Sep 01 05:03:01.084898 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1631/3263] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:02:59 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:01.092146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:01.097601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:01.111268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.117587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.125124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.127682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.135187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.136026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.159060 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 HTTP/1.1 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '360af898-9d37-4f14-a30b-95e19c0d6e79'} Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:01.161234 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:03:01.166918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:01.168528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:01.169659 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00b42510-b01d-4a4d-b965-7b566b4d3df6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 404 len: 111 microversion: 2.1 time: 0.082028 Sep 01 05:03:01.170996 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1632/3264] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:01 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:01.177834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:01.178918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:01.186028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.186819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.187510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.188397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.189090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.189709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.479444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:03:01.486855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:03:01.487603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:03:01.488123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:03:01.488977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:03:01.522756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.527800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.528794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.531860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.532967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.534846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.619467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:03:01.659338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for user 3908868db8e340f2b24025c148fd3d40 and project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:03:01.744222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:01.758352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:03:01.765004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:03:01.944864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c9450aa-4f08-44f9-ac1f-6b35fa182cd7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.138876 Sep 01 05:03:01.948704 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1633/3265] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:02:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:03:01.956657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-993fd9af-3ea9-41d2-8eab-bb169c407772 req-51e56eb1-9606-46d1-b298-bf3f10e21d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "80612bef-94e4-4a55-8de5-db8e954f58a5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:01.977732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-993fd9af-3ea9-41d2-8eab-bb169c407772 req-51e56eb1-9606-46d1-b298-bf3f10e21d49 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:01.978628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-993fd9af-3ea9-41d2-8eab-bb169c407772 req-51e56eb1-9606-46d1-b298-bf3f10e21d49 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:01.979317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-993fd9af-3ea9-41d2-8eab-bb169c407772 req-51e56eb1-9606-46d1-b298-bf3f10e21d49 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:01.997888 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-993fd9af-3ea9-41d2-8eab-bb169c407772 req-51e56eb1-9606-46d1-b298-bf3f10e21d49 service nova] Creating event network-changed:80612bef-94e4-4a55-8de5-db8e954f58a5 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:02.008281 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-993fd9af-3ea9-41d2-8eab-bb169c407772 req-51e56eb1-9606-46d1-b298-bf3f10e21d49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056626 Sep 01 05:03:02.015063 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1634/3266] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:02.026995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d65e26b-690f-4ebb-8e6a-a1f509066887 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '.version_select at 0x7fa75b3b3ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:02.103689 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d65e26b-690f-4ebb-8e6a-a1f509066887 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758477392" status: 202 len: 0 microversion: 2.1 time: 0.086683 Sep 01 05:03:02.108473 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1635/3267] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758477392 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:03:02.120765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8aa8cbe6-00db-448c-9d5a-f162bfab4baf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:02.122528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8aa8cbe6-00db-448c-9d5a-f162bfab4baf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:02.375967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aa8cbe6-00db-448c-9d5a-f162bfab4baf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:02.393319 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8aa8cbe6-00db-448c-9d5a-f162bfab4baf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1221 microversion: 2.1 time: 0.277054 Sep 01 05:03:02.410536 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1636/3268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:02 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1221 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:02.418584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:02.427020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:02.439361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:02.440430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:02.441110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:02.444449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:02.445271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:02.445824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:02.821433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:02.850482 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba5fb64f-1925-46ed-aadb-978b9f3a3e4d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1494 microversion: 2.1 time: 1.667292 Sep 01 05:03:02.857190 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1633/3269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:01 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1494 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:03.280555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:03.295337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:03.296797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:03.298014 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1745253-6ca3-43ee-95bb-0f0d76ca9a57 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.886098 Sep 01 05:03:03.298604 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1637/3270] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:02 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:03.416991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:03.417630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:03.434382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:03.435746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:03.438374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:03.439245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:03.439732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:03.440173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:03.861136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:03.878715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:03.879362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:03.879738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cb0c009-dfb3-4b44-ad28-48e35e7a6aef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1273 microversion: 2.1 time: 0.466736 Sep 01 05:03:03.893483 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1634/3271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:03 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:03.893893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:03.893893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:03.893893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:03.893893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:03.893893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:03.893893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:04.325569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:04.326259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:04.342299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:04.346306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:04.346975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:04.348782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:04.350825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:04.352167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:04.394872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:04.410129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ebb419d-a4c3-448a-9dee-0341efab0728 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 200 len: 1452 microversion: 2.1 time: 0.533220 Sep 01 05:03:04.419996 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1638/3272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:03 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 1452 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:04.639163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e3267d0a-e35c-49fd-8088-e6237536d668 req-28235a19-388e-4624-ac44-eb5d326e17de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de0f57df-c4be-4fe7-aef3-2bf23bb3000e", "name": "network-vif-deleted", "tag": "e311eac6-6d26-4a3b-bbfe-83331c55499b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:04.665338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3267d0a-e35c-49fd-8088-e6237536d668 req-28235a19-388e-4624-ac44-eb5d326e17de service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:04.666082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3267d0a-e35c-49fd-8088-e6237536d668 req-28235a19-388e-4624-ac44-eb5d326e17de service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:04.666762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3267d0a-e35c-49fd-8088-e6237536d668 req-28235a19-388e-4624-ac44-eb5d326e17de service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:04.683834 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e3267d0a-e35c-49fd-8088-e6237536d668 req-28235a19-388e-4624-ac44-eb5d326e17de service nova] Creating event network-vif-deleted:e311eac6-6d26-4a3b-bbfe-83331c55499b for instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e on n-h1-820368-37 Sep 01 05:03:04.691568 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e3267d0a-e35c-49fd-8088-e6237536d668 req-28235a19-388e-4624-ac44-eb5d326e17de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060461 Sep 01 05:03:04.693069 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1639/3273] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:03:04.904859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:04.906026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:04.922800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:04.925568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:04.927052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:04.928608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:04.930005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:04.932508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:05.595881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:05.960526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:05.972996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-994d271e-cd25-4e0c-b6f3-1186a0e6c880 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1279 microversion: 2.1 time: 1.074010 Sep 01 05:03:05.974173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1640/3274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:04 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1279 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:05.984807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:05.987824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:06.009271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:06.013060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:06.018567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:06.019575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:06.020218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:06.020810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:06.054823 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e HTTP/1.1 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'de0f57df-c4be-4fe7-aef3-2bf23bb3000e'} Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:06.057508 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:06.062105 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:06.064071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:06.068135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-feb4182e-6d2b-402e-8ae3-359d6677e09d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 404 len: 111 microversion: 2.1 time: 0.092936 Sep 01 05:03:06.069432 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1641/3275] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:05 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:06.328671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-975057564", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "26efcc6d-9b04-4cad-a136-216393ada266"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:06.330299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:06.352093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:06.357930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:06.362148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f228e5c-4ca0-4560-893e-5288324d50c4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 2.040507 Sep 01 05:03:06.364218 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1635/3276] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:04 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:06.417686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] validate_networks() for [('26efcc6d-9b04-4cad-a136-216393ada266', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:03:06.599660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1756806094", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:06.685080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:03:06.685508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:03:06.685990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:03:06.686399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:03:06.687199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:03:06.696706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:06.697192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:06.697625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:06.698341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:06.698789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:06.699262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:06.721842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Getting quotas for project 9e66054828e3466ca084b41f5fce2faf. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:03:06.728820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Getting quotas for user ec044413e1914e44b0839aa7c901d614 and project 9e66054828e3466ca084b41f5fce2faf. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:03:06.746618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:03:06.752698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:03:06.829237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e80d5e24-cd71-4734-92ac-d34768dfc0f5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.411564 Sep 01 05:03:06.830337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1636/3277] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 05:03:06.846770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-765d9d0e-9fc4-4bf9-9bd4-50592efa0958 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:06.850315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-765d9d0e-9fc4-4bf9-9bd4-50592efa0958 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:07.155307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-765d9d0e-9fc4-4bf9-9bd4-50592efa0958 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:07.169988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-765d9d0e-9fc4-4bf9-9bd4-50592efa0958 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:07.179493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-765d9d0e-9fc4-4bf9-9bd4-50592efa0958 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:07.207227 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-765d9d0e-9fc4-4bf9-9bd4-50592efa0958 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1454 microversion: 2.91 time: 0.365046 Sep 01 05:03:07.210454 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1637/3278] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:06 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1454 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:07.238039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:07.239625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:07.259341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:07.261750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:07.262452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:07.263437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:07.264087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:07.264692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:07.957671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:07.966909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ddb53e42-990e-4d5b-b255-114e57cf749e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 0.753621 Sep 01 05:03:07.978909 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1638/3279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:07 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:07.978909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:07.978909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:07.980499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:07.981399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:07.982073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:07.983227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:07.983917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:07.984601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:08.711753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:08.764694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:08.768502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:08.773299 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-212979db-65ad-472f-955a-a842329082d6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.803760 Sep 01 05:03:08.774412 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1639/3280] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:07 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:08.813318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bb44093b-ed3b-4b01-ad92-54fe85fb4d37 req-1ab34dee-4203-41a9-9512-4f27266cb1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e6c322-8878-4d61-b782-6adb266189dd", "tag": "281863a5-4cf6-4485-9da1-8a963f174461"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:08.856338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb44093b-ed3b-4b01-ad92-54fe85fb4d37 req-1ab34dee-4203-41a9-9512-4f27266cb1d0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:08.860245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb44093b-ed3b-4b01-ad92-54fe85fb4d37 req-1ab34dee-4203-41a9-9512-4f27266cb1d0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:08.861420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb44093b-ed3b-4b01-ad92-54fe85fb4d37 req-1ab34dee-4203-41a9-9512-4f27266cb1d0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:08.893087 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bb44093b-ed3b-4b01-ad92-54fe85fb4d37 req-1ab34dee-4203-41a9-9512-4f27266cb1d0 service nova] Creating event network-changed:281863a5-4cf6-4485-9da1-8a963f174461 for instance 93e6c322-8878-4d61-b782-6adb266189dd on n-h2-820368-37 Sep 01 05:03:08.906867 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bb44093b-ed3b-4b01-ad92-54fe85fb4d37 req-1ab34dee-4203-41a9-9512-4f27266cb1d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114318 Sep 01 05:03:08.911720 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1640/3281] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:08.925827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b014482f-7271-42e0-8f07-9e09e4a4f70d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: .version_select at 0x7fa75bd6f160>, body: {"keypair": {"name": "tempest-keypair-838459883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlYl8lZ5j6ys9jK86PL+op6uMqE37PCimq2dDaNFj9zN6doaq/Z5NHpQH9YBAF/AZpVIQbRDg5nVrizGjTqjIvEEykP4L76chwCPYfGeC9ZBINRBeK0qiJMzWIsHHUg3w=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:08.963220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b014482f-7271-42e0-8f07-9e09e4a4f70d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:03:08.984084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b014482f-7271-42e0-8f07-9e09e4a4f70d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:03:08.992874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:09.052726 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b014482f-7271-42e0-8f07-9e09e4a4f70d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138664 Sep 01 05:03:09.060511 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1641/3282] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:03:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:09.063389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:09.064065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:09.082207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:09.083176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:09.083995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:09.086240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:09.087539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:09.088178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:09.336959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:03:09.336959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:03:09.336959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:03:09.337616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:03:09.338551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:03:09.350078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:09.350798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:09.352462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:09.353443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:09.353920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:09.354359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:09.382000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:03:09.391622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Getting quotas for user 13fb72fe72dc4d829030d73ac0cd7e5b and project 4ca194d8b2844794b9865963e05753b5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:03:09.409449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:03:09.413257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:03:09.475394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:09.496085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:09.502007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:09.502754 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d60c194-a786-4c4b-a6da-0e9a006d6898 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.178344 Sep 01 05:03:09.504933 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1642/3283] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:03:09.515910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:09.517592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:09.523029 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c11a5985-a180-4300-bcf3-e24ec0e5e882 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1512 microversion: 2.91 time: 0.468043 Sep 01 05:03:09.524417 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1642/3284] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:09 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:09.529179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:09.530166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:09.530623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:09.545738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:09.551081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:09.551391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:10.023840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1b2b0b5a-10ec-41ce-b6f8-e54729983288 req-c6f17f50-b669-40bd-b9b2-ef6876963743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c448560-5b05-4bef-bb1a-bb8986beef90", "tag": "41bc75f2-503b-4e11-b063-b2499d2f4f7e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:10.029640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.037076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1b2b0b5a-10ec-41ce-b6f8-e54729983288 req-c6f17f50-b669-40bd-b9b2-ef6876963743 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:10.037632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1b2b0b5a-10ec-41ce-b6f8-e54729983288 req-c6f17f50-b669-40bd-b9b2-ef6876963743 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:10.038076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1b2b0b5a-10ec-41ce-b6f8-e54729983288 req-c6f17f50-b669-40bd-b9b2-ef6876963743 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:10.038864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22bbe92f-931a-4534-98e5-857a8dac996e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 0.532840 Sep 01 05:03:10.039640 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1643/3285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:09 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:10.053047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-853fc985-637a-4726-9950-205b62642305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:10.053047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-853fc985-637a-4726-9950-205b62642305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:10.077158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1b2b0b5a-10ec-41ce-b6f8-e54729983288 req-c6f17f50-b669-40bd-b9b2-ef6876963743 service nova] Creating event network-changed:41bc75f2-503b-4e11-b063-b2499d2f4f7e for instance 6c448560-5b05-4bef-bb1a-bb8986beef90 on n-h2-820368-37 Sep 01 05:03:10.084141 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1b2b0b5a-10ec-41ce-b6f8-e54729983288 req-c6f17f50-b669-40bd-b9b2-ef6876963743 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556908 Sep 01 05:03:10.085325 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1643/3286] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:10.096642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:10.097767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:10.109568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:10.111590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:10.112342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:10.113630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:10.114448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:10.115367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:10.225990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-853fc985-637a-4726-9950-205b62642305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.237415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-853fc985-637a-4726-9950-205b62642305 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1214 microversion: 2.1 time: 0.196814 Sep 01 05:03:10.238695 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1644/3287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:10 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:10.554229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:10.556100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:10.569573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:10.570712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:10.571470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:10.572574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:10.573504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:10.574639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:10.729508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.745202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.747122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.761589 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12187894-0058-4dbe-ba09-4a7e8afe606d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1533 microversion: 2.91 time: 0.211518 Sep 01 05:03:10.790467 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1645/3288] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:10 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1533 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:10.801081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.817154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.823072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:10.826511 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77117a5b-e0ca-45bf-a2bd-2a8bc1febd6b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.739704 Sep 01 05:03:10.827938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1644/3289] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:10 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:11.062836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:11.063767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:11.078179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.079013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.079469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.084029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.084658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.085706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.224581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:11.225453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:11.236921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.238433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.239526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.254221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.255311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.255934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.411435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lazy-loading 'services' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:11.473961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6074bba-da49-4b46-bbb2-4461eb7e2135 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1940 microversion: 2.91 time: 0.679597 Sep 01 05:03:11.477688 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1646/3290] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:10 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1940 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:11.500665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:11.505257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:11.525099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.527987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.529048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.531259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.532603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.536517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.574581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:11.586160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-814780ec-14c7-46f0-845a-7a96c6e78f5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 0.526755 Sep 01 05:03:11.587223 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1645/3291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:11 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:11.602699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:11.603365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:11.624683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.625170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.628753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.629691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.630448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.640845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.810453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:11.827198 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea4c1ced-e3fe-42f3-bd35-de3c9cf0cf35 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1218 microversion: 2.1 time: 0.341480 Sep 01 05:03:11.829738 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1647/3292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:11 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:11.852584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:11.853818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:11.868403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.872155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.874346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.877373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.878829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.882021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.901273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lazy-loading 'services' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:11.944990 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a31a9cd8-7a21-402c-87b7-4977f55242e0 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1940 microversion: 2.91 time: 0.356643 Sep 01 05:03:11.955284 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1646/3293] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:11 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1940 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:11.972910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:11.977744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.987815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.988543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:11.989577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:11.990210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:11.990921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:12.046292 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-067443b6-8d37-46ec-949d-47c5d4eb9290 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.076906 Sep 01 05:03:12.047553 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1647/3294] 10.222.0.26 () {60 vars in 1217 bytes} [Thu Sep 1 05:03:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:03:12.070432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:12.071671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:12.080034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:12.080798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:12.081505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:12.082470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:12.083221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:12.085389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:12.115386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:12.140409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lazy-loading 'flavor' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:12.564647 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fff176cc-97ae-4354-bb03-b700cd1615c6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action" status: 202 len: 0 microversion: 2.91 time: 0.508165 Sep 01 05:03:12.565639 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1648/3295] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:03:12 2022] POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:03:12.584564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:12.585290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:12.616868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:12.617977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:12.618800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:12.619839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:12.621604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:12.624389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:12.947357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:12.963354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:12.965248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:12.973994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-584b3464-3733-496a-a4f1-463257387cf2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.403219 Sep 01 05:03:12.976176 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1649/3296] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:12 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:12.991608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:12.992467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:13.003698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:13.006314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:13.008286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:13.009254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:13.012139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:13.012788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:13.811500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:13.827770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:13.834038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:13.845827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7739527b-89cd-434b-9942-468f027a7982 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.997010 Sep 01 05:03:13.847758 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1648/3297] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:11 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:13.856309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:13.857248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:13.866681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:13.867540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:13.868295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:13.869436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:13.870061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:13.870620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:13.983231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:14.008138 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1525062a-3e00-4543-a185-2d22f5e472b1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1272 microversion: 2.1 time: 0.156246 Sep 01 05:03:14.016177 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1649/3298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:13 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:14.027598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:14.032718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:14.033333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:14.040543 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c58e53c-1e9a-4636-9744-5bfce23ba2bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 1.052928 Sep 01 05:03:14.055336 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1650/3299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:12 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:14.066482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:14.070651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:14.073935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:14.075318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:14.076005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:14.077426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:14.253441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1391583008", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9642a39a-f472-4737-aec3-d2f3e852c183"}], "security_groups": [{"name": "tempest-securitygroup--573244386"}], "key_name": "tempest-keypair-838459883", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:14.685947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:14.691147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:14.698445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:14.701321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:14.708750 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-828fcde9-47c1-4667-8f9b-3a6b8bb44eb2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.680066 Sep 01 05:03:14.709708 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1650/3300] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:14 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:14.873301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:14.877208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:14.878355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] validate_networks() for [('9642a39a-f472-4737-aec3-d2f3e852c183', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:03:14.890966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:14.899341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:14.899904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:14.901898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:14.904313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:14.904894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:15.593172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:15.605505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:15.609620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:15.611111 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59d7a6f0-d3ca-4a3f-b77b-458a323c3b3e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.746510 Sep 01 05:03:15.612339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1651/3301] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:14 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:15.617152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:15.618144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:15.626813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:15.627815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:15.628620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:15.629638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:15.630404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:15.631179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:15.941577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:15.950663 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-577dece5-e17f-482f-952c-7386fce54b7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1272 microversion: 2.1 time: 0.337008 Sep 01 05:03:15.951653 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1652/3302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:15 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:15.957860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:15.958813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:15.965185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:15.966127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:15.966745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:15.967493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:15.967942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:15.968363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.325067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:17.337540 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edf8533a-30d5-4ee7-8a32-faa13049d0c5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 1.384446 Sep 01 05:03:17.338148 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1653/3303] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:15 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:17.342962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:17.343966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:17.353617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.355662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.359659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.360789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.361155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.361689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.557149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:17.570169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:17.572553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:17.579103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-888031bd-9fce-4eb7-8d43-0a4c0739c060 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.239473 Sep 01 05:03:17.580058 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1654/3304] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:17 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:17.586244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0c457256-1675-4265-8496-2cd1b53d175f req-41a19e0c-125f-419c-bb7d-3829c9bd1d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e6c322-8878-4d61-b782-6adb266189dd", "name": "network-vif-plugged", "status": "completed", "tag": "281863a5-4cf6-4485-9da1-8a963f174461"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:17.597885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0c457256-1675-4265-8496-2cd1b53d175f req-41a19e0c-125f-419c-bb7d-3829c9bd1d85 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.598800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0c457256-1675-4265-8496-2cd1b53d175f req-41a19e0c-125f-419c-bb7d-3829c9bd1d85 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.599505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0c457256-1675-4265-8496-2cd1b53d175f req-41a19e0c-125f-419c-bb7d-3829c9bd1d85 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.614998 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0c457256-1675-4265-8496-2cd1b53d175f req-41a19e0c-125f-419c-bb7d-3829c9bd1d85 service nova] Creating event network-vif-plugged:281863a5-4cf6-4485-9da1-8a963f174461 for instance 93e6c322-8878-4d61-b782-6adb266189dd on n-h2-820368-37 Sep 01 05:03:17.622447 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0c457256-1675-4265-8496-2cd1b53d175f req-41a19e0c-125f-419c-bb7d-3829c9bd1d85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040390 Sep 01 05:03:17.624014 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1655/3305] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:17.631001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:17.632255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:17.640775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.641693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.642300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.643251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.643876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.644456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.658015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:03:17.658572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:03:17.659821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:03:17.660537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:03:17.664071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:03:17.682810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.683342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.686566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.689914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.691892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.692375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.723153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:03:17.729189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:03:17.745219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:03:17.748860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:03:17.813297 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cf67f1a-3b1d-4497-8c93-9e2ad7246b4d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.566403 Sep 01 05:03:17.814735 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1651/3306] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:03:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:03:17.819782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:17.820850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:17.828853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.829489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.830044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:17.831041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:17.831637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:17.832150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:18.190019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:18.202437 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4543ac5-7655-44b6-9090-ea97abc4ae40 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1272 microversion: 2.1 time: 0.386257 Sep 01 05:03:18.203932 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1652/3307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:17 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:18.210217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3793c129-5664-4f0f-b12f-58d42d4b6f58 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:18.211518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3793c129-5664-4f0f-b12f-58d42d4b6f58 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:18.491737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3793c129-5664-4f0f-b12f-58d42d4b6f58 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:18.494417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=27 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:18.512946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3793c129-5664-4f0f-b12f-58d42d4b6f58 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1241 microversion: 2.1 time: 0.307449 Sep 01 05:03:18.513868 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1653/3308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:18 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1241 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:18.518756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:18.519583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:18.538648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:18.539437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:18.539872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:18.540681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:18.541143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:18.541698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:18.797896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:18.812335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:18.813856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:18.815273 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9dbd15d-98de-412f-b200-26a2bf71ab53 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.189560 Sep 01 05:03:18.816569 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1656/3309] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:17 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:18.835826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:18.836430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:18.846085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:18.846586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:18.848154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:18.849092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:18.850462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:18.850826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.368696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:19.431234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:19.446198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:19.450875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:19.458904 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b561a28b-c51d-458c-80da-a45a816db68a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.640622 Sep 01 05:03:19.463333 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1657/3310] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:18 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:19.486444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:19.487187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:19.494616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.495159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.495599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.497208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.497900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.498339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.742461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:19.755046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04b884ac-4c4e-4234-9bb9-11c867c7c777 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1272 microversion: 2.1 time: 0.290053 Sep 01 05:03:19.756085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1658/3311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:19 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:19.761243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:19.762385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:19.776340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:19.787810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.789522 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94ccf9b6-ee48-46cd-8fd4-a3a12ed41a87 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 1.274351 Sep 01 05:03:19.789707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.790926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.791770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.792514 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1654/3312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:18 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:19.793255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.795284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.808340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-afd0960b-8bc5-4325-aeb4-1510b9563715 req-375250a3-ff34-4aec-b665-f3a2f7669b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c448560-5b05-4bef-bb1a-bb8986beef90", "name": "network-vif-plugged", "status": "completed", "tag": "41bc75f2-503b-4e11-b063-b2499d2f4f7e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:19.839629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afd0960b-8bc5-4325-aeb4-1510b9563715 req-375250a3-ff34-4aec-b665-f3a2f7669b45 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.843640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afd0960b-8bc5-4325-aeb4-1510b9563715 req-375250a3-ff34-4aec-b665-f3a2f7669b45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.847531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afd0960b-8bc5-4325-aeb4-1510b9563715 req-375250a3-ff34-4aec-b665-f3a2f7669b45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.873854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-afd0960b-8bc5-4325-aeb4-1510b9563715 req-375250a3-ff34-4aec-b665-f3a2f7669b45 service nova] Creating event network-vif-plugged:41bc75f2-503b-4e11-b063-b2499d2f4f7e for instance 6c448560-5b05-4bef-bb1a-bb8986beef90 on n-h2-820368-37 Sep 01 05:03:19.879392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-afd0960b-8bc5-4325-aeb4-1510b9563715 req-375250a3-ff34-4aec-b665-f3a2f7669b45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082626 Sep 01 05:03:19.880145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1655/3313] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:19.886108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:19.887188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:19.894707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.895710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.896725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.898325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:19.899680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:19.900765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:19.977418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:19.989691 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46951eb0-d209-4074-a982-48cc38b7fbd9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1299 microversion: 2.1 time: 0.231420 Sep 01 05:03:19.990297 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1659/3314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:19 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:20.471734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:20.494661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:20.499335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:20.502420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:20.503498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:20.507151 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb8deaaa-b42f-4551-9c61-1c666b3744d7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.624224 Sep 01 05:03:20.524194 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1656/3315] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:19 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:20.538056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:20.544064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:20.552034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:20.553330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:20.556102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:20.557644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:20.558276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:20.686833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:20.705715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:20.707260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:20.724112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46396150-8c00-4068-9c27-8445f0b89a97 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.236393 Sep 01 05:03:20.731161 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1660/3316] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:20 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:20.780219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:20.781470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:20.793860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:20.794593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:20.795229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:20.798159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:20.799577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:20.803493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:20.815813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:20.816425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:20.828424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:20.828926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:20.829360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:20.830368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:20.830536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:20.830992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:21.575327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:21.594340 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c63a2e50-cb64-499c-bfc6-cdc2693428c1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.818454 Sep 01 05:03:21.610748 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1657/3317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:20 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:21.610748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:21.610748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:21.615769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:21.616285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:21.618051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:21.619836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:21.620317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:21.620747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:21.859660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:21.875296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65ab4c30-e28d-4eb3-a114-6e522833bead tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1321 microversion: 2.1 time: 1.062049 Sep 01 05:03:21.878506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1661/3318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:20 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1321 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:21.884787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:21.901722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:21.923183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:21.924089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:21.924858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:21.928159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:21.928982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:21.929796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:22.328703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.364404 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25e541d3-5412-4696-bcb8-69cf787877ab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.759051 Sep 01 05:03:22.365992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1658/3319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:21 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:22.389998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:22.391138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:22.412059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:22.412977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:22.417065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:22.420296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:22.420873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:22.422093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:22.514188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.534576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.544022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.549970 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b697910-8ca0-452c-be37-f0e3d0dc4711 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.669932 Sep 01 05:03:22.560295 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1662/3320] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:21 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:22.617882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:22.618420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:22.636252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:22.636997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:22.637453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:22.638605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:22.639130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:22.639569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:22.644526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.662065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.665628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:22.684456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf1a42ee-e23e-4f92-b38b-7a23b112a528 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.314435 Sep 01 05:03:22.685478 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1659/3321] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:22 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:22.899668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:22.900607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:22.914668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:22.915226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:22.915676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:22.920246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:22.923195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:22.923695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.040778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:23.054871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-389519ef-b879-4a87-955f-36168d92f452 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.440976 Sep 01 05:03:23.068166 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1663/3322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:22 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:23.352476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7fabeb6f-cc7a-4b71-8ce1-0ec32cecb285 req-d9fa1b0a-9972-4544-a454-f14ee8fbec23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ff2d06-6e45-4684-8043-d1b0f45c793c", "tag": "fd85ed3a-74f7-414b-bddd-f9b6784cc144"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:23.370160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7fabeb6f-cc7a-4b71-8ce1-0ec32cecb285 req-d9fa1b0a-9972-4544-a454-f14ee8fbec23 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.372134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7fabeb6f-cc7a-4b71-8ce1-0ec32cecb285 req-d9fa1b0a-9972-4544-a454-f14ee8fbec23 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.372847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7fabeb6f-cc7a-4b71-8ce1-0ec32cecb285 req-d9fa1b0a-9972-4544-a454-f14ee8fbec23 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.391097 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7fabeb6f-cc7a-4b71-8ce1-0ec32cecb285 req-d9fa1b0a-9972-4544-a454-f14ee8fbec23 service nova] Creating event network-changed:fd85ed3a-74f7-414b-bddd-f9b6784cc144 for instance 22ff2d06-6e45-4684-8043-d1b0f45c793c on n-h1-820368-37 Sep 01 05:03:23.399940 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7fabeb6f-cc7a-4b71-8ce1-0ec32cecb285 req-d9fa1b0a-9972-4544-a454-f14ee8fbec23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049844 Sep 01 05:03:23.401380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1664/3323] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:03:23.414781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:23.416227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:23.421876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:23.424497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:23.431858 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8b34906-bb03-41a1-8c7d-dee3c8ee1c34 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1515 microversion: 2.1 time: 0.537847 Sep 01 05:03:23.432381 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1660/3324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:22 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1515 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:23.450768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.451969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.452418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.453152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.453845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.454574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.459713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:23.466471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:23.483290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.486064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.487802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.488711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.490292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.491096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.540268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'flavor' on Instance uuid 6c448560-5b05-4bef-bb1a-bb8986beef90 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:23.654509 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-021383cb-be39-4608-88ad-83b16a41833f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action" status: 200 len: 32 microversion: 2.1 time: 0.200953 Sep 01 05:03:23.655666 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1661/3325] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:23 2022] POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:03:23.673954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-22d7dc50-87ab-4bba-89f8-48661580ac96 req-68d51327-5d6c-4e77-834b-0dc4282f8884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014cdf37-b18d-440a-a187-c221b6636f77", "tag": "7a4ffffd-2fba-4215-81f9-64da9d93cf35"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:23.691600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-22d7dc50-87ab-4bba-89f8-48661580ac96 req-68d51327-5d6c-4e77-834b-0dc4282f8884 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.692674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-22d7dc50-87ab-4bba-89f8-48661580ac96 req-68d51327-5d6c-4e77-834b-0dc4282f8884 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.693290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-22d7dc50-87ab-4bba-89f8-48661580ac96 req-68d51327-5d6c-4e77-834b-0dc4282f8884 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.707042 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-22d7dc50-87ab-4bba-89f8-48661580ac96 req-68d51327-5d6c-4e77-834b-0dc4282f8884 service nova] Creating event network-changed:7a4ffffd-2fba-4215-81f9-64da9d93cf35 for instance 014cdf37-b18d-440a-a187-c221b6636f77 on n-h2-820368-37 Sep 01 05:03:23.719785 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-22d7dc50-87ab-4bba-89f8-48661580ac96 req-68d51327-5d6c-4e77-834b-0dc4282f8884 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062351 Sep 01 05:03:23.722651 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1662/3326] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:23.732272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:23.732796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:23.740464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.740953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.741386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:23.742098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:23.742549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:23.743020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.272083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.287024 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f606cce3-7c88-4de2-b135-d6e073f6361c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.882718 Sep 01 05:03:24.288191 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1665/3327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:23 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:24.295210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:24.296144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:24.306034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:24.306515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:24.306968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.307715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:24.308166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:24.308989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.699394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.711327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.713302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.716245 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38d8f869-7ff5-4930-a3c3-a224c50c77a3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.992245 Sep 01 05:03:24.716896 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1663/3328] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:23 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:24.738558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:24.739125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:24.745428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:24.745928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:24.746361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.747141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:24.747648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:24.748222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.751583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:24.918199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.922158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.929904 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d92f28a9-59a7-4824-9bcd-3c7cf03bd95e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.640232 Sep 01 05:03:24.930989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1666/3329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:24 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:24.933152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.935594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:24.936421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:24.937034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:24.943941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:24.945046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:24.945975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.947625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:24.948373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:24.948974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:24.954104 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf4fba1a-1e79-4ae3-a65d-a477655334f3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.222954 Sep 01 05:03:24.955623 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1664/3330] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:24 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:25.311221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:25.312313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:25.320436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:25.321422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:25.322096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:25.323133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:25.323839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:25.325513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:25.375311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:25.384073 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68ac2e28-51cd-4e5d-99e8-7c7082bbe2eb tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.452000 Sep 01 05:03:25.385128 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1667/3331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:24 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:25.716946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:25.726441 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9317c6be-9a17-4f18-ba21-4a403c91acf8 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.420571 Sep 01 05:03:25.740550 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1665/3332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:25 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:25.741867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:25.742681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:25.752231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:25.753034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:25.753642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:25.755625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:25.761484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:25.762284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:25.960596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:25.961389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:25.968220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:25.968907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:25.969653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:25.979253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:25.979253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:25.979253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.133131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.135762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:26.145725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.147828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.149153 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fff7327a-8ce6-4531-8b41-285e4c99b155 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.411312 Sep 01 05:03:26.150024 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1668/3333] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:25 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:26.155667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:26.156273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:26.165145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:26.166275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:26.167830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.169155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:26.169653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:26.170123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.326227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.336732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.338959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.340479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.346029 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53137fdb-8e01-4114-9e14-7ceac6197742 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.194558 Sep 01 05:03:26.346566 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e969675b-24a0-466e-b178-bcd4bc931774 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.389843 Sep 01 05:03:26.346694 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1669/3334] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:26 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:26.347778 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1666/3335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:25 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:26.408866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:26.409950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:26.417227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:26.418030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:26.418610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.419555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:26.420014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:26.420448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.748932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:26.749579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:26.761661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:26.762372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:26.763501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:26.763990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.764964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:26.765701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:26.766334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:26.776675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12d50126-070d-4f52-b52c-bf6478aefc49 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.372149 Sep 01 05:03:26.785056 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1670/3336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:26 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:27.104090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.153127 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90b2a1b8-ce01-42b9-972a-9d4e14c42694 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.405626 Sep 01 05:03:27.170677 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1667/3337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:26 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:27.177130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:27.177761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:27.184303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.185092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.185749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.186700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.187631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.188287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.373992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:27.375012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:27.400796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.401745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.402609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.403701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.404420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.405286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.574073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.583874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.585620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.587067 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-300d3ddd-22b5-4aeb-83a9-c02c4f57d09c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.414487 Sep 01 05:03:27.602784 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1671/3338] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:27 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:27.608928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:27.609749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:27.616694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.617479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.618099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.619023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.619645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.620246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.716112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:27.780420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.800891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.806060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:27.822778 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1d1dea5-2e14-4705-b091-3b1b9cdacda0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.217639 Sep 01 05:03:27.824869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1672/3339] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:27 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:27.838245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:27.840382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:27.849807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.850720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.851954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:27.853748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:27.854483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:27.859944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:28.512364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:28.519083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:28.536505 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-811ff72e-584c-4a1b-b0a3-055f34db5bef tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 1.171705 Sep 01 05:03:28.539000 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1668/3340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:27 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:28.546166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:28.547118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:28.557197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:28.558402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:28.559224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:28.560243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:28.561163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:28.561847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:28.994124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.013854 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b22387e-05f1-4f34-85be-043b352b507b tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 1.187055 Sep 01 05:03:29.029114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1673/3341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:27 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:29.054012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:29.054832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:29.062255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:29.062943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:29.063494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:29.064267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:29.064924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:29.065346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:29.236714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.252169 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89082774-3d3f-46fd-bd2f-2d6f6883f754 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.710775 Sep 01 05:03:29.252777 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1669/3342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:28 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:29.257632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:29.262650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:29.274969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:29.280738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:29.281484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:29.282791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:29.283470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:29.284099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:29.525127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.551309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.559627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.579695 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44a544ce-58b5-4fd6-bea9-f6d1e9888da2 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.323583 Sep 01 05:03:29.582834 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1670/3343] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:29 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:29.609104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:29.610507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:29.618227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:29.620266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:29.622013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:29.626427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:29.628176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:29.630653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:29.770626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.802421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.806037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:29.807703 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-adbf777c-baf7-4b5f-ac5e-7abc7ce20896 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.759296 Sep 01 05:03:29.808697 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1674/3344] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:29 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:30.039608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:30.040343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:30.061660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.064516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.065656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.068647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.069480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.072606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.106138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:30.116280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d1d0461-9326-4f1d-a2c1-7c0498ad88d5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.531357 Sep 01 05:03:30.116884 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1671/3345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:29 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:30.283580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:30.284799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:30.294928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.296399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.296977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.300068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.300914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.301621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.563580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:30.581380 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-930faabe-910d-4820-9a32-3e939ea82e7e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.546262 Sep 01 05:03:30.583988 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1675/3346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:30 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:30.612027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:30.613154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:30.627504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.628414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.629046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.629972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.630801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.631437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.636538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:30.646817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89685f0a-efac-4819-8f37-8ef71cfff8a9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.374829 Sep 01 05:03:30.668550 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1672/3347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:30 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:30.742864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:30.756714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:30.758504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:30.766514 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1107bfc-f6ce-4592-92f3-a992c26a5e17 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.162046 Sep 01 05:03:30.779665 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1676/3348] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:30 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:03:30.832747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:30.833832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:30.841886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:30.844329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.845251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.846238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:30.848619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:30.849522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:30.850211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.138661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:31.140134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:31.151720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.154190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.159049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.160171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.160852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.161660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.190761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:31.243793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:31.245597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:31.248082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2bed929-c662-4045-b8e9-17fbdebdd9f2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.419794 Sep 01 05:03:31.267111 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1673/3349] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:30 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:31.381621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-604a5659-a5da-451c-bf73-128e1cb83a23 req-0777fb6d-810b-4670-8eed-fe1a24a667c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ff2d06-6e45-4684-8043-d1b0f45c793c", "name": "network-vif-plugged", "status": "completed", "tag": "fd85ed3a-74f7-414b-bddd-f9b6784cc144"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:31.389159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:31.410253 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d74a7a04-2e3a-4413-9468-57ca840d9fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.276229 Sep 01 05:03:31.412310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-604a5659-a5da-451c-bf73-128e1cb83a23 req-0777fb6d-810b-4670-8eed-fe1a24a667c5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.413091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-604a5659-a5da-451c-bf73-128e1cb83a23 req-0777fb6d-810b-4670-8eed-fe1a24a667c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.413691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-604a5659-a5da-451c-bf73-128e1cb83a23 req-0777fb6d-810b-4670-8eed-fe1a24a667c5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.414636 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1677/3350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:31 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:31.438629 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-604a5659-a5da-451c-bf73-128e1cb83a23 req-0777fb6d-810b-4670-8eed-fe1a24a667c5 service nova] Creating event network-vif-plugged:fd85ed3a-74f7-414b-bddd-f9b6784cc144 for instance 22ff2d06-6e45-4684-8043-d1b0f45c793c on n-h1-820368-37 Sep 01 05:03:31.444200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-604a5659-a5da-451c-bf73-128e1cb83a23 req-0777fb6d-810b-4670-8eed-fe1a24a667c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074462 Sep 01 05:03:31.445416 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1674/3351] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:31.612135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:31.612765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:31.624992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.625810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.626435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.627392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.628176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.628785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.676219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:31.678387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:31.687682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.688476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.689634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:31.690644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:31.691639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:31.692937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.171174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.178851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.185378 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b76a36ea-6ecd-4ad4-8927-b2632d1e9a07 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.576767 Sep 01 05:03:32.189451 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b4ef10d-5bb4-43c8-af63-9923abe34f77 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.518624 Sep 01 05:03:32.190872 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1675/3352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:31 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:32.199593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:32.201725 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1678/3353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:31 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:32.205931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:32.219937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:32.220602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:32.221332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.222296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:32.223007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:32.223648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.285559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:32.286471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:32.296498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:32.298282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:32.298998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.300184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:32.302185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:32.303070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.406253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.433415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.438333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.458297 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c13ad97e-6fbc-4eb2-bb4c-4cc4f7c76e52 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.264453 Sep 01 05:03:32.460675 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1676/3354] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:32 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:32.478256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:32.479480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:32.497890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:32.498755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:32.499572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.500816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:32.501370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:32.501923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:32.810876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.822197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.825658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.828218 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7635563c-3f8f-470f-86f8-67b2d2079cad tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.554039 Sep 01 05:03:32.829392 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1679/3355] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:32 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:32.963653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:32.975663 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4558ee74-ec38-4f81-ae7d-c8d921daadc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.513085 Sep 01 05:03:32.976277 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1677/3356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:32 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:33.211115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:33.212496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:33.212931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:33.213761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:33.220256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.220923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.221467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.221722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.222379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.222543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.223129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.223477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.223768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.224952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.225595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.226316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.467401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:33.471547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:33.476784 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbf1bbbb-1be6-4bf9-8196-abcaa80743d7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1366 microversion: 2.1 time: 0.267647 Sep 01 05:03:33.477578 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1678/3357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:33 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:33.487296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-91b8f6dd-bdd9-4fa3-af8d-b2ae13944ef3 req-82338e2b-58a7-4a25-b727-41a89114e5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014cdf37-b18d-440a-a187-c221b6636f77", "name": "network-vif-plugged", "status": "completed", "tag": "7a4ffffd-2fba-4215-81f9-64da9d93cf35"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:33.491059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e65befb-4b5a-4efc-b999-7e7236bc83fc tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.284671 Sep 01 05:03:33.491845 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1680/3358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:33 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:33.496578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:33.497194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:33.500733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-91b8f6dd-bdd9-4fa3-af8d-b2ae13944ef3 req-82338e2b-58a7-4a25-b727-41a89114e5da service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.501682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-91b8f6dd-bdd9-4fa3-af8d-b2ae13944ef3 req-82338e2b-58a7-4a25-b727-41a89114e5da service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.502871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-91b8f6dd-bdd9-4fa3-af8d-b2ae13944ef3 req-82338e2b-58a7-4a25-b727-41a89114e5da service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.503591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.504280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.505415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.505667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.506074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.507030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.520918 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-91b8f6dd-bdd9-4fa3-af8d-b2ae13944ef3 req-82338e2b-58a7-4a25-b727-41a89114e5da service nova] Creating event network-vif-plugged:7a4ffffd-2fba-4215-81f9-64da9d93cf35 for instance 014cdf37-b18d-440a-a187-c221b6636f77 on n-h2-820368-37 Sep 01 05:03:33.527419 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-91b8f6dd-bdd9-4fa3-af8d-b2ae13944ef3 req-82338e2b-58a7-4a25-b727-41a89114e5da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047781 Sep 01 05:03:33.528778 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1679/3359] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:33.585252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:33.595430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:33.596895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:33.603337 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-717fa8ee-eaf1-47f2-ac93-c2e64ab4add1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.109809 Sep 01 05:03:33.603617 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1681/3360] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:33 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:33.856343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:33.857299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:33.864320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.864907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.865406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:33.866183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:33.866699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:33.867412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:34.000318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:34.001080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:34.009792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:34.010530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:34.011335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:34.012655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:34.013497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:34.014088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:34.160114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:34.174549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:34.177302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:34.178770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b27a25ca-0a88-4764-a05a-bd29a52be337 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.327368 Sep 01 05:03:34.180350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1680/3361] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:33 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:34.448191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:34.457727 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-112b5966-00b5-4b4c-87f9-6434a14fe40a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.463891 Sep 01 05:03:34.458615 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1682/3362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:33 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:34.500207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:34.502233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:34.514999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:34.516041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:34.535633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:34.545079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:34.548489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:34.549323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:34.554440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:34.555332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:34.557777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:34.558746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:34.559700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:34.560564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:34.564015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:34.566765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.405723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:35.420717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbf02da3-305d-4036-b3c4-6405e30e7889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1314 microversion: 2.1 time: 0.912421 Sep 01 05:03:35.436076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1683/3363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:34 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:35.459205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:35.460752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:35.467788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:35.468517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:35.469155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.470047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:35.470677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:35.471305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.499472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:35.514722 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a39b8f46-27f7-4453-8121-cf51be79b45b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1557 microversion: 2.1 time: 1.020514 Sep 01 05:03:35.547633 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1681/3364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:34 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1557 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:35.567090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:35.567897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:35.570032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:35.584532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:35.588625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:35.590935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:35.592018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:35.593708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.594984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:35.595850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:35.598185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.602636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-688c1a3a-9db2-4c27-91c9-e37b1141dd06 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.164539 Sep 01 05:03:35.605557 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1684/3365] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:35 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:35.616362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:35.618187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:35.632962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:35.633816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:35.634430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.636695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:35.638397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:35.639056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:35.654389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:35.672108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:36.395747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.408330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02ba5cf9-e828-44f5-9e32-8b6b1171c086 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.801280 Sep 01 05:03:36.411645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1685/3366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:35 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:36.423341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:36.425942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:36.440287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:36.441068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:36.441713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:36.443420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:36.444315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:36.444908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:36.633846 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee9a75fa-e1cd-49f6-afee-050a3f0f004d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214803 Sep 01 05:03:36.635665 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1686/3367] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:03:36 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:36.646110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:36.647060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:36.664221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:36.665037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:36.665776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:36.667143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:36.667950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:36.668625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:36.705300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.724116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.725805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.732807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-328446c3-7008-4e23-84c0-ca81de207a58 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 1.180074 Sep 01 05:03:36.733704 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1682/3368] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:35 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:36.747406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:36.748338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:36.757137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:36.759869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:36.760535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:36.761620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:36.767639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:36.768089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:36.959179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.974551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.977470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:36.984961 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7b22abd-1211-47e2-bcee-c87f0c38d419 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.249225 Sep 01 05:03:36.986356 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1683/3369] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:36 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:37.241291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:37.266918 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8962f25e-666d-4145-96ce-8571e1be1cb7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1501 microversion: 2.1 time: 0.629673 Sep 01 05:03:37.276389 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1687/3370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:36 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1501 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:37.304524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:37.306264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:37.333220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:37.336494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:37.337258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:37.338419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:37.339092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:37.340685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:37.416961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lazy-loading 'flavor' on Instance uuid 014cdf37-b18d-440a-a187-c221b6636f77 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:37.435472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:37.436831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:37.451336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:37.451984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:37.452552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:37.456297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:37.458247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:37.458865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:37.591600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6da2a00a-3e17-4aed-ae3d-23e071d5571d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "POST /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77/action" status: 202 len: 0 microversion: 2.1 time: 0.300242 Sep 01 05:03:37.592229 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1684/3371] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:37 2022] POST /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:03:37.603083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:37.631239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:37.657866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:37.658763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:37.659443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:37.660418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:37.661224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:37.661871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:37.972996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:37.984158 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fb5fcce-e45a-4e6d-bde8-408c18de9881 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.553152 Sep 01 05:03:38.022836 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1688/3372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:37 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:38.028673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:38.042604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:38.049391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.063442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:38.064059 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd195b49-fb16-4dc8-9445-d6faedd1874f tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1509 microversion: 2.1 time: 0.466754 Sep 01 05:03:38.064430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:38.066927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:38.068132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:38.068904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:38.069494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:38.071598 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1685/3373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:37 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:38.077517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:38.078344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:38.085979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:38.086479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:38.086948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:38.087672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:38.088274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:38.088705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:38.439115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.450290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.452279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.458614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d2c0432-da37-4564-88f4-0d586c98fac7 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.385832 Sep 01 05:03:38.460312 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1686/3374] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:38 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:38.675154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.686428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.703537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:38.704837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cea10f6c-34ed-445b-be09-efb6de70de2e tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.680686 Sep 01 05:03:38.705452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1689/3375] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:38 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:39.015255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:39.015998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:39.035496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.038294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.039535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.043110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.044432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.044833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.090856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:39.092216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:39.108497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.109319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.110018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.110926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.111557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.112178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.438028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:39.439962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:39.452544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdef3161-b0aa-4fa8-a338-982b76a3c997 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1492 microversion: 2.1 time: 0.366725 Sep 01 05:03:39.454373 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1690/3376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:39 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1492 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:39.456102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64ceb039-a433-4678-bb8f-1a8c97db0ae4 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.445822 Sep 01 05:03:39.464715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-48870af5-d3cd-42b7-962c-feb7cf2c654d req-6235f2cb-57dd-40df-a20b-2c37a9a21725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ff2d06-6e45-4684-8043-d1b0f45c793c", "tag": "fd85ed3a-74f7-414b-bddd-f9b6784cc144"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:39.468175 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1687/3377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:39 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:39.483293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:39.483802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:39.487658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-48870af5-d3cd-42b7-962c-feb7cf2c654d req-6235f2cb-57dd-40df-a20b-2c37a9a21725 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.492171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-48870af5-d3cd-42b7-962c-feb7cf2c654d req-6235f2cb-57dd-40df-a20b-2c37a9a21725 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.492970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-48870af5-d3cd-42b7-962c-feb7cf2c654d req-6235f2cb-57dd-40df-a20b-2c37a9a21725 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.502698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.503220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.505212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.508705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.509157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.509597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.518922 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-48870af5-d3cd-42b7-962c-feb7cf2c654d req-6235f2cb-57dd-40df-a20b-2c37a9a21725 service nova] Creating event network-changed:fd85ed3a-74f7-414b-bddd-f9b6784cc144 for instance 22ff2d06-6e45-4684-8043-d1b0f45c793c on n-h1-820368-37 Sep 01 05:03:39.535684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-48870af5-d3cd-42b7-962c-feb7cf2c654d req-6235f2cb-57dd-40df-a20b-2c37a9a21725 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079797 Sep 01 05:03:39.545157 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1691/3378] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:39.552259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:39.553273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:39.560606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:03:39.572913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.573402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.573906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.575062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.575748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.579292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.753310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a88e950-9c6d-4676-a5e5-d1b35648e6d1 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 204 len: 0 microversion: 2.1 time: 0.276559 Sep 01 05:03:39.757790 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1688/3379] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:39 2022] DELETE /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:03:39.770147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:39.772894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:39.774014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:39.780250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:39.782336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:39.787797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.788520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.788952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.789919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.796615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.797509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.799502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b93e074-be64-47e9-a5d4-0a3043400597 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.252666 Sep 01 05:03:39.804216 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1692/3380] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:39 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:39.827492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:39.828304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:39.846787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.849245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.851923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:39.853818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:39.855942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:39.861572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:40.326685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:40.355223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:40.358588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:40.360637 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20cdd6f6-b020-49db-86fb-07bfd6a844d0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.601511 Sep 01 05:03:40.385729 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1689/3381] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:39 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:40.479379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:40.480733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:40.492769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:40.494633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:40.496146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:40.497655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:40.499473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:40.501335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:40.502178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:40.518223 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca2e5c5b-6a09-43ae-9fa4-caef392a9dfe tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1498 microversion: 2.1 time: 0.712681 Sep 01 05:03:40.529093 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1693/3382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:39 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1498 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:40.835206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:40.835835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:40.850805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:40.852908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:40.853390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:40.854140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:40.860410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:40.864021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:40.879206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:40.903491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb276553-9513-43e7-a5c4-6616d453765a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.428150 Sep 01 05:03:40.908673 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1690/3383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:40 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:40.913794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8338e21f-c85a-43ce-8f18-052b82ec1079 req-3bdcfd24-e77d-4ea1-9a0e-888bd6dfa391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "a4bac124-45b5-4944-b285-6c67626879ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:40.943983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8338e21f-c85a-43ce-8f18-052b82ec1079 req-3bdcfd24-e77d-4ea1-9a0e-888bd6dfa391 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:40.944793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8338e21f-c85a-43ce-8f18-052b82ec1079 req-3bdcfd24-e77d-4ea1-9a0e-888bd6dfa391 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:40.945383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8338e21f-c85a-43ce-8f18-052b82ec1079 req-3bdcfd24-e77d-4ea1-9a0e-888bd6dfa391 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:40.972892 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8338e21f-c85a-43ce-8f18-052b82ec1079 req-3bdcfd24-e77d-4ea1-9a0e-888bd6dfa391 service nova] Creating event network-vif-plugged:a4bac124-45b5-4944-b285-6c67626879ea for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:40.984146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8338e21f-c85a-43ce-8f18-052b82ec1079 req-3bdcfd24-e77d-4ea1-9a0e-888bd6dfa391 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073495 Sep 01 05:03:40.985992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1691/3384] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:41.118507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:41.138109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:41.142231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:41.157968 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebd9841c-201e-4700-bbd5-8baa9af79ff4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.327574 Sep 01 05:03:41.160842 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1694/3385] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:40 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:41.393653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:41.394696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:41.409207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:41.416607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:41.418961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:41.420699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:41.422858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:41.426497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:41.559747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:41.561307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:41.569772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:41.570602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:41.571315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:41.572247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:41.572934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:41.573890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:42.364000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.376021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.377899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.379898 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11d01425-1169-4d50-9246-71af8e5f7f26 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.990314 Sep 01 05:03:42.384078 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1692/3386] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:41 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:42.390602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:42.391569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:42.406763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:42.411017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:42.411970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:42.413726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:42.414831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:42.415903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:42.452965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.466538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97bcfbb7-eeae-4c97-8dea-52b30075c07d tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1498 microversion: 2.1 time: 0.911430 Sep 01 05:03:42.468933 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1695/3387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:41 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1498 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:42.475184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:42.476118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:42.483469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:42.484360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:42.484892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:42.485717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:42.486283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:42.486909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:42.701976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.712570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.714053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:42.727578 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74cfafa7-8257-43de-b630-ad128fd22bca tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.256974 Sep 01 05:03:42.728173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1696/3388] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:42 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:42.992304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:43.001685 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-006e383b-7f43-4b8e-8073-fa03a9c509bd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.619691 Sep 01 05:03:43.005819 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1693/3389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:42 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:43.206159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "8ef9bc71-9cca-402d-bd69-f3f06cc051ec"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "02b6b504-6c18-4e13-9d47-992ebe76b188"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:43.232967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.233462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.233899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:43.259412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] Creating event network-vif-plugged:8ef9bc71-9cca-402d-bd69-f3f06cc051ec for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:43.261843 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] Creating event network-vif-plugged:02b6b504-6c18-4e13-9d47-992ebe76b188 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:43.279179 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f4fe3950-a646-4185-8f41-bc457ab62fd8 req-75686c50-a310-42f5-b283-b6b6d9dab14a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076093 Sep 01 05:03:43.280110 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1697/3390] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:43.412133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:43.412778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:43.432875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.433484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.433953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:43.437802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.438528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.440303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:43.491900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:43.492626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:43.517712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.518263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.518714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:43.525798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.526132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.526583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:43.840929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:43.858694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44a7d058-5a88-4c02-86c3-a6c972c48816 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1456 microversion: 2.1 time: 0.371264 Sep 01 05:03:43.862283 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1698/3391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:43 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1456 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:43.870031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:43.871845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:43.921651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.922481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.923161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:43.925462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:43.927259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:43.927920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.086210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.088498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.097573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.099296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.100919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f54f33d6-1365-4afc-88aa-35269f7c9113 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.697034 Sep 01 05:03:44.110979 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1694/3392] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:43 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:44.110979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cea7e4df-34d5-4aa7-b9d2-4d8bd4420299 req-33f8e103-3885-4c38-a459-23065f6629e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014cdf37-b18d-440a-a187-c221b6636f77", "name": "network-vif-deleted", "tag": "7a4ffffd-2fba-4215-81f9-64da9d93cf35"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:44.119083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cea7e4df-34d5-4aa7-b9d2-4d8bd4420299 req-33f8e103-3885-4c38-a459-23065f6629e9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:44.119567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cea7e4df-34d5-4aa7-b9d2-4d8bd4420299 req-33f8e103-3885-4c38-a459-23065f6629e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:44.119990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cea7e4df-34d5-4aa7-b9d2-4d8bd4420299 req-33f8e103-3885-4c38-a459-23065f6629e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.133218 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cea7e4df-34d5-4aa7-b9d2-4d8bd4420299 req-33f8e103-3885-4c38-a459-23065f6629e9 service nova] Creating event network-vif-deleted:7a4ffffd-2fba-4215-81f9-64da9d93cf35 for instance 014cdf37-b18d-440a-a187-c221b6636f77 on n-h2-820368-37 Sep 01 05:03:44.138183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.139280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cea7e4df-34d5-4aa7-b9d2-4d8bd4420299 req-33f8e103-3885-4c38-a459-23065f6629e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036150 Sep 01 05:03:44.139781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.144274 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1695/3393] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:44.151271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:44.152470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:44.160191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:44.161001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:44.161606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.161743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e243cc18-1a01-4d6d-aaeb-bbb471fc6543 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1560 microversion: 2.91 time: 0.290780 Sep 01 05:03:44.174915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1699/3394] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:43 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1560 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:44.179927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:44.179927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:44.179927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.386154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:44.390780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:44.401468 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af6c2f4e-0b8c-4148-abbd-077c3175da61 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.255356 Sep 01 05:03:44.402812 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1696/3395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:44 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:44.884754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:44.886217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:44.898491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:44.900456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:44.900885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.901837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:44.902270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:44.902690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.948134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:44.949219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:44.949775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:44.950237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lazy-loading 'fault' on Instance uuid 014cdf37-b18d-440a-a187-c221b6636f77 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:44.996296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.008118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91f8f3e7-f193-4a2b-9460-1b4f6327f42e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1304 microversion: 2.1 time: 0.128826 Sep 01 05:03:45.008820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1700/3396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:44 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:45.141224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:45.143261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:45.165080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.165634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.166043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.166778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.169134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.170932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.191058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:45.192007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:45.206977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.208122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.208747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.209664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.213418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.214410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.454397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.468379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.470223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.481970 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e089cbc-56ca-4fe8-9da4-0dde715dcc87 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.296946 Sep 01 05:03:45.486103 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1701/3397] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:45 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:45.513854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "fee31787-083d-4363-9ccf-f1cca229253f"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "fcbe2c69-ec2d-45ac-afa8-4f81e1107b90"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "80612bef-94e4-4a55-8de5-db8e954f58a5"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-plugged", "status": "completed", "tag": "c07a473c-435b-4a82-9cec-ed1e4ee32c70"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:45.549295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.550056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.551206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.588141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.600264 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Creating event network-vif-plugged:fee31787-083d-4363-9ccf-f1cca229253f for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:45.601175 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Creating event network-vif-plugged:fcbe2c69-ec2d-45ac-afa8-4f81e1107b90 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:45.602095 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Creating event network-vif-plugged:80612bef-94e4-4a55-8de5-db8e954f58a5 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:45.602286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.602609 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] Creating event network-vif-plugged:c07a473c-435b-4a82-9cec-ed1e4ee32c70 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:45.604542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.606180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82380d81-e880-4f81-b95b-b18bda8de86b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.474144 Sep 01 05:03:45.607003 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1697/3398] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:45 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:45.609927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4c778c6a-dd12-4f0f-ab23-93162f0ddd96 req-fd73f68a-40d6-4ef4-9352-be7fc5775e2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.122135 Sep 01 05:03:45.610920 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1702/3399] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:45.620432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:45.621143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:45.635627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.641957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.643015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.646408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:45.648822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:45.652578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:45.851733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:45.861230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b18a9120-f8cf-40fb-bb86-62f0be5b8dfe tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1521 microversion: 2.1 time: 0.251933 Sep 01 05:03:45.861889 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1698/3400] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:45 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:46.034193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:46.039629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:46.077319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.078556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.080854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.082352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.083637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.085075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.217438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:46.227688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.228441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.228992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.229716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lazy-loading 'fault' on Instance uuid 014cdf37-b18d-440a-a187-c221b6636f77 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:46.493093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13fb72fe72dc4d829030d73ac0cd7e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca194d8b2844794b9865963e05753b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:46.499354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:46.504002 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9591266-8d2b-4b9b-a73b-550429832f82 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 200 len: 1304 microversion: 2.1 time: 0.475425 Sep 01 05:03:46.508148 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1703/3401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:46 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 1304 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:46.512965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:46.513731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:46.526567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.528229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.528229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.528554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.528770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.542007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.638559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:46.643122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:46.666778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.667672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.668079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.669143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.669617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.670070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.693150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:46.712011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:46.717061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:46.738820 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90d17107-f44e-4eee-bff5-a62ed7a32a2a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.228689 Sep 01 05:03:46.740140 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1699/3402] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:46 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:46.885852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:46.886557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:46.895411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.898684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.899180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:46.902003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:46.902353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:46.902800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.120984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:47.142180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:47.143921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:47.145377 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb2bc1ed-225f-40a4-b2fb-06273ea10e83 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1878 microversion: 2.42 time: 0.513234 Sep 01 05:03:47.163315 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1704/3403] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:46 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1878 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:47.330941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:47.348594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c9fc76d-0f33-4372-bae4-d259ada75c28 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1501 microversion: 2.1 time: 0.466556 Sep 01 05:03:47.377690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:47.382207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:47.393949 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1700/3404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:46 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1501 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:47.405037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.405755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.406395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.407724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.408358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.408960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.534496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:47.535268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:47.566583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.567373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.567840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.568602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.569070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.569499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.601386 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 HTTP/1.1 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '014cdf37-b18d-440a-a187-c221b6636f77'} Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:47.611274 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:47.616489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c94c61d-4c11-4fe8-af90-215402f27f70 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 404 len: 111 microversion: 2.1 time: 0.088664 Sep 01 05:03:47.625978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1701/3405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:47 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:03:47.631143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:47.639463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:47.656256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.657578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.658246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.667574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.668337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.668981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.703676 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 HTTP/1.1 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '014cdf37-b18d-440a-a187-c221b6636f77'} Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:47.707785 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.712821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.726642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:47.730427 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79812c43-f065-442d-87f5-a0584abba7e7 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 404 len: 111 microversion: 2.1 time: 0.103172 Sep 01 05:03:47.731057 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1702/3406] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:47 2022] DELETE /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:47.741517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:47.742549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 014cdf37-b18d-440a-a187-c221b6636f77] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:47.755941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.756855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.757787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.759008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.759744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.760419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.815486 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 HTTP/1.1 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '014cdf37-b18d-440a-a187-c221b6636f77'} Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:47.824597 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. Sep 01 05:03:47.829426 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:47.836247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 014cdf37-b18d-440a-a187-c221b6636f77 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:47.849422 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bfa600a-f482-4d0e-b685-17092bf50f95 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77" status: 404 len: 111 microversion: 2.1 time: 0.104730 Sep 01 05:03:47.850083 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1703/3407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:47 2022] GET /compute/v2.1/servers/014cdf37-b18d-440a-a187-c221b6636f77 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:47.863428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:47.864045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:47.880379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.880877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.881318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:47.883868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:47.884344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:47.884837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.544387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:48.567384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:48.578279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:48.595096 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9168251d-c1e5-4553-9caf-46585cbc42ec tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.740996 Sep 01 05:03:48.596033 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1704/3408] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:47 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:48.607231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:48.608211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:48.623576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.624071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.627613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.629956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.631894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.632378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.671225 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e HTTP/1.1 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'de0f57df-c4be-4fe7-aef3-2bf23bb3000e'} Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:48.677628 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:48.682530 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c57ab088-c001-4881-a463-dfa3f6502d28 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 404 len: 111 microversion: 2.1 time: 0.080107 Sep 01 05:03:48.687550 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1705/3409] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:48 2022] DELETE /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:48.695853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:48.696431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:48.699000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:48.717726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.718142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.718591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.719362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.720017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.720918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.735470 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75682c82-95a0-4b64-92a7-918424049f13 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1516 microversion: 2.1 time: 1.363504 Sep 01 05:03:48.754753 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1705/3410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:47 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1516 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:48.754753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:48.754753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: de0f57df-c4be-4fe7-aef3-2bf23bb3000e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:48.768369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.769143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.769357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.770021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.770480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.771117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.859889 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e HTTP/1.1 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'de0f57df-c4be-4fe7-aef3-2bf23bb3000e'} Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:48.862824 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. Sep 01 05:03:48.868085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.871849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance de0f57df-c4be-4fe7-aef3-2bf23bb3000e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:48.875619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e5f88b4-04b3-4f00-86ca-d1a87299bd93 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e" status: 404 len: 111 microversion: 2.1 time: 0.132493 Sep 01 05:03:48.876784 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1706/3411] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:48 2022] GET /compute/v2.1/servers/de0f57df-c4be-4fe7-aef3-2bf23bb3000e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:48.890402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a7abeb-734c-4fe9-88da-e3f55810c373 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:48.896673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4a7abeb-734c-4fe9-88da-e3f55810c373 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:48.923028 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f4a7abeb-734c-4fe9-88da-e3f55810c373 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Instance 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937 could not be found. Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a7abeb-734c-4fe9-88da-e3f55810c373 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/1d83a9d0-08be-43bd-8e71-c0fbdcfc2937/action HTTP/1.1 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 14 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: {"rescue": {}} Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937 could not be found. Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '1d83a9d0-08be-43bd-8e71-c0fbdcfc2937', 'body': {'rescue': {}}} Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937 could not be found. Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937 could not be found. Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.931761 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937 could not be found. Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a7abeb-734c-4fe9-88da-e3f55810c373 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 404 to user: Instance 1d83a9d0-08be-43bd-8e71-c0fbdcfc2937 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4a7abeb-734c-4fe9-88da-e3f55810c373 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/1d83a9d0-08be-43bd-8e71-c0fbdcfc2937/action" status: 404 len: 111 microversion: 2.1 time: 0.048812 Sep 01 05:03:48.944091 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1707/3412] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:48 2022] POST /compute/v2.1/servers/1d83a9d0-08be-43bd-8e71-c0fbdcfc2937/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:48.952097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:48.953033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:48.976181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.976661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.977095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:48.977811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:48.978270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:48.978699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.032992 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 HTTP/1.1 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '47bce25e-f4e3-4ca2-82db-63be8850fdf9'} Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:49.043909 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.048927 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.050862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:49.051981 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b2cb9a8-08a4-4371-bf78-32751f11e88e tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 404 len: 111 microversion: 2.1 time: 0.107449 Sep 01 05:03:49.056438 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1708/3413] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:48 2022] DELETE /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:49.079232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:49.080250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:49.109535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.115278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.116089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.123137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.124439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.127801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.296084 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c1a2f5d-9601-45e6-b34a-087297f1e034 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action" status: 202 len: 0 microversion: 2.1 time: 0.237895 Sep 01 05:03:49.300605 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1709/3414] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:49 2022] POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:03:49.311147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:49.311863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 47bce25e-f4e3-4ca2-82db-63be8850fdf9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:49.349684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.350298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.350740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.351516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.351987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.352413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.385660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:49.400701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:49.403280 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.404824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:49.411946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9c9fc4e-7514-42ac-8e39-64e18fb78cc5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2832 microversion: 2.42 time: 0.719745 Sep 01 05:03:49.412996 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1706/3415] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:48 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2832 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 HTTP/1.1 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '47bce25e-f4e3-4ca2-82db-63be8850fdf9'} Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:49.413735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. Sep 01 05:03:49.418263 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.423383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 47bce25e-f4e3-4ca2-82db-63be8850fdf9 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:49.424458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9d55a21-a96b-4796-a559-cea8263f5d01 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9" status: 404 len: 111 microversion: 2.1 time: 0.122036 Sep 01 05:03:49.425037 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1710/3416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:49 2022] GET /compute/v2.1/servers/47bce25e-f4e3-4ca2-82db-63be8850fdf9 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:49.425552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:49.426274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:49.441659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.442175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.442615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.443396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.443845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.444255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.453251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:49.453792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:49.487588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.488099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.488548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.489403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.490216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.490783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.550619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c HTTP/1.1 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c'} Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:49.555394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:49.560264 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:49.562738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:49.566612 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f48ed55-92bb-4027-b0f3-700d8b60a780 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 404 len: 111 microversion: 2.1 time: 0.129913 Sep 01 05:03:49.569893 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1711/3417] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:49 2022] DELETE /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:49.583075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:49.585426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:49.599618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.602967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.606066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.607262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.607953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.609682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.926673 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2824cec-53d9-4cf3-b4fb-1c8c83de1bb2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.354914 Sep 01 05:03:49.927646 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1712/3418] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 05:03:49 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8/os-interface => generated 1828 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:49.933312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:49.934398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:49.949863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.960543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.961441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:49.964009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:49.966359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:49.967039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:50.004409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c HTTP/1.1 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c'} Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:50.006586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. Sep 01 05:03:50.011483 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.024535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:50.025107 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb73971e-3626-4057-879d-e2902088cc78 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c" status: 404 len: 111 microversion: 2.1 time: 0.095816 Sep 01 05:03:50.026574 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1713/3419] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:49 2022] GET /compute/v2.1/servers/7ae023e0-d3d9-4fc4-97d5-cc19505f1f9c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:50.046393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:50.051293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:50.066335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:50.066846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:50.067313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:50.068309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:50.068985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:50.069621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:50.661429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:50.678744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:50.687486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:50.699780 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f37468e-1bb7-45a4-a884-a84aba7b492a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.661685 Sep 01 05:03:50.711142 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1714/3420] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:50 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:50.729271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b19d9923-22b3-42b4-baf4-002f659a7b09 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:50.732204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b19d9923-22b3-42b4-baf4-002f659a7b09 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:50.750121 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b19d9923-22b3-42b4-baf4-002f659a7b09 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b19d9923-22b3-42b4-baf4-002f659a7b09 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a HTTP/1.1 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4ca0e454-303a-4b6e-8e10-f83c36fd9a0a'} Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.751735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b19d9923-22b3-42b4-baf4-002f659a7b09 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:50.757621 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b19d9923-22b3-42b4-baf4-002f659a7b09 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a" status: 404 len: 111 microversion: 2.1 time: 0.039155 Sep 01 05:03:50.763283 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1715/3421] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:50 2022] DELETE /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:50.768330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b6513f1-393e-4069-8afb-68485a1b0889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:50.768965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b6513f1-393e-4069-8afb-68485a1b0889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:50.786951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6b6513f1-393e-4069-8afb-68485a1b0889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b6513f1-393e-4069-8afb-68485a1b0889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a HTTP/1.1 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4ca0e454-303a-4b6e-8e10-f83c36fd9a0a'} Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:50.788443 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b6513f1-393e-4069-8afb-68485a1b0889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 4ca0e454-303a-4b6e-8e10-f83c36fd9a0a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b6513f1-393e-4069-8afb-68485a1b0889 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a" status: 404 len: 111 microversion: 2.1 time: 0.025490 Sep 01 05:03:50.795655 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1716/3422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:50 2022] GET /compute/v2.1/servers/4ca0e454-303a-4b6e-8e10-f83c36fd9a0a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:51.187243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:51.199674 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8855c046-35c0-4917-acd9-bc0d24bf4878 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1521 microversion: 2.1 time: 1.785490 Sep 01 05:03:51.200276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1707/3423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:49 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1521 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:51.731007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:51.731982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:51.751643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:51.756770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:51.758815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:51.761858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:51.766207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:51.769618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:52.159147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:52.182415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:52.192778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:52.213581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1dde5b7-37ae-4cc7-8206-0a82fff9e35e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.487405 Sep 01 05:03:52.221270 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1717/3424] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:51 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:52.224399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:52.225643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:52.239121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:52.239918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:52.240533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:52.241582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:52.242206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:52.243183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:52.288991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a7b391f5-6e4d-42ec-9638-5de739c89040 req-9f0ae03c-8777-46fe-9896-b9a83baf4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "tag": "02b6b504-6c18-4e13-9d47-992ebe76b188"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:52.317833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7b391f5-6e4d-42ec-9638-5de739c89040 req-9f0ae03c-8777-46fe-9896-b9a83baf4d67 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:52.318309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7b391f5-6e4d-42ec-9638-5de739c89040 req-9f0ae03c-8777-46fe-9896-b9a83baf4d67 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:52.318966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7b391f5-6e4d-42ec-9638-5de739c89040 req-9f0ae03c-8777-46fe-9896-b9a83baf4d67 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:52.346961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a7b391f5-6e4d-42ec-9638-5de739c89040 req-9f0ae03c-8777-46fe-9896-b9a83baf4d67 service nova] Creating event network-changed:02b6b504-6c18-4e13-9d47-992ebe76b188 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:03:52.361981 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a7b391f5-6e4d-42ec-9638-5de739c89040 req-9f0ae03c-8777-46fe-9896-b9a83baf4d67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078936 Sep 01 05:03:52.365542 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1718/3425] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:03:52.745971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:52.779051 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-743c9393-7461-40c4-aabe-7af039b4f22e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1501 microversion: 2.1 time: 0.551404 Sep 01 05:03:52.782797 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1708/3426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:52 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1501 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:03:52.806084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:52.811853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:52.829987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:52.834648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:52.835489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:52.836501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:52.838903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:52.845001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:52.911720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'flavor' on Instance uuid 93e6c322-8878-4d61-b782-6adb266189dd {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:52.942654 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Cannot 'rescue' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state paused Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action HTTP/1.1 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 14 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: {"rescue": {}} Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'rescue' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state paused Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '93e6c322-8878-4d61-b782-6adb266189dd', 'body': {'rescue': {}}} Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93e6c322-8878-4d61-b782-6adb266189dd in vm_state paused. Cannot rescue while the instance is in this state. Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state paused Sep 01 05:03:52.950560 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state paused Sep 01 05:03:52.957912 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:52.960678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 409 to user: Cannot 'rescue' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state paused {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:52.966516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30f0bc3c-a507-4625-9b54-2babbabcd2be tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action" status: 409 len: 144 microversion: 2.1 time: 0.166541 Sep 01 05:03:52.967958 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1719/3427] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:52 2022] POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action => generated 144 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:03:52.978674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:52.979345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:53.000933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:53.001913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:53.002673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:53.005872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:53.006719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:53.007448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:53.189657 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10b3240c-c441-4763-a60d-e989fa005d99 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action" status: 202 len: 0 microversion: 2.1 time: 0.215191 Sep 01 05:03:53.191342 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1709/3428] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:52 2022] POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:03:53.201690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:53.202487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:53.221926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:53.222905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:53.252979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:53.255424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:53.266719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:53.272918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:53.273940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:53.280326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:53.332202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:53.336178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:53.339461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:53.347917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:53.348673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:53.349341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:53.501280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:53.517284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:53.519847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:53.532744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1663ec6-0abf-4b6b-aba8-010ec2a6f1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.271456 Sep 01 05:03:53.534046 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1710/3429] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:53 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:54.387236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:54.402750 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-722dc813-b72b-4384-80fb-50f89b1cc5c9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1508 microversion: 2.1 time: 1.207353 Sep 01 05:03:54.419278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1720/3430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:53 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1508 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:54.562749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:54.563632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:54.578643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:54.579184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:54.579632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:54.580422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:54.580905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:54.581218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:55.070485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:55.093552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:55.099311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:55.115132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f5c0cd9-d95c-48ae-847f-6c549f25cf83 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.557207 Sep 01 05:03:55.117976 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1711/3431] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:54 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:55.428765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:55.429759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:55.459820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:55.460195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:55.471428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:55.472930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:55.473684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:55.474364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:56.144119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:56.145375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:56.159190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:56.159985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:56.161445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:56.164875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:56.165650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:56.167191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:56.245797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:56.263784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b07f129-f26d-4bd4-a6f7-5dfb9473b089 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1516 microversion: 2.1 time: 0.837691 Sep 01 05:03:56.275016 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1721/3432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:55 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1516 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:03:56.439764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:56.460849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:56.473155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:56.496845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:56.506717 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3566b4a8-69cc-4bbd-aaef-b1f03a7061d0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.361002 Sep 01 05:03:56.509220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1712/3433] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:56 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:57.540852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:57.545730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:57.569955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:57.572601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:57.573345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:57.576687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:57.577397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:57.578030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:57.960297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:57.980496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:58.000983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:58.029987 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b019c39-f1f7-4502-a26c-ca407c6a4d55 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.497914 Sep 01 05:03:58.053163 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1722/3434] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:57 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:58.875056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:58.875729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:58.899689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:58.900639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:58.901636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:58.902605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:58.903309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:58.903937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:58.940795 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd HTTP/1.1 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '88bb1e1a-a2d0-4bc3-8b90-de2de37726bd'} Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:58.942867 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:58.947514 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:58.950028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:58.951770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-943df921-90ca-41f0-9d45-e83bcd3bb316 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 404 len: 111 microversion: 2.1 time: 0.082508 Sep 01 05:03:58.952948 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1713/3435] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:58 2022] DELETE /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:58.962039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:58.962660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:58.971435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:58.972296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:58.973592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:58.975989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:58.976882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:58.977555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.035136 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd HTTP/1.1 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '88bb1e1a-a2d0-4bc3-8b90-de2de37726bd'} Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:59.039214 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance 88bb1e1a-a2d0-4bc3-8b90-de2de37726bd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:59.044116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb33c9cd-4205-435e-bbaa-409031a1d882 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd" status: 404 len: 111 microversion: 2.1 time: 0.083358 Sep 01 05:03:59.045342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1723/3436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:58 2022] GET /compute/v2.1/servers/88bb1e1a-a2d0-4bc3-8b90-de2de37726bd => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:59.057057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:59.059271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:59.078091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:59.078710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:59.086196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.093484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.093484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.097896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.100997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.117252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.140601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.151180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.151868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.152793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.154119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.154749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.187069 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b HTTP/1.1 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'dc60faa4-394d-45cd-89a9-95818ecfb47b'} Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:59.207765 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:59.216101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-036f49cd-cc65-4533-a6bc-067e002c0d30 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 404 len: 111 microversion: 2.1 time: 0.159162 Sep 01 05:03:59.219192 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1714/3437] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:03:59 2022] DELETE /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:59.237738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:59.238381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] [instance: dc60faa4-394d-45cd-89a9-95818ecfb47b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:59.283900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.285611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.286067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.289161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.290542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.291336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.329964 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] HTTP exception thrown: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Request method failure captured: Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b HTTP/1.1 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDvZcvc-S8JvEJGxnpmPA5ZiAca5shs-9Z9HS05DXfeH7SidwhhJe4r5z7pMkuXHjFeoTwaV7agaHzsmCdheR-9lnmv1vw30c7BWEcO0pYQWZ5NgXwvVnL86VJRrQ1e0rk9_76dA1sbqfd_Nv63Sic0Wf-5yLvgVdAKra7S44_RcIak Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ca194d8b2844794b9865963e05753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ca194d8b2844794b9865963e05753b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4ca194d8b2844794b9865963e05753b5 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860553351 Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 13fb72fe72dc4d829030d73ac0cd7e5b Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-1860553351-project Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'dc60faa4-394d-45cd-89a9-95818ecfb47b'} Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:03:59.334004 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. Sep 01 05:03:59.339870 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:03:59.342416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] Returning 404 to user: Instance dc60faa4-394d-45cd-89a9-95818ecfb47b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:03:59.344904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52bc7e5d-c465-4c0c-ab1b-6d55993cf676 tempest-DeleteServersTestJSON-1860553351 tempest-DeleteServersTestJSON-1860553351-project] 10.222.0.26 "GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b" status: 404 len: 111 microversion: 2.1 time: 0.124631 Sep 01 05:03:59.355444 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1715/3438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:59 2022] GET /compute/v2.1/servers/dc60faa4-394d-45cd-89a9-95818ecfb47b => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:59.369952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:03:59.373425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:59.390649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.391439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.392772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.394658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.397053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.398392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.476475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'flavor' on Instance uuid 93e6c322-8878-4d61-b782-6adb266189dd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:03:59.518573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:59.545549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:59.571120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:59.587759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:03:59.622385 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4764734-f48d-4d61-9578-b1af5f6cd78d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.561699 Sep 01 05:03:59.633430 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1724/3439] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:03:59 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:03:59.676169 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc727042-2ce7-4912-88f1-ac1b91b1f572 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action" status: 200 len: 32 microversion: 2.1 time: 0.319110 Sep 01 05:03:59.689971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:03:59.690596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:03:59.700209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1716/3440] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:03:59 2022] POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action => generated 32 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:03:59.709362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.709866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.710393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:03:59.711349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:03:59.736202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:03:59.736702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:00.669145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:00.670711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:00.702995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:00.704244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:00.704893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:00.706177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:00.709102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:00.712110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:01.055448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:01.056915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:01.071569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:01.073102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:01.076351 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-678f9877-315a-4359-ab3d-adfe4a786cde tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 1.383368 Sep 01 05:04:01.077369 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1725/3441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:03:59 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:01.094063 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb23bad5-e099-44ee-8e10-8c3668a31af9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.431445 Sep 01 05:04:01.103286 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1717/3442] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:00 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:02.113830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:02.116216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:02.127322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:02.128127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:02.141662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:02.143240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:02.144014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:02.147705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:02.148358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:02.149020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:02.149193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:02.150289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:02.153863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:02.155747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:02.160892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:02.162929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:02.439715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:02.456741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:02.459154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:02.473484 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35fa4be5-8982-47c9-89bf-5d211a1dd1a6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.350284 Sep 01 05:04:02.492672 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1718/3443] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:02 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:02.661036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:02.676828 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-648a2851-7f2b-48f4-8bb9-a49672adcea2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.571919 Sep 01 05:04:02.677442 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1726/3444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:02 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:03.506136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:03.507713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:03.519599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:03.519982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:03.520410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:03.529173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:03.529935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:03.531364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:03.701133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:03.702388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:03.712835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:03.719824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:03.720627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:03.721696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:03.722440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:03.723082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:03.756599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:03.777608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:03.787727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:03.794879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-659e31d9-abb8-4b68-84e0-411905354c0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.292944 Sep 01 05:04:03.811164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:03.811707 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1719/3445] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:03 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:04.333860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:04.344209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6c79375-639d-40b4-85e3-02425117b4d7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.648419 Sep 01 05:04:04.376474 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1727/3446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:03 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:04.821833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:04.822445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:04.844534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:04.845352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:04.847845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:04.848776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:04.849055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:04.849484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:05.285255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:05.310535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:05.318712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:05.330847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3254a9b-6eac-40db-8067-edda04a89b26 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.512789 Sep 01 05:04:05.351774 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1720/3447] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:04 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:05.384202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:05.385997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:05.416563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:05.417499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:05.418280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:05.420437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:05.424233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:05.428885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:06.365372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:06.366677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:06.382747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:06.384877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:06.385609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:06.389771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:06.410071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:06.410918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:06.412407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:06.413960 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58f9cb60-5a13-49dc-b5ac-17ede3570d6d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 1.034681 Sep 01 05:04:06.420636 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1728/3448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:05 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:07.126154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:07.139627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:07.142988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:07.157531 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fcec79b-e490-4fb7-bedd-285c6df881f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.796607 Sep 01 05:04:07.160413 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1721/3449] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:06 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:07.472134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:07.473522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:07.486225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:07.489691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:07.496027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:07.500983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:07.501800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:07.502482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:07.936007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:07.944283 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84b165d9-5926-4a0d-99df-2d3c64937eb6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.480900 Sep 01 05:04:07.951788 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1729/3450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:07 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:08.191474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:08.193080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:08.223561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:08.224064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:08.224496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:08.225209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:08.239619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:08.244085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:08.381089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:08.394979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:08.396424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:08.428395 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-427258bc-c851-4383-8622-6e113d9e8137 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.244579 Sep 01 05:04:08.443213 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1722/3451] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:08 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:08.976731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:08.977842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:09.001060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:09.001954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:09.007079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:09.008609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:09.009480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:09.012013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:09.456809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:09.457386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:09.470231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:09.475702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:09.476450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:09.478070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:09.478789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:09.479621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:09.742781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:09.748926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:09.761473 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef7ab761-22fb-41b6-b90f-37632b156af1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.790279 Sep 01 05:04:09.762086 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1730/3452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:08 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:09.765978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:09.768226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:09.786165 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea9daf0d-127c-445a-b45f-7482101b12a1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.335480 Sep 01 05:04:09.787493 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1723/3453] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:09 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:10.787178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:10.789098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:10.814452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:10.815258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:10.815967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:10.816920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:10.819121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:10.823348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:10.824444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:10.825369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:10.831849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:10.832487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:10.833945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:10.836245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:10.837054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:10.841112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:11.104064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:11.119959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:11.134130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:11.149985 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cbdfe49-25ce-4e8f-b5ae-4da90ea96f3c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.339209 Sep 01 05:04:11.167392 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1724/3454] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:10 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:11.451611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:11.464081 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d297048b-2caf-4420-9520-708307aa2ebd tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.685060 Sep 01 05:04:11.477370 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1731/3455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:10 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:12.183928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:12.185049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:12.200559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:12.201169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:12.201480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:12.202174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:12.202737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:12.203193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:12.350107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:12.364775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:12.367217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:12.377752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12468a39-1bf2-4d7e-94c1-8e99b7d92fd4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1537 microversion: 2.91 time: 0.199807 Sep 01 05:04:12.379405 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1725/3456] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:12 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:12.492977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:12.494810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:12.514171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:12.516348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:12.517853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:12.518910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:12.520310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:12.521473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:12.829748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:12.840598 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-415a749f-8587-4a6d-9b5d-6b67465dbaf5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.354512 Sep 01 05:04:12.844285 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1732/3457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:12 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:13.428186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:13.428810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:13.459982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:13.460508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:13.461157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:13.461890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:13.462344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:13.462764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:13.654577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:13.669622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:13.672032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:13.679058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-620970b9-463b-4c39-a98a-2839b7cbf053 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1540 microversion: 2.91 time: 0.268365 Sep 01 05:04:13.693359 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1726/3458] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:13 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1540 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:13.715642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:13.718648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:13.746655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:13.747474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:13.750357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:13.751421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:13.752125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:13.752728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:13.856346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-820368-37". {{(pid=128863) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:04:13.865488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:13.866637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:13.877480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:13.879755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:13.880739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:13.884627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:13.886483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:13.887730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:14.001536 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e429c8e-db89-4bf3-b7b0-825291ddf957 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action" status: 202 len: 0 microversion: 2.91 time: 0.291167 Sep 01 05:04:14.003689 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1733/3459] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:04:13 2022] POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:04:14.028172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:14.031691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:14.049352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:14.051449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:14.052264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:14.055414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:14.057541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:14.058201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:14.268258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:14.283782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:14.288346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:14.300982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62c16d25-bb22-4738-be07-19ad7209a8ee tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1488 microversion: 2.91 time: 0.291698 Sep 01 05:04:14.301596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1734/3460] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:14 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1488 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:14.526680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:14.567675 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31e11e1e-e5a7-4b39-b59d-39ded37f9e24 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.705360 Sep 01 05:04:14.572406 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1727/3461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:13 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:15.329786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:15.330547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:15.353876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:15.354436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:15.361520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:15.362269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:15.362761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:15.363230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:15.448570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:15.449064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:15.470352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:15.470773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:15.471320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:15.485127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:15.487717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:15.488189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:15.583970 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3cc8233-6201-4b2d-aa93-cc863e93bce2 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/ips" status: 200 len: 151 microversion: 2.1 time: 0.139717 Sep 01 05:04:15.592587 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1728/3462] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:04:15 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/ips => generated 151 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:04:15.599197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:15.599760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:15.608220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:15.609882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:15.610555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:15.611574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:15.612355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:15.613260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:16.537808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:16.547986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:16.561153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:16.568730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:16.587003 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74b3d469-b785-46fc-9ead-49695af1af5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1488 microversion: 2.91 time: 1.261166 Sep 01 05:04:16.592913 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1735/3463] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:15 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1488 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:16.719603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:16.736739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-186bb34b-3d19-47bb-acbd-651023430bf1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 1.142122 Sep 01 05:04:16.739720 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1729/3464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:15 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:17.619627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:17.621504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:17.637958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:17.638459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:17.639958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:17.641029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:17.641315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:17.641763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:17.763335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:17.764251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:17.793744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:17.796458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:17.797059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:17.801102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:17.803365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:17.804544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:17.975664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:17.991577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:18.004483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:18.018780 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7854ab7d-ad57-479b-8d18-11751d3da3ef tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.404377 Sep 01 05:04:18.019760 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1736/3465] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:17 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:04:18.500144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:18.524749 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf5b412c-cce2-46ae-a496-6edfa7dd9e43 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1502 microversion: 2.1 time: 0.767166 Sep 01 05:04:18.526343 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1730/3466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:17 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1502 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:18.550691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4ea7a79-7bf3-4b68-b61c-1c30de14cd8c"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:18.568812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:18.587571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:18.592703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:18.594875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:18.596182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:18.598280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:18.600702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:18.670834 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Cannot 'attach_volume' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state rescued Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/os-volume_attachments HTTP/1.1 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 74 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "d4ea7a79-7bf3-4b68-b61c-1c30de14cd8c"}} Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'attach_volume' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state rescued Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'server_id': '93e6c322-8878-4d61-b782-6adb266189dd', 'body': {'volumeAttachment': {'volumeId': 'd4ea7a79-7bf3-4b68-b61c-1c30de14cd8c'}}} Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93e6c322-8878-4d61-b782-6adb266189dd in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 05:04:18.673491 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state rescued Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state rescued Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 409 to user: Cannot 'attach_volume' instance 93e6c322-8878-4d61-b782-6adb266189dd while it is in vm_state rescued {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9baafe3-064e-4607-bf75-82124ee20d47 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.129981 Sep 01 05:04:18.683943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1737/3467] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:04:18 2022] POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/os-volume_attachments => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:04:18.688036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:18.688778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:18.702426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:18.716151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:18.716856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:18.719917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:18.720660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:18.732463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:18.764059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bf1dc11-5fd0-4190-af3e-7c66528d7b3c"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:18.768033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:18.789352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:18.792189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:18.793090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:18.794309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:18.794806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:18.806343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:18.896924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:19.021911 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a09fab01-d7e1-46f2-b6ab-558d8d5eb8c0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action" status: 202 len: 0 microversion: 2.1 time: 0.339489 Sep 01 05:04:19.022560 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1731/3468] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:04:18 2022] POST /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:04:19.036221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:19.036935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:19.060253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:19.060806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:19.061180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:19.061901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:19.062353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:19.062873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:19.527116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d403b80c-9bb9-4dff-a21b-a08cddce673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766791 Sep 01 05:04:19.531053 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1738/3469] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:04:18 2022] POST /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:04:19.563929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:19.565016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:19.581542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:19.583518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:19.584846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:19.587606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:19.589079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:19.590431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:20.426578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:20.447441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:20.458991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:20.473347 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfc2c1d5-737c-4018-ab25-9f6a85269e0a tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.925697 Sep 01 05:04:20.475657 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1739/3470] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:19 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:21.083213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:21.097327 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2360925d-7e64-45af-82dc-78af0707c606 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1510 microversion: 2.1 time: 2.065669 Sep 01 05:04:21.098761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1732/3471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:19 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1510 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:21.504470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:21.505291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:21.526369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:21.536478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:21.539249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:21.540190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:21.543438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:21.544037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:21.850576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:21.874480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:21.876242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:21.902110 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c47ebfb-5c00-45af-9982-660386411a05 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.402135 Sep 01 05:04:21.902741 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1740/3472] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:21 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:22.128076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:22.130694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:22.145029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:22.151261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:22.151981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:22.152904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:22.153565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:22.154221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:22.930869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:22.931493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:22.943928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:22.944417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:22.944853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:22.945570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:22.946025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:22.946450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:23.529605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:23.552557 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e24aca59-7ed9-4a95-b477-4b1fb3e81c9b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1510 microversion: 2.1 time: 1.429714 Sep 01 05:04:23.555974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:23.559370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:23.572348 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1733/3473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:22 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1510 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:23.580135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:23.582546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:23.597222 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-845b2f4a-6c17-444d-bf7d-28610a243ab8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.671285 Sep 01 05:04:23.604468 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1741/3474] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:22 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:04:24.585384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:24.586259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:24.606499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:24.607041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:24.607487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:24.608212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:24.608679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:24.609107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:24.645107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:24.645738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:24.679485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:24.686605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:24.689476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:24.709122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:24.712235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:24.715420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:25.226215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:25.245673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:25.251977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:25.281544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c755b7e-6905-47a7-b85e-0685140066a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.643268 Sep 01 05:04:25.288116 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1742/3475] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:24 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:25.316709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:25.329597 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de468717-5155-40e1-a594-f40b6b3a6bba tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1510 microversion: 2.1 time: 0.749047 Sep 01 05:04:25.347398 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1734/3476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:24 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1510 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:26.324908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:26.326381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:26.346612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:26.348256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:26.349339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:26.351069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:26.352696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:26.354659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:26.355397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:26.356917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:26.370383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:26.371019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:26.371373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:26.372416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:26.377351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:26.379274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:26.716661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:26.734726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:26.736858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:26.758699 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b633ab7-c8e5-4c01-b042-476bde955565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.437909 Sep 01 05:04:26.776928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1743/3477] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:26 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:27.640557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:27.692172 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c91f0b5c-ec18-47a7-a019-fe3b7b42510f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1516 microversion: 2.1 time: 1.340025 Sep 01 05:04:27.696419 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1735/3478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:26 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1516 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:27.796936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:27.798732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:27.820905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:27.829102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:27.830371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:27.833672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:27.834554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:27.837061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:28.347678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:28.368502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:28.380117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:28.406666 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c80aa3a0-993e-49cc-968e-a9368fb26e3e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.613378 Sep 01 05:04:28.408251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1744/3479] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:27 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:29.443549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:29.445185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:29.480663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=67 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:29.492562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:29.494163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:29.495325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:29.500231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:29.504723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:29.505671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:29.871081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:29.885726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:29.900119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:29.918184 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-424d7e65-2404-4616-9777-8e67cfaf81f0 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.480242 Sep 01 05:04:29.926044 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1736/3480] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:29 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:30.972585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:30.973323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:31.008475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:31.009434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:31.009555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:31.010497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:31.016291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:31.039182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:32.169146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:32.190498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:32.204937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:32.243467 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d70e1a44-f2e9-4b91-b27b-e50197555c7d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 1.275419 Sep 01 05:04:32.250040 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1745/3481] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:30 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:32.432299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31f7465f-20c5-4af9-80d6-2f3604a39fc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'create', calling method: .version_select at 0x7fa760329e50>, body: {"keypair": {"name": "tempest-keypair-980572928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUVJHjp0Qp4OrIkHvA98IJzgcoReCFeRbUPY/WMzm9SPDdl0WamdrnJS+GRQik+U/G9m84FyOs6+1hN3oMoJX9Q9E8CNzCXQzke5sqQolHF+0iRYw2y+jo20XoR3OZYMQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:32.516040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-31f7465f-20c5-4af9-80d6-2f3604a39fc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:04:32.548729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-31f7465f-20c5-4af9-80d6-2f3604a39fc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for user 3908868db8e340f2b24025c148fd3d40 and project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:04:32.627718 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31f7465f-20c5-4af9-80d6-2f3604a39fc8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199672 Sep 01 05:04:32.633288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1737/3482] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:04:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:32.862972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-542313924", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "6a55ef29-3665-4ee4-9546-ea904fa17891"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:33.072919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] validate_networks() for [('6a55ef29-3665-4ee4-9546-ea904fa17891', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:04:33.274524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:33.275414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:33.285808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:33.286287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:33.286736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:33.287523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:33.287996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:33.300546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:33.828671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:33.848092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:33.850580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:33.864024 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64579f46-3a17-4da0-ab35-5652fd410d5d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.593378 Sep 01 05:04:33.868438 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1738/3483] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:33 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:04:34.656225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:04:34.656796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:04:34.658261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:04:34.659363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:04:34.659897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:04:34.700454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:34.703941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:34.706432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:34.709583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:34.711144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:34.712078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:34.784381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Getting quotas for project 955a8b83d53e4051821332d61b01dc9b. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:04:34.791166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Getting quotas for user 08997672c334463aa87b00fa1f6a9a56 and project 955a8b83d53e4051821332d61b01dc9b. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:04:34.834750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:04:34.837934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:04:34.903298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:34.903298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:34.917843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:34.928793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:34.929848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:34.936610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:34.938810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:34.944857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:35.078241 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c906305-a0c8-4058-8b9c-63a3de9fd5e0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.503053 Sep 01 05:04:35.081522 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1746/3484] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:04:35.095743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85e77e0f-8f67-4462-8b62-1c076c4e6668 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:35.096552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85e77e0f-8f67-4462-8b62-1c076c4e6668 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:35.215762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:35.245296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:35.251119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:35.279807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ec6e5c8-7871-4d53-9907-9196a1b79b80 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.384040 Sep 01 05:04:35.280424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1739/3485] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:34 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:35.441869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85e77e0f-8f67-4462-8b62-1c076c4e6668 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:35.462007 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85e77e0f-8f67-4462-8b62-1c076c4e6668 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1217 microversion: 2.1 time: 0.370357 Sep 01 05:04:35.462622 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1747/3486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:35 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:36.312942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:36.313786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:36.353470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:36.354456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:36.368867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:36.369920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:36.370539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:36.371027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:36.523336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:36.524771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:36.553715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:36.554394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:36.554723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:36.558530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:36.559322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:36.561421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:36.994038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:37.003738 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bec6d2a7-23f7-4ddc-8f12-4dd1abc04db6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1221 microversion: 2.1 time: 0.515229 Sep 01 05:04:37.006127 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1748/3487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:36 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1221 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:37.013006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:37.055037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:37.058251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:37.069934 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71164bf9-767f-491f-bace-da0cd0cd35b1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.762873 Sep 01 05:04:37.071464 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1740/3488] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:36 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:38.033579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:38.034854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:38.104733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:38.107054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:38.107421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:38.111801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:38.113109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:38.115963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:38.132105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:38.132852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:38.180688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:38.182075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:38.182835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:38.184142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:38.191230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:38.195656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:38.469405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:38.477718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:38.484150 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-844e336e-e34f-4ef9-b148-550f2ace0db7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1269 microversion: 2.1 time: 0.461481 Sep 01 05:04:38.492553 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1749/3489] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:38 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1269 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:38.501417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:38.506615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:38.519573 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccb01d46-6d64-4529-99ea-c7b241fa1492 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.424257 Sep 01 05:04:38.538357 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1741/3490] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:38 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:39.147124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-994656132", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b759c36e-f7d8-44ac-a2b7-b10948466f71"}], "security_groups": [{"name": "tempest-securitygroup--413632521"}], "key_name": "tempest-keypair-980572928", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:39.512586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:39.515608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:39.535467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:39.536267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:39.537262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:39.538785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:39.540016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:39.540992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:40.268411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:40.281805 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e33e826e-042a-4db8-a9e4-1870842b2f3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1275 microversion: 2.1 time: 0.778868 Sep 01 05:04:40.283290 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1742/3491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:39 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1275 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:40.289839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:40.290742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:40.292457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] validate_networks() for [('b759c36e-f7d8-44ac-a2b7-b10948466f71', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:04:40.305996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:40.307059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:40.308129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:40.309445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:40.310301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:40.311138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:40.680623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:40.691933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:40.694410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:40.702932 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58b4080c-c296-47e6-8853-b115be13c393 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1533 microversion: 2.91 time: 0.417274 Sep 01 05:04:40.709887 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1743/3492] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:40 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1533 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:40.770699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:40.771822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:40.784468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:40.784976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:40.785682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:40.786435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:40.787417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:40.787776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:40.993865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lazy-loading 'services' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:04:41.038725 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c387af75-e7d6-4d03-85b4-cd8025d294a5 tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1940 microversion: 2.91 time: 0.273465 Sep 01 05:04:41.040171 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1744/3493] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:40 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1940 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:41.074660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:41.075949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:41.088573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:41.090710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:41.091527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:41.093848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:41.094697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:41.095509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:41.148009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lazy-loading 'flavor' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:04:41.556039 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4b053a8-7a57-4f14-816f-ecaaa4f1b819 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action" status: 202 len: 0 microversion: 2.91 time: 0.491853 Sep 01 05:04:41.557597 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1745/3494] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:04:41 2022] POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:04:41.563964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:41.565653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:41.574448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:41.575598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:41.576486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:41.577792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:41.578533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:41.579197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:41.599493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:41.744491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:41.765439 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d57731b2-f9c5-4c07-9cf3-d88d59c58559 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1275 microversion: 2.1 time: 0.206275 Sep 01 05:04:41.770932 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1746/3495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:41 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:41.779868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bf1dc11-5fd0-4190-af3e-7c66528d7b3c"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:41.797067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:41.811333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:41.812481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:41.813206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:41.815712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:41.816846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:41.817767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.035203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Invalid volume: volume 9bf1dc11-5fd0-4190-af3e-7c66528d7b3c is already attached to instances: 22ff2d06-6e45-4684-8043-d1b0f45c793c Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments HTTP/1.1 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 74 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: {"volumeAttachment": {"volumeId": "9bf1dc11-5fd0-4190-af3e-7c66528d7b3c"}} Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid volume: volume 9bf1dc11-5fd0-4190-af3e-7c66528d7b3c is already attached to instances: 22ff2d06-6e45-4684-8043-d1b0f45c793c Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '22ff2d06-6e45-4684-8043-d1b0f45c793c', 'body': {'volumeAttachment': {'volumeId': '9bf1dc11-5fd0-4190-af3e-7c66528d7b3c'}}} Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9bf1dc11-5fd0-4190-af3e-7c66528d7b3c is already attached to instances: 22ff2d06-6e45-4684-8043-d1b0f45c793c Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:04:42.039404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9bf1dc11-5fd0-4190-af3e-7c66528d7b3c is already attached to instances: 22ff2d06-6e45-4684-8043-d1b0f45c793c Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9bf1dc11-5fd0-4190-af3e-7c66528d7b3c is already attached to instances: 22ff2d06-6e45-4684-8043-d1b0f45c793c Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 400 to user: Invalid volume: volume 9bf1dc11-5fd0-4190-af3e-7c66528d7b3c is already attached to instances: 22ff2d06-6e45-4684-8043-d1b0f45c793c {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b4cb64a-8b12-41a5-9588-fa7c6d8a3efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.271818 Sep 01 05:04:42.046525 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1747/3496] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:04:41 2022] POST /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 174 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:04:42.075700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:42.082164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:42.087636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:04:42.087636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:04:42.089041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:04:42.089661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:04:42.090640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:04:42.108348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.112412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.113578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.115781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.116750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.117528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.118419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.119789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.122055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.125309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.126184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.130733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.178460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:04:42.195593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Getting quotas for user 3908868db8e340f2b24025c148fd3d40 and project 6d30cd8cf35b46a79180096815df2f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:04:42.228215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:04:42.236741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:04:42.328161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:42.349586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:42.351111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:42.375798 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76613fcf-2797-4c9a-9491-884accb80a66 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.327425 Sep 01 05:04:42.376676 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1748/3497] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:42 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:42.396249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a78f21f8-36a7-4569-a2c2-a4593928be20 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.254068 Sep 01 05:04:42.411275 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1750/3498] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:04:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 3265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:04:42.411614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:42.411614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:42.415372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.415372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.415372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.416429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.417662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.420743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.424726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bd663a4-31d6-4c0f-aeeb-7ae47575d556 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:42.425426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1bd663a4-31d6-4c0f-aeeb-7ae47575d556 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:42.577764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:42.663126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lazy-loading 'services' on Instance uuid 22ff2d06-6e45-4684-8043-d1b0f45c793c {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:04:42.671376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1bd663a4-31d6-4c0f-aeeb-7ae47575d556 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:42.681447 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1bd663a4-31d6-4c0f-aeeb-7ae47575d556 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1244 microversion: 2.1 time: 0.262322 Sep 01 05:04:42.686707 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1751/3499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:42 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1244 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:42.811387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:42.812633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:42.825510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.827036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.827550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.832010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.832445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.833176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.857648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce5ee244-e8a8-408d-876b-48d26aefc043 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments/9bf1dc11-5fd0-4190-af3e-7c66528d7b3c" status: 202 len: 0 microversion: 2.1 time: 0.458521 Sep 01 05:04:42.859017 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1749/3500] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:04:42 2022] DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments/9bf1dc11-5fd0-4190-af3e-7c66528d7b3c => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:04:42.878738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:42.887798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:42.915778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.918207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.920461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:42.924756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:42.926359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:42.926815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:43.055042 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1775208a-41bd-49ed-b984-b1db52856dd6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187956 Sep 01 05:04:43.055639 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1750/3501] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:42 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:43.419100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:43.420258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:43.436648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:43.438304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:43.441465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:43.443128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:43.444726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:43.446326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:44.049704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:44.084988 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14618fd5-24fb-481a-89ce-a728ad711c02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 1.284188 Sep 01 05:04:44.087312 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1752/3502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:42 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:44.121776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:44.122866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:44.146338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:44.153163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:44.154307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:44.159558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:44.161657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:44.162570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:44.164059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:44.165130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:44.172556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:44.180394 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1a38608-1432-4ac2-b176-5ac92ef346b9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.769339 Sep 01 05:04:44.181829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1751/3503] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:43 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:04:44.194990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:44.197909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:44.213848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:44.216118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:44.220279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:44.220957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:44.221433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:44.222085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:44.338674 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2188ccd1-8c93-4732-b2f1-c3580377e1de tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155069 Sep 01 05:04:44.340665 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1752/3504] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:44 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:44.441124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:44.474846 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aca2a3c3-5b72-4bed-b7f1-2ec3df34eb4e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1296 microversion: 2.1 time: 0.372060 Sep 01 05:04:44.476607 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1753/3505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:44 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1296 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:44.623345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:44.628637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:44.659731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:44.660962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:44.661933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:44.663438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:44.664516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:44.666587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:45.132621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:45.133650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:45.164716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:45.165237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:45.165747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:45.166560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:45.167077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:45.167528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:45.900563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:45.918047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:45.921840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:45.927321 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2a33c18-8121-4e5c-8ffc-905f4d54e2f7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2951 microversion: 2.42 time: 1.309133 Sep 01 05:04:45.942816 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1753/3506] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:44 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2951 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:45.960227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:45.965453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:45.978084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:45.978831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:45.979689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:45.981311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:45.985220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:45.985744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.111178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:46.122700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6c29265-a72b-4509-b1b7-a9d8a3cfda5d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 0.997842 Sep 01 05:04:46.123979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1754/3507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:45 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:46.134372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:46.137930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:46.146613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.147431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.148051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.148940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.149742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.150774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.167785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:46.182830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:46.184597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:46.201134 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4865cbad-01aa-4b70-8632-b33c37d71648 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.256837 Sep 01 05:04:46.203891 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1754/3508] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:45 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:46.224939 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fae942c-10c8-4ce5-92ca-76553232b964 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099295 Sep 01 05:04:46.225432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:46.226475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:46.228592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1755/3509] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:46 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:46.238571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:46.241447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.242253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.243215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:46.243960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.248743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.249586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.250248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.261012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.265355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.266911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.267975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.268670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.269336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:46.593708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:46.624521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c29087b7-67a7-4227-91bc-35279849c7ee tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1302 microversion: 2.1 time: 0.418837 Sep 01 05:04:46.628637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1755/3510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:46 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1302 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:46.882575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a03a2f5-3401-4a08-a291-947395645818 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.651663 Sep 01 05:04:46.883620 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1756/3511] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 05:04:46 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8/os-interface => generated 1828 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:46.917060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4a56475b-9c9f-4a71-bfdb-a5ea3dceef8b req-c9431095-3eb9-4094-91d5-82a58f2fbe2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb0702b-3d1c-476f-951b-8039a1bb1f5d", "tag": "81f82c12-4553-4817-8a49-4e69fbb7bdc1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:46.955656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a56475b-9c9f-4a71-bfdb-a5ea3dceef8b req-c9431095-3eb9-4094-91d5-82a58f2fbe2b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:46.956492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a56475b-9c9f-4a71-bfdb-a5ea3dceef8b req-c9431095-3eb9-4094-91d5-82a58f2fbe2b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:46.957239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a56475b-9c9f-4a71-bfdb-a5ea3dceef8b req-c9431095-3eb9-4094-91d5-82a58f2fbe2b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.007808 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4a56475b-9c9f-4a71-bfdb-a5ea3dceef8b req-c9431095-3eb9-4094-91d5-82a58f2fbe2b service nova] Creating event network-changed:81f82c12-4553-4817-8a49-4e69fbb7bdc1 for instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d on n-h2-820368-37 Sep 01 05:04:47.037616 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4a56475b-9c9f-4a71-bfdb-a5ea3dceef8b req-c9431095-3eb9-4094-91d5-82a58f2fbe2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127881 Sep 01 05:04:47.039216 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1756/3512] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:04:47.153019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:47.162197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:47.202665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.203838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.205810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.207608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.208756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.209798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.238019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:47.248780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:47.270311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.274233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.275085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.277039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.277858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.278597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.701630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:47.731970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:47.741608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:47.762620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93fca1d6-f675-4e93-8b7e-6fa0a1c61490 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.532926 Sep 01 05:04:47.763514 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1757/3513] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:47 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:47.774804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:47.783181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:47.804453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.805274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.806477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.810040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.810747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.812523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.896130 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eeb23a88-3a09-4782-b027-b798d6b1c726 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131181 Sep 01 05:04:47.896792 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1758/3514] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:47 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:47.911733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:47.914643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:47.928482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.930074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.930918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:47.933554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:47.934226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:47.934977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:48.684757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:48.712224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45d3427f-38ac-4ced-89ea-c3f888dea052 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 1.566046 Sep 01 05:04:48.713632 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1757/3515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:47 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:48.753621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6267e3f1-1595-4161-aff4-e2add03d1264 req-7ed38457-b1f7-4665-a206-4624e0473668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:48.782525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:48.823887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6267e3f1-1595-4161-aff4-e2add03d1264 req-7ed38457-b1f7-4665-a206-4624e0473668 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:48.824767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6267e3f1-1595-4161-aff4-e2add03d1264 req-7ed38457-b1f7-4665-a206-4624e0473668 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:48.825469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6267e3f1-1595-4161-aff4-e2add03d1264 req-7ed38457-b1f7-4665-a206-4624e0473668 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:48.870825 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6267e3f1-1595-4161-aff4-e2add03d1264 req-7ed38457-b1f7-4665-a206-4624e0473668 service nova] Creating event network-changed:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:04:48.894139 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6267e3f1-1595-4161-aff4-e2add03d1264 req-7ed38457-b1f7-4665-a206-4624e0473668 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177979 Sep 01 05:04:48.895787 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1758/3516] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:48.917187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:48.921300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:48.951373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:48.952535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:48.953666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:48.955302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:48.956460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:48.958461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:49.240717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:49.255915 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-039ecb71-9006-4bae-9eeb-caa438badf9c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1369 microversion: 2.1 time: 1.355399 Sep 01 05:04:49.256580 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1759/3517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:47 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1369 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:49.266369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:49.271900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:49.288330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:49.289158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:49.293147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:49.294417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:49.295093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:49.295714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:49.368775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c1d9e43-923c-4679-8ec2-a3ccf30852fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110721 Sep 01 05:04:49.372439 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1760/3518] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:49 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:49.411557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:49.454210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:49.462075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:49.500720 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba334d48-7b27-4835-8036-b25403326d30 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.602598 Sep 01 05:04:49.502116 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1759/3519] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:48 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:49.746833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:49.751329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:49.773600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:49.774100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:49.774554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:49.791114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:49.791893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:49.793648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.215027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:50.227995 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c2301e8-3a43-4ca3-9cb1-adc16f419b4a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 0.494780 Sep 01 05:04:50.240459 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1761/3520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:49 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:50.278806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:50.279712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:50.298176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:50.300391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:50.303526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.306062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:50.308347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:50.309995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.390594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:50.394203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:50.403103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:50.404299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:50.405278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.406274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:50.407356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:50.408061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.451646 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94301f31-8353-4eda-a498-346dfa814697 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067246 Sep 01 05:04:50.457163 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1762/3521] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:50 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:04:50.541102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:50.543961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:50.564202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:50.565472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:50.566439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.568783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:50.569994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:50.570853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:50.580623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:50.581906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:50.593313 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d39cada7-ea98-40bf-bb59-cbb0752d6e29 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1369 microversion: 2.1 time: 0.320007 Sep 01 05:04:50.593915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1760/3522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:50 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1369 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:50.743175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:50.768356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:50.774068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:50.787338 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db497d81-673c-4345-89b7-ede72f0388d9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.258566 Sep 01 05:04:50.789025 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1763/3523] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:50 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:51.259783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:51.276069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:51.292903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.295264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.296474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.298003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.299198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.300947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.467434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:51.476156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:51.492450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.493004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.496882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.498538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.499704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.502363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.598741 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e0e6f4b-630f-42d6-a708-315685df8d61 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136975 Sep 01 05:04:51.606125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1764/3524] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:51 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:04:51.619569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:51.620253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:51.634479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.639614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.640559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.641589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.643538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.646839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.736294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:51.754564 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d097c28c-699d-4b55-944a-df2a1d6e7e08 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 0.502652 Sep 01 05:04:51.768680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1761/3525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:51 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:51.828824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:51.831827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:51.839317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.840394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.841038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:51.845418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:51.846283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:51.846999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.082379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:52.086511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:52.108899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:52.113598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:52.129096 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3ebcc59-ebeb-47c0-90f5-c660c9d8bc68 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.305260 Sep 01 05:04:52.132452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1762/3526] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:51 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:52.217967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:52.232255 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1ad2230-49c5-44cc-9ce9-d4f491f2273c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1369 microversion: 2.1 time: 0.618933 Sep 01 05:04:52.235398 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1765/3527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:51 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1369 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:52.624229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:52.632641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:52.652259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:52.659694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:52.661417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:52.662815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.665143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:52.667070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:52.669467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.682984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:52.757870 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5adbb25-85b2-4e4a-91b3-a05d3550673a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144112 Sep 01 05:04:52.766214 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1763/3528] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:04:52 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:04:52.796833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:52.801886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:52.827519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:52.828194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:52.828816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.829734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:52.830339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:52.830935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.890651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:52.892142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:52.908480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:52.909299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:52.909958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.911042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:52.912130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:52.912820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:52.948856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:04:53.095262 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bb09ef9-e033-41b9-990e-8b8556cdc7ef tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 204 len: 0 microversion: 2.1 time: 0.226303 Sep 01 05:04:53.096628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1764/3529] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:04:52 2022] DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:04:53.110822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:53.112700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:53.120729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:53.121676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:53.123058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:53.124449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:53.125294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:53.125967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:54.145202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:54.163361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2881e2d-c60f-4944-9038-e7d38033adc0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 1.375595 Sep 01 05:04:54.177384 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1766/3530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:52 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:54.185770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:54.187422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:54.198669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:54.199908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:54.200893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:54.202363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:54.203512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:54.204587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:54.205043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:54.220304 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8368f214-8982-4e74-8763-9a09aad74bf1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1682 microversion: 2.1 time: 1.115051 Sep 01 05:04:54.221367 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1765/3531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:53 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1682 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:54.234117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:54.234744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:54.252136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:54.252783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:54.253236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:54.256252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:54.257199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:54.257652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:54.412070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:54.442809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:54.450969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:54.468970 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9bf0231-8d91-49c4-ac97-4fbbf23e299e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.289914 Sep 01 05:04:54.474718 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1767/3532] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:54 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:54.638911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:54.695215 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10c7dd43-0a30-4818-9fe0-7c911a1d9c79 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1369 microversion: 2.1 time: 0.472349 Sep 01 05:04:54.706551 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1766/3533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:54 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1369 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:55.203905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:55.204662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:55.216916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:55.218487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:55.219061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:55.219745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:55.222274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:55.223021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:55.227070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:55.254060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:55.255971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:55.268352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:55.269158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:55.269775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:55.272125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:55.275175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:55.275921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:55.946470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:55.962263 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71dc812f-ff68-4ac7-af58-2c0a9c645570 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 0.761819 Sep 01 05:04:55.964516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1768/3534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:55 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:55.964916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:55.971479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:55.972343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:55.982174 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e954430c-4269-48da-aaa5-3a526b062527 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1682 microversion: 2.1 time: 0.732247 Sep 01 05:04:55.982565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:55.983121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1767/3535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:55 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1682 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:55.984069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:55.984928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:55.985845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:55.986821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:55.987928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:55.988309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8741576e-9143-4846-b077-cd294065672a req-2b4b60d8-16c2-4479-b130-5e5cfc348e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "name": "network-vif-plugged", "status": "completed", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:56.013173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8741576e-9143-4846-b077-cd294065672a req-2b4b60d8-16c2-4479-b130-5e5cfc348e27 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:56.015572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8741576e-9143-4846-b077-cd294065672a req-2b4b60d8-16c2-4479-b130-5e5cfc348e27 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:56.017734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8741576e-9143-4846-b077-cd294065672a req-2b4b60d8-16c2-4479-b130-5e5cfc348e27 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:56.051649 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8741576e-9143-4846-b077-cd294065672a req-2b4b60d8-16c2-4479-b130-5e5cfc348e27 service nova] Creating event network-vif-plugged:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:04:56.066183 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8741576e-9143-4846-b077-cd294065672a req-2b4b60d8-16c2-4479-b130-5e5cfc348e27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081757 Sep 01 05:04:56.067506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1768/3536] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:56.080794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:56.081840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:56.089005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:56.089825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:56.090470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:56.091430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:56.092085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:56.092738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:56.412953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:56.435543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:56.438092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:56.458638 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58c1d016-0d73-4860-909f-b13979e6b65b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.492329 Sep 01 05:04:56.464864 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1769/3537] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:55 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:56.480494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-963150bd-ab4d-4447-bd54-584beaa0678c req-f50ba44f-77a0-49e5-a7c7-7bd16b718c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ff2d06-6e45-4684-8043-d1b0f45c793c", "name": "network-vif-deleted", "tag": "fd85ed3a-74f7-414b-bddd-f9b6784cc144"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:56.502761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-963150bd-ab4d-4447-bd54-584beaa0678c req-f50ba44f-77a0-49e5-a7c7-7bd16b718c33 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:56.505454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-963150bd-ab4d-4447-bd54-584beaa0678c req-f50ba44f-77a0-49e5-a7c7-7bd16b718c33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:56.507667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-963150bd-ab4d-4447-bd54-584beaa0678c req-f50ba44f-77a0-49e5-a7c7-7bd16b718c33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:56.536046 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-963150bd-ab4d-4447-bd54-584beaa0678c req-f50ba44f-77a0-49e5-a7c7-7bd16b718c33 service nova] Creating event network-vif-deleted:fd85ed3a-74f7-414b-bddd-f9b6784cc144 for instance 22ff2d06-6e45-4684-8043-d1b0f45c793c on n-h1-820368-37 Sep 01 05:04:56.545366 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-963150bd-ab4d-4447-bd54-584beaa0678c req-f50ba44f-77a0-49e5-a7c7-7bd16b718c33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078635 Sep 01 05:04:56.551163 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1770/3538] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:56.683535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:56.709421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66f442c8-bb71-4cd0-a50a-5a1b6927a143 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1369 microversion: 2.1 time: 0.640333 Sep 01 05:04:56.712126 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1769/3539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:56 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1369 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:56.988056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:56.989095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:56.999039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.005228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:57.006168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:57.011718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.012173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.012929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.013385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.013810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.020978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.021763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.022366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.023348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.023972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.024720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.108156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.109424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.110424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.111261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lazy-loading 'fault' on Instance uuid 22ff2d06-6e45-4684-8043-d1b0f45c793c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:04:57.193932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:57.211825 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f29667d8-20e9-4840-bc28-6829d7cf9f7a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 200 len: 1331 microversion: 2.1 time: 0.209388 Sep 01 05:04:57.231235 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1770/3540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:56 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 1331 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:04:57.425141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:57.434462 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7539edd9-87bd-4ba8-afb9-cfb2b2ad13c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 0.450637 Sep 01 05:04:57.449522 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1771/3541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:56 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:57.497549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:57.499418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:57.516884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.518534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.521113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.523208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.524642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.526552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.680319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:57.711210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:57.718033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:57.735331 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed016f86-1b75-4f61-af86-3ebdc41fd93b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1560 microversion: 2.91 time: 0.242748 Sep 01 05:04:57.736972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1771/3542] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:57 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:57.760316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:57.761894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:57.769167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.769920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.770561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:57.771530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:57.772163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:57.772834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.132732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:58.142828 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ac4c9da-de7d-460e-9b49-eb69a4d35281 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1369 microversion: 2.1 time: 0.387721 Sep 01 05:04:58.149279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1772/3543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:57 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1369 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:04:58.304424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e8bea6a9-7166-4412-a0a9-a56e286f3550 req-ae154581-7f0c-427d-b6c4-ba6db342d58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb0702b-3d1c-476f-951b-8039a1bb1f5d", "name": "network-vif-plugged", "status": "completed", "tag": "81f82c12-4553-4817-8a49-4e69fbb7bdc1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:04:58.305400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:58.305400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:58.321436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.327323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.329635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.333789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.338620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e8bea6a9-7166-4412-a0a9-a56e286f3550 req-ae154581-7f0c-427d-b6c4-ba6db342d58e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.339832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e8bea6a9-7166-4412-a0a9-a56e286f3550 req-ae154581-7f0c-427d-b6c4-ba6db342d58e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.340294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e8bea6a9-7166-4412-a0a9-a56e286f3550 req-ae154581-7f0c-427d-b6c4-ba6db342d58e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.341136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.342072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.382077 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e8bea6a9-7166-4412-a0a9-a56e286f3550 req-ae154581-7f0c-427d-b6c4-ba6db342d58e service nova] Creating event network-vif-plugged:81f82c12-4553-4817-8a49-4e69fbb7bdc1 for instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d on n-h2-820368-37 Sep 01 05:04:58.386756 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c HTTP/1.1 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '22ff2d06-6e45-4684-8043-d1b0f45c793c'} Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:04:58.392715 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:04:58.399967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:04:58.400850 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e8bea6a9-7166-4412-a0a9-a56e286f3550 req-ae154581-7f0c-427d-b6c4-ba6db342d58e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167569 Sep 01 05:04:58.400850 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1772/3544] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:04:58.402473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:04:58.404997 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64bde9a6-c625-4a92-869a-4c8ee1422839 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 404 len: 111 microversion: 2.1 time: 0.158881 Sep 01 05:04:58.410563 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1773/3545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:58 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:04:58.419836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cc3cade-349c-4f02-ac1a-6feda9036b51 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '.version_select at 0x7fa75b39b670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:58.466194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:58.466987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:58.474239 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cc3cade-349c-4f02-ac1a-6feda9036b51 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838459883" status: 202 len: 0 microversion: 2.1 time: 0.061011 Sep 01 05:04:58.479748 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1773/3546] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:04:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838459883 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:04:58.491730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.492838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.494259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.495767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.498027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.499737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.796398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:58.798628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:58.816279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.859371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.860439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:58.865868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:58.871169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:58.871926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:59.601279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:59.623304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:59.633426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:04:59.648418 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8071288-7074-4671-9b10-f5513944be0d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1560 microversion: 2.91 time: 0.870749 Sep 01 05:04:59.656829 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1774/3547] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:04:58 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1560 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:04:59.679836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:04:59.684181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:04:59.705801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:59.706592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:59.709771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:04:59.711670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:04:59.717122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:04:59.717601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:00.019362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:00.034428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-caf2bdaa-36bb-4515-9f96-90fd919fb43d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 1.576257 Sep 01 05:05:00.043327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1774/3548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:58 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:00.473437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:00.515584 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f73412c4-10ca-49f9-92e5-59c925f18786 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1564 microversion: 2.1 time: 0.840923 Sep 01 05:05:00.524601 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1775/3549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:04:59 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1564 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:00.547645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:00.548049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:00.560174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:00.564417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:00.565178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:00.575540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:00.579237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:00.579899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:00.689337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:00.690441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:00.722975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:00.723867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:00.724615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:00.727044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:00.728380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:00.729464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:00.902172 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edf41782-c8f6-408b-a916-b788fb01327b tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358981 Sep 01 05:05:00.903637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1775/3550] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:05:00 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-interface => generated 285 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:01.064043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:01.065485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:01.084600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:01.085132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:01.085668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:01.086304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:01.086767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:01.087247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:01.832108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:01.843241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:01.850559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:01.868716 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0410c335-00fa-4932-aaaf-5ba970b9b1c4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 1.186469 Sep 01 05:05:01.869488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1776/3551] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:00 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:01.881200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-311ab496-96fa-4b4c-aab2-d600c40d0a00 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: .version_select at 0x7fa75b2e0160>, body: {"keypair": {"name": "tempest-keypair-1195252899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBVpsBgxkEreDokpZie/JFrIsQ5N7wpj9p+KIaj1DScoa/QHw7H64A1l/flh+PVQMsKgaxQWpDDAmj+8EQJczJdmxynkgbdsB7KtbCZ3MTdHy7GjpMecW3IQV0ZFQFnIQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:01.926653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-311ab496-96fa-4b4c-aab2-d600c40d0a00 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:05:01.941726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-311ab496-96fa-4b4c-aab2-d600c40d0a00 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:05:02.025079 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-311ab496-96fa-4b4c-aab2-d600c40d0a00 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154104 Sep 01 05:05:02.026200 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1777/3552] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:05:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:02.934578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:02.935236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:02.962144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:02.963116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:02.966402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:02.967458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:02.971656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:02.976265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:03.289909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:03.334794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-752a3b60-e4d1-4780-9e3c-82c5d4ed50cc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1317 microversion: 2.1 time: 2.274682 Sep 01 05:05:03.335916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1776/3553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:01 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1317 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:03.350540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:03.382521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:03.394742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:03.421325 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4768fe4f-5ef5-4a9c-96ee-209d368f6816 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.497017 Sep 01 05:05:03.427374 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1778/3554] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:02 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:04.375478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:04.376308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:04.397787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:04.398269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:04.398878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:04.399799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:04.400472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:04.401221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:04.470958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:04.473027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:04.518053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:04.519259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:04.520202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:04.521728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:04.522815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:04.523848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:04.833884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:04.849592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:04.854480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:04.862343 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cddef86-b247-4a40-a7e4-eba472bff692 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.398673 Sep 01 05:05:04.864739 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1779/3555] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:04 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:05.001629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:05.010329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a38d3bb-b5bc-4c18-b37f-717dff0bb735 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1507 microversion: 2.1 time: 0.638722 Sep 01 05:05:05.029590 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1777/3556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:04 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1507 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:05.037229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:05.039650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:05.065347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:05.068062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:05.069954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:05.072265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:05.073270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:05.073883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:05.896263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:05.897320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:05.924372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:05.925214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:05.925944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:05.927235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:05.927979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:05.928647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:06.375819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:06.384731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:06.393745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:06.405231 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-054d323c-2b6c-42e2-9c86-06c0bf3d7046 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.515705 Sep 01 05:05:06.406658 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1778/3557] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:05 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:06.678760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:06.681399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:06.691884 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19dd3e56-5530-44fd-9315-0296bdbf2af3 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1507 microversion: 2.1 time: 1.662567 Sep 01 05:05:06.696508 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1780/3558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:05 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1507 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:06.718591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:06.725648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:06.735553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:06.736843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:06.737511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:06.738452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:06.739517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:06.740195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:06.851674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:05:06.852558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:05:06.853354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:05:06.854134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:05:06.854781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:05:06.987777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:07.007689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:07.011544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:07.015601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:07.016903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:07.019054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:07.027087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:07.095615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:07.130612 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a0faa85-9b57-4787-9a0e-82c405fb7867 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "POST /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d/action" status: 202 len: 1109 microversion: 2.1 time: 0.414855 Sep 01 05:05:07.137458 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1779/3559] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:05:06 2022] POST /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d/action => generated 1109 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 01 05:05:07.176572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:07.177615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:07.204509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:07.212555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:07.214238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:07.217910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:07.226845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:07.233160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:07.437188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:07.438102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:07.464222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:07.465032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:07.468486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:07.473984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:07.475126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:07.477862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:07.952309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:07.977288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:07.981003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:07.993179 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87229299-4290-4c25-a9fc-4b0f96f15af6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.562214 Sep 01 05:05:08.021833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:08.025328 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1780/3560] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:07 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:08.038236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-711723446", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9642a39a-f472-4737-aec3-d2f3e852c183"}], "security_groups": [{"name": "tempest-securitygroup--632684258"}], "key_name": "tempest-keypair-1195252899", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:08.040978 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-628f9825-4c77-4caf-aa62-2dd02adf8690 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.869160 Sep 01 05:05:08.045254 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1781/3561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:07 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:08.082044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-38eef3c7-0346-46ad-b260-8b6b65bc8425 req-e5d422cb-1621-489a-aa53-1f39145bd427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:08.119072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-38eef3c7-0346-46ad-b260-8b6b65bc8425 req-e5d422cb-1621-489a-aa53-1f39145bd427 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:08.121114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-38eef3c7-0346-46ad-b260-8b6b65bc8425 req-e5d422cb-1621-489a-aa53-1f39145bd427 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:08.121830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-38eef3c7-0346-46ad-b260-8b6b65bc8425 req-e5d422cb-1621-489a-aa53-1f39145bd427 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:08.158322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-38eef3c7-0346-46ad-b260-8b6b65bc8425 req-e5d422cb-1621-489a-aa53-1f39145bd427 service nova] Creating event network-changed:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:05:08.168050 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-38eef3c7-0346-46ad-b260-8b6b65bc8425 req-e5d422cb-1621-489a-aa53-1f39145bd427 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121058 Sep 01 05:05:08.173273 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1782/3562] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:08.574499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] validate_networks() for [('9642a39a-f472-4737-aec3-d2f3e852c183', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:05:09.054626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:09.055417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:09.080866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:09.081421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:09.081879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:09.082632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:09.083145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:09.094700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:09.410213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:05:09.410995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:05:09.411500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:05:09.411904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:05:09.412597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:05:09.451478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:09.452286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:09.453034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:09.454114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:09.454797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:09.455331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:09.497632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:09.517532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:09.526578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:09.530909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:05:09.555070 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a678401a-14ff-45ec-af21-717ef6403565 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.506641 Sep 01 05:05:09.555865 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1783/3563] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:09 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:09.567359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Getting quotas for user 15f14c11aec640a5b4dddfb2b249ddc7 and project 330e2577f5604ff485744c7f53deb302. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:05:09.579942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:09.583000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:09.599085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:05:09.615027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:05:09.617899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:09.623953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:09.625393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:09.627716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:09.628449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:09.630284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:09.735334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f08fb0c7-8be4-4204-ad1d-4eec07db3623 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.708230 Sep 01 05:05:09.737786 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1781/3564] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:05:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:05:09.753251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1692b927-5241-4dae-8b92-6b63abcc7d59 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:09.754175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1692b927-5241-4dae-8b92-6b63abcc7d59 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:10.647360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1692b927-5241-4dae-8b92-6b63abcc7d59 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:10.714871 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1692b927-5241-4dae-8b92-6b63abcc7d59 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1241 microversion: 2.1 time: 0.958660 Sep 01 05:05:10.737387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1782/3565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:09 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1241 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:10.768803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:10.772660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:10.840318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:10.841428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:10.844587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:10.848123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:10.849437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:10.853314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:10.962266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:10.989527 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5329d37b-fd54-498a-9be0-711d2f4b340a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 1.432193 Sep 01 05:05:11.022923 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1784/3566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:09 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:11.055264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:11.073365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:11.075400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:11.116967 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-524d2119-8cf2-45da-80b9-8309f6fc40f4 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.367816 Sep 01 05:05:11.127576 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1783/3567] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:10 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:11.757971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:11.783645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:11.845586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:11.846854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:11.854931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:11.863755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:11.864694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:11.867229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:11.983529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:12.039863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:12.041314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:12.079107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:12.079978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:12.080862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:12.081988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:12.082609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:12.083796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:12.372733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:12.447684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64381bba-f683-49ae-afb6-0cf415ccef18 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1237 microversion: 2.1 time: 0.662309 Sep 01 05:05:12.449283 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1785/3568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:11 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1237 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:12.464790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:12.472327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:12.503212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:12.504817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:12.514655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:12.516124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:12.519706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:12.524204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:12.826132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:12.868959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:12.882365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:12.920555 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd9d9d7f-49e2-4120-8cfc-05bf4737f520 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.467957 Sep 01 05:05:12.931293 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1786/3569] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:12 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:12.982999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:13.020740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d2aa8c0-53f3-477d-aea8-a15f4cbdd52b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.984852 Sep 01 05:05:13.050340 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1784/3570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:12 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:13.470767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:13.471639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:13.496634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:13.497027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:13.500568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:13.501426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:13.501930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:13.502361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:13.972844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:13.974379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:13.988591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:14.000347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:14.000743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:14.006490 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-071378ab-3734-4d58-bcf6-87745105b8a0 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1299 microversion: 2.1 time: 0.539757 Sep 01 05:05:14.007592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:14.009666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:14.010462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:14.010921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:14.021242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1787/3571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:13 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1299 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:14.063620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:14.064599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:14.075860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:14.080165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:14.080887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:14.081798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:14.082417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:14.088273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:14.206929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:14.222467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:14.232507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:14.250459 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f4ea903-b06f-4aec-aad1-e074263ae4bc tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.281769 Sep 01 05:05:14.253116 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1785/3572] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:13 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:15.030171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:15.031665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:15.056268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:15.057515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:15.060900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:15.067457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:15.068881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:15.080053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:15.254383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:15.267258 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cfa0c48b-32b0-41cc-ae94-d0bdaa33bd02 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 1.207484 Sep 01 05:05:15.281672 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1788/3573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:14 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:15.290312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:15.291733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:15.297884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:15.300981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:15.302181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:15.302862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:15.304337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:15.305226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:15.305853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:15.427701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:15.448727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c67f9227-8e88-49ee-9a79-9484b07419d1 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1299 microversion: 2.1 time: 0.422448 Sep 01 05:05:15.459933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:15.466157 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1786/3574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:15 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1299 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:15.486754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:15.492358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:15.500402 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8da09438-9046-4fb8-b515-76fc2f3edfa5 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.216847 Sep 01 05:05:15.501994 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1789/3575] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:15 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:16.293387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:16.294365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:16.327976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:16.329172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:16.330164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:16.334530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:16.335964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:16.339433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:16.492280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:16.494318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:16.507013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:16.509334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:16.510360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:16.513255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:16.514407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:16.515439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:16.696917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:16.707940 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35c267c8-e5a3-4477-acae-655c0eab6ebc tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.421747 Sep 01 05:05:16.709031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:16.727453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1787/3576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:16 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:16.737714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:16.741995 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdc50497-7c0d-4f7f-a821-dd9543774d74 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1299 microversion: 2.1 time: 0.257853 Sep 01 05:05:16.743025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:16.749228 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1790/3577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:16 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1299 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:16.761804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:16.762297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:16.762726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:16.763473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:16.763923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:16.764341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:16.973066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:16.999372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:17.009939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:17.038681 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c5b1d0a-01e2-4fb0-b50f-e483eaf0ad5c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.298832 Sep 01 05:05:17.059417 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1788/3578] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:16 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:17.730459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:17.731113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:17.752966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:17.754900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:17.755572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:17.756615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:17.758496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:17.760035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:17.767337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:17.768381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:17.781713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:17.783732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:17.786716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:17.790018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:17.790588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:17.791050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:18.472045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:18.489107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d84d62dc-4aad-45ce-9836-4f46a90436fb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.724306 Sep 01 05:05:18.490124 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1789/3579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:17 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:18.503969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:18.505261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:18.532949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:18.533447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:18.535327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:18.541723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:18.542814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:18.543848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:18.544483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:18.551862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef8d418d-e536-4051-98eb-8da6bbdfb76a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.825357 Sep 01 05:05:18.554792 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1791/3580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:17 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:18.679711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:18.698672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:18.703138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:18.720467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-126c5fd0-4fa1-430a-9e87-24bed55d400c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.227604 Sep 01 05:05:18.721112 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1790/3581] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:18 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:18.859161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ec3dd6b1-f4c0-4d30-8fc6-67334774a207 req-f805870e-9469-40c0-b14a-bce515d197dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e56cc3-eb85-4489-8da9-21c81329e289", "tag": "07a72401-ca67-4310-b590-e3e635a77186"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:18.889046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec3dd6b1-f4c0-4d30-8fc6-67334774a207 req-f805870e-9469-40c0-b14a-bce515d197dd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:18.907889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec3dd6b1-f4c0-4d30-8fc6-67334774a207 req-f805870e-9469-40c0-b14a-bce515d197dd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:18.912514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec3dd6b1-f4c0-4d30-8fc6-67334774a207 req-f805870e-9469-40c0-b14a-bce515d197dd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:18.944583 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ec3dd6b1-f4c0-4d30-8fc6-67334774a207 req-f805870e-9469-40c0-b14a-bce515d197dd service nova] Creating event network-changed:07a72401-ca67-4310-b590-e3e635a77186 for instance a1e56cc3-eb85-4489-8da9-21c81329e289 on n-h2-820368-37 Sep 01 05:05:18.957056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ec3dd6b1-f4c0-4d30-8fc6-67334774a207 req-f805870e-9469-40c0-b14a-bce515d197dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113876 Sep 01 05:05:18.957943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1792/3582] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:19.518528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:19.519830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:19.548751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:19.582834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:19.583983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:19.584620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:19.585521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:19.585770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:19.586251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:19.586644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:19.587416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:19.612511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:19.613170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:19.614239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:19.616584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:19.617083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:19.620121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:20.258833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:20.269486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:20.275938 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb303401-f57f-45a3-954f-2975ca12ff29 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.696444 Sep 01 05:05:20.279679 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1793/3583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:19 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:20.282614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8617b7f-8d16-4fb4-844f-ff0d3a69a909 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.772305 Sep 01 05:05:20.283449 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1791/3584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:19 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:20.294153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:20.295423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:20.312876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:20.313660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:20.314109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:20.314832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:20.318349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:20.318811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:20.436816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:20.448483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:20.449986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:20.465358 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa7c75a5-61df-4cb5-bc79-95cfabe48297 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.184302 Sep 01 05:05:20.466454 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1794/3585] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:20 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:21.312315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:21.315083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:21.315801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:21.317248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:21.330784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:21.355080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:21.356020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:21.375493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:21.375969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:21.376953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:21.379589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:21.380390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:21.380896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:21.381419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:21.381731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:21.382577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:21.383338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:22.131470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:22.148270 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-954e22ad-1911-4d86-9a23-7f74143ce7d5 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.846742 Sep 01 05:05:22.164940 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1792/3586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:21 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:22.184232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:22.185248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:22.198606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:22.207707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:22.208209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:22.210373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:22.214875 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f148ad81-16f7-4947-bfdb-bdf0e20ac69b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.906649 Sep 01 05:05:22.217186 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1795/3587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:21 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:22.246833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:22.248108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:22.251634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:23.117000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:23.138608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:23.141849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:23.153901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ca125e8-d429-4c6c-a592-747ec0d60309 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.986437 Sep 01 05:05:23.170981 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1793/3588] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:22 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:23.188439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:23.188913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:23.197756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:23.198737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:23.199517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:23.201295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:23.201936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:23.203096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:23.247901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:23.250110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:23.263932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:23.264601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:23.268016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:23.268926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:23.269513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:23.270470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:23.522331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:23.540526 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9f5e7e1-94b8-47f8-af3f-2874709b6011 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1514 microversion: 2.1 time: 0.356320 Sep 01 05:05:23.542074 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1796/3589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:23 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:23.596431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:23.610372 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02365d2c-c0b0-472d-941b-4ef851effbc4 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.367386 Sep 01 05:05:23.633125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1794/3590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:23 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:24.192368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:24.193916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:24.209431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:24.212726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:24.213464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:24.218276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:24.221879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:24.224222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:24.387350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:24.401089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:24.403578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:24.412043 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba06dc31-954d-4576-9e62-a860a0ccb206 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1555 microversion: 2.91 time: 0.227666 Sep 01 05:05:24.413363 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1797/3591] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:24 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:24.570273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:24.576930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:24.599727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:24.605498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:24.607710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:24.620665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:24.621857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:24.622844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:24.649874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:24.651389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:24.661160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:24.662721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:24.663442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:24.667238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:24.672396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:24.674370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:25.263894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:25.267299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:25.275597 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-537da74d-981d-413a-8cbc-5fe6f9b9bb6c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.633840 Sep 01 05:05:25.289706 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1798/3592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:24 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:25.297930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:25.307347 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fea29671-9304-4082-be86-a9856ec0637c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 0.744611 Sep 01 05:05:25.308370 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1795/3593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:24 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:25.438716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:25.439535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:25.451608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:25.452257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:25.452800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:25.464092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:25.464871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:25.465675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:25.623932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:25.654018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:25.655848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:25.664953 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c07b75b-9612-43a1-9851-340e5f77966e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1537 microversion: 2.91 time: 0.230778 Sep 01 05:05:25.667177 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1799/3594] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:25 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:26.299406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:26.300706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:26.312939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:26.322802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:26.323629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:26.326073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:26.328584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:26.329265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:26.329955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:26.330863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:26.334830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:26.363116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:26.370183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:26.377557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:26.380646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:26.385838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:26.387477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:26.982187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:26.997211 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b61d13a-8955-417e-ae27-eb2143f1be6b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 0.671459 Sep 01 05:05:27.011020 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1800/3595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:26 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:27.011020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:27.020585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:27.022746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:27.023905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:27.024067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:27.024802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:27.025336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:27.025771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:27.092590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:27.110208 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55f73621-5baf-4af8-b26a-441cdd00f798 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.816074 Sep 01 05:05:27.124723 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1796/3596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:26 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:27.138189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:27.152239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:27.154853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:27.171032 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-993f2256-822c-4f7b-9460-9ac91c934169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1537 microversion: 2.91 time: 0.164589 Sep 01 05:05:27.183756 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1801/3597] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:27 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1537 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:27.375763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4adb5aca-934d-412d-a043-9fea8371e649 req-b6bb4ed0-a4eb-48fa-badd-9281a462c269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e56cc3-eb85-4489-8da9-21c81329e289", "name": "network-vif-plugged", "status": "completed", "tag": "07a72401-ca67-4310-b590-e3e635a77186"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:27.400031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4adb5aca-934d-412d-a043-9fea8371e649 req-b6bb4ed0-a4eb-48fa-badd-9281a462c269 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:27.400767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4adb5aca-934d-412d-a043-9fea8371e649 req-b6bb4ed0-a4eb-48fa-badd-9281a462c269 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:27.401227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4adb5aca-934d-412d-a043-9fea8371e649 req-b6bb4ed0-a4eb-48fa-badd-9281a462c269 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:27.426693 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4adb5aca-934d-412d-a043-9fea8371e649 req-b6bb4ed0-a4eb-48fa-badd-9281a462c269 service nova] Creating event network-vif-plugged:07a72401-ca67-4310-b590-e3e635a77186 for instance a1e56cc3-eb85-4489-8da9-21c81329e289 on n-h2-820368-37 Sep 01 05:05:27.433787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4adb5aca-934d-412d-a043-9fea8371e649 req-b6bb4ed0-a4eb-48fa-badd-9281a462c269 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062420 Sep 01 05:05:27.435132 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1797/3598] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:28.027870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:28.028531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:28.036525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.037239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.037908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.038664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.039161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.039594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.141208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:28.143069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:28.152036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.152883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.153336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.155287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.155794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.157750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.176366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:28.308408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.317203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9be52e6-8569-4ac8-a5a5-f1cc0cfdd0df tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 0.296322 Sep 01 05:05:28.318100 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1802/3599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:28 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:28.325016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:28.325997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:28.332973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.333826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.334627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.335460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.336008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.336556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.397920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.420171 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a44b9b34-b0c4-417b-be43-a686603d4350 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1366 microversion: 2.1 time: 0.283887 Sep 01 05:05:28.420171 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1798/3600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:28 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:28.471945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.488050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.495908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.506836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65cef3dd-bc83-47f1-9592-88cd752f824e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1480 microversion: 2.91 time: 0.187211 Sep 01 05:05:28.530241 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1803/3601] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:28 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1480 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:28.533116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:28.537486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:28.547756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.548604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.549304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.550473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.551612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.552355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.651994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-820368-37". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:05:28.759721 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1f7cb91-312a-4988-917d-d13b91e38a6a tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action" status: 202 len: 0 microversion: 2.91 time: 0.231461 Sep 01 05:05:28.760348 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1799/3602] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:05:28 2022] POST /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:05:28.769039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:28.769662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:28.780639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.781091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.781520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.782585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:28.787743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:28.788221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:28.878601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.891584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.893163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:28.900689 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc49d5ae-2b0f-4101-869b-01de325a9931 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1488 microversion: 2.91 time: 0.135836 Sep 01 05:05:28.916735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1804/3603] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:28 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1488 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:29.342136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:29.343503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:29.356796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.357317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.360414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.361257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.369180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.369180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.445601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:29.446463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:29.466059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.466059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.466717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.469300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.470123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.473065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.857371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:29.874543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:29.877801 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fceffa15-c10b-4f63-8eaa-ab26515ba219 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 0.540144 Sep 01 05:05:29.891562 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a8d9850-31dc-467b-9355-bddb1013613a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1556 microversion: 2.1 time: 0.451356 Sep 01 05:05:29.891562 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1805/3604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:29 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1556 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:29.907803 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1800/3605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:29 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:29.913579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-353726c2-fa35-4919-be28-8861f8bc2d24 req-f13a83da-bd1c-44c4-ac25-762a14e696b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb0702b-3d1c-476f-951b-8039a1bb1f5d", "name": "network-vif-unplugged", "status": "completed", "tag": "81f82c12-4553-4817-8a49-4e69fbb7bdc1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:29.921418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:29.922052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:29.938019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-353726c2-fa35-4919-be28-8861f8bc2d24 req-f13a83da-bd1c-44c4-ac25-762a14e696b2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.939157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.940108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.940298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-353726c2-fa35-4919-be28-8861f8bc2d24 req-f13a83da-bd1c-44c4-ac25-762a14e696b2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.940834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.942158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.942825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.943509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.945179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-353726c2-fa35-4919-be28-8861f8bc2d24 req-f13a83da-bd1c-44c4-ac25-762a14e696b2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.971889 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-353726c2-fa35-4919-be28-8861f8bc2d24 req-f13a83da-bd1c-44c4-ac25-762a14e696b2 service nova] Creating event network-vif-unplugged:81f82c12-4553-4817-8a49-4e69fbb7bdc1 for instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d on n-h2-820368-37 Sep 01 05:05:29.977425 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-353726c2-fa35-4919-be28-8861f8bc2d24 req-f13a83da-bd1c-44c4-ac25-762a14e696b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086597 Sep 01 05:05:29.978571 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1806/3606] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:29.985786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:29.986674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:29.995618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.996666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.997324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:29.998250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:29.998968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:29.999633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:30.140401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:30.155225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:30.157516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:30.158362 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcf5ff66-24c6-4d94-b0d2-5c690bcff53d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248578 Sep 01 05:05:30.159315 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1801/3607] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:05:29 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:30.168113 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5db86c62-1f1e-4a56-a49c-5d470e9830bb tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1488 microversion: 2.91 time: 0.184113 Sep 01 05:05:30.169421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1807/3608] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:29 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1488 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:30.914257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:30.914868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:30.932970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:30.936434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:30.938561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:30.942320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:30.946359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:30.947423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:31.198931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:31.200951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:31.210551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:31.211687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:31.213724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:31.215653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:31.218549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:31.219143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:31.430427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:31.455225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:31.466482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:31.471941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:31.483797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26a191b2-515b-4beb-a71e-ea47726b125b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.293038 Sep 01 05:05:31.484702 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1808/3609] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:31 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:31.499358 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a946694-f8af-47e1-9c75-15a2f915496d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 0.585977 Sep 01 05:05:31.515777 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1802/3610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:30 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:32.418737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9d5b70cb-b98a-4793-aecc-6f3bc895f2ce req-86d6b826-da2c-4c5d-b81f-f3cb0498c096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e56cc3-eb85-4489-8da9-21c81329e289", "tag": "07a72401-ca67-4310-b590-e3e635a77186"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:32.437273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d5b70cb-b98a-4793-aecc-6f3bc895f2ce req-86d6b826-da2c-4c5d-b81f-f3cb0498c096 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:32.437775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d5b70cb-b98a-4793-aecc-6f3bc895f2ce req-86d6b826-da2c-4c5d-b81f-f3cb0498c096 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:32.438268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d5b70cb-b98a-4793-aecc-6f3bc895f2ce req-86d6b826-da2c-4c5d-b81f-f3cb0498c096 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:32.466687 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9d5b70cb-b98a-4793-aecc-6f3bc895f2ce req-86d6b826-da2c-4c5d-b81f-f3cb0498c096 service nova] Creating event network-changed:07a72401-ca67-4310-b590-e3e635a77186 for instance a1e56cc3-eb85-4489-8da9-21c81329e289 on n-h2-820368-37 Sep 01 05:05:32.472463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9d5b70cb-b98a-4793-aecc-6f3bc895f2ce req-86d6b826-da2c-4c5d-b81f-f3cb0498c096 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057882 Sep 01 05:05:32.473733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1809/3611] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:32.534797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:32.538683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:32.539297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:32.545099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:32.589169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:32.594380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:32.595316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:32.604981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:32.605421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:32.606198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:32.606668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:32.611480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:32.613963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:32.615712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:32.619898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:32.626012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:32.928944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:32.942470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:32.950374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:32.975253 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e33a53ef-5340-4fd7-8500-8f4d05cd3071 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.467313 Sep 01 05:05:32.976162 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1803/3612] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:32 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:33.123784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bff07c7c-7239-4f88-84c3-836abf138679"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:33.134690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:33.163702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:33.171564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:33.172471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:33.182907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:33.184122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:33.185024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:33.233122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:33.247357 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25b8bd89-cf3b-434d-bc79-bdba0206c5e4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 0.728115 Sep 01 05:05:33.266450 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1810/3613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:32 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:34.029092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:34.029714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:34.055948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:34.056463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:34.056921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:34.057686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:34.069256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:34.069637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:34.122862 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d442a6ab-5004-43d3-8f44-486d1eda6fa2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.011410 Sep 01 05:05:34.123549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1804/3614] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:05:33 2022] POST /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:34.283180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:34.285451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:34.297698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:34.298585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:34.299505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:34.300523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:34.301228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:34.301873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:34.321803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:34.355835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:34.363848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:34.391893 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3adebe8-cccc-42af-9e34-f7c0077a209c tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.369025 Sep 01 05:05:34.392531 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1811/3615] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:34 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:34.443474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6ed9a80c-3259-47e4-a8b8-54c5a3916a14 req-63c9e182-7755-41ab-88f0-5bde2e9428c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb0702b-3d1c-476f-951b-8039a1bb1f5d", "name": "network-vif-plugged", "status": "completed", "tag": "81f82c12-4553-4817-8a49-4e69fbb7bdc1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:34.488539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ed9a80c-3259-47e4-a8b8-54c5a3916a14 req-63c9e182-7755-41ab-88f0-5bde2e9428c6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:34.489027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ed9a80c-3259-47e4-a8b8-54c5a3916a14 req-63c9e182-7755-41ab-88f0-5bde2e9428c6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:34.510045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ed9a80c-3259-47e4-a8b8-54c5a3916a14 req-63c9e182-7755-41ab-88f0-5bde2e9428c6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:34.560593 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6ed9a80c-3259-47e4-a8b8-54c5a3916a14 req-63c9e182-7755-41ab-88f0-5bde2e9428c6 service nova] Creating event network-vif-plugged:81f82c12-4553-4817-8a49-4e69fbb7bdc1 for instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d on n-h2-820368-37 Sep 01 05:05:34.578559 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6ed9a80c-3259-47e4-a8b8-54c5a3916a14 req-63c9e182-7755-41ab-88f0-5bde2e9428c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139940 Sep 01 05:05:34.579231 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1812/3616] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:35.447076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:35.447843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:35.474819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:35.491751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:35.492574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:35.493862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:35.494904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:35.503753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:35.643766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:35.663617 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc4d6a1c-d462-481d-83f7-51f6d1a22503 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 1.378632 Sep 01 05:05:35.664852 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1805/3617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:34 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:36.027604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:36.062008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:36.077467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:36.126403 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-900be8bc-52c9-4cb1-a7fe-f105cbaeba8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.697114 Sep 01 05:05:36.127450 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1813/3618] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:35 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:36.694029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:36.694832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:36.708235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:36.708739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:36.709185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:36.709912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:36.716416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:36.717890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:37.169885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:37.171360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:37.184641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:37.199772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:37.200615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:37.201617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:37.202325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:37.203034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:38.172188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:38.210055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:38.223034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:38.250802 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-115a8da4-2272-4c5b-9b5d-13917dc92e8d tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 1.081409 Sep 01 05:05:38.254730 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1814/3619] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:37 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:38.720154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:38.768234 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54578eb8-5b6a-49cd-a0e0-c87d7b155a37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1520 microversion: 2.1 time: 2.063769 Sep 01 05:05:38.780617 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1806/3620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:36 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1520 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:39.278777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:39.279593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:39.298485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:39.302196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:39.302743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:39.305572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:39.307782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:39.310206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:39.766090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:39.774055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:39.787090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:39.799015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:39.800288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:39.815919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:39.819858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:39.821456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:39.825072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:39.825921 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0685e16a-2fc3-45ab-8d8c-6eefa049b8bf tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.551699 Sep 01 05:05:39.827644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:39.835239 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1815/3621] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:39 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:39.844511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:40.552251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:40.570338 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af97c365-dd1e-40ca-b509-54f99729d8bf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1505 microversion: 2.1 time: 0.772616 Sep 01 05:05:40.572780 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1807/3622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:39 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1505 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:40.597883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:40.600281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:40.609072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:40.610480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:40.611185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:40.612087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:40.612702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:40.613384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:40.860239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:40.861597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:40.878189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:40.879378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:40.885234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:40.893269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:40.894235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:40.897464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:41.049801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:41.064383 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92712fdc-aa15-49d5-ae3b-264a62f616dd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 200 len: 1505 microversion: 2.1 time: 0.471601 Sep 01 05:05:41.082620 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1816/3623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:40 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:41.135931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:41.140473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:41.171180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:41.174419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:41.175400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:41.179765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:41.181330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:41.182779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:41.190666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:41.206078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:41.214930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:41.249649 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1382d8b-14e4-4964-85c8-a0db91c2d6a9 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.394795 Sep 01 05:05:41.251622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:41.257547 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1808/3624] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:40 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:41.309762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:05:41.559439 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11a781da-7e85-4de2-8ac9-a78c2d67b51a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 204 len: 0 microversion: 2.1 time: 0.470236 Sep 01 05:05:41.560718 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1817/3625] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:05:41 2022] DELETE /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:05:42.125019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2021748181", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "6a55ef29-3665-4ee4-9546-ea904fa17891"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:42.234035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] validate_networks() for [('6a55ef29-3665-4ee4-9546-ea904fa17891', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:05:42.281697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:42.282775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:42.293695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:42.294429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:42.295096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:42.295984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:42.296778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:42.297360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:42.484821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:42.502281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:42.504738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:42.536024 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf3d0b52-660f-4d23-b8ab-becd819a35bd tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.258512 Sep 01 05:05:42.551462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1818/3626] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:42 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:43.564502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:43.565136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:43.574511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:05:43.575106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:05:43.575427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:05:43.575841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:05:43.576240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:05:43.592085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:43.603387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:43.604380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:43.606286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:43.608688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:43.610361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:43.610564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:43.611179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:43.613228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:43.615027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:43.619718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:43.620172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:43.680973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Getting quotas for project 955a8b83d53e4051821332d61b01dc9b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:05:43.689813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Getting quotas for user 08997672c334463aa87b00fa1f6a9a56 and project 955a8b83d53e4051821332d61b01dc9b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:05:43.709419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:05:43.712505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:05:43.829086 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-deecf78e-cf26-44ea-92f5-2bb9696fc599 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705556 Sep 01 05:05:43.830782 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1809/3627] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:05:43.841334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cf2d84e-e8d6-4d36-9711-a993b6073778 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:43.844690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cf2d84e-e8d6-4d36-9711-a993b6073778 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:44.024809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:44.046008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:44.052859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:44.076215 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30c418fc-b16e-4791-b151-895d2c609c41 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.515700 Sep 01 05:05:44.091849 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1819/3628] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:43 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:44.099739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cf2d84e-e8d6-4d36-9711-a993b6073778 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:44.107427 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cf2d84e-e8d6-4d36-9711-a993b6073778 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1218 microversion: 2.1 time: 0.270066 Sep 01 05:05:44.108037 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1810/3629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:43 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:45.113946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:45.114734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:45.134743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:45.135738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:45.152686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:45.163449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:45.174527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:45.182067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:45.182855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:45.188028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:45.188918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:45.190257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:45.191228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:45.193008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:45.193512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:45.193960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:45.426703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:45.443839 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4d08f3e-89aa-4ba4-a7dd-15111abbcd0b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1222 microversion: 2.1 time: 0.314845 Sep 01 05:05:45.451778 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1820/3630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:45 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:45.550573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:45.588820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:45.609475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:45.636311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ee0d5f1-215b-4191-ae50-574aaf1ea21e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.530380 Sep 01 05:05:45.649559 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1811/3631] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:45 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:46.479109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:46.480441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:46.501416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:46.521578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:46.534185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:46.537960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:46.537960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:46.537960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:46.537960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:46.668421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:46.669124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:46.700001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:46.700510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:46.706275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:46.708388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:46.712111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:46.717709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:46.813260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:46.824921 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22cfb5a4-d9ad-4241-a622-8c9b66ad6d1e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1288 microversion: 2.1 time: 0.352527 Sep 01 05:05:46.830407 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1821/3632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:46 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1288 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:46.973303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:46.990457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:46.992453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:47.006771 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1ffda5c-bebf-448a-a86a-b1e59efb83f6 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.344402 Sep 01 05:05:47.024177 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1812/3633] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:46 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:47.849343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:47.850691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:47.868853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:47.869866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:47.870726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:47.871848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:47.872542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:47.875521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:48.054585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:48.055460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:48.079652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:48.081619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:48.082870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:48.084224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:48.085130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:48.087477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:48.374084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:48.408006 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56e22828-75b3-4ebd-af35-8a53cfa91892 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1276 microversion: 2.1 time: 0.551919 Sep 01 05:05:48.415589 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1822/3634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:47 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1276 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:48.470828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:48.501545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:48.512893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:48.531335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f9d14142-82b0-4235-ab9a-021e21afa957 req-bc99b780-f67c-45ff-b394-e4ae2ecb35d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb0702b-3d1c-476f-951b-8039a1bb1f5d", "name": "network-vif-deleted", "tag": "81f82c12-4553-4817-8a49-4e69fbb7bdc1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:48.562855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f9d14142-82b0-4235-ab9a-021e21afa957 req-bc99b780-f67c-45ff-b394-e4ae2ecb35d4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:48.566412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f9d14142-82b0-4235-ab9a-021e21afa957 req-bc99b780-f67c-45ff-b394-e4ae2ecb35d4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:48.568260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f9d14142-82b0-4235-ab9a-021e21afa957 req-bc99b780-f67c-45ff-b394-e4ae2ecb35d4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:48.575807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b26d3fe7-a61e-4300-b334-b0b6ad11279b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.509298 Sep 01 05:05:48.624861 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1813/3635] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:48 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:48.656411 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f9d14142-82b0-4235-ab9a-021e21afa957 req-bc99b780-f67c-45ff-b394-e4ae2ecb35d4 service nova] Creating event network-vif-deleted:81f82c12-4553-4817-8a49-4e69fbb7bdc1 for instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d on n-h2-820368-37 Sep 01 05:05:48.675024 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f9d14142-82b0-4235-ab9a-021e21afa957 req-bc99b780-f67c-45ff-b394-e4ae2ecb35d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148998 Sep 01 05:05:48.678861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1823/3636] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:49.442221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:49.445814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:49.470941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:49.475120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:49.480369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:49.489113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:49.491393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:49.495173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:49.612687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:49.635914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:49.636796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:49.665213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:49.665763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:49.666207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:49.666969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:49.672253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:49.677125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:49.909389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:49.941748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:49.943609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:50.005237 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-561b8a85-bb6f-43c8-a291-937db0f7c2b3 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.382528 Sep 01 05:05:50.033527 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1824/3637] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:49 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:50.345710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:50.355847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3559e1f-e215-408e-bad0-5cc70609f178 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1318 microversion: 2.1 time: 0.925765 Sep 01 05:05:50.374833 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1814/3638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:49 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1318 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:50.856722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00e96716-e567-49b2-b5e3-697e82ba9959 req-60dfe0f7-1480-4778-ab33-26322dd296c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a99c01-a249-41d4-ac54-475aa42d473b", "tag": "ee50ebf0-55da-411b-8a52-64cde30fad60"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:50.885725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00e96716-e567-49b2-b5e3-697e82ba9959 req-60dfe0f7-1480-4778-ab33-26322dd296c3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:50.888335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00e96716-e567-49b2-b5e3-697e82ba9959 req-60dfe0f7-1480-4778-ab33-26322dd296c3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:50.890163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00e96716-e567-49b2-b5e3-697e82ba9959 req-60dfe0f7-1480-4778-ab33-26322dd296c3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:50.921286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-00e96716-e567-49b2-b5e3-697e82ba9959 req-60dfe0f7-1480-4778-ab33-26322dd296c3 service nova] Creating event network-changed:ee50ebf0-55da-411b-8a52-64cde30fad60 for instance e2a99c01-a249-41d4-ac54-475aa42d473b on n-h1-820368-37 Sep 01 05:05:50.928320 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00e96716-e567-49b2-b5e3-697e82ba9959 req-60dfe0f7-1480-4778-ab33-26322dd296c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077628 Sep 01 05:05:50.930388 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1825/3639] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:51.037460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:51.038157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:51.054227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:51.055286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:51.057655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:51.058716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:51.059429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:51.064422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:51.194403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:51.204500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:51.206106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:51.223375 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7284a88c-4f1a-4aec-9257-27c46df1f169 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.190885 Sep 01 05:05:51.235641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1815/3640] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:51 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:51.382556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:51.383665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:51.396676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:51.397178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:51.397616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:51.398337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:51.398789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:51.399357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:51.660867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:51.685975 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d3b3a06-3fc4-4848-a1ab-a7e98fe0ee0a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1318 microversion: 2.1 time: 0.307600 Sep 01 05:05:51.686583 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1826/3641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:51 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:52.249154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:52.249633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:52.262019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:52.262524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:52.262974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:52.263709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:52.264157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:52.265363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:52.387263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:52.396879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:52.398688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:52.406305 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-157163fa-56ae-4763-892b-400923e0688b tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.161125 Sep 01 05:05:52.407563 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1816/3642] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:52 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:52.719203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:52.720948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:52.738237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:52.738972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:52.739562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:52.740902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:52.744052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:52.744904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:53.154832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:53.181086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e126fb28-7e01-4b16-921e-f0d89765d94f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1318 microversion: 2.1 time: 0.477179 Sep 01 05:05:53.186966 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1827/3643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:52 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:53.433616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:53.434816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:53.445992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:53.459151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:53.459875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:53.460780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:53.461565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:53.462180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:53.664939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:53.815271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:53.825816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:53.828136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:53.836116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-422b891a-ee3f-42ea-a11a-9d07d116451e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.406415 Sep 01 05:05:53.837602 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1817/3644] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:53 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:54.202310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:54.203540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:54.226852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:54.232104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:54.233784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:54.235094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:54.236100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:54.239523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:54.578399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:54.607477 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-270f4605-2386-47bc-9605-238daa9d5427 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1318 microversion: 2.1 time: 0.408833 Sep 01 05:05:54.610033 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1828/3645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:54 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:54.866676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:54.867902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:54.877302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:54.886279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:54.887102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:54.889100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:54.890170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:54.892114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:54.893270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:55.190686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:55.222832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:55.224747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:55.239673 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f697587c-7eee-4985-ad07-0ee3db8508ea tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.377383 Sep 01 05:05:55.240188 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1818/3646] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:54 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:05:55.493792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:55.496994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:55.504727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:55.505771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:55.505940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:55.506841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:55.507575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:55.508021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:55.543545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'flavor' on Instance uuid 27b9c200-02b4-4279-9ae9-540f328d4d24 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:05:55.637354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:55.645380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:55.683021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:55.684073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:55.684874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:55.690452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:55.693995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:55.696520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:55.780125 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f31bc28-905d-4613-8d34-4bd78fa820b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/action" status: 200 len: 32 microversion: 2.1 time: 0.285335 Sep 01 05:05:55.782713 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1829/3647] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:05:55 2022] POST /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:05:55.798046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:55.801508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:55.817037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:55.821416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:55.822424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:55.823404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:55.825557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:55.826204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:56.152735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:56.175788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2a2f45a-3d2f-4b55-b139-672bf9a4d63d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1318 microversion: 2.1 time: 0.544953 Sep 01 05:05:56.181485 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1819/3648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:55 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:56.197620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-21e86a42-329c-404a-96f9-0c86eff0c1e6 req-4a47cf0d-c560-494f-9b8b-b2695d66a75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a99c01-a249-41d4-ac54-475aa42d473b", "name": "network-vif-plugged", "status": "completed", "tag": "ee50ebf0-55da-411b-8a52-64cde30fad60"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:05:56.220182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-21e86a42-329c-404a-96f9-0c86eff0c1e6 req-4a47cf0d-c560-494f-9b8b-b2695d66a75e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:56.220664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-21e86a42-329c-404a-96f9-0c86eff0c1e6 req-4a47cf0d-c560-494f-9b8b-b2695d66a75e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:56.221094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-21e86a42-329c-404a-96f9-0c86eff0c1e6 req-4a47cf0d-c560-494f-9b8b-b2695d66a75e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:56.235231 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-21e86a42-329c-404a-96f9-0c86eff0c1e6 req-4a47cf0d-c560-494f-9b8b-b2695d66a75e service nova] Creating event network-vif-plugged:ee50ebf0-55da-411b-8a52-64cde30fad60 for instance e2a99c01-a249-41d4-ac54-475aa42d473b on n-h1-820368-37 Sep 01 05:05:56.246788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-21e86a42-329c-404a-96f9-0c86eff0c1e6 req-4a47cf0d-c560-494f-9b8b-b2695d66a75e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063842 Sep 01 05:05:56.247605 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1820/3649] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:05:56.276643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:56.278523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:56.292429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:56.297229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:56.298104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:56.300716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:56.305777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:56.307790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:56.310574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:56.322465 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23aa9991-63de-45cf-8902-1f5a48708ca5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.533930 Sep 01 05:05:56.323329 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1830/3650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:55 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:56.456991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:56.472007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:56.474173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:56.477530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:56.485397 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0036743-cf61-4d9b-adea-cacaad2af06e tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.214238 Sep 01 05:05:56.486785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1821/3651] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:56 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:57.202178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:57.203532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:57.211293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:57.223796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:57.224351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:57.225185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:57.225718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:57.226227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:57.368123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:57.377728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:57.400266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:57.401156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:57.401938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:57.403289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:57.404362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:57.405332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:57.961521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:58.007402 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54e8a642-ec02-4453-8733-cf3f8fd6b693 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.639778 Sep 01 05:05:58.008276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1822/3652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:57 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:58.037906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:58.039774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:58.063251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:58.064708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:58.073760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:58.075445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:58.076560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:58.077621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:58.128866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:58.132523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:58.159131 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd199b76-f010-4201-a623-dd0c83db39e6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1318 microversion: 2.1 time: 0.960716 Sep 01 05:05:58.175825 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1831/3653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:57 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1318 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:05:58.229636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:58.241801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:58.243830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:58.250317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e8aa382-cf46-40e7-84c3-d11ad4c5c05f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1546 microversion: 2.91 time: 0.239008 Sep 01 05:05:58.250980 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1823/3654] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:58 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:05:59.033539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:59.034159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:59.049663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.050487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.051118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.052408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.053348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.053936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.196522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:59.209251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:59.226578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.229070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.230040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.231198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.233408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.234007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.826864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:59.860770 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4ed5d09-65ab-4758-897a-348e15d12ce9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.832127 Sep 01 05:05:59.866024 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1832/3655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:59 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:05:59.889872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:05:59.895865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:05:59.908283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.913050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.913746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.916818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:05:59.918524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:05:59.919513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:05:59.962914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:05:59.985064 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f489ef92-209c-459c-bdc5-007493a82eb9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1509 microversion: 2.1 time: 0.805778 Sep 01 05:05:59.986547 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1824/3656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:05:59 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1509 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:00.037870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.039861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.052820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.053993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.055787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.058093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.058526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.059635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.061205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.069966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.073471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.080034 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-203d47e7-e9ca-453e-a2b5-7bf9ba680d42 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1533 microversion: 2.91 time: 0.197259 Sep 01 05:06:00.094167 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1833/3657] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:05:59 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1533 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:06:00.125022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.127295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.136864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.137991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.138878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.139988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.142945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.144314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.339496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] Lazy-loading 'services' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:06:00.387527 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54405630-4c30-41ee-b462-5f5746c81cef tempest-UnshelveToHostMultiNodesTest-1920627054 tempest-UnshelveToHostMultiNodesTest-1920627054-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1940 microversion: 2.91 time: 0.268176 Sep 01 05:06:00.389322 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1834/3658] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:00 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1940 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:06:00.443462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.444318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.458979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.459575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.460161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.460856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.461448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.462083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.469796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.493326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:06:00.505586 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10a9033d-687e-4cdc-becf-6dc2ddf81458 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1509 microversion: 2.1 time: 0.474436 Sep 01 05:06:00.516425 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1825/3659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:00 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:00.557263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:00.562791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.578490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.582988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.586515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.589901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.592008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.593059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.621735 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d1a27e3-6725-4d58-9718-c7fdedb26cd1 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 204 len: 0 microversion: 2.91 time: 0.186836 Sep 01 05:06:00.622634 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1835/3660] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:06:00 2022] DELETE /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:06:00.632862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.633964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.641500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.642267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.642470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.643287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.643749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.644481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.739455 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c88c8758-07aa-48a0-a738-6b5834eec62f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "PUT /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1081 microversion: 2.1 time: 0.188102 Sep 01 05:06:00.753315 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1826/3661] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:06:00 2022] PUT /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1081 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:00.779921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.780930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.800356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.806948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.806948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.807647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.808370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.819686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.884555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.900198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.908554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:00.933578 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfcfab3f-f62f-4c44-8e1b-2cd1603eb86f tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.305152 Sep 01 05:06:00.943695 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1836/3662] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:00 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:06:00.955073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:00.956475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:00.986094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.988049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.991904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:00.994090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:00.994853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:00.995587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:01.380225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:01.397268 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a029ca0f-b47e-42f4-bd84-bef9a466aba1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1507 microversion: 2.1 time: 0.621875 Sep 01 05:06:01.407768 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1827/3663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:00 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1507 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:01.438718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:01.446845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:01.447498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:01.454715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:01.456007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:01.456630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:01.457108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5553d906-1d94-44f0-a1ac-390050936733 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.511533 Sep 01 05:06:01.457769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:01.458175 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1837/3664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:00 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:01.458809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:01.460416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:01.966209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:01.966415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:01.982071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:01.982585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:01.983085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:01.983936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:01.984286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:01.984720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.215351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:02.227067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:02.230925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:02.238006 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ad0ad92-3da2-477d-bffe-f9f2c1921d32 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1539 microversion: 2.91 time: 0.281765 Sep 01 05:06:02.240518 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1838/3665] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:01 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1539 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:06:02.351948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:02.366324 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d98682b-eeef-4384-963f-f2a35da298e2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1507 microversion: 2.1 time: 0.925421 Sep 01 05:06:02.367284 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1828/3666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:01 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1507 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:02.394963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:02.398063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:02.416353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.418816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.420747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.423040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.426209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.426694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.494332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:02.495386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:02.506846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.507641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.508750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.510455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.511210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.511833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.623122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:06:02.623685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:06:02.624060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:06:02.624640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:06:02.625215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:06:02.742167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:02.758857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.761620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.762148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.765229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.765627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.766084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.837694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9b6068c-fb04-46e6-95ee-f6a6f68241ec tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "POST /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b/action" status: 202 len: 1113 microversion: 2.1 time: 0.447665 Sep 01 05:06:02.851980 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1839/3667] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:06:02 2022] POST /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b/action => generated 1113 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 05:06:02.874573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:02.877971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:02.893139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.895237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.896342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:02.898025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:02.899245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:02.900303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:03.301983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:03.333335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d03eb37-6622-48a3-a418-f49c3218d9aa tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.845257 Sep 01 05:06:03.347961 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1829/3668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:02 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:03.374217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:03.377823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:03.391404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:03.392531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:03.393603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:03.395812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:03.397507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:03.399327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:03.487222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:03.487983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:03.488987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:03.489821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lazy-loading 'fault' on Instance uuid 4b563d3f-92c4-418e-9ec4-6c9166836be1 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:06:03.575480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:03.582036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:03.585730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-125a9d3c-5d2a-4270-825f-d750a1390dc9 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.720769 Sep 01 05:06:03.600900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:03.601843 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1840/3669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:02 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:03.606866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:03.608914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec044413e1914e44b0839aa7c901d614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66054828e3466ca084b41f5fce2faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:03.617088 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ddfe46c-6553-40d6-9466-84e60bd5d0b8 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 200 len: 1544 microversion: 2.91 time: 0.267371 Sep 01 05:06:03.617894 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1830/3670] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:03 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 1544 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:06:04.375730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:04.377055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:04.400382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:04.401225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:04.401660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:04.402991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:04.403493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:04.403872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:04.611755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:04.613080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:04.620826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:04.621321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:04.621754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:04.622444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:04.623116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:04.623541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:04.628125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:04.639234 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d6b673f-205d-4c10-8147-2d74b50065b6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.267484 Sep 01 05:06:04.652158 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1841/3671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:04 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:04.660064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:04.660917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] [instance: 4b563d3f-92c4-418e-9ec4-6c9166836be1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:04.669147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:04.669641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:04.670077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:04.670785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:04.671275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:04.671694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:04.688286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] HTTP exception thrown: Instance 4b563d3f-92c4-418e-9ec4-6c9166836be1 could not be found. Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Request method failure captured: Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 HTTP/1.1 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED0IyOtCqr5_n_ynNsWKmqGHkZj9gLNFOdM0_G9VoctVvLlvFQLfYQ1O3tvKceJpBICj41V8dpeuUgJzR6eidub5NroA3hrPXhTps6VRsoeGJKgq9vsy-UkcfipPuQXyVIdLFOr2tyuJOrYB46Xtb8hdoDdPSxW3eJ-jyaJDSyvnJow Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.91 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9e66054828e3466ca084b41f5fce2faf Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1585412368 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e66054828e3466ca084b41f5fce2faf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e66054828e3466ca084b41f5fce2faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e66054828e3466ca084b41f5fce2faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e66054828e3466ca084b41f5fce2faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1585412368 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9e66054828e3466ca084b41f5fce2faf Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1585412368 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-UnshelveToHostMultiNodesTest-1585412368-project Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ec044413e1914e44b0839aa7c901d614 Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1585412368-project Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4b563d3f-92c4-418e-9ec4-6c9166836be1 could not be found. Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4b563d3f-92c4-418e-9ec4-6c9166836be1'} Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b563d3f-92c4-418e-9ec4-6c9166836be1 could not be found. Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b563d3f-92c4-418e-9ec4-6c9166836be1 could not be found. Sep 01 05:06:04.690012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b563d3f-92c4-418e-9ec4-6c9166836be1 could not be found. Sep 01 05:06:04.693747 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:06:04.695308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] Returning 404 to user: Instance 4b563d3f-92c4-418e-9ec4-6c9166836be1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:06:04.696511 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-882015ab-b316-4e2b-bab3-ef73cd24b341 tempest-UnshelveToHostMultiNodesTest-1585412368 tempest-UnshelveToHostMultiNodesTest-1585412368-project] 10.222.0.26 "GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1" status: 404 len: 111 microversion: 2.91 time: 0.042989 Sep 01 05:06:04.697433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1842/3672] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:04 2022] GET /compute/v2.1/servers/4b563d3f-92c4-418e-9ec4-6c9166836be1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:06:04.987845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:05.000600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23718bc6-ea00-4ec6-97ed-4b6c28722fbf tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.392788 Sep 01 05:06:05.007256 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1831/3673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:04 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:05.667591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:05.668493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:05.677560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:05.678196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:05.678875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:05.679895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:05.680610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:05.681383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:06.030332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:06.031136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:06.047502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:06.047986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:06.048533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:06.049330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:06.049950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:06.051321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:06.123700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:06.136532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb81987d-fc80-45ae-9c43-ca8bc26af6af tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.473877 Sep 01 05:06:06.152151 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1843/3674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:05 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:06.322806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:06.341391 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3231a9b6-60c1-4e09-a025-16f658cce3a1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.316761 Sep 01 05:06:06.342825 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1832/3675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:06 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:07.163856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:07.170181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:07.202725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:07.204068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:07.207657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:07.209736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:07.210238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:07.210681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:07.364088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:07.365425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:07.376700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:07.377428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:07.378052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:07.379233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:07.379842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:07.380270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:07.578460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:07.593792 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17ad8212-2803-48e9-bac0-dfc21ae7b475 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.437896 Sep 01 05:06:07.610116 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1844/3676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:07 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:07.687986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:07.708253 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-026ddcd2-0094-407a-9470-d9c5f640e813 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.348638 Sep 01 05:06:07.712487 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1833/3677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:07 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:08.616648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:08.617477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:08.629537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:08.630720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:08.634173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:08.635716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:08.636364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:08.640271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:08.649848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:08.738820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:08.740139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:08.759911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:08.761233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:08.761818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:08.762842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:08.763350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:08.764432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:08.868170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:08.881242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04f8ec21-6c05-4ff6-9329-8b64c05c69a6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.268237 Sep 01 05:06:08.899142 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1845/3678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:08 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:08.964620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:08.977996 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8a6c1ff-aab3-48dd-8d5a-6cc97ad20131 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.243643 Sep 01 05:06:08.978615 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1834/3679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:08 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:09.910016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:09.911742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:09.921106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:09.921712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:09.922398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:09.923255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:09.923943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:09.924834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:10.001580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:10.002198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:10.037196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:10.038141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:10.038939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:10.042000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:10.043154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:10.045058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:10.608347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:10.616988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:10.625232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a446173-8b93-47d8-a88e-09b281e99a6c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.722038 Sep 01 05:06:10.634926 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1846/3680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:09 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:10.645053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2436eade-128e-4b26-88f0-f2a777a7a3d2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.649171 Sep 01 05:06:10.659517 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1835/3681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:09 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:11.661991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:11.677069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:11.679586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:11.687532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:11.728259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:11.730697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:11.732631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:11.733740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:11.735855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:11.736345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:11.737752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:11.740116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:11.741232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:11.743104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:11.744824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:11.745535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:12.662413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:12.688102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:12.693859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12b6288d-fde6-47a8-a117-fce6287b77bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 1.043665 Sep 01 05:06:12.699568 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abe21c17-7763-4c14-9e94-1664a43d5f06 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 1.033439 Sep 01 05:06:12.700198 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1836/3682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:11 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:12.717088 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1847/3683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:11 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:13.740736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:13.741613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:13.751288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:13.751969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:13.776022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:13.776547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:13.777542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:13.778050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:13.778478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:13.781618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:13.783738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:13.786247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:13.786713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:13.788139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:13.788577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:13.790594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:14.414703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:14.429473 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5572be0c-4829-4ef4-8ab4-4e5527d48c9f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.693211 Sep 01 05:06:14.448041 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1837/3684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:13 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:14.513058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:14.538616 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8b48e54-0697-4358-8a30-66d1bc9bf7e1 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 0.793827 Sep 01 05:06:14.541317 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1848/3685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:13 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:15.457234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:15.457234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:15.470424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:15.470973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:15.471418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:15.472143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:15.472604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:15.473035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:15.561663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:15.562281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:15.576414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:15.584935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:15.585257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:15.586072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:15.586759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:15.596878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:15.987163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:16.031240 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dde68dae-6972-47ab-88de-e473f1cc3321 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.563221 Sep 01 05:06:16.032376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1838/3686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:15 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:16.593940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:16.607930 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8845ef52-2178-4267-bfdf-36a5fc69a07b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 1.050102 Sep 01 05:06:16.624285 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1849/3687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:15 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:17.053915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:17.056688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:17.072813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:17.077126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:17.077814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:17.078868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:17.079555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:17.080147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:17.435812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:17.451996 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cb05b7d-c144-4c0a-8a9c-988b830b7263 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.402032 Sep 01 05:06:17.456713 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1839/3688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:17 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:17.646140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:17.651394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:17.665809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.684352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:17.685326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:17.685676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:17.689870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:17.697093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:17.698017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:18.176547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-997a7e54-3005-4284-b68f-b24d74e94984 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Action: 'create', calling method: .version_select at 0x7fa75b0844c0>, body: {"pool": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:19.749284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:19.775720 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5def166-6f41-4d65-bf22-07b1c26c9258 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1518 microversion: 2.1 time: 2.143159 Sep 01 05:06:19.782812 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1850/3689] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:17 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1518 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:19.800050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:19.802616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:19.835392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:19.839778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:19.840978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:19.842343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:19.844525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:19.845203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:20.733822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:20.759736 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01a87f8a-4c7b-42a8-918b-8eebe3b0db72 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.972406 Sep 01 05:06:20.761661 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1851/3690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:19 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:20.810119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:20.817310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:20.824552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:20.825157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:20.825839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:20.830372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:20.831460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:20.832078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:21.765760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:21.797922 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fff310a1-c04c-4f81-be6f-13e1376b5e3c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1524 microversion: 2.1 time: 0.994125 Sep 01 05:06:21.799525 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1852/3691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:20 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1524 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:21.815551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:21.816501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:21.827276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:21.828093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:21.829098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:21.830229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:21.831018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:21.833806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:22.199049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:22.228085 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb6a6d47-7fc4-4ab2-a2b2-71f406ecb4f9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.417475 Sep 01 05:06:22.229686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1853/3692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:21 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:22.836852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:22.837890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:22.858978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:22.859955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:22.860526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:22.864095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:22.864887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:22.865656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:23.478590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:23.503512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2202835d-cddd-4c48-92cf-f78a7869ea01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1524 microversion: 2.1 time: 0.672299 Sep 01 05:06:23.523555 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1854/3693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:22 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1524 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:23.529937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:23.530814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:23.557738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:23.558258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:23.565288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:23.568251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:23.569497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:23.571333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:24.323265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:24.339260 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55c572a0-fd07-4d8b-a6df-9d8b3af7beb2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1735 microversion: 2.1 time: 0.813936 Sep 01 05:06:24.370931 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1855/3694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:23 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1735 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:24.539516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:24.540150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:24.549047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:24.550167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:24.551007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:24.552318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:24.552994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:24.553605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:25.847168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-997a7e54-3005-4284-b68f-b24d74e94984 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 7.932297 Sep 01 05:06:25.850288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1840/3695] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 05:06:17 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 7936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:06:25.883983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:25.884982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:25.897357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:25.898845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:25.899971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:25.901401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:25.902378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:25.903544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:25.918220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:25.928802 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-376d166a-5610-4c02-9b6e-8fd2bd54fe01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1524 microversion: 2.1 time: 1.395415 Sep 01 05:06:25.940002 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1856/3696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:24 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1524 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:25.945480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f4898479-edc1-4b11-80f8-5343bdeb95ba req-55bff48e-1c6f-4be7-86bc-e2700a39d776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a99c01-a249-41d4-ac54-475aa42d473b", "name": "network-vif-unplugged", "status": "completed", "tag": "ee50ebf0-55da-411b-8a52-64cde30fad60"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:25.967771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4898479-edc1-4b11-80f8-5343bdeb95ba req-55bff48e-1c6f-4be7-86bc-e2700a39d776 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:25.971703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4898479-edc1-4b11-80f8-5343bdeb95ba req-55bff48e-1c6f-4be7-86bc-e2700a39d776 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:25.972168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4898479-edc1-4b11-80f8-5343bdeb95ba req-55bff48e-1c6f-4be7-86bc-e2700a39d776 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:25.991273 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f4898479-edc1-4b11-80f8-5343bdeb95ba req-55bff48e-1c6f-4be7-86bc-e2700a39d776 service nova] Creating event network-vif-unplugged:ee50ebf0-55da-411b-8a52-64cde30fad60 for instance e2a99c01-a249-41d4-ac54-475aa42d473b on n-h1-820368-37 Sep 01 05:06:25.999593 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f4898479-edc1-4b11-80f8-5343bdeb95ba req-55bff48e-1c6f-4be7-86bc-e2700a39d776 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057850 Sep 01 05:06:26.006340 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1857/3697] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:26.028942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a61861a3-e40c-464c-b1cc-1ac1afa7b048 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Action: 'create', calling method: .version_select at 0x7fa75bc21430>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:26.632353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:26.641789 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e49feb9b-2005-4647-a138-edfdb4203caf tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1715 microversion: 2.1 time: 0.789881 Sep 01 05:06:26.677745 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1841/3698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:25 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1715 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:26.881069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:26.881898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:26.918181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:26.919083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:26.919877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:26.921118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:26.921919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:26.922847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:27.220641 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Cannot 'detach_volume' instance 27b9c200-02b4-4279-9ae9-540f328d4d24 while it is in vm_state rescued Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments/bff07c7c-7239-4f88-84c3-836abf138679 HTTP/1.1 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: exception: Cannot 'detach_volume' instance 27b9c200-02b4-4279-9ae9-540f328d4d24 while it is in vm_state rescued Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '27b9c200-02b4-4279-9ae9-540f328d4d24', 'id': 'bff07c7c-7239-4f88-84c3-836abf138679'} Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 27b9c200-02b4-4279-9ae9-540f328d4d24 while it is in vm_state rescued Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:06:27.226275 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 27b9c200-02b4-4279-9ae9-540f328d4d24 while it is in vm_state rescued Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:06:27.233477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 409 to user: Cannot 'detach_volume' instance 27b9c200-02b4-4279-9ae9-540f328d4d24 while it is in vm_state rescued {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:06:27.236425 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19950826-dbf5-4934-934b-5efa27e0ae09 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments/bff07c7c-7239-4f88-84c3-836abf138679" status: 409 len: 152 microversion: 2.1 time: 0.361071 Sep 01 05:06:27.238082 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1842/3699] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:06:26 2022] DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments/bff07c7c-7239-4f88-84c3-836abf138679 => generated 152 bytes in 365 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:06:27.261407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:27.262778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:27.286008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:27.289106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:27.290246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:27.293040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:27.296596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:27.299580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:27.973956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:27.984246 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-972f6586-ea1a-446e-b8cb-9edba6b27385 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1524 microversion: 2.1 time: 0.741723 Sep 01 05:06:27.988480 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1843/3700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:27 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1524 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:28.005833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:28.007855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:28.011764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=50 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:28.021650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:28.022509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:28.024152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:28.025075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:28.025803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:28.026394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:28.330847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c77fa43-01da-4ed3-8a51-b50bf1100fdc tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/action" status: 202 len: 0 microversion: 2.1 time: 0.335744 Sep 01 05:06:28.333809 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1844/3701] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:06:27 2022] POST /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:06:28.368418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:28.370602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:28.392933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:28.393997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:28.394580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:28.395470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:28.396118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:28.396713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:28.995734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:29.005017 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5fafdb61-82d3-4a4b-b2ab-4c2673883214 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1723 microversion: 2.1 time: 0.655596 Sep 01 05:06:29.011733 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1845/3702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:28 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1723 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:29.037239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:29.046423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:29.099100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:29.111921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:29.112950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:29.120828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:29.125800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:29.135761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:29.747539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:29.774521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46e6ed02-7a73-48fd-bba2-790b6b3504d7 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1524 microversion: 2.1 time: 0.744842 Sep 01 05:06:29.783029 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1846/3703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:29 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1524 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:29.815193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-94f19fb8-10f1-48dd-aad3-b4fa41eff743 req-88732da4-9dde-4e8d-b8d7-52cbef3b340c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a99c01-a249-41d4-ac54-475aa42d473b", "name": "network-vif-plugged", "status": "completed", "tag": "ee50ebf0-55da-411b-8a52-64cde30fad60"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:29.847322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-94f19fb8-10f1-48dd-aad3-b4fa41eff743 req-88732da4-9dde-4e8d-b8d7-52cbef3b340c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:29.853903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-94f19fb8-10f1-48dd-aad3-b4fa41eff743 req-88732da4-9dde-4e8d-b8d7-52cbef3b340c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:29.855061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-94f19fb8-10f1-48dd-aad3-b4fa41eff743 req-88732da4-9dde-4e8d-b8d7-52cbef3b340c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:29.900553 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-94f19fb8-10f1-48dd-aad3-b4fa41eff743 req-88732da4-9dde-4e8d-b8d7-52cbef3b340c service nova] Creating event network-vif-plugged:ee50ebf0-55da-411b-8a52-64cde30fad60 for instance e2a99c01-a249-41d4-ac54-475aa42d473b on n-h1-820368-37 Sep 01 05:06:29.921987 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-94f19fb8-10f1-48dd-aad3-b4fa41eff743 req-88732da4-9dde-4e8d-b8d7-52cbef3b340c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123590 Sep 01 05:06:29.924001 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1847/3704] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:30.047656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:30.053832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:30.084704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:30.090455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:30.091951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:30.093459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:30.096299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:30.100961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:30.118083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:30.479044 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a61861a3-e40c-464c-b1cc-1ac1afa7b048 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.468518 Sep 01 05:06:30.481573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1858/3705] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 05:06:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:30.514388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-128bb44a-65db-473a-9a9b-80aab4356507 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Action: 'create', calling method: .version_select at 0x7fa75be42c10>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:30.889740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:30.917163 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47808592-b4fc-4203-9d57-5f502a57dd4a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1723 microversion: 2.1 time: 0.881922 Sep 01 05:06:30.947005 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1848/3706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:30 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1723 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:30.966819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:30.971107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:30.986238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:30.987574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:30.988760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:30.990399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:30.991611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:30.993090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:31.674570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:31.700564 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e9cfec8-c7fb-463d-ba41-1c6fdd1c1cde tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1524 microversion: 2.1 time: 0.747505 Sep 01 05:06:31.704824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1849/3707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:30 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1524 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:31.963752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:31.965240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:32.037245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:32.038089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:32.038942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:32.040291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:32.040950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:32.041793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:32.926290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:32.937339 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81c710b4-42b4-47f6-a6da-e154213e870a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1729 microversion: 2.1 time: 0.981013 Sep 01 05:06:32.949115 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1850/3708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:31 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1729 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:32.957506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:32.960669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:32.976031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:32.976880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:32.977494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:32.978385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:32.981011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:32.995861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:33.424066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:33.452991 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db2b21b2-aaa5-48de-add7-d0d281e0bc81 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1509 microversion: 2.1 time: 0.499725 Sep 01 05:06:33.455218 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1851/3709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:32 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:33.504536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:33.505904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:33.529271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:33.529779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:33.530225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:33.540061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:33.540578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:33.541026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:33.894097 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c50f1c53-d5f2-4be3-a7bb-18b9c27727c7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.398783 Sep 01 05:06:33.894718 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1852/3710] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:06:33 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-interface => generated 285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:33.900726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:33.901354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:33.915467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:33.915969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:33.916406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:33.917137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:33.917595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:33.918021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:34.904638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:34.943879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f29007a3-48bc-4410-aaae-22ea88b006ae tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 200 len: 1509 microversion: 2.1 time: 1.048006 Sep 01 05:06:34.945147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1853/3711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:33 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 1509 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:34.970538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:34.971208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:34.981717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:34.984363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:34.990031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:34.991183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:34.991915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:34.992585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:35.029535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:06:35.251077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-412c8717-94ad-49c8-9c4a-d01eb806cf12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 204 len: 0 microversion: 2.1 time: 0.285735 Sep 01 05:06:35.255634 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1854/3712] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:06:34 2022] DELETE /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:06:35.429644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1661296057", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "6a55ef29-3665-4ee4-9546-ea904fa17891"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:35.529413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] validate_networks() for [('6a55ef29-3665-4ee4-9546-ea904fa17891', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:06:35.968578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=15 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:35.981534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=73 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:38.842925 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-128bb44a-65db-473a-9a9b-80aab4356507 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.340905 Sep 01 05:06:38.843956 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1859/3713] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 05:06:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:38.848777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4f21de51-db79-48ee-be4f-b5f3d891065b req-81236c59-b961-4deb-a7f1-8bdc02b65621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a99c01-a249-41d4-ac54-475aa42d473b", "name": "network-vif-deleted", "tag": "ee50ebf0-55da-411b-8a52-64cde30fad60"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:38.888175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4f21de51-db79-48ee-be4f-b5f3d891065b req-81236c59-b961-4deb-a7f1-8bdc02b65621 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:38.888823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4f21de51-db79-48ee-be4f-b5f3d891065b req-81236c59-b961-4deb-a7f1-8bdc02b65621 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:38.889277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4f21de51-db79-48ee-be4f-b5f3d891065b req-81236c59-b961-4deb-a7f1-8bdc02b65621 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:38.928941 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4f21de51-db79-48ee-be4f-b5f3d891065b req-81236c59-b961-4deb-a7f1-8bdc02b65621 service nova] Creating event network-vif-deleted:ee50ebf0-55da-411b-8a52-64cde30fad60 for instance e2a99c01-a249-41d4-ac54-475aa42d473b on n-h1-820368-37 Sep 01 05:06:38.944965 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4f21de51-db79-48ee-be4f-b5f3d891065b req-81236c59-b961-4deb-a7f1-8bdc02b65621 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099519 Sep 01 05:06:38.947099 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1860/3714] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:38.961726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2604266f-59ce-4ec7-b217-380df6a00a44 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Action: 'create', calling method: .version_select at 0x7fa75b3694c0>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:39.520936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:06:39.524489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:06:39.525625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:06:39.526560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:06:39.527471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:06:39.564705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:39.566205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:39.567637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:39.569424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:39.572802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:39.573907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:39.625664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Getting quotas for project 955a8b83d53e4051821332d61b01dc9b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:06:39.637736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Getting quotas for user 08997672c334463aa87b00fa1f6a9a56 and project 955a8b83d53e4051821332d61b01dc9b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:06:39.665501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:06:39.671062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:06:39.944875 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2be36443-3a55-4dcb-a972-b8e910bf8d12 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.519871 Sep 01 05:06:39.960806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1855/3715] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:06:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:06:39.991930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-425f4e80-d68e-43ef-bc5f-2923850a2cea tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:39.995982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-425f4e80-d68e-43ef-bc5f-2923850a2cea tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:40.306801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-425f4e80-d68e-43ef-bc5f-2923850a2cea tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:40.334167 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-425f4e80-d68e-43ef-bc5f-2923850a2cea tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1218 microversion: 2.1 time: 0.371398 Sep 01 05:06:40.338159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1856/3716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:39 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1218 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:40.652861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a174eb2f-7278-4453-a121-f874cfc8dcda req-c272dd54-46c0-4756-bd06-4185f00228b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:40.703406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a174eb2f-7278-4453-a121-f874cfc8dcda req-c272dd54-46c0-4756-bd06-4185f00228b0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:40.704706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a174eb2f-7278-4453-a121-f874cfc8dcda req-c272dd54-46c0-4756-bd06-4185f00228b0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:40.705898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a174eb2f-7278-4453-a121-f874cfc8dcda req-c272dd54-46c0-4756-bd06-4185f00228b0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:40.795385 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a174eb2f-7278-4453-a121-f874cfc8dcda req-c272dd54-46c0-4756-bd06-4185f00228b0 service nova] Creating event network-changed:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:06:40.816494 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a174eb2f-7278-4453-a121-f874cfc8dcda req-c272dd54-46c0-4756-bd06-4185f00228b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185382 Sep 01 05:06:40.819650 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1857/3717] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:41.391702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:41.405997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:41.437186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:41.438094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:41.438717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:41.440669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:41.441350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:41.446423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:41.607840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:41.676428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc66edef-c95f-45cd-a749-f757e0a5bd01 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1214 microversion: 2.1 time: 0.316221 Sep 01 05:06:41.678157 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1858/3718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:41 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1214 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:42.701263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:42.702187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:42.717665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:42.720470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:42.721721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:42.727301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:42.737860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:42.738774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:42.971925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:42.986458 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01aa8e78-2d83-4221-8737-ea4b5f26b9f8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1278 microversion: 2.1 time: 0.289861 Sep 01 05:06:42.987172 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1859/3719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:42 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:43.005189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-786c20a6-b547-4f4e-949e-91a3c14e4292 req-1ff60591-8f09-41ae-ab73-65b73cd0dd8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:43.030864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-786c20a6-b547-4f4e-949e-91a3c14e4292 req-1ff60591-8f09-41ae-ab73-65b73cd0dd8e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:43.031940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-786c20a6-b547-4f4e-949e-91a3c14e4292 req-1ff60591-8f09-41ae-ab73-65b73cd0dd8e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:43.033418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-786c20a6-b547-4f4e-949e-91a3c14e4292 req-1ff60591-8f09-41ae-ab73-65b73cd0dd8e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:43.061305 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-786c20a6-b547-4f4e-949e-91a3c14e4292 req-1ff60591-8f09-41ae-ab73-65b73cd0dd8e service nova] Creating event network-changed:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:06:43.076152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-786c20a6-b547-4f4e-949e-91a3c14e4292 req-1ff60591-8f09-41ae-ab73-65b73cd0dd8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086109 Sep 01 05:06:43.077877 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1860/3720] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:44.025487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:44.038283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:44.073475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:44.079731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:44.081099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:44.090976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:44.091701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:44.094823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:44.262048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:44.281950 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-625d7d92-8a7c-4bdb-8547-221cc09a1eac tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1276 microversion: 2.1 time: 0.263887 Sep 01 05:06:44.290297 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1861/3721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:44 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:44.314090 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2604266f-59ce-4ec7-b217-380df6a00a44 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.363279 Sep 01 05:06:44.315636 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1861/3722] 10.222.0.26 () {60 vars in 1170 bytes} [Thu Sep 1 05:06:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:44.336524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69143123-8b06-49e7-9fdd-eb344baed4f3 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa75b730a60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:44.777639 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69143123-8b06-49e7-9fdd-eb344baed4f3 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/2345db8f-91aa-491c-aedb-61f9230b85af" status: 200 len: 141 microversion: 2.1 time: 0.447891 Sep 01 05:06:44.794035 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1862/3723] 10.222.0.26 () {58 vars in 1260 bytes} [Thu Sep 1 05:06:44 2022] GET /compute/v2.1/os-floating-ips/2345db8f-91aa-491c-aedb-61f9230b85af => generated 141 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:44.799029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3096e08-a125-4cd4-a9f7-abcbf4112096 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa76023a5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:45.316357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:45.318442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:45.348043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:45.349093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:45.349851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:45.353380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:45.354241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:45.355056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:46.184774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:46.219392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80b77fd7-45e3-452a-bef9-4c071e09091e tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1318 microversion: 2.1 time: 0.910509 Sep 01 05:06:46.221765 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1863/3724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:45 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1318 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:46.243219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:46.244227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:46.272359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:46.273964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:46.275380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:46.276600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:46.278168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:46.281858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:46.379212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e6bc678-47ab-4a53-8644-78ea28d68271 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/ips" status: 200 len: 150 microversion: 2.1 time: 0.155715 Sep 01 05:06:46.380866 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1864/3725] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:06:46 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/ips => generated 150 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:47.414937 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3096e08-a125-4cd4-a9f7-abcbf4112096 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/2345db8f-91aa-491c-aedb-61f9230b85af" status: 202 len: 0 microversion: 2.1 time: 2.614900 Sep 01 05:06:47.414937 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1862/3726] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:06:44 2022] DELETE /compute/v2.1/os-floating-ips/2345db8f-91aa-491c-aedb-61f9230b85af => generated 0 bytes in 2617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:06:47.415705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:47.416822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:47.432041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:47.432602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:47.433058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:47.433809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:47.434276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:47.434700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6f88b2f0-510c-494f-a71c-bd0a393ccfa4 req-0edec4fd-5f70-48df-b1bc-a699d6eacb6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5e63af-6b43-45cd-9c50-e88a675c433b", "tag": "f63583a3-9b9b-40a7-9577-4bc2c052ac15"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:47.435847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:47.463724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6f88b2f0-510c-494f-a71c-bd0a393ccfa4 req-0edec4fd-5f70-48df-b1bc-a699d6eacb6e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:47.464210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6f88b2f0-510c-494f-a71c-bd0a393ccfa4 req-0edec4fd-5f70-48df-b1bc-a699d6eacb6e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:47.464633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6f88b2f0-510c-494f-a71c-bd0a393ccfa4 req-0edec4fd-5f70-48df-b1bc-a699d6eacb6e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:47.498774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6f88b2f0-510c-494f-a71c-bd0a393ccfa4 req-0edec4fd-5f70-48df-b1bc-a699d6eacb6e service nova] Creating event network-changed:f63583a3-9b9b-40a7-9577-4bc2c052ac15 for instance 2c5e63af-6b43-45cd-9c50-e88a675c433b on n-h1-820368-37 Sep 01 05:06:47.512416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6f88b2f0-510c-494f-a71c-bd0a393ccfa4 req-0edec4fd-5f70-48df-b1bc-a699d6eacb6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349140 Sep 01 05:06:47.513077 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1865/3727] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:06:47.519458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55fc9c4f-c7aa-4ed3-8439-3b245f308b4f tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa76412dca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:48.067780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55fc9c4f-c7aa-4ed3-8439-3b245f308b4f tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.553011 Sep 01 05:06:48.069219 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1866/3728] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Sep 1 05:06:47 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:06:48.083942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5882aeb0-9caf-43a5-b441-0ada481c0e2f tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa75b0451f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:48.291181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:48.303837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd429f97-2f77-46a2-a043-fbdbe735866c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1318 microversion: 2.1 time: 0.893116 Sep 01 05:06:48.306216 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1863/3729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:47 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:48.680664 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5882aeb0-9caf-43a5-b441-0ada481c0e2f tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.603539 Sep 01 05:06:48.681726 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1867/3730] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 05:06:48 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:48.696471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50b97846-ecec-4ee6-8ed4-a093712b0882 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa75be91700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:49.320975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1cb8773-b62d-4695-b7d5-9d1c4636bbd1"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:49.324073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:49.346295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:49.347173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:49.347843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:49.352190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:49.353026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:49.353674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:49.608728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:49.993767 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90287142-d401-413f-8ce6-4e56ec2cdf39 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "POST /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669858 Sep 01 05:06:50.000544 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1868/3731] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:06:49 2022] POST /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:50.042932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:50.046476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:50.066517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:50.071760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:50.072636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:50.073809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:50.075942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:50.078000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:50.095699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:50.330576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:51.156675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:51.171930 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55e41701-90ef-4d8e-83e0-79e0ad891d51 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1318 microversion: 2.1 time: 1.160635 Sep 01 05:06:51.172653 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1869/3732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:50 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1318 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:52.305639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:52.310146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:52.329234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:52.332627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:52.333262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:52.334407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:52.336293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:52.337203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:52.391847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:06:52.572232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-772be9d1-6080-49e2-8a62-c2bb24e3532a tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 204 len: 0 microversion: 2.42 time: 0.724439 Sep 01 05:06:52.577337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1870/3733] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:06:51 2022] DELETE /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:06:52.585913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:52.586989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:52.596837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:52.597946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:52.598991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:52.600401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:52.602075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:52.603017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:53.078134 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50b97846-ecec-4ee6-8ed4-a093712b0882 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/3e1d68a1-4597-4334-957c-ecd65603006b" status: 202 len: 0 microversion: 2.1 time: 4.379520 Sep 01 05:06:53.088318 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1864/3734] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:06:48 2022] DELETE /compute/v2.1/os-floating-ips/3e1d68a1-4597-4334-957c-ecd65603006b => generated 0 bytes in 4397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:06:53.121233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:53.123043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:53.129305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:53.142904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bca586b0-20e7-4dc5-9dbd-491390f8e1a4 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1318 microversion: 2.1 time: 0.563196 Sep 01 05:06:53.143697 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1871/3735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:52 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:53.146172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:53.148558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:53.148774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98275f83-7054-4423-a9e4-c8ffc11b0d65 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa75af6cca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:53.149941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:53.151640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:53.152982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:53.154035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:53.773812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:53.818981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:53.829916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:53.840917 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c198e3d-8c9e-4f33-a594-8fb86ec917cf tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2957 microversion: 2.42 time: 0.741155 Sep 01 05:06:53.862596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1865/3736] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:53 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2957 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:06:54.174215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:54.176045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:54.185921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:54.187298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:54.188062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:54.189807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:54.190724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:54.191488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:55.144602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:55.169883 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4291eca7-5276-430b-a3fd-3e91a0c23c85 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1318 microversion: 2.1 time: 1.009095 Sep 01 05:06:55.170510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1866/3737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:54 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1318 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:55.180872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:55.181850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:55.199081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:55.199613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:55.200037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:55.200781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:55.201249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:55.201687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:55.720087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:55.757932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:55.763469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:55.769349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86556481-cb92-41c3-a761-b25fc6e098fc tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2957 microversion: 2.42 time: 0.595173 Sep 01 05:06:55.791683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1867/3738] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:55 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2957 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:06:55.806853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cd60a5bf-f428-40c9-bb12-3f9b7e62495f req-56d08bec-b9fa-47a3-8cc8-3427a68b95a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5e63af-6b43-45cd-9c50-e88a675c433b", "name": "network-vif-plugged", "status": "completed", "tag": "f63583a3-9b9b-40a7-9577-4bc2c052ac15"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:06:55.830442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd60a5bf-f428-40c9-bb12-3f9b7e62495f req-56d08bec-b9fa-47a3-8cc8-3427a68b95a3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:55.831410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd60a5bf-f428-40c9-bb12-3f9b7e62495f req-56d08bec-b9fa-47a3-8cc8-3427a68b95a3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:55.831943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd60a5bf-f428-40c9-bb12-3f9b7e62495f req-56d08bec-b9fa-47a3-8cc8-3427a68b95a3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:55.860069 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cd60a5bf-f428-40c9-bb12-3f9b7e62495f req-56d08bec-b9fa-47a3-8cc8-3427a68b95a3 service nova] Creating event network-vif-plugged:f63583a3-9b9b-40a7-9577-4bc2c052ac15 for instance 2c5e63af-6b43-45cd-9c50-e88a675c433b on n-h1-820368-37 Sep 01 05:06:55.883376 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cd60a5bf-f428-40c9-bb12-3f9b7e62495f req-56d08bec-b9fa-47a3-8cc8-3427a68b95a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089772 Sep 01 05:06:55.884292 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1868/3739] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:06:56.199011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:56.199933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:56.218444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:56.219070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:56.221633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:56.222820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:56.226052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:56.229873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:56.804500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:56.815938 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98275f83-7054-4423-a9e4-c8ffc11b0d65 tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/f85dba67-a144-4220-a2f7-2e122f96e975" status: 202 len: 0 microversion: 2.1 time: 3.670962 Sep 01 05:06:56.816984 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1872/3740] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:06:53 2022] DELETE /compute/v2.1/os-floating-ips/f85dba67-a144-4220-a2f7-2e122f96e975 => generated 0 bytes in 3672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:06:56.821830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a34b85f-c695-4f5d-a5e5-2b52317a2dfd tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1318 microversion: 2.1 time: 0.628362 Sep 01 05:06:56.822446 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1869/3741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:56 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:06:56.827359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f26807e-9c58-4027-9bdf-b0d53c89930b tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] Calling method '.version_select at 0x7fa75bfc03a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:56.836835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:56.837531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:56.874522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:56.879157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:56.881708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:56.887056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:56.891553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:56.894772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:58.200882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:58.232209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:58.235889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:58.239180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05620972-50d2-495f-aeb0-149282a35212 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2957 microversion: 2.42 time: 1.419806 Sep 01 05:06:58.263568 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1873/3742] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:56 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2957 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:06:58.283625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:58.284949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:58.288822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:58.307425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:58.309735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:58.310789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:58.312767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:58.313841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:58.314814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:59.615052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:06:59.624881 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ee39694-c890-4686-85f6-23c2355b9d46 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1508 microversion: 2.1 time: 1.359245 Sep 01 05:06:59.625476 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1874/3743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:58 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1508 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:06:59.642466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:59.645981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:59.666168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:59.667463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:59.668692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:59.669662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:59.672856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:59.674037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:59.783836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f26807e-9c58-4027-9bdf-b0d53c89930b tempest-FloatingIPDetailsTestJSON-835239322 tempest-FloatingIPDetailsTestJSON-835239322-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/16de91c6-2e1e-40c6-9b91-b83bcfd9315f" status: 202 len: 0 microversion: 2.1 time: 2.959735 Sep 01 05:06:59.785422 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1870/3744] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:06:56 2022] DELETE /compute/v2.1/os-floating-ips/16de91c6-2e1e-40c6-9b91-b83bcfd9315f => generated 0 bytes in 2962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:06:59.791969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:06:59.792781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:06:59.836736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:59.847901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:59.849169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:06:59.855221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:06:59.856556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:06:59.864077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:00.831930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:00.858361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:00.868113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:00.871202 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78127209-d86e-47ee-888c-f8569768468c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2936 microversion: 2.42 time: 1.236975 Sep 01 05:07:00.873743 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1875/3745] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:06:59 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2936 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:00.892740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4891c400-28c0-4160-9252-d144fa7a694f req-c4266869-434b-40be-9ff4-3a49cddbe3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-unplugged", "status": "completed", "tag": "a4bac124-45b5-4944-b285-6c67626879ea"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:00.930198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4891c400-28c0-4160-9252-d144fa7a694f req-c4266869-434b-40be-9ff4-3a49cddbe3fd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:00.930871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4891c400-28c0-4160-9252-d144fa7a694f req-c4266869-434b-40be-9ff4-3a49cddbe3fd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:00.934930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4891c400-28c0-4160-9252-d144fa7a694f req-c4266869-434b-40be-9ff4-3a49cddbe3fd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:01.014394 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4891c400-28c0-4160-9252-d144fa7a694f req-c4266869-434b-40be-9ff4-3a49cddbe3fd service nova] Creating event network-vif-unplugged:a4bac124-45b5-4944-b285-6c67626879ea for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:01.020826 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4891c400-28c0-4160-9252-d144fa7a694f req-c4266869-434b-40be-9ff4-3a49cddbe3fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145499 Sep 01 05:07:01.021975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1876/3746] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:01.108358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:01.128453 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-799ed941-f697-4db2-8667-ff5fd4135919 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1508 microversion: 2.1 time: 1.339683 Sep 01 05:07:01.131460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1871/3747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:06:59 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1508 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:01.177115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:01.182424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:01.201556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:01.202831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:01.204232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:01.205903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:01.207628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:01.208638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:01.393288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c52cf975-533e-4cd0-a358-1b6027caa03b tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "PUT /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1080 microversion: 2.1 time: 0.224320 Sep 01 05:07:01.409529 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1877/3748] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:07:01 2022] PUT /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1080 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:01.432426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:01.435614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:01.456208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:01.458576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:01.461648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:01.462746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:01.463473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:01.468711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:01.932057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:01.935749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:01.969408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:01.973070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:01.977652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:01.979296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:01.987843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:01.989124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:02.075445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:02.086314 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcdc6b63-ef30-48a4-b275-eecaa0d1b193 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1506 microversion: 2.1 time: 0.662140 Sep 01 05:07:02.096084 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1872/3749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:01 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:02.133253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:02.134726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:02.157814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:02.161453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:02.165147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:02.167823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:02.168543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:02.169222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:03.065841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:03.089270 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1bbe31e-2790-47e2-99f4-cc38bfd0616a tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1506 microversion: 2.1 time: 0.960110 Sep 01 05:07:03.099079 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1873/3750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:02 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1506 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:03.117512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:03.142879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:03.155029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:03.160235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:03.167789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:03.170010 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c45f21b0-7e50-472d-a91b-ba6c39bc6b20 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2915 microversion: 2.42 time: 1.245159 Sep 01 05:07:03.171740 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1878/3751] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:01 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2915 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:03.188682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:03.194147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:03.197750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:03.199803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:03.202345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:03.203999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:03.256600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-unplugged", "status": "completed", "tag": "80612bef-94e4-4a55-8de5-db8e954f58a5"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-unplugged", "status": "completed", "tag": "02b6b504-6c18-4e13-9d47-992ebe76b188"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-unplugged", "status": "completed", "tag": "fee31787-083d-4363-9ccf-f1cca229253f"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-unplugged", "status": "completed", "tag": "fcbe2c69-ec2d-45ac-afa8-4f81e1107b90"}, {"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-unplugged", "status": "completed", "tag": "c07a473c-435b-4a82-9cec-ed1e4ee32c70"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:03.326841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:03.327976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:03.331313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:03.396381 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Creating event network-vif-unplugged:80612bef-94e4-4a55-8de5-db8e954f58a5 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:03.398296 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Creating event network-vif-unplugged:02b6b504-6c18-4e13-9d47-992ebe76b188 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:03.400255 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Creating event network-vif-unplugged:fee31787-083d-4363-9ccf-f1cca229253f for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:03.402815 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Creating event network-vif-unplugged:fcbe2c69-ec2d-45ac-afa8-4f81e1107b90 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:03.403970 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] Creating event network-vif-unplugged:c07a473c-435b-4a82-9cec-ed1e4ee32c70 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:03.429674 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6cfabe43-c762-4854-8d4b-e2d2ef323395 req-4da2c66b-b2e4-4b04-89e1-12e678ce21d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.177154 Sep 01 05:07:03.433667 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1879/3752] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:03.502748 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e80be8ba-0d52-40db-9a26-ed54cd7a02d0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "PUT /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1082 microversion: 2.1 time: 0.362673 Sep 01 05:07:03.504081 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1874/3753] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:07:03 2022] PUT /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1082 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:03.531387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:03.532794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:03.545084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:03.545996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:03.563802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:03.567282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:03.568209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:03.568816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:04.171698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:04.184548 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8419b862-ea05-4067-bbb1-f7f57c05ef97 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1508 microversion: 2.1 time: 0.662032 Sep 01 05:07:04.188848 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1880/3754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:03 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1508 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:04.231045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:04.232259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:04.236317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:04.237654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:04.254110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:04.261357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:04.261543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:04.262785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:04.264348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:04.265546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:04.268673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:04.269400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:04.271786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:04.275231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:04.276622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:04.288021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:05.192996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:05.211506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:05.213241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:05.219887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-179c40d9-c74d-47c6-851a-d809fcebe615 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2915 microversion: 2.42 time: 1.020802 Sep 01 05:07:05.235502 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1875/3755] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:04 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2915 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:05.807562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:05.844794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73afc46f-738a-4ce2-9704-8882d5295c4c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1508 microversion: 2.1 time: 1.619501 Sep 01 05:07:05.848566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1881/3756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:04 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1508 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:05.882453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:05.883252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:05.895745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:05.898132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:05.903693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:05.904784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:05.905433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:05.906061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:05.989653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:06.045001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:07:06.162758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=27 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:06.206176 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f430e677-5f85-4111-b0a8-8f180d06e80d tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 204 len: 0 microversion: 2.1 time: 0.329054 Sep 01 05:07:06.207782 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1876/3757] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:07:05 2022] DELETE /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:06.224973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:06.226262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:06.248534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:06.250779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:06.264412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:06.269470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:06.270624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:06.273197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:06.274949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:06.275977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:06.278671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:06.279218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:06.282531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:06.284728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:06.288865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:06.289562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:06.387353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:07:06.536306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Instance is already in deleting state, ignoring this request Sep 01 05:07:06.540681 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06bd33c8-2c63-4f7f-b7aa-d2f89d8c193c tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 204 len: 0 microversion: 2.1 time: 0.319285 Sep 01 05:07:06.545270 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1882/3758] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:07:06 2022] DELETE /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:06.567575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:06.568468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:06.584023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:06.586112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:06.590189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:06.591541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:06.592306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:06.593040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:07.457433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:07.479270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:07.481185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:07.483063 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e12b6808-83b1-4904-a30d-4f5444a1cfa0 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2868 microversion: 2.42 time: 1.241647 Sep 01 05:07:07.501030 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1877/3759] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:06 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2868 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:07.514983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a536f8fe-d44c-42fb-a8e1-dafced4d5588 req-d1977979-d40d-4eb2-a055-d0a550d34735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-deleted", "tag": "02b6b504-6c18-4e13-9d47-992ebe76b188"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:07.542080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a536f8fe-d44c-42fb-a8e1-dafced4d5588 req-d1977979-d40d-4eb2-a055-d0a550d34735 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:07.542901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a536f8fe-d44c-42fb-a8e1-dafced4d5588 req-d1977979-d40d-4eb2-a055-d0a550d34735 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:07.543516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a536f8fe-d44c-42fb-a8e1-dafced4d5588 req-d1977979-d40d-4eb2-a055-d0a550d34735 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:07.561299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:07.575634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a536f8fe-d44c-42fb-a8e1-dafced4d5588 req-d1977979-d40d-4eb2-a055-d0a550d34735 service nova] Creating event network-vif-deleted:02b6b504-6c18-4e13-9d47-992ebe76b188 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:07.576120 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce2eca5a-e33a-476a-b15b-937ce5615480 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1514 microversion: 2.1 time: 1.018351 Sep 01 05:07:07.576996 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1883/3760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:06 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1514 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:07.601113 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a536f8fe-d44c-42fb-a8e1-dafced4d5588 req-d1977979-d40d-4eb2-a055-d0a550d34735 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098129 Sep 01 05:07:07.603916 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1878/3761] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:08.509192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:08.509870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:08.551060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:08.551893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:08.552416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:08.553252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:08.553846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:08.555059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:08.598929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:08.604791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:08.637188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:08.643544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:08.651634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:08.653246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:08.653824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:08.654435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:08.675923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:09.614489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:09.636427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51a4b7d9-daf2-4b90-b948-a94968bac9c2 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1514 microversion: 2.1 time: 1.042310 Sep 01 05:07:09.637622 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1879/3762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:08 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1514 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:10.312136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:10.385084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:10.398490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:10.406732 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59b1f095-093e-4a59-a4ee-4543a847b49f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2576 microversion: 2.42 time: 1.901861 Sep 01 05:07:10.409565 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1884/3763] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:08 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2576 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:10.483145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-88cb6a4e-25c7-4269-85ae-de88361dc775 req-003a025c-ca3c-463c-ac2a-64625a7b8a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-deleted", "tag": "fcbe2c69-ec2d-45ac-afa8-4f81e1107b90"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:10.498709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-677ba6ed-a7a5-4825-be13-6a0e1ad6ce55 req-2cc69090-4964-4223-aba7-a09e4245ef5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5e63af-6b43-45cd-9c50-e88a675c433b", "name": "network-vif-deleted", "tag": "f63583a3-9b9b-40a7-9577-4bc2c052ac15"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:10.508819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-88cb6a4e-25c7-4269-85ae-de88361dc775 req-003a025c-ca3c-463c-ac2a-64625a7b8a9e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:10.511668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-88cb6a4e-25c7-4269-85ae-de88361dc775 req-003a025c-ca3c-463c-ac2a-64625a7b8a9e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:10.512272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-88cb6a4e-25c7-4269-85ae-de88361dc775 req-003a025c-ca3c-463c-ac2a-64625a7b8a9e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:10.533817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-677ba6ed-a7a5-4825-be13-6a0e1ad6ce55 req-2cc69090-4964-4223-aba7-a09e4245ef5e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:10.539049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-677ba6ed-a7a5-4825-be13-6a0e1ad6ce55 req-2cc69090-4964-4223-aba7-a09e4245ef5e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:10.541092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-677ba6ed-a7a5-4825-be13-6a0e1ad6ce55 req-2cc69090-4964-4223-aba7-a09e4245ef5e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:10.616183 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-677ba6ed-a7a5-4825-be13-6a0e1ad6ce55 req-2cc69090-4964-4223-aba7-a09e4245ef5e service nova] Creating event network-vif-deleted:f63583a3-9b9b-40a7-9577-4bc2c052ac15 for instance 2c5e63af-6b43-45cd-9c50-e88a675c433b on n-h1-820368-37 Sep 01 05:07:10.632478 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-677ba6ed-a7a5-4825-be13-6a0e1ad6ce55 req-2cc69090-4964-4223-aba7-a09e4245ef5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137471 Sep 01 05:07:10.634197 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1885/3764] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:10.655130 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-88cb6a4e-25c7-4269-85ae-de88361dc775 req-003a025c-ca3c-463c-ac2a-64625a7b8a9e service nova] Creating event network-vif-deleted:fcbe2c69-ec2d-45ac-afa8-4f81e1107b90 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:10.660607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:10.661763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:10.678815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:10.679757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:10.680471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:10.681904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:10.682569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:10.683256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:10.708074 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-88cb6a4e-25c7-4269-85ae-de88361dc775 req-003a025c-ca3c-463c-ac2a-64625a7b8a9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231838 Sep 01 05:07:10.718323 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1880/3765] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 01 05:07:11.105918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08997672c334463aa87b00fa1f6a9a56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955a8b83d53e4051821332d61b01dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:11.150906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34a75fe0-5422-431d-9cf5-67982d62b53f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 200 len: 1303 microversion: 2.1 time: 0.489934 Sep 01 05:07:11.154058 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1886/3766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:10 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 1303 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:11.402711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:11.410874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:11.442010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:11.442722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:11.453693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:11.455602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:11.455989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:11.456807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:11.458299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:11.459206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:11.461547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:11.463138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:11.464167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:11.473908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:11.474938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:11.478480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:11.773591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lazy-loading 'services' on Instance uuid a1e56cc3-eb85-4489-8da9-21c81329e289 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:07:11.987667 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe6d1fb0-fe3d-4f6e-911a-ef8b7ef3dba6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments/c1cb8773-b62d-4695-b7d5-9d1c4636bbd1" status: 202 len: 0 microversion: 2.1 time: 0.604809 Sep 01 05:07:11.988644 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1881/3767] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:07:11 2022] DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments/c1cb8773-b62d-4695-b7d5-9d1c4636bbd1 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:07:12.027182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.032705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.089714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.093330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.098094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.104611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.106207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.107358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.191910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f335f5b3-b1fb-4ef8-9dfa-88a73f833560 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196920 Sep 01 05:07:12.193789 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1882/3768] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:11 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:12.205777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.206657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 2c5e63af-6b43-45cd-9c50-e88a675c433b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.224079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.226035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.227892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.234049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.236897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.237813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.271066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] HTTP exception thrown: Instance 2c5e63af-6b43-45cd-9c50-e88a675c433b could not be found. Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Request method failure captured: Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b HTTP/1.1 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED1gtL6NfSJPAMw2DbQg_4fBEvVwVApDWi0F1lbSe6es7o-St_5sEoKzc9q_fUOFnYUcyMk_a1hm7oOjgl2wpKKuoX8zSbFh4uaw-xl-_VxXxSLv4WtdZPBcLDvZ4o4vcwl1TjQ-VmioNmKe2sOtXip0Qw8Dy8_urKKJkx4th_Xd-xs Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 08997672c334463aa87b00fa1f6a9a56 Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 2c5e63af-6b43-45cd-9c50-e88a675c433b could not be found. Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '2c5e63af-6b43-45cd-9c50-e88a675c433b'} Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5e63af-6b43-45cd-9c50-e88a675c433b could not be found. Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5e63af-6b43-45cd-9c50-e88a675c433b could not be found. Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.275686 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5e63af-6b43-45cd-9c50-e88a675c433b could not be found. Sep 01 05:07:12.280446 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.282000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Returning 404 to user: Instance 2c5e63af-6b43-45cd-9c50-e88a675c433b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:12.287538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-daddc2c1-1f13-4cc3-82ff-e2f086030d37 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b" status: 404 len: 111 microversion: 2.1 time: 0.091177 Sep 01 05:07:12.288876 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1883/3769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:12 2022] GET /compute/v2.1/servers/2c5e63af-6b43-45cd-9c50-e88a675c433b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:12.309604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.312129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.338931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.339745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.340480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.342708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.342708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.342963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.388859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] HTTP exception thrown: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Request method failure captured: Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b HTTP/1.1 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED1gtL6NfSJPAMw2DbQg_4fBEvVwVApDWi0F1lbSe6es7o-St_5sEoKzc9q_fUOFnYUcyMk_a1hm7oOjgl2wpKKuoX8zSbFh4uaw-xl-_VxXxSLv4WtdZPBcLDvZ4o4vcwl1TjQ-VmioNmKe2sOtXip0Qw8Dy8_urKKJkx4th_Xd-xs Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 08997672c334463aa87b00fa1f6a9a56 Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e2a99c01-a249-41d4-ac54-475aa42d473b'} Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:12.393023 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Returning 404 to user: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fce2870d-06fe-4a0c-a0b6-f5514f0b936f tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 404 len: 111 microversion: 2.1 time: 0.100060 Sep 01 05:07:12.415870 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1884/3770] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:07:12 2022] DELETE /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:12.477992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.488565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: e2a99c01-a249-41d4-ac54-475aa42d473b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.539812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.548796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.549943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.552111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.553364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.556403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.632967 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] HTTP exception thrown: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Request method failure captured: Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b HTTP/1.1 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED1gtL6NfSJPAMw2DbQg_4fBEvVwVApDWi0F1lbSe6es7o-St_5sEoKzc9q_fUOFnYUcyMk_a1hm7oOjgl2wpKKuoX8zSbFh4uaw-xl-_VxXxSLv4WtdZPBcLDvZ4o4vcwl1TjQ-VmioNmKe2sOtXip0Qw8Dy8_urKKJkx4th_Xd-xs Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 08997672c334463aa87b00fa1f6a9a56 Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e2a99c01-a249-41d4-ac54-475aa42d473b'} Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.637836 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.644102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Returning 404 to user: Instance e2a99c01-a249-41d4-ac54-475aa42d473b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:12.655117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da59f4fb-b227-4ec3-9a66-f0047fe81dd8 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b" status: 404 len: 111 microversion: 2.1 time: 0.236696 Sep 01 05:07:12.666187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1885/3771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:12 2022] GET /compute/v2.1/servers/e2a99c01-a249-41d4-ac54-475aa42d473b => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:12.679364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.680284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.702728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.704020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.704806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.706061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.706951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.708580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.770189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:12.780615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:12.784885 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] HTTP exception thrown: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.786391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Request method failure captured: Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d HTTP/1.1 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED1gtL6NfSJPAMw2DbQg_4fBEvVwVApDWi0F1lbSe6es7o-St_5sEoKzc9q_fUOFnYUcyMk_a1hm7oOjgl2wpKKuoX8zSbFh4uaw-xl-_VxXxSLv4WtdZPBcLDvZ4o4vcwl1TjQ-VmioNmKe2sOtXip0Qw8Dy8_urKKJkx4th_Xd-xs Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 08997672c334463aa87b00fa1f6a9a56 Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '3eb0702b-3d1c-476f-951b-8039a1bb1f5d'} Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:12.794668 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Returning 404 to user: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2174b58-c6a4-4340-b12a-494dfe20e7b6 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 404 len: 111 microversion: 2.1 time: 0.130655 Sep 01 05:07:12.805525 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1886/3772] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:07:12 2022] DELETE /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:12.808970 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70e10995-a92d-4b23-b9bb-db5be7ff3a36 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2417 microversion: 2.42 time: 1.354184 Sep 01 05:07:12.808970 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1887/3773] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:11 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2417 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:07:12.808970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.808970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] [instance: 3eb0702b-3d1c-476f-951b-8039a1bb1f5d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.823710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:12.824275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:12.832507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.833011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.833445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.834170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.834624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.835153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.850494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.851645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.852336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.853282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:12.857431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:12.858176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:12.886166 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] HTTP exception thrown: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Request method failure captured: Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d HTTP/1.1 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED1gtL6NfSJPAMw2DbQg_4fBEvVwVApDWi0F1lbSe6es7o-St_5sEoKzc9q_fUOFnYUcyMk_a1hm7oOjgl2wpKKuoX8zSbFh4uaw-xl-_VxXxSLv4WtdZPBcLDvZ4o4vcwl1TjQ-VmioNmKe2sOtXip0Qw8Dy8_urKKJkx4th_Xd-xs Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/955a8b83d53e4051821332d61b01dc9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 955a8b83d53e4051821332d61b01dc9b Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1114804720 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 08997672c334463aa87b00fa1f6a9a56 Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerDiskConfigTestJSON-1114804720-project Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3eb0702b-3d1c-476f-951b-8039a1bb1f5d'} Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:12.888918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] Returning 404 to user: Instance 3eb0702b-3d1c-476f-951b-8039a1bb1f5d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cc63c02-9a9a-458a-be82-7b7f54e3bbf0 tempest-ServerDiskConfigTestJSON-1114804720 tempest-ServerDiskConfigTestJSON-1114804720-project] 10.222.0.26 "GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d" status: 404 len: 111 microversion: 2.1 time: 0.088278 Sep 01 05:07:12.896740 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1888/3774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:12 2022] GET /compute/v2.1/servers/3eb0702b-3d1c-476f-951b-8039a1bb1f5d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:13.001111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'services' on Instance uuid 27b9c200-02b4-4279-9ae9-540f328d4d24 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:07:13.146174 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-931d3cce-88c8-4051-a29c-738466c6b71f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments/bff07c7c-7239-4f88-84c3-836abf138679" status: 202 len: 0 microversion: 2.1 time: 0.347552 Sep 01 05:07:13.148462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1887/3775] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:07:12 2022] DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments/bff07c7c-7239-4f88-84c3-836abf138679 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:07:13.166929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:13.172891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:13.215141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:13.217789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:13.219527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:13.223281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:13.232035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:13.233289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:13.234118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:13.234794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:13.239190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:13.243550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:13.247781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:13.249703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:13.251002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:13.279648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:13.284804 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8ac2bfa-fba3-4779-a794-8abb872b6e30 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131740 Sep 01 05:07:13.291129 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1889/3776] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:13 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:13.366812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd447c54-a3b9-40ae-82e0-51c331b11670 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158491 Sep 01 05:07:13.399594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1888/3777] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:13 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:13.830237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:13.831216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:13.862057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:13.862569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:13.863256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:13.864258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:13.879545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:13.880094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:14.299035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:14.301934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:14.322563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:14.325576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:14.326038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:14.326824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:14.327326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:14.327807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:14.398809 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92ff174a-b8ce-4070-8e5b-623c8a79848a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103718 Sep 01 05:07:14.410110 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1889/3778] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:14 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:14.472561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:14.478520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:14.491956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:14.493470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:14.494195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:14.498154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:14.499194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:14.499817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:14.575213 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cea9946-4a8c-4704-a3a1-5a6803d14b47 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108897 Sep 01 05:07:14.580175 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1890/3779] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:14 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:14.663433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dbac3545-6a1f-494d-8bf2-caaa98afb029 req-03da8380-3f3e-401a-a242-b0ebaa1327cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-deleted", "tag": "80612bef-94e4-4a55-8de5-db8e954f58a5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:14.687684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dbac3545-6a1f-494d-8bf2-caaa98afb029 req-03da8380-3f3e-401a-a242-b0ebaa1327cd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:14.688170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dbac3545-6a1f-494d-8bf2-caaa98afb029 req-03da8380-3f3e-401a-a242-b0ebaa1327cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:14.688814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dbac3545-6a1f-494d-8bf2-caaa98afb029 req-03da8380-3f3e-401a-a242-b0ebaa1327cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:14.711664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dbac3545-6a1f-494d-8bf2-caaa98afb029 req-03da8380-3f3e-401a-a242-b0ebaa1327cd service nova] Creating event network-vif-deleted:80612bef-94e4-4a55-8de5-db8e954f58a5 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:14.728899 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dbac3545-6a1f-494d-8bf2-caaa98afb029 req-03da8380-3f3e-401a-a242-b0ebaa1327cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069569 Sep 01 05:07:14.729913 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1891/3780] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:15.257310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:15.270873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:15.272968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:15.284592 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c9958ab-f9b8-4732-8939-d60adf18e516 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2370 microversion: 2.42 time: 1.460346 Sep 01 05:07:15.285520 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1890/3781] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:13 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2370 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:15.425120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:15.428606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:15.445100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:15.445759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:15.446382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:15.455450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:15.456197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:15.456833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:15.530144 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2d7d5c4-2dd8-4002-8a6c-da6a3f437972 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108644 Sep 01 05:07:15.541486 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1892/3782] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:15 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:15.593051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:15.595596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:15.608436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:15.608946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:15.609386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:15.610119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:15.610581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:15.611050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:15.661456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54f896ec-284c-4cff-8805-23f3786a814b tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072647 Sep 01 05:07:15.667500 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1891/3783] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:15 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:16.331418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:16.332066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:16.349304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.354801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.357354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.358398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.361451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.367635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.540496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:16.543154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:16.564471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.565337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.565956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.566909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.567508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.568065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.613155 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6f542ba-008b-4174-be58-b02ff8b1c3c1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076967 Sep 01 05:07:16.619982 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1892/3784] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:16 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:16.681580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:16.687284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:16.701519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.703050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.704206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.707119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.707807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.708858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.825954 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b8407c6-c802-4789-b27c-3261f951b648 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155102 Sep 01 05:07:16.830641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1893/3785] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:16 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:16.836635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-361af202-ac17-40f3-ab3c-bdb2ef1a1efb req-0e46a0b3-9ca4-4ba3-9c0f-a582595a476c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-deleted", "tag": "fee31787-083d-4363-9ccf-f1cca229253f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:16.880794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-361af202-ac17-40f3-ab3c-bdb2ef1a1efb req-0e46a0b3-9ca4-4ba3-9c0f-a582595a476c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:16.881273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-361af202-ac17-40f3-ab3c-bdb2ef1a1efb req-0e46a0b3-9ca4-4ba3-9c0f-a582595a476c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:16.881736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-361af202-ac17-40f3-ab3c-bdb2ef1a1efb req-0e46a0b3-9ca4-4ba3-9c0f-a582595a476c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:16.903156 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-361af202-ac17-40f3-ab3c-bdb2ef1a1efb req-0e46a0b3-9ca4-4ba3-9c0f-a582595a476c service nova] Creating event network-vif-deleted:fee31787-083d-4363-9ccf-f1cca229253f for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:16.911182 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-361af202-ac17-40f3-ab3c-bdb2ef1a1efb req-0e46a0b3-9ca4-4ba3-9c0f-a582595a476c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081534 Sep 01 05:07:16.913686 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1894/3786] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:17.396754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:17.469701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:17.478645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:17.481259 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae0607be-faca-4dc1-80cd-147e4db3d4b2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 2209 microversion: 2.42 time: 1.155263 Sep 01 05:07:17.482566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1893/3787] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:16 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 2209 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:07:17.675233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:17.693182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:17.740564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:17.743930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:17.744801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:17.777870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:17.779856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:17.789024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:17.863406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:17.879868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:17.900329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c7b88cc-526f-4a7f-babf-9d3a1ea84c5a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.273743 Sep 01 05:07:17.908589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1895/3788] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:17 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:17.917908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:17.918750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:17.920149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:17.922088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:17.926376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:17.929665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:18.048013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:18.076528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73d07566-ce83-413c-b275-e749de2bcaab tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240432 Sep 01 05:07:18.077147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1894/3789] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:17 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:18.511065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:18.511814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:18.524763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:18.526476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:18.529143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:18.530508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:18.531647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:18.533781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:18.918253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:18.921818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:18.954202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:18.955288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:18.956019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:18.956945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:18.960203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:18.960867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:19.030487 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1113d1a2-923b-4477-a72a-04832a70af7f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116109 Sep 01 05:07:19.033047 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1895/3790] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:18 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:19.090345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:19.093301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:19.112669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:19.113987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:19.115101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:19.119814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:19.121539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:19.122627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:19.234566 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b171f7c-9485-468c-b43b-7446ccf95575 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148926 Sep 01 05:07:19.235690 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1896/3791] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:19 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:19.373416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:19.387846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:19.391621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:19.393998 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f90fb5a-3998-4af4-988d-89fd23f4a515 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1984 microversion: 2.42 time: 0.887749 Sep 01 05:07:19.408578 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1896/3792] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:18 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1984 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:19.599592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-21740421-e76f-4f07-aa84-7a5e3c6f42d4 req-25f047c8-82ad-4e7d-b9d1-fa6aedd6e961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c11330-3df4-492f-a49d-f8a7b32e54a8", "name": "network-vif-deleted", "tag": "c07a473c-435b-4a82-9cec-ed1e4ee32c70"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:19.659291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-21740421-e76f-4f07-aa84-7a5e3c6f42d4 req-25f047c8-82ad-4e7d-b9d1-fa6aedd6e961 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:19.660707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-21740421-e76f-4f07-aa84-7a5e3c6f42d4 req-25f047c8-82ad-4e7d-b9d1-fa6aedd6e961 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:19.661753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-21740421-e76f-4f07-aa84-7a5e3c6f42d4 req-25f047c8-82ad-4e7d-b9d1-fa6aedd6e961 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:19.696927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-21740421-e76f-4f07-aa84-7a5e3c6f42d4 req-25f047c8-82ad-4e7d-b9d1-fa6aedd6e961 service nova] Creating event network-vif-deleted:c07a473c-435b-4a82-9cec-ed1e4ee32c70 for instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 on n-h1-820368-37 Sep 01 05:07:19.708290 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-21740421-e76f-4f07-aa84-7a5e3c6f42d4 req-25f047c8-82ad-4e7d-b9d1-fa6aedd6e961 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119065 Sep 01 05:07:19.710920 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1897/3793] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:20.047628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:20.050710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:20.068571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:20.071488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:20.073532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:20.075729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:20.078770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:20.079551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:20.159279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bc9de5a-9abb-46e3-b352-808cd9fcd784 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116642 Sep 01 05:07:20.160803 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1897/3794] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:20 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:20.248865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:20.251567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:20.278703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:20.282030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:20.282853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:20.283658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:20.284134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:20.284565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:20.387374 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29cd5c73-d606-441a-a2d9-b42e3dadf7c6 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143511 Sep 01 05:07:20.391549 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1898/3795] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:20 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:20.445197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:20.448302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:20.477607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:20.480695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:20.481155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:20.481942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:20.482468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:20.482836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:21.173738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:21.176488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:21.212536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:21.213672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:21.214399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:21.215843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:21.216564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:21.217168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:21.297512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:21.318365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:21.320465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:21.329062 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b28600f-18b4-4db7-b142-d3fedf0724ed tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.895422 Sep 01 05:07:21.335740 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1898/3796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:20 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:21.372174 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6df7a00c-2b5e-4d1f-93e3-ead286c24651 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202368 Sep 01 05:07:21.373814 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1899/3797] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:21 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:21.402850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:21.405472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:21.416475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:21.430982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:21.440558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:21.441938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:21.442436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:21.442956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:21.533207 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c26c9a5-7490-41b1-95d7-84c9a480ee9f tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135552 Sep 01 05:07:21.536935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1899/3798] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:21 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:22.355374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:22.356190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:22.387108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:22.389521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:22.415648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:22.419680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:22.424696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:22.427106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:22.429489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:22.433650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:22.434336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:22.435835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:22.440254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:22.441377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:22.444069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:22.445959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:22.559958 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97f35a1c-530c-4b33-b86e-fb664e63a575 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178279 Sep 01 05:07:22.569618 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1900/3799] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:22 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:22.574879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:22.577198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:22.586476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:22.588757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:22.589519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:22.590473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:22.591139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:22.591875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:22.645222 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-029614b5-46b8-4a16-af38-38fdf685f0cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074327 Sep 01 05:07:22.646087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1901/3800] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:22 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:07:22.691532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:22.710197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:22.712162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:22.713582 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11107be0-51af-49ef-917b-5b1255c7aec4 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.364448 Sep 01 05:07:22.714718 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1900/3801] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:22 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:23.598952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:23.635335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:23.703879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:23.704737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:23.708148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:23.714189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:23.728612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:23.729823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:23.766820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:23.768882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:23.805889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:23.807808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:23.808678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:23.822114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:23.823539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:23.824842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:23.942367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c51c7239-5d95-411c-8c7c-1f283cee8d8c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.355754 Sep 01 05:07:23.950183 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1902/3802] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:23 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:24.517411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:24.575987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:24.578989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:24.581115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7eca612d-c86b-4a00-9563-a6a040646a7d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.841908 Sep 01 05:07:24.598931 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1901/3803] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:23 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:25.033362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:25.038147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:25.077485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:25.079171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:25.080082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:25.081387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:25.082285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:25.083241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:25.090461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:25.196437 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1514e6f-11b7-43f7-aae4-0b84bf34ffd6 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227468 Sep 01 05:07:25.197327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1903/3804] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:24 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:25.641502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:25.648729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:25.681725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:25.683204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:25.688403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:25.690629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:25.698005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:25.700334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:26.084453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:26.132459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:26.135213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:26.137153 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea39f0e0-78db-4545-a698-a187a868c2c3 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.504568 Sep 01 05:07:26.152891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1902/3805] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:25 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:26.213000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:26.215279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:26.238803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:26.246031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:26.246378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:26.247176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:26.247636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:26.248331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:26.394306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91d9d426-cd38-4c3f-adcf-0390ce13d2e5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178764 Sep 01 05:07:26.395677 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1904/3806] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:26 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:27.175161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:27.175950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:27.200999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:27.201387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:27.202009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:27.202981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:27.204313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:27.206745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:27.429468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:27.440915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:27.466354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:27.471157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:27.471879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:27.473127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:27.473867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:27.478861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:27.627619 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79760dda-740e-4174-b336-1c726a764bab tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216160 Sep 01 05:07:27.640242 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1905/3807] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:27 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:27.770659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:27.785268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:27.797650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:27.805116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3614f2d9-1079-450f-8aab-793dfecefdf7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.633458 Sep 01 05:07:27.812022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1903/3808] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:27 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:28.656325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:28.661431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:28.676416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=64 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:28.696654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:28.706285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:28.711321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:28.712883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:28.731557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:28.732493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:28.862511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:28.865981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8471bafd-2f3e-4441-9bc8-3b3328fbb03f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215902 Sep 01 05:07:28.873020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:28.874998 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1906/3809] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:28 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:28.910989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:28.913644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:28.914802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:28.920701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:28.921636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:28.922451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:29.263999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:29.293858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:29.300678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:29.305850 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-067475b2-6a92-4654-9f6a-9b80c37f69a8 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.450672 Sep 01 05:07:29.326569 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1904/3810] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:28 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:29.891080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:29.902262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:29.947795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:29.949986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:29.960085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:29.966312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:29.968081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:29.972241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:30.123334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6ba5113-4fd6-4804-8f8d-2e7ac5d878bb tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243078 Sep 01 05:07:30.129396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1907/3811] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:29 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:30.370046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:30.373094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:30.391460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:30.394426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:30.395867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:30.398158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:30.399458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:30.400650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:30.909774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:30.941547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:30.943068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:30.946402 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ef39cc3-1382-4eef-9832-f10a1cc34482 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.587721 Sep 01 05:07:30.964427 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1905/3812] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:30 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:31.145236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:31.151889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:31.217695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:31.218583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:31.219483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:31.220805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:31.221650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:31.222340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:31.344594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a682722b-c61c-4a09-88df-d05d451c9309 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207858 Sep 01 05:07:31.349362 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1908/3813] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:31 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:07:31.985671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:31.986755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:32.004697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:32.006975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:32.011652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:32.012760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:32.013468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:32.014137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:32.159312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-119561268", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:32.223818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:32.282193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:07:32.283532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:07:32.284229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:07:32.284911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:07:32.285542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:07:32.288066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:32.302639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:32.311116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6813e04b-5a3a-4f00-989c-5a23766e2915 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.333109 Sep 01 05:07:32.312251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:32.323995 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1909/3814] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:31 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:32.324143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:32.324143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:32.324143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:32.324143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:32.324418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:32.408385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Getting quotas for project cc8fa9bdbd304d5b9bd994f1f4adfdbd. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:07:32.422949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Getting quotas for user 99b3ff7ed2724677b75bc233bf21cb61 and project cc8fa9bdbd304d5b9bd994f1f4adfdbd. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:07:32.451591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:07:32.454535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:07:32.498989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1694202540", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "63ad42ce-ca8d-4f08-993f-e98e03c5e312"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:32.615960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] validate_networks() for [('63ad42ce-ca8d-4f08-993f-e98e03c5e312', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:07:32.624894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e064d923-0a57-45cd-91dd-46d4521119da tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.794527 Sep 01 05:07:32.633872 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1906/3815] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:07:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:07:32.640098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:32.642837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:32.651986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:32.652576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:32.653691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:32.654714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:32.656249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:32.656963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:32.737071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-657d1d56-efdd-47c9-b90c-2bd61a0d2060 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101320 Sep 01 05:07:32.742726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1907/3816] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:32 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:32.756688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa13f09d-708a-4e50-95fc-bba50d06db77 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:32.757757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa13f09d-708a-4e50-95fc-bba50d06db77 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:32.999641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa13f09d-708a-4e50-95fc-bba50d06db77 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:33.049490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa13f09d-708a-4e50-95fc-bba50d06db77 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:33.051682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa13f09d-708a-4e50-95fc-bba50d06db77 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:33.053943 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa13f09d-708a-4e50-95fc-bba50d06db77 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1280 microversion: 2.47 time: 0.309238 Sep 01 05:07:33.055188 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1908/3817] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:32 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:33.339500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:33.340160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:33.352775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:33.359210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:33.359836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:33.363511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:33.364117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:33.364949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:33.498792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:33.515793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:33.518721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:33.523459 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b888e246-c420-4a8e-a837-f198391841fe tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.185974 Sep 01 05:07:33.524357 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1909/3818] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:33 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:07:33.755928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:33.759021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:33.791707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:33.793566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:33.795928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:33.801802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:33.802689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:33.807325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:33.905644 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5a3ec3b-0c71-4427-9d4c-bd6987927fa5 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155304 Sep 01 05:07:33.918398 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1910/3819] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:07:33 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:07:33.936853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:33.939896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:33.957481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:33.959014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:33.959919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:33.963455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:33.964568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:33.967913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:34.127565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:07:34.518932 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47115330-039a-44a1-9ba3-bf3f95a48053 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 204 len: 0 microversion: 2.1 time: 0.591108 Sep 01 05:07:34.519680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1911/3820] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:07:33 2022] DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:34.538606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:34.538606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:34.598207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:34.598618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:34.599098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:34.601435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:34.607546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:34.608150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:34.637993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:35.562773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:35.576868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:07:35.577449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:07:35.577843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:35.578183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:07:35.578734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:07:35.579285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:07:35.580757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:35.582242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fdb00ce-cb6c-47db-99d8-1e0c136469dd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1284 microversion: 2.47 time: 1.061405 Sep 01 05:07:35.582841 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1912/3821] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:34 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1284 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:35.598356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.598356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.598356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.598356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.598356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.598356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.604475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:35.607211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:35.609506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:35.620319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for project cc9dddd7fe5040a68d289bade73e0232. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:07:35.627274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.627515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for user 512e22d177264c46982afa469c3446da and project cc9dddd7fe5040a68d289bade73e0232. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:07:35.628168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.628795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.630009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.630703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.631363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.669361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:07:35.677265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:07:35.713119 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Cannot 'reboot' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action HTTP/1.1 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 28 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: {"reboot": {"type": "HARD"}} Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'reboot' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '6c448560-5b05-4bef-bb1a-bb8986beef90', 'body': {'reboot': {'type': 'HARD'}}} Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:07:35.716715 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:35.722492 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:35.726853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 409 to user: Cannot 'reboot' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:35.728603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5f27680-f0ac-4244-a52a-a2521c1c9751 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action" status: 409 len: 145 microversion: 2.1 time: 0.128355 Sep 01 05:07:35.729867 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1913/3822] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:07:35 2022] POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action => generated 145 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:07:35.756349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:35.757801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:35.776764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.778015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.781023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.782115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.783469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.789552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.815431 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db1c866c-310d-4ed0-87b5-be094ba2a5c3 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.497345 Sep 01 05:07:35.816363 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1910/3823] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:07:35.849441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:35.852346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:35.877579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.880552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.883353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:35.884440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:35.889717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:35.890902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:36.424484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:36.481232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:36.487195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:36.514183 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fd36b31-f236-413d-b054-2e03cf392f23 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.691646 Sep 01 05:07:36.520550 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1911/3824] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:35 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:36.533120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:36.545381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:36.567975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:36.571494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:36.571956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:36.572712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:36.573174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:36.573602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:36.704375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:36.733226 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Cannot 'rebuild' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:36.735294 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-514edf51-df2c-4295-aaf8-90f9dfbe508c tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1681 microversion: 2.1 time: 0.990660 Sep 01 05:07:36.738253 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1914/3825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:35 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1681 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action HTTP/1.1 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 65 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: exception: Cannot 'rebuild' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '6c448560-5b05-4bef-bb1a-bb8986beef90', 'body': {'rebuild': {'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db'}}} Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:07:36.746714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued Sep 01 05:07:36.750422 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:07:36.752439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 409 to user: Cannot 'rebuild' instance 6c448560-5b05-4bef-bb1a-bb8986beef90 while it is in vm_state rescued {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:36.767727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b2f6dfc-fdf3-499d-b7fb-7a45765f7b4d tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action" status: 409 len: 146 microversion: 2.1 time: 0.239578 Sep 01 05:07:36.774350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1912/3826] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:07:36 2022] POST /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90/action => generated 146 bytes in 251 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:07:36.790462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c567a637-1fad-49c0-806e-dcdde720951c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:36.791652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c567a637-1fad-49c0-806e-dcdde720951c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:36.810369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:36.815048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:36.901736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:36.903302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:36.919498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:36.923782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:36.927973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:36.929183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:37.498337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c567a637-1fad-49c0-806e-dcdde720951c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:37.513108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c567a637-1fad-49c0-806e-dcdde720951c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1225 microversion: 2.1 time: 0.770103 Sep 01 05:07:37.542631 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1915/3827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:36 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1225 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:37.563863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:37.564768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:37.566497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:37.586940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:37.587933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:37.588669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:37.589695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:37.591769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:37.594042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:37.598014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:37.608993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:37.613740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61f4b3ca-e8fc-46fb-9113-7589660ccc20 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1338 microversion: 2.47 time: 0.833034 Sep 01 05:07:37.635966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1913/3828] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:36 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1338 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:37.666692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:37.672674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:37.688881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:37.690072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:37.691540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:37.718658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:37.720254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:37.721657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:37.793985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:07:38.059450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb675d6d-4516-44b9-b98b-05c320ed030f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 204 len: 0 microversion: 2.1 time: 0.515015 Sep 01 05:07:38.060098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1916/3829] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:07:37 2022] DELETE /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:07:38.096381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:38.098466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:38.125312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:38.126259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:38.130014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:38.131254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:38.133828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:38.134558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:38.460808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:38.477456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:38.484140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:38.485416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20845cdb-ead3-471b-8e32-540c3bd0dcc2 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.848042 Sep 01 05:07:38.486003 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1914/3830] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:37 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:38.534087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:38.535099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:38.593603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:38.597993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:38.618501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:38.619879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:38.622951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:38.628131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:39.386129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:39.410244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4ff7e56-5aa9-4c76-8e85-c59a8b865280 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1681 microversion: 2.1 time: 1.348658 Sep 01 05:07:39.411675 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1917/3831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:38 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1681 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:39.417115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:39.418008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:39.429252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:39.429931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:39.434454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:39.435507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:39.436137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:39.436714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:39.622340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:39.658521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:39.681214 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2622cd8-e0c4-419e-9302-7ff59cf01680 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1689 microversion: 2.1 time: 1.164127 Sep 01 05:07:39.682706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1915/3832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:38 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1689 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:39.719958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9dc605ef-8dbb-4341-b2ae-4e89502305e5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1277 microversion: 2.1 time: 0.298124 Sep 01 05:07:39.723885 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1918/3833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:39 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:39.729352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:39.730595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:39.769632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:39.771323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:39.777701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:39.778551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:39.779322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:39.780542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:39.781361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:39.782103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:39.808838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:39.811821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:39.813795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:39.818165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:39.819093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:39.819841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:40.283556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:40.327502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:40.339437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:40.341493 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c55db7d-06b5-4d70-8c1a-ebc8d6d3e032 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1338 microversion: 2.47 time: 0.656818 Sep 01 05:07:40.342419 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1916/3834] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:39 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1338 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:40.456465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:40.457125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:40.470639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:40.473630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:40.474131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:40.476665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:40.485225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:40.485225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:40.485534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:40.493226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:40.494750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:40.522793 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dada9cfe-37ed-43a8-b6c2-d9493fed2dd5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.751801 Sep 01 05:07:40.523449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1919/3835] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:39 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:40.725881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:40.726939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:40.741305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:40.744467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:40.745151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:40.746690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:40.752763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:40.758463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:41.430805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:41.439743 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5b8bf01-d4a7-4b55-a2e5-048c00e8dcb7 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1681 microversion: 2.1 time: 0.988895 Sep 01 05:07:41.459598 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1917/3836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:40 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1681 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:07:41.472574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:41.493610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:41.520000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:41.520546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:41.520994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:41.525230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:41.527440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:41.529082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.027782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.038532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92a04fec-f280-4d6b-889b-dd3689685a73 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1283 microversion: 2.1 time: 0.572155 Sep 01 05:07:42.066523 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1918/3837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:41 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1283 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:42.091380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:42.092340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:42.092625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.112892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.113388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.117794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.118861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.121841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.122705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.151871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdec871c-aa1d-415f-8b9b-dac7788c8dd1 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1689 microversion: 2.1 time: 1.429934 Sep 01 05:07:42.179125 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1920/3838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:40 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1689 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:07:42.228682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:42.229387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:42.245977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.249255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.249722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.252206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.257049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.259332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.367406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:42.658507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.685820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.694833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.696118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bd27549-865f-4d72-b5ee-9c769869c3d3 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1359 microversion: 2.47 time: 0.628442 Sep 01 05:07:42.696698 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1919/3839] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:42 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1359 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:42.696881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.713417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.720331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:42.725013 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dec46be9-ae78-4c7b-8f63-12535d042591 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.526599 Sep 01 05:07:42.726922 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1921/3840] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:42 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:42.733118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1560885988"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:42.736659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:42.748739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.749611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.750259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:42.750389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.751258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:42.751686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.752547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.753161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.760420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.761309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.761981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:42.763026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:42.763894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:42.764694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:43.291965 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8ef2d82-6238-42b7-96ac-4f17cccfd1f8 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "POST /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508/action" status: 202 len: 52 microversion: 2.47 time: 0.557154 Sep 01 05:07:43.298631 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1922/3841] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:07:42 2022] POST /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508/action => generated 52 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:07:43.345494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:43.346335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:43.414413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:43.417148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:43.422231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:43.423611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:43.424283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:43.424948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:43.543509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:43.547465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:43.578182 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-967e4c4e-21c7-4abf-94f6-ea6c14f6a76a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1614 microversion: 2.1 time: 0.854585 Sep 01 05:07:43.579811 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1920/3842] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:42 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1614 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:43.589231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:43.590235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:43.618607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:43.621572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:43.622554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:43.624786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:43.629426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:43.630532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:44.168244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:44.212753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42587cf1-cef1-4282-90f8-3058049c4713 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1283 microversion: 2.1 time: 0.909277 Sep 01 05:07:44.218815 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1923/3843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:43 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1283 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:44.237343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:44.241393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:44.277328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:44.282058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:44.284504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:44.291488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:44.292773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:44.297513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:44.412747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:07:44.639117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04177ac0-cf54-4e61-b4ed-9e6edec93cdd tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 204 len: 0 microversion: 2.47 time: 0.416167 Sep 01 05:07:44.642543 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1924/3844] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:07:44 2022] DELETE /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:07:44.658702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:44.664796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:44.709084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:44.718014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:44.720123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:44.721878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:44.723110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:44.724356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:44.785136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.269681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:45.314738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:45.335810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:45.338107 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3736ede7-14ff-4ec7-bfd9-8e3935be3b33 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.691503 Sep 01 05:07:45.339598 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1925/3845] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:44 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:45.375076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:45.376288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:45.397487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.400731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.402280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.404523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.406176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.407930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.480692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:45.493657 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef340f01-5665-48bf-b484-42363b216e2c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1689 microversion: 2.1 time: 1.912179 Sep 01 05:07:45.509426 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1921/3846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:43 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1689 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:45.529533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:45.530038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:45.546054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.547015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.547891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.548932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.549805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.550481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.655657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.674317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:45.720999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15f14c11aec640a5b4dddfb2b249ddc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e2577f5604ff485744c7f53deb302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:45.733828 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4a53cba-e192-4360-ae13-91ccad2f6efa tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 200 len: 1326 microversion: 2.1 time: 0.385110 Sep 01 05:07:45.737929 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1926/3847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:45 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 1326 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:45.759034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4fb60796-36fe-4cb2-9c8f-b52d9629c872 req-9ea044e2-a04c-4a8b-a93c-881147d80b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e56cc3-eb85-4489-8da9-21c81329e289", "name": "network-vif-deleted", "tag": "07a72401-ca67-4310-b590-e3e635a77186"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:45.785621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4fb60796-36fe-4cb2-9c8f-b52d9629c872 req-9ea044e2-a04c-4a8b-a93c-881147d80b33 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.788987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4fb60796-36fe-4cb2-9c8f-b52d9629c872 req-9ea044e2-a04c-4a8b-a93c-881147d80b33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.789872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4fb60796-36fe-4cb2-9c8f-b52d9629c872 req-9ea044e2-a04c-4a8b-a93c-881147d80b33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.823158 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4fb60796-36fe-4cb2-9c8f-b52d9629c872 req-9ea044e2-a04c-4a8b-a93c-881147d80b33 service nova] Creating event network-vif-deleted:07a72401-ca67-4310-b590-e3e635a77186 for instance a1e56cc3-eb85-4489-8da9-21c81329e289 on n-h2-820368-37 Sep 01 05:07:45.840672 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4fb60796-36fe-4cb2-9c8f-b52d9629c872 req-9ea044e2-a04c-4a8b-a93c-881147d80b33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101137 Sep 01 05:07:45.842147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1927/3848] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:45.859589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:45.862812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:45.894423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.898143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.898766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.899749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:45.900322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:45.904326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:45.976552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:46.011414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:46.029150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:46.031510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a340c13-a27d-4715-810b-f1231adb6020 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1365 microversion: 2.47 time: 0.524768 Sep 01 05:07:46.055405 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1922/3849] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:45 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1365 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:46.399091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:46.400209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:46.430740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:46.436119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:46.437342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:46.440340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:46.441863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:46.446056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:47.509844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:47.799653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:47.848719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:47.867171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:47.874599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b172fb5-d172-4481-986c-b7ebdddd5e18 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 1.484489 Sep 01 05:07:47.880592 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1923/3850] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:46 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:47.913978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:47.920140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:47.953054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:47.963408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:47.979681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:47.982456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:47.985642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:47.989911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:48.613763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:48.626491 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51ab491a-2af6-4ffe-9a1f-0cd61b56bc78 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 2.782477 Sep 01 05:07:48.629337 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1928/3851] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:45 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 2786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:48.637844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:48.645210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:48.678608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:48.685749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:48.701669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:48.704341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:48.711819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:48.719238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:48.798018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:48.806921 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6bee215c-b755-43be-9c93-a6ba6d381cd2 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1689 microversion: 2.1 time: 0.923579 Sep 01 05:07:48.814190 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1924/3852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:47 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1689 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:48.829981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:48.833503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:48.850360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:48.851589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:48.852292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:48.853316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:48.854067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:48.859942 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:07:48.860124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 HTTP/1.1 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a1e56cc3-eb85-4489-8da9-21c81329e289'} Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:48.861730 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:48.865813 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9391ce58-a2e8-4a9a-a4e3-13a3b12dac85 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 404 len: 111 microversion: 2.1 time: 0.232553 Sep 01 05:07:48.876563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1929/3853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:48 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:48.955320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:48.956419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:48.959183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:48.962039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lazy-loading 'fault' on Instance uuid 93906a15-1f8d-41c7-9776-1460039bf508 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:07:49.083466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9d48e34e-a55c-458f-ab13-52994c251e0f req-6983b127-ac99-4acf-b8ff-05a3ac885199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "name": "network-vif-unplugged", "status": "completed", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:49.100362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d48e34e-a55c-458f-ab13-52994c251e0f req-6983b127-ac99-4acf-b8ff-05a3ac885199 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:49.101175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d48e34e-a55c-458f-ab13-52994c251e0f req-6983b127-ac99-4acf-b8ff-05a3ac885199 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:49.101794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d48e34e-a55c-458f-ab13-52994c251e0f req-6983b127-ac99-4acf-b8ff-05a3ac885199 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:49.137212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9d48e34e-a55c-458f-ab13-52994c251e0f req-6983b127-ac99-4acf-b8ff-05a3ac885199 service nova] Creating event network-vif-unplugged:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:07:49.149891 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9d48e34e-a55c-458f-ab13-52994c251e0f req-6983b127-ac99-4acf-b8ff-05a3ac885199 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.270099 Sep 01 05:07:49.153276 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1930/3854] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:49.167707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56bee2e3-f3bf-4634-85db-41e6a2aca273 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '.version_select at 0x7fa760179430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:49.185764 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56bee2e3-f3bf-4634-85db-41e6a2aca273 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:07:49.263476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:49.272900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:49.286448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99b3ff7ed2724677b75bc233bf21cb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8fa9bdbd304d5b9bd994f1f4adfdbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:49.291848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-390176e6-409f-43e1-a7ff-7f6df6cc9954 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 200 len: 1370 microversion: 2.47 time: 0.476136 Sep 01 05:07:49.299698 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1925/3855] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:48 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 1370 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:49.305846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:49.307521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:49.330792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:49.335729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:49.336460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:49.337422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:49.338063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:49.338654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:49.561659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:49.584477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:49.587902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:49.612780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ffb8e26-6486-4aa3-9321-9ca34c516480 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.310883 Sep 01 05:07:49.618357 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1926/3856] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:49 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:49.650636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:49.651735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:49.672426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:49.675526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:49.676153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:49.680299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:49.683008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:49.685969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.194037 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-56bee2e3-f3bf-4634-85db-41e6a2aca273 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40528. Sep 01 05:07:50.222992 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56bee2e3-f3bf-4634-85db-41e6a2aca273 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195252899" status: 202 len: 0 microversion: 2.1 time: 1.068159 Sep 01 05:07:50.227679 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1931/3857] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195252899 => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:07:50.243277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:50.244229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:50.251798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:50.252299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:50.252743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.253463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:50.253922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:50.254356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.582611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:50.616737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa9575c6-868e-4339-a711-e20ffadc9aa9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1622 microversion: 2.1 time: 0.384990 Sep 01 05:07:50.621390 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1932/3858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:50 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1622 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:50.641704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:50.643068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] [instance: 93906a15-1f8d-41c7-9776-1460039bf508] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:50.669116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:50.669732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:50.670356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.680496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:50.681165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:50.681831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.733106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] HTTP exception thrown: Instance 93906a15-1f8d-41c7-9776-1460039bf508 could not be found. Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Request method failure captured: Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 HTTP/1.1 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4T8R19KINsBcKusTO5q7jTxy3gu33t2BjQJP2GzYrYehVW10we-4dOd4Tf1GGtMNtyMzNiIbu_C4smZ6akQGaAPk0hJ0Ni4TGZrpk9p9LkeHyA044wiuzcOCjx-t_gHaIvotC05VB7wF3fbA54d-9rpdFV7D-xKn3Kf9SKeZ10ibs Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.47 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc8fa9bdbd304d5b9bd994f1f4adfdbd Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAaction247Test-623760538 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc8fa9bdbd304d5b9bd994f1f4adfdbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc8fa9bdbd304d5b9bd994f1f4adfdbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc8fa9bdbd304d5b9bd994f1f4adfdbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc8fa9bdbd304d5b9bd994f1f4adfdbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAaction247Test-623760538 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc8fa9bdbd304d5b9bd994f1f4adfdbd Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAaction247Test-623760538 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAaction247Test-623760538-project Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 99b3ff7ed2724677b75bc233bf21cb61 Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAaction247Test-623760538-project Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 93906a15-1f8d-41c7-9776-1460039bf508 could not be found. Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '93906a15-1f8d-41c7-9776-1460039bf508'} Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93906a15-1f8d-41c7-9776-1460039bf508 could not be found. Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93906a15-1f8d-41c7-9776-1460039bf508 could not be found. Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:50.737939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93906a15-1f8d-41c7-9776-1460039bf508 could not be found. Sep 01 05:07:50.744329 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:50.748755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] Returning 404 to user: Instance 93906a15-1f8d-41c7-9776-1460039bf508 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:50.750469 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c531d826-7973-4881-b563-8db7da69a547 tempest-ServersAaction247Test-623760538 tempest-ServersAaction247Test-623760538-project] 10.222.0.26 "GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508" status: 404 len: 111 microversion: 2.47 time: 0.127189 Sep 01 05:07:50.757042 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1933/3859] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:50 2022] GET /compute/v2.1/servers/93906a15-1f8d-41c7-9776-1460039bf508 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:07:50.777599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:50.778202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:50.809253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:50.811526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:50.813673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.820408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:50.821010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:50.821462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:50.909625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:50.919406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-196864f0-cee4-4aa0-8af3-abca8dd8a265 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 1.273315 Sep 01 05:07:50.932999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1927/3860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:49 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:07:51.053773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:51.080420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:51.086864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:51.088346 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15300b84-82ed-42b8-a9db-cef7996d8a5d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.322680 Sep 01 05:07:51.123963 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1934/3861] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:50 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:51.158356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d1deee7e-2ac7-457a-b689-bf6931c49e40 req-a9551824-9586-4501-89b9-1d77e9887094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b9c200-02b4-4279-9ae9-540f328d4d24", "name": "network-vif-deleted", "tag": "78fa559b-0637-4430-a32a-76962b1f7114"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:51.175519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d1deee7e-2ac7-457a-b689-bf6931c49e40 req-a9551824-9586-4501-89b9-1d77e9887094 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:51.179691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d1deee7e-2ac7-457a-b689-bf6931c49e40 req-a9551824-9586-4501-89b9-1d77e9887094 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:51.180394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d1deee7e-2ac7-457a-b689-bf6931c49e40 req-a9551824-9586-4501-89b9-1d77e9887094 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:51.231306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d1deee7e-2ac7-457a-b689-bf6931c49e40 req-a9551824-9586-4501-89b9-1d77e9887094 service nova] Creating event network-vif-deleted:78fa559b-0637-4430-a32a-76962b1f7114 for instance 27b9c200-02b4-4279-9ae9-540f328d4d24 on n-h1-820368-37 Sep 01 05:07:51.247244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d1deee7e-2ac7-457a-b689-bf6931c49e40 req-a9551824-9586-4501-89b9-1d77e9887094 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096784 Sep 01 05:07:51.258629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1928/3862] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:51.645105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:51.646733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:51.678203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:51.678439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:51.695674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:51.697175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:51.697995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:51.698748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:51.788656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:51.789546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:51.790363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:51.791259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'fault' on Instance uuid 27b9c200-02b4-4279-9ae9-540f328d4d24 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:07:51.943297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:51.949361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:51.968296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:51.971538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:51.973002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:51.975396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:51.977574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:51.978745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:52.855633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:52.867161 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f2b9513-1f11-4668-8e79-dbc51157109f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 200 len: 1334 microversion: 2.1 time: 1.228673 Sep 01 05:07:52.884174 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1935/3863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:51 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 1334 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:52.889669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:52.890600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:52.899687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:52.900530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:52.901186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:52.902125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:52.902786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:52.904540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:53.593399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:53.649866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:53.653081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:53.655232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-174d30db-2420-47b5-b7d0-ce0a0d427566 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.769471 Sep 01 05:07:53.659626 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1936/3864] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:52 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:53.698862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-708010f6-3973-4586-90a6-685e6b576734 req-261f60c4-a1fb-4cbe-942d-a1cfac3b34f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2fd882-450d-47e3-85bd-57078b919b76", "tag": "45a168a3-c632-43c1-9938-c90602510427"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:07:53.739622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-708010f6-3973-4586-90a6-685e6b576734 req-261f60c4-a1fb-4cbe-942d-a1cfac3b34f1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:53.740452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-708010f6-3973-4586-90a6-685e6b576734 req-261f60c4-a1fb-4cbe-942d-a1cfac3b34f1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:53.742302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-708010f6-3973-4586-90a6-685e6b576734 req-261f60c4-a1fb-4cbe-942d-a1cfac3b34f1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:53.770730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-708010f6-3973-4586-90a6-685e6b576734 req-261f60c4-a1fb-4cbe-942d-a1cfac3b34f1 service nova] Creating event network-changed:45a168a3-c632-43c1-9938-c90602510427 for instance ab2fd882-450d-47e3-85bd-57078b919b76 on n-h2-820368-37 Sep 01 05:07:53.795334 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-708010f6-3973-4586-90a6-685e6b576734 req-261f60c4-a1fb-4cbe-942d-a1cfac3b34f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114812 Sep 01 05:07:53.797957 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1937/3865] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:07:53.845672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:53.861357 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3567eae2-877c-4d5a-8dd8-d53006e6c8f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 1.923541 Sep 01 05:07:53.862061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1929/3866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:51 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:53.903894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:53.926253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 27b9c200-02b4-4279-9ae9-540f328d4d24] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:53.963504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:53.966151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:53.970608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:53.974235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:53.978956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:53.983354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:54.082083 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 could not be found. Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 HTTP/1.1 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 could not be found. Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '27b9c200-02b4-4279-9ae9-540f328d4d24'} Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 could not be found. Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 could not be found. Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:54.085873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 could not be found. Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 404 to user: Instance 27b9c200-02b4-4279-9ae9-540f328d4d24 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:07:54.089399 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5bb0c01-d1cf-43de-8503-c08c5716042c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24" status: 404 len: 111 microversion: 2.1 time: 0.200271 Sep 01 05:07:54.092811 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1938/3867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:53 2022] GET /compute/v2.1/servers/27b9c200-02b4-4279-9ae9-540f328d4d24 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:07:54.098982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80c5e0c2-e64d-4940-beb0-3f569d2c6f6f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '.version_select at 0x7fa75b1199d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:54.145074 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80c5e0c2-e64d-4940-beb0-3f569d2c6f6f tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980572928" status: 202 len: 0 microversion: 2.1 time: 0.050752 Sep 01 05:07:54.146399 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1930/3868] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:07:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980572928 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:07:54.691994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:54.706619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:54.725221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:54.726041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:54.738641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:54.739303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:54.739879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:54.740624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:54.904036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:54.904036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:54.925556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:54.926423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:54.927238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:54.936703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:54.937935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:54.943886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:54.993200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:55.040450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:55.045093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:55.060177 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fe76647-749d-4a69-967a-a4af60bbf97c tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.367215 Sep 01 05:07:55.063004 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1939/3869] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:54 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:55.664677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:55.705883 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd754cd3-df9e-427f-b2d3-3fc5e74e6120 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 0.812256 Sep 01 05:07:55.709473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1931/3870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:54 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:56.106031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:56.108704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:56.153189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:56.190507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:56.192194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:56.195052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:56.196647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:56.204039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:56.521847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:56.569138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:56.573874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:56.581599 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1860ce07-a75f-462f-9f28-22db559d6852 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.498895 Sep 01 05:07:56.590060 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1940/3871] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:56 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:07:56.739632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:56.744595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:56.760423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:56.762084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:56.763158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:56.764929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:56.765994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:56.770542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:57.651336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:57.652664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:57.725984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:57.726865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:57.727715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:57.729057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:57.729912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:57.730689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:58.306374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:58.326423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:58.328450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:58.330047 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88e04b85-98aa-4a19-874b-05e6c0a1c3ba tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.698593 Sep 01 05:07:58.332495 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1941/3872] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:57 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:07:58.540463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:58.565693 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8286860c-d37c-460e-a921-bbc828007868 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 1.835149 Sep 01 05:07:58.581484 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1932/3873] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:56 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:07:59.377819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:59.378992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:59.409246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:59.410140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:59.410969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:59.419695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:59.422297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:59.423291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:59.596148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:07:59.597018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:07:59.608468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:59.617673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:59.619615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:59.620144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:59.627473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:07:59.627473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:07:59.627473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:07:59.646873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:59.683351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:59.689361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:07:59.693205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c6feaf1-d847-4d5a-be89-173145d6bc56 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.323631 Sep 01 05:07:59.696323 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1942/3874] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:07:59 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:00.732512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:00.734672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:00.775337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:00.792287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:00.792817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:00.800435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:00.800994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:00.821912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:00.888714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:00.939312 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8628e87-3578-4afc-9c62-74419ec45e6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 1.337475 Sep 01 05:08:00.940166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1933/3875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:07:59 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:01.259889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:01.313872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:01.321670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:01.323193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba5224d8-559d-4a3e-9442-3acdeb186678 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.601523 Sep 01 05:08:01.335811 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1943/3876] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:00 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:01.976552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:01.978271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:01.993479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:01.998791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:01.999668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:02.000824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:02.001981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:02.002674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:02.358397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:02.360434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:02.387876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:02.392676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:02.396411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:02.397831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:02.400149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:02.400971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:02.435374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:02.456267 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aaf8b70a-5786-4d7e-8e60-03c3626a15a0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 0.480719 Sep 01 05:08:02.468328 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1934/3877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:01 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:02.671671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:02.689510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:02.694427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:02.696294 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b966299-e86b-4b72-926a-9de7e467af3d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.347415 Sep 01 05:08:02.699247 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1944/3878] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:02 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:02.759213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-02b22de6-1e65-4091-bf6e-bde8d688c619 req-6d5f8720-6ca2-4e5e-bbca-7d8a5280046c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2fd882-450d-47e3-85bd-57078b919b76", "name": "network-vif-plugged", "status": "completed", "tag": "45a168a3-c632-43c1-9938-c90602510427"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:02.792048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02b22de6-1e65-4091-bf6e-bde8d688c619 req-6d5f8720-6ca2-4e5e-bbca-7d8a5280046c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:02.797024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02b22de6-1e65-4091-bf6e-bde8d688c619 req-6d5f8720-6ca2-4e5e-bbca-7d8a5280046c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:02.797940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02b22de6-1e65-4091-bf6e-bde8d688c619 req-6d5f8720-6ca2-4e5e-bbca-7d8a5280046c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:02.837141 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-02b22de6-1e65-4091-bf6e-bde8d688c619 req-6d5f8720-6ca2-4e5e-bbca-7d8a5280046c service nova] Creating event network-vif-plugged:45a168a3-c632-43c1-9938-c90602510427 for instance ab2fd882-450d-47e3-85bd-57078b919b76 on n-h2-820368-37 Sep 01 05:08:02.874974 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-02b22de6-1e65-4091-bf6e-bde8d688c619 req-6d5f8720-6ca2-4e5e-bbca-7d8a5280046c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119174 Sep 01 05:08:02.878308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1935/3879] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:08:03.505076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:03.506047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:03.524251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:03.524862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:03.526103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:03.528435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:03.532291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:03.533439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:03.746797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:03.748074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:03.813117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:03.815401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:03.824167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:03.825260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:03.834225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:03.836580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:04.226124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:04.241766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:04.243512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:04.259648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-922946cf-4bdb-4bf4-ae25-8c798c085723 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.520916 Sep 01 05:08:04.270224 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1936/3880] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:03 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:04.457332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:04.479293 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a20137a6-23eb-4f20-a4da-bedb433549e1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1325 microversion: 2.1 time: 0.981817 Sep 01 05:08:04.484805 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1945/3881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:03 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1325 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:05.297680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:05.298832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:05.356824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:05.357861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:05.358612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:05.359885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:05.360659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:05.361387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:05.597236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:05.606612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:05.665630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:05.672822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:05.686405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:05.687213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:05.688444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:05.689255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:05.689991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:05.912917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:05.963847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:05.990242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:05.992444 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c7b2d9e9-255d-4357-a299-74d8d27613df tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.702300 Sep 01 05:08:06.015411 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1937/3882] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:05 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:06.618660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:06.626741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:06.706714 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e496557-2801-4f10-a907-9a1d6c586e97 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 1.189222 Sep 01 05:08:06.732743 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1946/3883] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:05 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:06.771018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:06.775242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:06.810615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:06.838343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:06.843064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:06.848071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:06.849982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:06.851047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:07.066001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:07.067161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:07.091417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:07.091987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:07.092625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:07.093413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:07.094105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:07.101132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:07.471142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:07.529827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:07.536128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:07.538629 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11d9a8f3-7997-4422-bd19-011a4526093b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.483491 Sep 01 05:08:07.557980 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1947/3884] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:07 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:07.747360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:07.779277 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20088f81-3765-4bd0-80d2-abbc54403e0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 1.015249 Sep 01 05:08:07.801313 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1938/3885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:06 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:07.826845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b04f90-7698-4fb6-bc00-8b21113c3943 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-460372232", "metadata": {"": ""}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b04f90-7698-4fb6-bc00-8b21113c3943 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action HTTP/1.1 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 106 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-460372232", "metadata": {"": ""}}} Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-460372232', 'metadata': {'': ''}}}} Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'': ''} Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:08:07.854704 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:07.862341 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:07.872333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b04f90-7698-4fb6-bc00-8b21113c3943 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:07.879796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82b04f90-7698-4fb6-bc00-8b21113c3943 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action" status: 400 len: 170 microversion: 2.1 time: 0.061663 Sep 01 05:08:07.889202 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1948/3886] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Sep 1 05:08:07 2022] POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action => generated 170 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:08:07.906002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:07.916778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:07.955142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:07.958730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:07.961705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:07.966929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:07.968290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:07.973646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:08.183606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:08.583872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:08.595452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:08.685209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:08.707866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:08.708821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:08.710204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:08.717734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:08.719162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:09.195293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:09.244459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:09.252162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:09.257108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a3d677d-21ff-4825-a5e7-11182241a0e7 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.681108 Sep 01 05:08:09.262927 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1949/3887] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:08 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:09.429008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:09.464582 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80db8082-1471-4d1e-983c-b035d71e2595 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 1.568012 Sep 01 05:08:09.473495 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1939/3888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:07 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:09.515024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:09.516201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:09.569135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:09.569980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:09.570777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:09.596877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:09.597950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:09.598976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:10.356943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:10.371710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:10.425625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:10.433132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:10.434071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:10.448123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:10.452373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:10.456408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:11.923418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:11.929218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:12.053869 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75e67a1e-8186-4e6b-ba5b-b34d61736021 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 2.523183 Sep 01 05:08:12.070678 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1950/3889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:09 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:12.078911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3155778-28af-41e8-ac91-41862acb5a15 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-395491901", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3155778-28af-41e8-ac91-41862acb5a15 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action HTTP/1.1 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 618 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-395491901", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-395491901', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:08:12.100825 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 01 05:08:12.103852 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.106495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3155778-28af-41e8-ac91-41862acb5a15 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:12.111121 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3155778-28af-41e8-ac91-41862acb5a15 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action" status: 400 len: 938 microversion: 2.1 time: 0.030225 Sep 01 05:08:12.115015 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1951/3890] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Sep 1 05:08:12 2022] POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action => generated 938 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:08:12.117479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:12.130295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:12.140128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:12.145038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:12.153426 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef34b8e0-5707-4378-91da-17cc83a8f4e6 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 1.822146 Sep 01 05:08:12.156113 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1940/3891] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:10 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:12.200296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:12.200782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:12.207320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:12.208216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:12.209106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:12.217114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:12.823331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:12.825995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:12.861683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:12.862714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:12.863637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:12.865145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:12.866383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:12.878488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:12.955011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 HTTP/1.1 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a1e56cc3-eb85-4489-8da9-21c81329e289'} Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:12.958646 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:12.963239 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:12.970576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:12.972356 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4a20f53-f428-4ab3-910c-72b604eeb93a tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 404 len: 111 microversion: 2.1 time: 0.156881 Sep 01 05:08:12.973817 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1941/3892] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:12 2022] DELETE /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:12.989259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:12.996311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: a1e56cc3-eb85-4489-8da9-21c81329e289] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:13.020588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:13.022971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:13.028725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:13.030645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:13.031917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:13.033275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:13.088477 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 HTTP/1.1 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a1e56cc3-eb85-4489-8da9-21c81329e289'} Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:13.092554 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. Sep 01 05:08:13.099494 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:13.106389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance a1e56cc3-eb85-4489-8da9-21c81329e289 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:13.108328 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78278c92-1565-4fe7-9ba8-609648159b49 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289" status: 404 len: 111 microversion: 2.1 time: 0.127424 Sep 01 05:08:13.113145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1942/3893] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:12 2022] GET /compute/v2.1/servers/a1e56cc3-eb85-4489-8da9-21c81329e289 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:08:13.190775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:13.192380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:13.223882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:13.230555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:13.231651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:13.232904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:13.234805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:13.240719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:13.731050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:13.736471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:13.759341 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8856eeab-5e91-4eec-af39-797153bf5109 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 1.642035 Sep 01 05:08:13.764303 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1952/3894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:12 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:13.809924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:13.810564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:13.814262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:13.823779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:13.825193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:13.825703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:13.826150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:13.833153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:13.834038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:13.834505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:13.841912 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83e4b87f-a480-4e66-82f7-3d76bb5b2b7b tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.645899 Sep 01 05:08:13.843419 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1943/3895] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:13 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:14.823537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:14.834938 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04633744-d35b-48b1-9aa9-b811e6556258 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 1.029423 Sep 01 05:08:14.840585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1953/3896] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:13 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:14.877336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-863ee284-def8-4549-92cc-5a472112b153 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:14.878154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.886656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-863ee284-def8-4549-92cc-5a472112b153 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action HTTP/1.1 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 285 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:14.897225 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:08:14.903722 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:14.913520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-863ee284-def8-4549-92cc-5a472112b153 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:14.914253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:14.915139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:14.919836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:14.920940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:14.923931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:14.924525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:14.938417 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-863ee284-def8-4549-92cc-5a472112b153 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action" status: 400 len: 619 microversion: 2.1 time: 0.068901 Sep 01 05:08:14.946379 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1944/3897] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Sep 1 05:08:14 2022] POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action => generated 619 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:08:14.969774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:14.976371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:15.002679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:15.005667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:15.008937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:15.011093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:15.015373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:15.037396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:15.238696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:15.268022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:15.271720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:15.279486 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04bdb4fa-5756-411f-be1c-8995f0cc2be9 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.407296 Sep 01 05:08:15.285342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1954/3898] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:15.839506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:15.870636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9811901c-6527-4034-877f-a8b096e9ae59 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 0.917238 Sep 01 05:08:15.872673 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1945/3899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:14 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:15.944523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:15.948243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:15.986556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:15.987426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:15.988305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:15.989812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:15.990788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:15.994847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:16.312515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:16.313304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:16.329027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:16.333575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:16.334444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:16.336834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:16.341506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:16.346742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:16.556738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:16.566925 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ffcc8dd-bd82-4cce-87b3-14523252b6b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 0.638273 Sep 01 05:08:16.570690 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1955/3900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:15 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:16.611042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:16.615263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1269231814"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:16.619644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:16.637609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:16.641452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:16.642189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:16.647641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:16.648461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:16.649899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:16.673356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:16.682585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:16.688007 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78233a97-7dd1-4188-9c00-a6458d8c64b5 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.379782 Sep 01 05:08:16.692845 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1946/3901] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:16 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:17.329766 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a94caff9-3a19-4c4e-ab96-6eebda6ee07a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action" status: 202 len: 0 microversion: 2.1 time: 0.715823 Sep 01 05:08:17.347630 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1956/3902] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:08:16 2022] POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 01 05:08:17.368889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-619482577"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:17.381009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:17.397330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:17.399633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:17.400754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:17.402428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:17.404045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:17.405147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:17.523020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1797935192", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:17.561298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Cannot 'createImage' instance ab2fd882-450d-47e3-85bd-57078b919b76 while it is in task_state image_snapshot_pending Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action HTTP/1.1 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 84 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-619482577"}} Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'createImage' instance ab2fd882-450d-47e3-85bd-57078b919b76 while it is in task_state image_snapshot_pending Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-619482577'}}} Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab2fd882-450d-47e3-85bd-57078b919b76 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:08:17.572791 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance ab2fd882-450d-47e3-85bd-57078b919b76 while it is in task_state image_snapshot_pending Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance ab2fd882-450d-47e3-85bd-57078b919b76 while it is in task_state image_snapshot_pending Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 409 to user: Cannot 'createImage' instance ab2fd882-450d-47e3-85bd-57078b919b76 while it is in task_state image_snapshot_pending {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-945fae85-d8bb-4fdb-9cf2-3e1097fb3e0e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action" status: 409 len: 167 microversion: 2.1 time: 0.219035 Sep 01 05:08:17.576594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1957/3903] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:08:17 2022] POST /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76/action => generated 167 bytes in 227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:08:17.595505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:17.596028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:17.627702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:17.628229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:17.633462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:17.634289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:17.634792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:17.635277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:17.722976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] validate_networks() for [('92eb1201-88b8-435c-abc8-33ca7d96301c', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:08:17.723604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:08:17.994466 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88641f7c-14e9-4926-a34e-32c79a7a652c tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 204 len: 0 microversion: 2.1 time: 0.413598 Sep 01 05:08:17.998659 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1958/3904] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:17 2022] DELETE /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:18.010808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e470b21-ab76-4fa4-8c64-a2bdd86766a2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '.version_select at 0x7fa75bec5160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:18.395823 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e470b21-ab76-4fa4-8c64-a2bdd86766a2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/images/0e925155-729e-439d-8dee-4a9f947b0e8a" status: 204 len: 0 microversion: 2.1 time: 0.394421 Sep 01 05:08:18.398674 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1959/3905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:17 2022] DELETE /compute/v2.1/images/0e925155-729e-439d-8dee-4a9f947b0e8a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:18.415287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:18.416912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:18.445200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:18.451693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:18.452427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:18.453331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:18.453951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:18.454531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:18.561300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:18.578582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:18.586313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:18.589717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd9faa18-e755-4990-9d9d-d6a4dc865d17 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1603 microversion: 2.42 time: 0.189287 Sep 01 05:08:18.591857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1960/3906] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:18 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1603 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:18.607729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:18.608644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:18.616793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:18.617196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:18.617688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:18.618419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:18.618869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:18.619363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.285547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:19.295028 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70f6d96b-e692-4dfd-b22c-3a56b8af9e83 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1507 microversion: 2.1 time: 0.701325 Sep 01 05:08:19.299806 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1961/3907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:18 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1507 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:19.315433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:19.323867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:19.336818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.337328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.337775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.338514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.339010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.339446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.401975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:08:19.403050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:08:19.403777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:08:19.404375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:08:19.404992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:08:19.432005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.436144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.437037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.438053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.438699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.439357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.488355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Getting quotas for project ae5596ad34e84c719aea37fdf7b730a4. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:08:19.513716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Getting quotas for user 7d8583adf5e64b4fbc7a9ed0e250d5e7 and project ae5596ad34e84c719aea37fdf7b730a4. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:08:19.571252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:08:19.574960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:08:19.718742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3342459-b728-4189-ba96-8803d6bd4f66 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.868035 Sep 01 05:08:19.729043 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1947/3908] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:08:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:08:19.735733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:19.736674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:19.753651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.754354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.758734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.759833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.760477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.761073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.837330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:19.858051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24b1a48a-2afd-4c55-97cb-4a8c16f913bd tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1534 microversion: 2.1 time: 0.550984 Sep 01 05:08:19.860119 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1962/3909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:19 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1534 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:19.880797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07ec000a-0d48-487f-934f-182b4081b9d1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:19.882105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07ec000a-0d48-487f-934f-182b4081b9d1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:19.903742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:19.906860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:19.922781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:19.927075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lazy-loading 'fault' on Instance uuid 11c11330-3df4-492f-a49d-f8a7b32e54a8 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:08:20.249326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:20.263734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:20.269423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498c97de06ca4ba4b4f4c3f129d17c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a1ce370a1484f8d08ba54910e4d53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:20.274437 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87974941-d7ab-4706-9152-5baa62542f6f tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 200 len: 1370 microversion: 2.42 time: 0.542889 Sep 01 05:08:20.282862 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1948/3910] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:19 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 1370 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:08:20.330346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:20.335409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:20.371084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:20.376276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:20.378026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:20.383938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:20.387541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:20.391802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:20.445657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-07ec000a-0d48-487f-934f-182b4081b9d1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:20.460730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07ec000a-0d48-487f-934f-182b4081b9d1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1214 microversion: 2.1 time: 0.596871 Sep 01 05:08:20.461371 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1963/3911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:19 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1214 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:20.884814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:20.885827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:20.898645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:20.900052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:20.901564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:20.903538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:20.904842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:20.905985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:20.970292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:21.173519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:21.183052 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99c602f5-aa7e-4b83-9226-1b491ae6304e tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1507 microversion: 2.1 time: 0.861470 Sep 01 05:08:21.195706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1949/3912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:20 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1507 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:21.333872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:21.334770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:21.350793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:21.351650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:21.352546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:21.354140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:21.354966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:21.355624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:21.415775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] HTTP exception thrown: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Request method failure captured: Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 HTTP/1.1 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDxYzdWHeWauRggKRKR3mv5VYDIy6htb3W3LmBFFJHb8lhvmI3p0lUaeOlrVOjPkfobtokwlb_O1AuT2m8UzSYzDHDVH-g_NAwdlnTRAgfDxTmZ6Ksy65Lm5Wr5LtwMUYC4ZxkXQBqw90T0pc0im1YxI9lly8rNRPyzTy_mfTUZ9M9A Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.42 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: dc1a1ce370a1484f8d08ba54910e4d53 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: dc1a1ce370a1484f8d08ba54910e4d53 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TaggedBootDevicesTest_v242-1483733877-project Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 498c97de06ca4ba4b4f4c3f129d17c3f Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1483733877-project Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '11c11330-3df4-492f-a49d-f8a7b32e54a8'} Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:21.419949 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:21.423979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Returning 404 to user: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:21.428383 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7357a55e-6918-4ff9-84a8-49a4f6f1cb6d tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 404 len: 111 microversion: 2.42 time: 0.098947 Sep 01 05:08:21.433809 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1950/3913] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:21 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:08:21.442863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c801ed0d-dba8-4721-9cdc-cf169f39d317 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '.version_select at 0x7fa764138430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:21.541652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c801ed0d-dba8-4721-9cdc-cf169f39d317 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918565657" status: 204 len: 0 microversion: 2.42 time: 0.104814 Sep 01 05:08:21.542733 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1951/3914] 10.222.0.26 () {60 vars in 1259 bytes} [Thu Sep 1 05:08:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918565657 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:08:21.560794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:21.561969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:21.576599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:21.577900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:21.579246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:21.580996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:21.582159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:21.583228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:21.776242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:21.795262 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bb63fb3-77bc-4c40-9456-d88c65d578d1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1540 microversion: 2.1 time: 0.914509 Sep 01 05:08:21.805133 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1964/3915] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:20 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1540 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:22.074289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a9e1e1c3-935a-40be-b76c-b8da390838d7 req-5a3d0873-b5d7-471d-84ae-73c8b723c566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c448560-5b05-4bef-bb1a-bb8986beef90", "name": "network-vif-deleted", "tag": "41bc75f2-503b-4e11-b063-b2499d2f4f7e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:22.106044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:22.135473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a9e1e1c3-935a-40be-b76c-b8da390838d7 req-5a3d0873-b5d7-471d-84ae-73c8b723c566 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:22.136064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a9e1e1c3-935a-40be-b76c-b8da390838d7 req-5a3d0873-b5d7-471d-84ae-73c8b723c566 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:22.136516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a9e1e1c3-935a-40be-b76c-b8da390838d7 req-5a3d0873-b5d7-471d-84ae-73c8b723c566 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:22.175187 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a9e1e1c3-935a-40be-b76c-b8da390838d7 req-5a3d0873-b5d7-471d-84ae-73c8b723c566 service nova] Creating event network-vif-deleted:41bc75f2-503b-4e11-b063-b2499d2f4f7e for instance 6c448560-5b05-4bef-bb1a-bb8986beef90 on n-h2-820368-37 Sep 01 05:08:22.181985 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bfb7e9d-327c-4efe-9010-081b457fbb7a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1210 microversion: 2.1 time: 0.636969 Sep 01 05:08:22.182841 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a9e1e1c3-935a-40be-b76c-b8da390838d7 req-5a3d0873-b5d7-471d-84ae-73c8b723c566 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112255 Sep 01 05:08:22.185734 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1965/3916] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:22.195703 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1952/3917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:21 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1210 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:22.239134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:22.240394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:22.258355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:22.274842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:22.275556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:22.277150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:22.277774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:22.278534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:22.511039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:22.520947 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-053e55c8-188f-46e7-a818-d3e458296405 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1292 microversion: 2.1 time: 0.295584 Sep 01 05:08:22.522853 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1966/3918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:22 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1292 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:22.835472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:22.836265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:22.889732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:22.894964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:22.896881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:22.902851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:22.904241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:22.911034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:23.236146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:23.237495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:23.263005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:23.263686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:23.264247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:23.265994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:23.271171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:23.277042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:23.495751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:23.503431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:23.524870 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d48d88a-1b82-4848-84c0-0071cee6058f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1540 microversion: 2.1 time: 0.696756 Sep 01 05:08:23.526664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ae169b2-78c3-46ef-bc62-f716fb757c7b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1284 microversion: 2.1 time: 0.295671 Sep 01 05:08:23.543621 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1953/3919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:22 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1540 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:23.544360 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1967/3920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:23 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1284 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:23.564636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:23.565718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:23.578445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:23.579412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:23.580105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:23.581124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:23.581815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:23.582773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:23.717609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:23.731972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:23.732612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:23.734740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'fault' on Instance uuid 6c448560-5b05-4bef-bb1a-bb8986beef90 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:08:23.969167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:23.980478 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6c244c2-ff18-45c7-bed8-21a5eb7eb523 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 200 len: 1311 microversion: 2.1 time: 0.426085 Sep 01 05:08:23.988325 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1954/3921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:23 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:24.549221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:24.550509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:24.573298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:24.574748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:24.586268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:24.610282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:24.615726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:24.616823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:24.617731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:24.618593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:24.622102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:24.623336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:24.624052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:24.624723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:24.625406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:24.628344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:24.827489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:24.839876 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c8f0546-c375-4e6c-8bb8-a2f9ddc0fde3 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1272 microversion: 2.1 time: 0.272852 Sep 01 05:08:24.852669 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1955/3922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:24 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:24.999773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:25.008511 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-267f44dc-15ef-4145-be2d-e4e5f848e9ab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1540 microversion: 2.1 time: 0.463072 Sep 01 05:08:25.024684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:25.025717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 6c448560-5b05-4bef-bb1a-bb8986beef90] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:25.034234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.037288 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1968/3923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:24 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1540 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:25.047145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.047902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.048986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.049719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.054707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.084107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 could not be found. Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 HTTP/1.1 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 could not be found. Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '6c448560-5b05-4bef-bb1a-bb8986beef90'} Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 could not be found. Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 could not be found. Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:25.086637 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 could not be found. Sep 01 05:08:25.090499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:25.096621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 404 to user: Instance 6c448560-5b05-4bef-bb1a-bb8986beef90 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:25.101641 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d55d0dc2-dfe5-417c-9630-53f628c476b8 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90" status: 404 len: 111 microversion: 2.1 time: 0.080855 Sep 01 05:08:25.102617 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1956/3924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:25 2022] GET /compute/v2.1/servers/6c448560-5b05-4bef-bb1a-bb8986beef90 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:08:25.111449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:25.112333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:25.122658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.134135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.135016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.135925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.136420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.136913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.210769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:08:25.536409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d2d6490-5a2d-470d-87d8-fe0f130c4ac7 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 204 len: 0 microversion: 2.1 time: 0.428243 Sep 01 05:08:25.537892 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1969/3925] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:25 2022] DELETE /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:08:25.546505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:25.547429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:25.567399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.570375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.571093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.572046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.578028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.579125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.889313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:25.890238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:25.925289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.932153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.935944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:25.944477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:25.945648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:25.948970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:27.152584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:27.171464 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0228332b-7ae7-4814-9a1c-244b46ced4f0 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 1.629025 Sep 01 05:08:27.188302 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1957/3926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:25 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:27.206301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:27.212274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:27.222408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:27.249434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:27.251725 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f29d33a-bb7a-43db-b594-d13ed3c1982e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 1.366990 Sep 01 05:08:27.253532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:27.254011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:27.254809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:27.255371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:27.256037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:27.260875 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1970/3927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:25 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:27.756098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:27.772566 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-551ac02a-b7b6-46fe-bd51-f347eb5a9993 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1522 microversion: 2.1 time: 0.580951 Sep 01 05:08:27.774591 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1958/3928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:27 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:27.814755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:27.815227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:27.845486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:27.846035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:27.849207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:27.858104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:27.858646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:27.860309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:27.938391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:08:28.166231 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-966fc360-4e1f-4d60-978a-adfe7c9c5be8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 204 len: 0 microversion: 2.1 time: 0.373978 Sep 01 05:08:28.167738 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1971/3929] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:27 2022] DELETE /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:08:28.176221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:28.177073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:28.190526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:28.195166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:28.196015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:28.201549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:28.201858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:28.202776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:28.203288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:28.204240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:28.221670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:28.232884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:28.233545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:28.242058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:28.242857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:28.244194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.048066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:29.082937 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bae884ad-c0af-4b67-8253-f35516d853d9 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 0.886290 Sep 01 05:08:29.085719 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1972/3930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:28 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:29.113327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:29.113970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:29.140998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.142242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.146372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.147478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.148995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.149477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.183589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:29.202515 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69c043f2-9220-45ca-90fa-3c8f2d5c45bf tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1528 microversion: 2.1 time: 1.027313 Sep 01 05:08:29.206112 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1959/3931] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:28 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1528 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:29.222358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:29.225219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:29.241255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.241690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.243988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.246946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.249132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.250859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.294812 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c HTTP/1.1 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '22ff2d06-6e45-4684-8043-d1b0f45c793c'} Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:29.296759 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f75295f2-c54e-4f49-b434-93fdfc98e21d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 404 len: 111 microversion: 2.1 time: 0.088866 Sep 01 05:08:29.301742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1960/3932] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:29 2022] DELETE /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:29.325035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:29.325930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 22ff2d06-6e45-4684-8043-d1b0f45c793c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:29.342438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.342438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.342796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.346403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.347497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.348120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.370943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c HTTP/1.1 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '22ff2d06-6e45-4684-8043-d1b0f45c793c'} Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.372768 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. Sep 01 05:08:29.376939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.379895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 22ff2d06-6e45-4684-8043-d1b0f45c793c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:29.381470 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ea34871-8db9-496e-88ad-3fb02ee9e4f9 tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c" status: 404 len: 111 microversion: 2.1 time: 0.073667 Sep 01 05:08:29.386099 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1961/3933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:29 2022] GET /compute/v2.1/servers/22ff2d06-6e45-4684-8043-d1b0f45c793c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:29.392845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:29.393811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:29.403557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.404555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.405264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.406261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.406910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.408076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.415183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:29.428539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 HTTP/1.1 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '45d57bc8-cbe9-4354-96a3-83553379e4b4'} Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:29.431345 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.435678 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.438154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:29.439816 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e7fc667-8bfd-416c-b46d-25cbe6159daf tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 404 len: 111 microversion: 2.1 time: 0.051786 Sep 01 05:08:29.440957 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1962/3934] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:29 2022] DELETE /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:29.453727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:29.455681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 45d57bc8-cbe9-4354-96a3-83553379e4b4] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:29.468413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:29.483211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.484185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.486984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.495282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:29.496035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:29.496864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:29.532236 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 HTTP/1.1 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '45d57bc8-cbe9-4354-96a3-83553379e4b4'} Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:29.535237 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. Sep 01 05:08:29.540287 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:29.545743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 45d57bc8-cbe9-4354-96a3-83553379e4b4 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:29.546878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45aca345-a2cb-4d27-9d6f-cb044317fead tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4" status: 404 len: 111 microversion: 2.1 time: 0.100907 Sep 01 05:08:29.551130 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1963/3935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:29 2022] GET /compute/v2.1/servers/45d57bc8-cbe9-4354-96a3-83553379e4b4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:29.749317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:29.783442 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7102f476-4e24-4cc9-a26e-de29ba3a0a67 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 0.690988 Sep 01 05:08:29.813448 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1973/3936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:29 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:30.109278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:30.110252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:30.112631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:30.114023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:30.130550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:30.131712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:30.132335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:30.133408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:30.134030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:30.134615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:30.195515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ee57e6d9-37a0-428c-9729-9a7a8551d605 req-6de8e856-5747-4adb-bd2b-bef76b619f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53baf9c2-045b-4d46-afb3-af91989b1945", "tag": "0f27d757-98c3-459e-8160-f804aa3b1851"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:30.254944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ee57e6d9-37a0-428c-9729-9a7a8551d605 req-6de8e856-5747-4adb-bd2b-bef76b619f8e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:30.255751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ee57e6d9-37a0-428c-9729-9a7a8551d605 req-6de8e856-5747-4adb-bd2b-bef76b619f8e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:30.266497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ee57e6d9-37a0-428c-9729-9a7a8551d605 req-6de8e856-5747-4adb-bd2b-bef76b619f8e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:30.311335 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ee57e6d9-37a0-428c-9729-9a7a8551d605 req-6de8e856-5747-4adb-bd2b-bef76b619f8e service nova] Creating event network-changed:0f27d757-98c3-459e-8160-f804aa3b1851 for instance 53baf9c2-045b-4d46-afb3-af91989b1945 on n-h1-820368-37 Sep 01 05:08:30.350952 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ee57e6d9-37a0-428c-9729-9a7a8551d605 req-6de8e856-5747-4adb-bd2b-bef76b619f8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170156 Sep 01 05:08:30.352974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1974/3937] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:30.380192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:30.382351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:30.396718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:30.398002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:30.399129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:30.404414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:30.405714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:30.406992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:30.472652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:31.749429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:31.760402 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-567ed656-aaf8-4bb5-aa75-56ce3d7eed45 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1522 microversion: 2.1 time: 1.655902 Sep 01 05:08:31.764586 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1964/3938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:30 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1522 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:31.772965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:31.780418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:31.781002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:31.796917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:31.796917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:31.796917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:31.803823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:31.804520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:31.804978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:31.843056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fa9e9a8-24f6-4e58-a3b8-6a6ca8f9556d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1528 microversion: 2.1 time: 1.487968 Sep 01 05:08:31.851309 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1975/3939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:30 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1528 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:32.369609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-31d982f7-caab-4cd1-b768-354c5cc4b9e4 req-8129adcd-8992-4123-a6d7-f19c8e247585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e6c322-8878-4d61-b782-6adb266189dd", "name": "network-vif-unplugged", "status": "completed", "tag": "281863a5-4cf6-4485-9da1-8a963f174461"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:32.391648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-31d982f7-caab-4cd1-b768-354c5cc4b9e4 req-8129adcd-8992-4123-a6d7-f19c8e247585 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.392144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-31d982f7-caab-4cd1-b768-354c5cc4b9e4 req-8129adcd-8992-4123-a6d7-f19c8e247585 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.392585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-31d982f7-caab-4cd1-b768-354c5cc4b9e4 req-8129adcd-8992-4123-a6d7-f19c8e247585 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.423075 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-31d982f7-caab-4cd1-b768-354c5cc4b9e4 req-8129adcd-8992-4123-a6d7-f19c8e247585 service nova] Creating event network-vif-unplugged:281863a5-4cf6-4485-9da1-8a963f174461 for instance 93e6c322-8878-4d61-b782-6adb266189dd on n-h2-820368-37 Sep 01 05:08:32.435836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-31d982f7-caab-4cd1-b768-354c5cc4b9e4 req-8129adcd-8992-4123-a6d7-f19c8e247585 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069233 Sep 01 05:08:32.446271 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1976/3940] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:08:32.587933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:32.588524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:32.603235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.604072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.605993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.609619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.610693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.611645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.643827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] HTTP exception thrown: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Request method failure captured: Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 HTTP/1.1 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDxYzdWHeWauRggKRKR3mv5VYDIy6htb3W3LmBFFJHb8lhvmI3p0lUaeOlrVOjPkfobtokwlb_O1AuT2m8UzSYzDHDVH-g_NAwdlnTRAgfDxTmZ6Ksy65Lm5Wr5LtwMUYC4ZxkXQBqw90T0pc0im1YxI9lly8rNRPyzTy_mfTUZ9M9A Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.42 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: dc1a1ce370a1484f8d08ba54910e4d53 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: dc1a1ce370a1484f8d08ba54910e4d53 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TaggedBootDevicesTest_v242-1483733877-project Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 498c97de06ca4ba4b4f4c3f129d17c3f Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1483733877-project Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '11c11330-3df4-492f-a49d-f8a7b32e54a8'} Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:32.649199 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.653187 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.656323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Returning 404 to user: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:32.657853 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e58893a6-bc32-431c-af70-857e63701035 tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 404 len: 111 microversion: 2.42 time: 0.076713 Sep 01 05:08:32.659055 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1977/3941] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:08:32 2022] DELETE /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:08:32.670124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:32.671188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] [instance: 11c11330-3df4-492f-a49d-f8a7b32e54a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:32.679740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.680588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.681258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.682402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.683159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.683806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.715654 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] HTTP exception thrown: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Request method failure captured: Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 HTTP/1.1 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDxYzdWHeWauRggKRKR3mv5VYDIy6htb3W3LmBFFJHb8lhvmI3p0lUaeOlrVOjPkfobtokwlb_O1AuT2m8UzSYzDHDVH-g_NAwdlnTRAgfDxTmZ6Ksy65Lm5Wr5LtwMUYC4ZxkXQBqw90T0pc0im1YxI9lly8rNRPyzTy_mfTUZ9M9A Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.42 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: dc1a1ce370a1484f8d08ba54910e4d53 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc1a1ce370a1484f8d08ba54910e4d53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: dc1a1ce370a1484f8d08ba54910e4d53 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1483733877 Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TaggedBootDevicesTest_v242-1483733877-project Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 498c97de06ca4ba4b4f4c3f129d17c3f Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1483733877-project Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '11c11330-3df4-492f-a49d-f8a7b32e54a8'} Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.719166 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] Returning 404 to user: Instance 11c11330-3df4-492f-a49d-f8a7b32e54a8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:32.732003 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5480737e-3192-456a-be67-e540498da3de tempest-TaggedBootDevicesTest_v242-1483733877 tempest-TaggedBootDevicesTest_v242-1483733877-project] 10.222.0.26 "GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8" status: 404 len: 111 microversion: 2.42 time: 0.061258 Sep 01 05:08:32.747192 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1978/3942] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:08:32 2022] GET /compute/v2.1/servers/11c11330-3df4-492f-a49d-f8a7b32e54a8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:08:32.794251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:32.819532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:32.823880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:32.861220 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba8e37c6-bdaa-4f94-8231-729c1071466b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 1.090182 Sep 01 05:08:32.864947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1965/3943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:31 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:32.865163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.870955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.870955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.870955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.870955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.870955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.893324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:32.894848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:32.938412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.939452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.944677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:32.946129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:32.954816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:32.962450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:33.305430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:33.320447 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-404ecefe-7899-42b1-852d-cfa12de4264a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1480 microversion: 2.1 time: 0.537908 Sep 01 05:08:33.335094 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1979/3944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:32 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1480 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:33.531989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e353da59-8052-4756-b8d9-573c14feffc5 req-e5d45c0d-255b-4127-95f5-d93c281a988d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e6c322-8878-4d61-b782-6adb266189dd", "name": "network-vif-deleted", "tag": "281863a5-4cf6-4485-9da1-8a963f174461"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:33.570430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e353da59-8052-4756-b8d9-573c14feffc5 req-e5d45c0d-255b-4127-95f5-d93c281a988d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:33.572282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e353da59-8052-4756-b8d9-573c14feffc5 req-e5d45c0d-255b-4127-95f5-d93c281a988d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:33.572965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e353da59-8052-4756-b8d9-573c14feffc5 req-e5d45c0d-255b-4127-95f5-d93c281a988d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:33.610706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e353da59-8052-4756-b8d9-573c14feffc5 req-e5d45c0d-255b-4127-95f5-d93c281a988d service nova] Creating event network-vif-deleted:281863a5-4cf6-4485-9da1-8a963f174461 for instance 93e6c322-8878-4d61-b782-6adb266189dd on n-h2-820368-37 Sep 01 05:08:33.621298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e353da59-8052-4756-b8d9-573c14feffc5 req-e5d45c0d-255b-4127-95f5-d93c281a988d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094129 Sep 01 05:08:33.622243 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1980/3945] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:08:33.705218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:33.726194 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9efe2ab9-0cde-4935-99cb-9b843705dfa1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1528 microversion: 2.1 time: 0.841143 Sep 01 05:08:33.727131 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1966/3946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:32 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1528 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:33.887933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:33.889581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:33.901944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:33.906605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:33.907233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:33.909218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:33.910349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:33.913354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:34.344483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:34.346180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:34.355872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:34.356495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:34.357355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:34.358183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:34.358753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:34.359455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:34.449901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:34.450764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:34.451520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:34.452263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lazy-loading 'fault' on Instance uuid 93e6c322-8878-4d61-b782-6adb266189dd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:08:34.914742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3908868db8e340f2b24025c148fd3d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d30cd8cf35b46a79180096815df2f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:34.943549 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6e7e21e-b505-4735-b61b-343cc91a4418 tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 200 len: 1312 microversion: 2.1 time: 0.595190 Sep 01 05:08:34.959816 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1967/3947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:34 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 1312 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:34.972706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:34.976329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:35.029873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:35.031943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:35.035553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:35.037241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:35.038048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:35.043303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:35.220119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:35.225208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:35.243329 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3139169-08d5-408c-b05d-c7fab6a0b107 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 1.357938 Sep 01 05:08:35.258045 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1981/3948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:33 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:35.421454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:35.432420 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f6a6d91-7742-4f7d-b3c1-480d8280847f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1486 microversion: 2.1 time: 0.470569 Sep 01 05:08:35.450925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1968/3949] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:34 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:35.673531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-776223c1-e682-4f86-912f-ad28a6369798 req-011aed89-27b4-4604-be6b-516f5f158515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2fd882-450d-47e3-85bd-57078b919b76", "name": "network-vif-deleted", "tag": "45a168a3-c632-43c1-9938-c90602510427"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:35.694158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-776223c1-e682-4f86-912f-ad28a6369798 req-011aed89-27b4-4604-be6b-516f5f158515 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:35.694650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-776223c1-e682-4f86-912f-ad28a6369798 req-011aed89-27b4-4604-be6b-516f5f158515 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:35.697928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-776223c1-e682-4f86-912f-ad28a6369798 req-011aed89-27b4-4604-be6b-516f5f158515 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:35.728477 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-776223c1-e682-4f86-912f-ad28a6369798 req-011aed89-27b4-4604-be6b-516f5f158515 service nova] Creating event network-vif-deleted:45a168a3-c632-43c1-9938-c90602510427 for instance ab2fd882-450d-47e3-85bd-57078b919b76 on n-h2-820368-37 Sep 01 05:08:35.744904 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-776223c1-e682-4f86-912f-ad28a6369798 req-011aed89-27b4-4604-be6b-516f5f158515 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075696 Sep 01 05:08:35.746065 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1982/3950] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:35.970944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:35.978128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] [instance: 93e6c322-8878-4d61-b782-6adb266189dd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:36.009543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.024047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.032361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.035422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.039375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.044586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.156727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] HTTP exception thrown: Instance 93e6c322-8878-4d61-b782-6adb266189dd could not be found. Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Request method failure captured: Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd HTTP/1.1 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDz6VyRmJrU467YbYefs3OK_OcphYM0g1aMW172r16Wrfcd0P7ep6RMxx9k78LVYoIG-CmHLR-V3Krjiljer6q1SryfvzTrrd6nZ-RFRa-03rkmwKt-1_w60S_LRlbf1Sy4iYj1bCTGoNH-TNL4mYPrdbVcthBV1Ecgj7y-VPd347WQ Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d30cd8cf35b46a79180096815df2f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 6d30cd8cf35b46a79180096815df2f8a Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1241441482 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 3908868db8e340f2b24025c148fd3d40 Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1241441482-project Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 93e6c322-8878-4d61-b782-6adb266189dd could not be found. Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '93e6c322-8878-4d61-b782-6adb266189dd'} Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e6c322-8878-4d61-b782-6adb266189dd could not be found. Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e6c322-8878-4d61-b782-6adb266189dd could not be found. Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:36.169062 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e6c322-8878-4d61-b782-6adb266189dd could not be found. Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] Returning 404 to user: Instance 93e6c322-8878-4d61-b782-6adb266189dd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da58bcf5-8dde-4b52-a4e8-c430ec71390a tempest-ServerRescueNegativeTestJSON-1241441482 tempest-ServerRescueNegativeTestJSON-1241441482-project] 10.222.0.26 "GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd" status: 404 len: 111 microversion: 2.1 time: 0.212128 Sep 01 05:08:36.180453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1969/3951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:35 2022] GET /compute/v2.1/servers/93e6c322-8878-4d61-b782-6adb266189dd => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:36.267641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:36.269123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:36.272961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:36.300012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.334944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.335974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.346106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.351542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.355623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.459259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:36.459985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:36.477909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.478595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.483453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.484595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.486401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.490791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.610097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:36.621862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:36.622745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:36.637068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lazy-loading 'fault' on Instance uuid ab2fd882-450d-47e3-85bd-57078b919b76 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:08:36.844130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:36.856578 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d634f48-87e4-430a-beea-ca69deb969ad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 200 len: 1315 microversion: 2.1 time: 0.401786 Sep 01 05:08:36.859635 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1970/3952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:36 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:37.008149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:37.028821 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1551a938-7264-4fa7-b5cd-f15e8122726b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 0.766273 Sep 01 05:08:37.042933 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1983/3953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:36 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:37.905307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:37.906861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:37.955907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:37.956430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:37.956885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:37.957752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:37.964127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:37.964127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:38.025196 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 HTTP/1.1 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76'} Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:38.054527 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:38.060418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:38.061160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:38.061867 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e925730f-efc1-489c-99a0-c521f108c568 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 404 len: 111 microversion: 2.1 time: 0.157079 Sep 01 05:08:38.062032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:38.068848 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1971/3954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:37 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:38.079778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:38.081545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:38.081681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3cb8d1da-c50f-49e3-bc8d-ff07d9fbe456 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'create', calling method: .version_select at 0x7fa75af61160>, body: {"keypair": {"name": "tempest-keypair-1717998580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHojt76LGYxFuKL2XpgZBuOAnx+YJtg1nHeGQMKpZAWUUNSKS/VXaL1JjKcR9QCRpD9WcicEMOwAX6Law7SH9In5zYmA+X55xwFDMil6smySMUWHlNM85TgzelBOkt5DA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:38.082498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:38.083959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:38.085116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:38.086401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:38.173769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3cb8d1da-c50f-49e3-bc8d-ff07d9fbe456 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for project cc9dddd7fe5040a68d289bade73e0232. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:08:38.187708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3cb8d1da-c50f-49e3-bc8d-ff07d9fbe456 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for user 512e22d177264c46982afa469c3446da and project cc9dddd7fe5040a68d289bade73e0232. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:08:38.289952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3cb8d1da-c50f-49e3-bc8d-ff07d9fbe456 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.213254 Sep 01 05:08:38.290501 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1972/3955] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:08:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:08:38.710397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:38.751046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60a9641b-bb5e-472c-b193-18c6141a2c8b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 0.699287 Sep 01 05:08:38.773701 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1984/3956] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:38 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:39.777411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:39.778313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:39.801332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:39.805956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:39.807863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:39.808752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:39.811170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:39.812833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:40.185471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:40.192709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-56410201-fc19-4453-a4b8-e6999658c9c6 req-251814c8-a8e0-418f-a067-7a7ea7847664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53baf9c2-045b-4d46-afb3-af91989b1945", "name": "network-vif-plugged", "status": "completed", "tag": "0f27d757-98c3-459e-8160-f804aa3b1851"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:40.200322 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f724938-d529-41bb-84dc-d1835c540f35 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 0.430344 Sep 01 05:08:40.218316 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1973/3957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:39 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:40.231510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56410201-fc19-4453-a4b8-e6999658c9c6 req-251814c8-a8e0-418f-a067-7a7ea7847664 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:40.232607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56410201-fc19-4453-a4b8-e6999658c9c6 req-251814c8-a8e0-418f-a067-7a7ea7847664 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:40.234535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56410201-fc19-4453-a4b8-e6999658c9c6 req-251814c8-a8e0-418f-a067-7a7ea7847664 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:40.295390 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-56410201-fc19-4453-a4b8-e6999658c9c6 req-251814c8-a8e0-418f-a067-7a7ea7847664 service nova] Creating event network-vif-plugged:0f27d757-98c3-459e-8160-f804aa3b1851 for instance 53baf9c2-045b-4d46-afb3-af91989b1945 on n-h1-820368-37 Sep 01 05:08:40.306782 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-56410201-fc19-4453-a4b8-e6999658c9c6 req-251814c8-a8e0-418f-a067-7a7ea7847664 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125105 Sep 01 05:08:40.311814 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1985/3958] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:08:40.951463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:40.952350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:40.994374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:40.995171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:41.028342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:41.034509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:41.041880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:41.043093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:41.109724 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 HTTP/1.1 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '360af898-9d37-4f14-a30b-95e19c0d6e79'} Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:41.113039 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.120439 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.136080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:41.136080 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2462e56-414b-472f-9215-8fe754d995cb tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 404 len: 111 microversion: 2.1 time: 0.183208 Sep 01 05:08:41.148742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:41.149615 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1974/3959] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:08:40 2022] DELETE /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:41.151288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] [instance: 360af898-9d37-4f14-a30b-95e19c0d6e79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:41.166718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:41.168121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:41.169997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:41.171985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:41.173155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:41.174646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:41.234774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:41.244453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:41.273216 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] HTTP exception thrown: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Request method failure captured: Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 HTTP/1.1 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEDv84n98akTxWSoySw4vOYvHwcd-cJCWYmGYoxrYru7fruLOuK9jmCHSajEgqGLXjR2KiHVZNTmC7I60dJxBVfbDgg1em540Cc-Rr6aO9oKGHZeZguAKolK_RYUJ4ubfwLlIeVQyvTckJkwomvowmIt5wGiOyaDMj6Vb65H0zB2WxbA Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/330e2577f5604ff485744c7f53deb302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_330e2577f5604ff485744c7f53deb302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/330e2577f5604ff485744c7f53deb302"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 330e2577f5604ff485744c7f53deb302 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1412743986 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 15f14c11aec640a5b4dddfb2b249ddc7 Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1412743986-project Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '360af898-9d37-4f14-a30b-95e19c0d6e79'} Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:08:41.281465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. Sep 01 05:08:41.295866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:08:41.302932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] Returning 404 to user: Instance 360af898-9d37-4f14-a30b-95e19c0d6e79 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:08:41.303780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:41.306750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:41.310136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:41.314610 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d8d2eec-49f8-4ff9-a278-431d76b3252d tempest-AttachVolumeNegativeTest-1412743986 tempest-AttachVolumeNegativeTest-1412743986-project] 10.222.0.26 "GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79" status: 404 len: 111 microversion: 2.1 time: 0.162919 Sep 01 05:08:41.317138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:41.327130 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1986/3960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:41 2022] GET /compute/v2.1/servers/360af898-9d37-4f14-a30b-95e19c0d6e79 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:08:41.327942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:41.334035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:42.118744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:42.134470 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a4a997c-0778-4cf7-a15c-e2605ef66f40 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1314 microversion: 2.1 time: 0.911308 Sep 01 05:08:42.141433 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1975/3961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:41 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:43.171252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:43.179920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:43.242531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:43.253243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:43.254624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:43.256522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:43.259167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:43.260647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:44.723504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:44.736264 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e42c9f1-5da2-43e8-90a5-998d531309c7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1500 microversion: 2.1 time: 1.572664 Sep 01 05:08:44.736878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1987/3962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:43 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1500 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:44.765909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:44.769026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:44.812268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:44.816048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:44.818677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:44.822675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:44.826821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:44.829590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:44.949500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lazy-loading 'flavor' on Instance uuid 53baf9c2-045b-4d46-afb3-af91989b1945 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:08:45.339893 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-569be762-0a7f-4536-8cc1-e7135e5c5e72 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "POST /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945/action" status: 200 len: 32 microversion: 2.1 time: 0.578996 Sep 01 05:08:45.349015 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1976/3963] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:08:44 2022] POST /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945/action => generated 32 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:08:45.369671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:45.372714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:45.432398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:45.432911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:45.433359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:45.434100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:45.434567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:45.435034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:46.046227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1809056768", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:08:46.226520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] validate_networks() for [('63ad42ce-ca8d-4f08-993f-e98e03c5e312', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:08:46.820898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:46.891756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfa19504-c57e-4e14-b788-9dcc9a36fd63 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 1.538131 Sep 01 05:08:46.923422 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1988/3964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:45 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:47.953696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:47.956194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:48.005149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:48.007286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:48.008263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:48.009763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:48.013444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:48.014513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:48.224173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:50.208255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:50.250217 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa297db6-32a3-417a-a720-aae737af1e07 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 2.295664 Sep 01 05:08:50.267038 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1989/3965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:47 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:50.415576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:08:50.416849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:08:50.418136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:08:50.419090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:08:50.420069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:08:50.450871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:50.453103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:50.457068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:50.460882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:50.462925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:50.466137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:50.518567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for project cc9dddd7fe5040a68d289bade73e0232. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:08:50.548595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for user 512e22d177264c46982afa469c3446da and project cc9dddd7fe5040a68d289bade73e0232. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:08:50.580345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:08:50.586186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:08:50.675361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89f04696-3916-420a-bf7e-974f0b9e8a31 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.632150 Sep 01 05:08:50.678330 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1977/3966] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:08:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:08:50.694116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-066187c9-1c0f-4e86-9b61-eb2204e3c488 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:50.695469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-066187c9-1c0f-4e86-9b61-eb2204e3c488 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:50.885536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-066187c9-1c0f-4e86-9b61-eb2204e3c488 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:50.903336 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-066187c9-1c0f-4e86-9b61-eb2204e3c488 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1225 microversion: 2.1 time: 0.210486 Sep 01 05:08:50.903336 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1990/3967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:50 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1225 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:51.298923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:51.306136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:51.357630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:51.359575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:51.361848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:51.368761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:51.369991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:51.376275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:51.941692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dd242ff-2501-4823-a0c4-c1ba65a4f132 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:51.949014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dd242ff-2501-4823-a0c4-c1ba65a4f132 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:52.195016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dd242ff-2501-4823-a0c4-c1ba65a4f132 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:52.224668 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dd242ff-2501-4823-a0c4-c1ba65a4f132 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1225 microversion: 2.1 time: 0.289966 Sep 01 05:08:52.233690 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1991/3968] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:51 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1225 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:52.331233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:52.344488 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0697baeb-0812-49ff-9529-9e8b29b1c7a7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 1.065591 Sep 01 05:08:52.345621 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1978/3969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:51 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:53.258972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:53.267509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:53.304245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:53.304746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:53.305179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:53.305899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:53.306356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:53.306779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:53.367541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:53.370100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:53.414916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:53.417309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:53.420440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:53.421515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:53.422956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:53.427327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:53.606473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:53.617790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6039dc4-fbaf-4d4e-9256-5f40812571fa tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1285 microversion: 2.1 time: 0.366840 Sep 01 05:08:53.618408 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1992/3970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:53 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1285 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:54.643086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:54.644287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:54.664338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:54.664839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:54.665274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:54.665996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:54.666449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:54.666873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:54.692043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:54.704553 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d724178a-8d74-46a4-b26c-c7ce0cda87e0 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 1.342157 Sep 01 05:08:54.708529 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1979/3971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:53 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:55.113804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:55.153765 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b007d906-0251-4dcf-92b9-674f9ae1d802 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1283 microversion: 2.1 time: 0.503835 Sep 01 05:08:55.161221 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1993/3972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:54 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1283 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:55.732704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:55.733518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:55.751952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:55.752764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:55.754770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:55.758426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:55.759344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:55.759984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:56.181070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:56.182376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:56.202430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:56.202952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:56.203582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:56.210087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:56.211790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:56.215270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:57.134716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:57.175272 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f82ed46c-7aab-439b-b41b-f4d6cc78f323 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1283 microversion: 2.1 time: 0.999222 Sep 01 05:08:57.184930 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1994/3973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:56 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1283 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:08:57.468541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:57.495273 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28055190-14b7-4c06-b4e4-e8951352befd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 1.767285 Sep 01 05:08:57.496299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1980/3974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:55 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:58.213276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:58.215356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:58.247381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:58.256022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:58.257338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:58.265187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:58.267316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:58.268110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:58.545364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:08:58.546471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:08:58.590099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:58.596347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:58.597816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:58.599430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:08:58.608833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:08:58.617344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:08:58.682663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:59.223947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:59.264391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:08:59.269226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e2b4f2e-6cab-4885-a5f6-ddfe9300e613 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 1.047252 Sep 01 05:08:59.274389 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2055f00c-e752-45b9-8a79-eadb03db6fbc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 0.740190 Sep 01 05:08:59.275341 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1995/3975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:58 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:08:59.277461 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1981/3976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:08:58 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:00.315049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:00.316061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:00.320034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:00.325818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:00.326475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:00.327475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:00.334698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:00.335466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:00.336239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:00.336715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:00.337142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:00.379666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:00.387416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:00.389344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:00.390999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:00.393312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:00.396860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:01.073264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.078426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:01.105050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:01.144284 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-485a0f0d-732a-420f-b81d-cfe07d67ca3c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 0.832296 Sep 01 05:09:01.166085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1996/3977] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:00 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:01.594106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:01.619708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ddb6789-7dd8-4252-9af0-1b1d18fd61b5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 1.308393 Sep 01 05:09:01.621222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1982/3978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:00 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:02.189566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:02.197676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:02.237330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:02.252218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:02.260088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:02.260852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:02.262123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:02.262984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:02.272065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:02.648329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:02.649357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:02.715758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:02.716780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:02.717479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:02.718740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:02.725421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:02.726764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:03.080615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:03.133492 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-491ed942-c84d-4207-981f-0b1e00acce94 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 0.969091 Sep 01 05:09:03.134435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1997/3979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:02 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:03.325260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:03.367262 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cec7fd4-53f5-4c32-9dcf-ada56f8d8cab tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 0.725801 Sep 01 05:09:03.382030 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1983/3980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:02 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:03.425308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a4ebda93-bfa9-40ec-a1bf-dbb3b522e323 req-65a2f657-b209-415f-a401-3e69505d59b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e236f6c-3e00-4700-acd1-e59a5c2ac9d7", "tag": "df348702-1bef-4335-a01e-e64879329394"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:03.479519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a4ebda93-bfa9-40ec-a1bf-dbb3b522e323 req-65a2f657-b209-415f-a401-3e69505d59b3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:03.480409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a4ebda93-bfa9-40ec-a1bf-dbb3b522e323 req-65a2f657-b209-415f-a401-3e69505d59b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:03.481196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a4ebda93-bfa9-40ec-a1bf-dbb3b522e323 req-65a2f657-b209-415f-a401-3e69505d59b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:03.531844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a4ebda93-bfa9-40ec-a1bf-dbb3b522e323 req-65a2f657-b209-415f-a401-3e69505d59b3 service nova] Creating event network-changed:df348702-1bef-4335-a01e-e64879329394 for instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 on n-h2-820368-37 Sep 01 05:09:03.554788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a4ebda93-bfa9-40ec-a1bf-dbb3b522e323 req-65a2f657-b209-415f-a401-3e69505d59b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183619 Sep 01 05:09:03.556481 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1998/3981] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:09:04.172497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:04.181844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:04.238923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:04.251592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:04.252661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:04.254256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:04.261235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:04.264692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:04.418578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:04.419364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:04.444806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:04.449280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:04.455718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:04.458254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:04.465016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:04.467321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:05.195802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:05.230100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acdebbb9-5031-4e71-91a7-08690994885b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 0.816387 Sep 01 05:09:05.231161 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1999/3982] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:04 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:05.457036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:05.469212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48da7b49-5574-41a3-92e1-345aa6037e76 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 1.304548 Sep 01 05:09:05.470517 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1984/3983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:04 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:06.269531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:06.270472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:06.292141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:06.292640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:06.293074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:06.293778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:06.294291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:06.294713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:06.369916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=82 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:06.511576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:06.512164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:06.527637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:06.538302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:06.538762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:06.543172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:06.543674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:06.544130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:07.091238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:07.111544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6eed6170-d6a3-4c7a-9446-ce43c6980695 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 0.846588 Sep 01 05:09:07.121974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2000/3984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:06 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:07.406464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:07.426848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e558ac58-4648-4d2f-87b2-6c063155cec5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1506 microversion: 2.1 time: 0.924584 Sep 01 05:09:07.440732 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1985/3985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:06 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1506 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:08.158014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:08.158652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:08.163675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=40 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:08.197685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:08.200798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:08.202421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:08.207406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:08.209058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:08.211982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:08.474595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:08.476467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:08.536792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:08.540718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:08.552581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:08.558275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:08.565906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:08.572265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:08.886432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:08.916259 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d1c0c78-24bd-4880-a08b-268ff319d5d5 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 0.780286 Sep 01 05:09:08.921168 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2001/3986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:08 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:09.307552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:09.317303 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e45dfe49-d307-411b-b998-9b865fd1e93a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1486 microversion: 2.1 time: 0.864713 Sep 01 05:09:09.319519 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1986/3987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:08 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1486 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:09.615786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-918664412", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:10.199905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-104419208", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "1ebb122b-512e-4853-88fe-90ba095e975b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:18.898004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:19.315976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=35 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:19.641087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:20.224634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=11 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:26.581045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] validate_networks() for [('92eb1201-88b8-435c-abc8-33ca7d96301c', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:09:26.605151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] validate_networks() for [('1ebb122b-512e-4853-88fe-90ba095e975b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:09:27.777396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:09:27.778237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:09:27.778470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:09:27.779128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:09:27.779716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:09:27.800761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:27.801475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:27.802530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:27.803926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:27.804784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:27.805364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:27.827693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Getting quotas for project 3d8407d45fd3441ca29dd0ad5b76fbc2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:09:27.833970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Getting quotas for user 2f51cc3a3ad04ef9bdcbef6b05446a60 and project 3d8407d45fd3441ca29dd0ad5b76fbc2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:09:27.858113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:09:27.860819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:09:27.923165 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8ea0303-035e-457f-99dd-ef8478fa2589 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 18.084537 Sep 01 05:09:27.924227 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1987/3988] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 18086 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:09:27.929808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:27.931298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:27.945522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:27.946461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:27.947213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:27.948266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:27.949047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:27.949905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:28.034682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:09:28.036278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:09:28.037008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:09:28.037835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:09:28.038343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:09:28.050361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:28.051189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:28.051699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:28.052714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:28.053411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:28.054189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:28.085395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Getting quotas for project ae5596ad34e84c719aea37fdf7b730a4. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:09:28.094086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Getting quotas for user 7d8583adf5e64b4fbc7a9ed0e250d5e7 and project ae5596ad34e84c719aea37fdf7b730a4. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:09:28.119549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:09:28.119549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:09:28.217371 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f88942ca-6c87-4fe8-b870-9890df9cfb37 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 18.606267 Sep 01 05:09:28.218051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2002/3989] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:09:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 18608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:09:28.230757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2eeefab-cc98-455a-9c2d-1010258e5c3b tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75b4308b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:28.290649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:28.306730 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3036c18-493a-43ba-8a6a-3d261567e965 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 0.375681 Sep 01 05:09:28.308961 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1988/3990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:27 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:28.324960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9e919030-d364-45fa-980a-0d88e1519245 req-fd1c8b94-f182-431b-b700-b7df612ea28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e236f6c-3e00-4700-acd1-e59a5c2ac9d7", "name": "network-vif-plugged", "status": "completed", "tag": "df348702-1bef-4335-a01e-e64879329394"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:28.359215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9e919030-d364-45fa-980a-0d88e1519245 req-fd1c8b94-f182-431b-b700-b7df612ea28e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:28.360130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9e919030-d364-45fa-980a-0d88e1519245 req-fd1c8b94-f182-431b-b700-b7df612ea28e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:28.361163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9e919030-d364-45fa-980a-0d88e1519245 req-fd1c8b94-f182-431b-b700-b7df612ea28e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:28.409385 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9e919030-d364-45fa-980a-0d88e1519245 req-fd1c8b94-f182-431b-b700-b7df612ea28e service nova] Creating event network-vif-plugged:df348702-1bef-4335-a01e-e64879329394 for instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 on n-h2-820368-37 Sep 01 05:09:28.418905 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2eeefab-cc98-455a-9c2d-1010258e5c3b tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bd8ca90f-70a6-4bee-871f-b72db11c0a59" status: 200 len: 350 microversion: 2.1 time: 0.192746 Sep 01 05:09:28.419505 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2003/3991] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:09:28 2022] GET /compute/v2.1/os-volumes/bd8ca90f-70a6-4bee-871f-b72db11c0a59 => generated 350 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:28.449655 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9e919030-d364-45fa-980a-0d88e1519245 req-fd1c8b94-f182-431b-b700-b7df612ea28e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137473 Sep 01 05:09:28.454772 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1989/3992] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:28.476408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0800b6fb-211c-45e3-a0ce-05fb9414a8f3 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:28.477632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0800b6fb-211c-45e3-a0ce-05fb9414a8f3 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:28.669908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0800b6fb-211c-45e3-a0ce-05fb9414a8f3 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:28.690654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0800b6fb-211c-45e3-a0ce-05fb9414a8f3 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:28.696236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0800b6fb-211c-45e3-a0ce-05fb9414a8f3 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:28.699311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0800b6fb-211c-45e3-a0ce-05fb9414a8f3 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1261 microversion: 2.26 time: 0.241517 Sep 01 05:09:28.701005 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1990/3993] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:28 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:28.724393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7b9ef02-9611-4293-8651-e86545728a5d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:28.725077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7b9ef02-9611-4293-8651-e86545728a5d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:28.788253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1449025927", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "599d399b-1ccc-42a9-8001-4eb855310c71"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:28.910256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] validate_networks() for [('599d399b-1ccc-42a9-8001-4eb855310c71', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:09:28.963403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7b9ef02-9611-4293-8651-e86545728a5d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:29.033727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7b9ef02-9611-4293-8651-e86545728a5d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1213 microversion: 2.1 time: 0.323456 Sep 01 05:09:29.048978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1991/3994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:28 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1213 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:29.379527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:29.380448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:29.397113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:29.397926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:29.399848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:29.400655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:29.401124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:29.403515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.108611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:30.121788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b85adea-382d-428a-9700-3181af04510b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1325 microversion: 2.1 time: 0.790356 Sep 01 05:09:30.122913 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1992/3995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:29 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1325 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:30.135732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:30.136746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:30.162537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:30.165828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:30.167232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.168586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:30.171761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:30.173134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.410304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:09:30.411466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:09:30.413591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:09:30.414051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:09:30.415639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:09:30.438282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:30.439869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:30.440920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:30.442723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.446204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:30.446987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:30.447952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.451354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:30.452914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:30.455216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16011fc7-0c8b-4767-8646-ae5388b66cde tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1313 microversion: 2.26 time: 0.330115 Sep 01 05:09:30.456012 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1993/3996] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:30 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:30.474625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Getting quotas for project 232ef7bca1ca4a64847ca86ccc484b29. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:09:30.482000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Getting quotas for user 26551f9bbbfd48d2b9998099e90310e5 and project 232ef7bca1ca4a64847ca86ccc484b29. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:09:30.497602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:30.500682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:09:30.501026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:30.503583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:09:30.515523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:30.517065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:30.517727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.519201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:30.521572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:30.523534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:30.588784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168197 Sep 01 05:09:30.599278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2004/3997] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:09:30.625616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-537222d0-ff94-4d71-b520-e2702d9390f5 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:30.626716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-537222d0-ff94-4d71-b520-e2702d9390f5 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:30.744261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:30.753382 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a22ebf0c-9df7-4d49-9777-d050b36cf1fc tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1265 microversion: 2.1 time: 0.269973 Sep 01 05:09:30.761310 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1994/3998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:30 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:30.810028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-537222d0-ff94-4d71-b520-e2702d9390f5 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:30.819797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-537222d0-ff94-4d71-b520-e2702d9390f5 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1217 microversion: 2.1 time: 0.218046 Sep 01 05:09:30.821917 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2005/3999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:30 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:31.148545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:31.149996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:31.166211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.168374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.169432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.172692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.173682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.176122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.479482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:31.481065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:31.497680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.500812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.503583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.506158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.508516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.511024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.803804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:31.830094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:31.831833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:31.834619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c96b736f-5ea3-438e-b0dd-afbf72324664 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1331 microversion: 2.26 time: 0.358706 Sep 01 05:09:31.854435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2006/4000] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:31 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1331 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:31.875748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:31.884945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:31.887047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:31.888330 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-651cffc5-b79f-4e78-bbfb-b04e815e81ba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1522 microversion: 2.1 time: 0.744312 Sep 01 05:09:31.891821 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1995/4001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:31 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1522 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:31.907075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:31.908465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:31.919097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.921889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.922502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.925770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.930416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.931153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.937031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.938947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.941825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:31.947449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:31.947970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:31.949272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:32.059201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:32.082195 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37d0c24e-faec-4dd3-b99f-d394de1945e7 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1213 microversion: 2.1 time: 0.188582 Sep 01 05:09:32.089395 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1996/4002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:31 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:32.106792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:32.107708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:32.122681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:32.123462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:32.124099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:32.124987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:32.125595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:32.126174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:32.250699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:32.261082 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b1dd4a0-2afe-4193-9c31-c3d243b0bbfe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1283 microversion: 2.1 time: 0.403473 Sep 01 05:09:32.265067 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2007/4003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:31 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1283 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:32.608807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fe4a137-b60f-4e45-8daa-7a61be391f9f tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75b17c9d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:32.700483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:32.715509 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ae69c10-8143-40fc-8678-b941058ff610 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1522 microversion: 2.1 time: 0.624617 Sep 01 05:09:32.716134 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1997/4004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:32 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1522 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:32.740999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-159132041"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:32.743828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:32.756986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:32.757728 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fe4a137-b60f-4e45-8daa-7a61be391f9f tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9d149793-b8f0-4e9f-b6dc-a6024b372607" status: 200 len: 350 microversion: 2.1 time: 0.152537 Sep 01 05:09:32.758170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:32.758798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:32.759141 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2008/4005] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:09:32 2022] GET /compute/v2.1/os-volumes/9d149793-b8f0-4e9f-b6dc-a6024b372607 => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:32.760065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:32.760697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:32.761306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:32.872112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:32.877303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:32.894759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:32.895512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:32.896139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:32.899185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:32.899868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:32.901095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:33.193412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:33.207726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:33.209151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:33.220211 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-847a06dd-0f87-4689-9f2c-448cfb71daef tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1319 microversion: 2.26 time: 0.361037 Sep 01 05:09:33.230912 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2009/4006] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:32 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:33.230912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:33.230912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:33.245435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:33.245969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:33.246451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:33.248752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:33.249512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:33.250124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:33.297539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b049fae-5990-4c07-b16b-34418d3a9a7c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7/action" status: 202 len: 0 microversion: 2.1 time: 0.560658 Sep 01 05:09:33.299824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1998/4007] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:09:32 2022] POST /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 01 05:09:33.309385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:33.310469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:33.322348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:33.323344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:33.324514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:33.325691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:33.326412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:33.327165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:33.437139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:33.455926 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec6aa996-55d0-4d7a-b818-e7aa422d2635 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1275 microversion: 2.1 time: 0.224128 Sep 01 05:09:33.469984 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2010/4008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:33 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:33.488363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1ea82db-c66c-4386-b4f5-37456609332f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '.version_select at 0x7fa75b17c280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:33.499677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:33.527710 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83c3f985-cdaf-4824-ab34-b80bdded8538 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1271 microversion: 2.1 time: 0.225239 Sep 01 05:09:33.528520 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 1999/4009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:33 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:33.848478 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1ea82db-c66c-4386-b4f5-37456609332f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6" status: 204 len: 0 microversion: 2.1 time: 0.377075 Sep 01 05:09:33.849624 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2011/4010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:33 2022] DELETE /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:09:33.858250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5fac9dc-b143-4616-be67-2ab16ec54aea tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '.version_select at 0x7fa75b02ab80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:33.893718 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b5fac9dc-b143-4616-be67-2ab16ec54aea tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Image not found. Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5fac9dc-b143-4616-be67-2ab16ec54aea tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6 HTTP/1.1 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: exception: Image not found. Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'f496cff3-9936-4984-a43b-7a093455cea6'} Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f496cff3-9936-4984-a43b-7a093455cea6 Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 01 05:09:33.896310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f496cff3-9936-4984-a43b-7a093455cea6 could not be found. Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5fac9dc-b143-4616-be67-2ab16ec54aea tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Image not found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:09:33.902562 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5fac9dc-b143-4616-be67-2ab16ec54aea tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6" status: 404 len: 62 microversion: 2.1 time: 0.043354 Sep 01 05:09:33.909394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:33.909394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:33.912144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2000/4011] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 05:09:33 2022] GET /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:09:33.924830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:33.925335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:33.925954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:33.926837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:33.927307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:33.927733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:34.245780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:34.246391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:34.262770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:34.271470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:34.276416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:34.277446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:34.278081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:34.278668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:35.145917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:35.167718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:35.169299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:35.170539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d359e9f-7a48-428f-8f42-ed82bd632b98 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1319 microversion: 2.26 time: 0.928811 Sep 01 05:09:35.194522 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2001/4012] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:34 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1319 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:35.206698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:35.207868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:35.228029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:35.229911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:35.230697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:35.231893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:35.232882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:35.234017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:36.262867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:36.277718 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4431ac5-2d0c-40ed-a4df-f9242257ef80 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1534 microversion: 2.1 time: 2.372713 Sep 01 05:09:36.279281 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2012/4013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:33 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1534 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:36.289459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:36.289966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:36.295071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:36.307704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:36.310430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:36.311782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:36.316267 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9103e23d-7421-496c-8f2b-ea589f069338 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 1.120110 Sep 01 05:09:36.317476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:36.318331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:36.319620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:36.325231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2002/4014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:35 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:36.341279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd79d69e-fb85-4a24-80c9-dfd41619e9d1 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75ae4e670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:36.526229 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd79d69e-fb85-4a24-80c9-dfd41619e9d1 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4cd478ae-6368-474a-8e8f-9c31ea6f4edd" status: 200 len: 351 microversion: 2.1 time: 0.199711 Sep 01 05:09:36.526835 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2003/4015] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:09:36 2022] GET /compute/v2.1/os-volumes/4cd478ae-6368-474a-8e8f-9c31ea6f4edd => generated 351 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:36.533147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:36.534479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:36.557076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:36.558399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:36.558658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:36.559733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:36.560193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:36.560633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:37.102307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:37.112036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:37.116923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:37.119828 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b7aed76-d798-4d54-86a0-aeef29091c6c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.591828 Sep 01 05:09:37.142998 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2004/4016] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:36 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:37.156833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9dec961-acea-42da-a4a9-7f5d285abd48 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75aefea60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:37.179646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:37.196802 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a4c154a-d038-4325-8ec5-c851fbeda38d tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.911498 Sep 01 05:09:37.197497 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2013/4017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:36 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:37.271312 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9dec961-acea-42da-a4a9-7f5d285abd48 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.124988 Sep 01 05:09:37.272801 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2005/4018] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Sep 1 05:09:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:37.289417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd7aa06d-d8a9-4d84-bfe4-ac9e32164f46 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75b14d160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:37.312932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:37.314362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:37.323872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:37.324830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:37.325529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:37.326736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:37.327529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:37.328616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:37.498826 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd7aa06d-d8a9-4d84-bfe4-ac9e32164f46 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.215948 Sep 01 05:09:37.501186 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2014/4019] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 1 05:09:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:37.513650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:37.518173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:37.538457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:37.542153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:37.543559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:37.546658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:37.547833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:37.548587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:37.820030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:38.164962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:38.176636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9de6b736-922a-497f-af8f-037cdb2a9359 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1540 microversion: 2.1 time: 0.876708 Sep 01 05:09:38.178318 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2006/4020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:37 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1540 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:38.184201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d22d1b-8c05-4832-857e-8ddfb4b58a4b tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75aefec10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:38.258983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:38.273881 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6dd8493-c2f6-4ac4-8e79-f2985d3a624c tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.771452 Sep 01 05:09:38.276302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2015/4021] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:37 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:38.323959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:38.329129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:38.360575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:38.362581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:38.365640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:38.369339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:38.372266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:38.372631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:38.424791 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01d22d1b-8c05-4832-857e-8ddfb4b58a4b tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.244720 Sep 01 05:09:38.426146 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2007/4022] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Sep 1 05:09:38 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:38.434629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:38.435937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:38.454305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:38.457280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:38.459446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:38.461150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:38.465540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:38.466306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:38.987363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:39.011244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:39.028682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:39.030046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:39.031263 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca8fd31a-ec36-4c66-927e-9380bd354a27 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.753708 Sep 01 05:09:39.032253 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2016/4023] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:38 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:39.045750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-633d47cf-1341-404f-a1f1-2d894300bb93 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75b1fb430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:39.121628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:39.134107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5aaf045e-391f-4e6b-bc57-d598b83dd4a2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.706651 Sep 01 05:09:39.140155 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2008/4024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:38 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:39.204043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:39.204750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:39.217707 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-633d47cf-1341-404f-a1f1-2d894300bb93 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184009 Sep 01 05:09:39.226989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2017/4025] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 1 05:09:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:39.232966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af1788c8-563c-48f0-8edd-ff4960721dd5 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75b1ce280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:39.236475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:39.237158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:39.237600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:39.241392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:39.243837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:39.247828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:39.296634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:39.377794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af1788c8-563c-48f0-8edd-ff4960721dd5 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.148968 Sep 01 05:09:39.378814 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2018/4026] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 1 05:09:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:09:39.383737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:39.384351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:39.395629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:39.396270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:39.396782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:39.397615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:39.398121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:39.398613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:40.194693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:40.228462 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42865c7f-34ec-4c3c-89ee-e37919b4f1f2 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1535 microversion: 2.1 time: 1.028422 Sep 01 05:09:40.230091 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2009/4027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:39 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1535 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:40.247903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5822c21-9b60-4bf4-81e4-73b01f875888 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75af7a9d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:40.262223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:40.270974 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00f03dd7-cf12-4b45-8686-4c18ee42efdb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.890889 Sep 01 05:09:40.271561 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2019/4028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:39 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:40.285358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-83527a43-c9e6-4a9f-844c-edea6620b831 req-51fd125a-6adf-4c96-9d18-a7827361db80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9400a56b-da9b-4a04-a8d0-46c36b063f4f", "tag": "7f8917f9-fcef-4ad7-a46c-6afd2816e151"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:40.314073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-83527a43-c9e6-4a9f-844c-edea6620b831 req-51fd125a-6adf-4c96-9d18-a7827361db80 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:40.314557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-83527a43-c9e6-4a9f-844c-edea6620b831 req-51fd125a-6adf-4c96-9d18-a7827361db80 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:40.315013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-83527a43-c9e6-4a9f-844c-edea6620b831 req-51fd125a-6adf-4c96-9d18-a7827361db80 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:40.366247 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-83527a43-c9e6-4a9f-844c-edea6620b831 req-51fd125a-6adf-4c96-9d18-a7827361db80 service nova] Creating event network-changed:7f8917f9-fcef-4ad7-a46c-6afd2816e151 for instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f on n-h1-820368-37 Sep 01 05:09:40.377587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-83527a43-c9e6-4a9f-844c-edea6620b831 req-51fd125a-6adf-4c96-9d18-a7827361db80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096406 Sep 01 05:09:40.378224 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2020/4029] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:40.386850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:40.396781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:40.403888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:40.411715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:40.412459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:40.413372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:40.413994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:40.414572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:40.437985 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5822c21-9b60-4bf4-81e4-73b01f875888 tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.193801 Sep 01 05:09:40.439350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2010/4030] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 05:09:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:40.446373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:40.448457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:40.464343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:40.470173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:40.470918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:40.473453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:40.476322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:40.477150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:40.490780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:40.815419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:41.208903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:41.217538 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d862eb9-ce5f-4e59-89c9-a1d763d741d7 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.776846 Sep 01 05:09:41.218455 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2011/4031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:40 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:41.224016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4840d741-fa08-4456-8278-6d2c0d2cd00d tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75af7a8b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:41.256149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:41.272465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:41.274241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:41.275502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a073290a-8ad1-41cd-a3ba-11991b8b6706 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.895363 Sep 01 05:09:41.282972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2021/4032] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:40 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:41.287338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9a1186f9-1305-46e6-99f3-859c3fdaf8ab req-13f1a052-81d0-4828-b1aa-ab89556fe93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e236f6c-3e00-4700-acd1-e59a5c2ac9d7", "name": "network-vif-plugged", "status": "completed", "tag": "df348702-1bef-4335-a01e-e64879329394"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:41.306655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a1186f9-1305-46e6-99f3-859c3fdaf8ab req-13f1a052-81d0-4828-b1aa-ab89556fe93e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.307423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a1186f9-1305-46e6-99f3-859c3fdaf8ab req-13f1a052-81d0-4828-b1aa-ab89556fe93e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.308021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a1186f9-1305-46e6-99f3-859c3fdaf8ab req-13f1a052-81d0-4828-b1aa-ab89556fe93e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:41.334763 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9a1186f9-1305-46e6-99f3-859c3fdaf8ab req-13f1a052-81d0-4828-b1aa-ab89556fe93e service nova] Creating event network-vif-plugged:df348702-1bef-4335-a01e-e64879329394 for instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 on n-h2-820368-37 Sep 01 05:09:41.340677 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9a1186f9-1305-46e6-99f3-859c3fdaf8ab req-13f1a052-81d0-4828-b1aa-ab89556fe93e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062862 Sep 01 05:09:41.341528 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2022/4033] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:41.350257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:41.351026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:41.366345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.366848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.367338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:41.370329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.370812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.371443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:41.378326 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4840d741-fa08-4456-8278-6d2c0d2cd00d tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.158454 Sep 01 05:09:41.379231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2012/4034] 10.222.0.26 () {58 vars in 1188 bytes} [Thu Sep 1 05:09:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:41.384348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:41.385173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:41.395546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.396188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.396725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:41.397922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.398570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.399288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:41.858981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:41.867728 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5007ad7a-33f3-4a8c-b94a-197c207a3dad tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1522 microversion: 2.1 time: 0.522948 Sep 01 05:09:41.868335 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2023/4035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:41 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:41.873207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-761cf111-a0cb-472b-b508-6159331bc90b tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] Calling method '.version_select at 0x7fa75be91b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:41.912218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:41.927521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1da87bf-1a57-4834-9ab2-151dc6762a42 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.546735 Sep 01 05:09:41.934628 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2013/4036] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:41 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:41.950041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:41.951536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:41.959149 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-761cf111-a0cb-472b-b508-6159331bc90b tempest-VolumesTestJSON-1257303867 tempest-VolumesTestJSON-1257303867-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089540 Sep 01 05:09:41.960257 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2024/4037] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 05:09:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:41.978307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.978859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.979329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:41.980073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:41.980523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:41.981138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.035601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:09:42.171643 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-735c5bb6-0511-4aec-ae58-a4cedec4e55d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 204 len: 0 microversion: 2.1 time: 0.234313 Sep 01 05:09:42.172298 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2014/4038] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:09:41 2022] DELETE /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:09:42.181063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:42.181822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:42.189618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.190114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.190539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.191510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.192123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.192796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.242586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:42.243338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:42.254090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.266858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.267351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.268115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.268582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.269004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.547810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:42.557606 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8196d9b1-6075-4132-a644-57575bacbc0c tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1528 microversion: 2.1 time: 0.380325 Sep 01 05:09:42.558187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2025/4039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:42 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1528 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:42.580117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:42.580868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:42.589613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.590101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.590533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.591277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.591731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.598707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.612574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:42.626347 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c8e4aef-97ab-42d6-9d09-915fce52f901 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.388246 Sep 01 05:09:42.638914 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2015/4040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:42 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:42.645036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5011400-a2cb-4d80-83ad-87cb2c0684c3", "tag": "f5a9fb3b-ef45-43e7-835c-5885b17e514d"}, {"name": "network-changed", "server_uuid": "292e8717-308e-4382-8cf1-c7f82a895082", "tag": "fc97ad5f-5552-4eb3-baf7-b26b19fceacd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:42.672532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.672868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.673300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.706143 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] Creating event network-changed:f5a9fb3b-ef45-43e7-835c-5885b17e514d for instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 on n-h2-820368-37 Sep 01 05:09:42.709401 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] Creating event network-changed:fc97ad5f-5552-4eb3-baf7-b26b19fceacd for instance 292e8717-308e-4382-8cf1-c7f82a895082 on n-h2-820368-37 Sep 01 05:09:42.724244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d6db5ddf-d8f8-4eea-bf12-960618b77b94 req-488c7fee-4180-4cec-8420-c7f2edf1245b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088035 Sep 01 05:09:42.724859 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2016/4041] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:42.953725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:42.954755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:42.969971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.973436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.974218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:42.978450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:42.994699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:42.995357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:43.103851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:43.115673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:43.117868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:43.119338 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0066412d-c9ce-48a7-b355-f34e299d41ee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.552942 Sep 01 05:09:43.120124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2026/4042] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:42 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:43.277977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:43.288259 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb14337d-6dc4-4d18-9a6b-43ee2fd6798a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.339579 Sep 01 05:09:43.302301 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2017/4043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:42 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:43.359009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-37a7c9a0-bccb-41d4-b331-1dd02d220f59 req-41ef316f-821f-48fb-8c96-36b27f335d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e236f6c-3e00-4700-acd1-e59a5c2ac9d7", "name": "network-vif-unplugged", "status": "completed", "tag": "df348702-1bef-4335-a01e-e64879329394"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:43.376288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37a7c9a0-bccb-41d4-b331-1dd02d220f59 req-41ef316f-821f-48fb-8c96-36b27f335d8c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:43.376843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37a7c9a0-bccb-41d4-b331-1dd02d220f59 req-41ef316f-821f-48fb-8c96-36b27f335d8c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:43.384911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37a7c9a0-bccb-41d4-b331-1dd02d220f59 req-41ef316f-821f-48fb-8c96-36b27f335d8c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:43.413982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-37a7c9a0-bccb-41d4-b331-1dd02d220f59 req-41ef316f-821f-48fb-8c96-36b27f335d8c service nova] Creating event network-vif-unplugged:df348702-1bef-4335-a01e-e64879329394 for instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 on n-h2-820368-37 Sep 01 05:09:43.421939 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-37a7c9a0-bccb-41d4-b331-1dd02d220f59 req-41ef316f-821f-48fb-8c96-36b27f335d8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066596 Sep 01 05:09:43.422566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2027/4044] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:43.580622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:43.581953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:43.590411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:43.591430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:43.592033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:43.592903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:43.593538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:43.594256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:43.660779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:43.663269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:43.680788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:43.681556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:43.684082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:43.691466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:43.691795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:43.692239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:44.297107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:44.306082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-182fcbe4-8be5-4960-9d82-e81e422a2db1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1528 microversion: 2.1 time: 0.730805 Sep 01 05:09:44.315319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2018/4045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:43 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1528 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:44.327827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:44.329358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:44.338423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:44.339911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:44.340500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:44.341592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:44.342311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:44.344138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:44.401894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:44.413071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7555878e-48e2-4d11-b87f-54c89561684c tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.766984 Sep 01 05:09:44.413687 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2028/4046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:43 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:44.426419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:44.427399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:44.448710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:44.449816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:44.450281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:44.451379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:44.451863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:44.452299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:44.678796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:44.696895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:44.698465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:44.702681 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4cf8501-c150-43c3-8024-b96cefa69fdd tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.385920 Sep 01 05:09:44.703285 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2019/4047] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:44 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:44.710164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:44.714331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:44.720379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c17a890e-14e4-44ff-837b-84ff74226491 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.305656 Sep 01 05:09:44.721310 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2029/4048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:44 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:45.336438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:45.338418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:45.355210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.356039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.356658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.357613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.358827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.359569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.524818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:45.526392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:45.538003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.542296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.542750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.543534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.544155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.551835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.647138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:45.659304 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-940420a9-42ca-4e18-b258-9c1e8af5b93b tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1528 microversion: 2.1 time: 0.330899 Sep 01 05:09:45.674037 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2020/4049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:45 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1528 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:45.743793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:45.744823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:45.762780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.765345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.766811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:45.767938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.771102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.773020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.773711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.780781 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52060beb-225d-4537-b8d7-81049e8f62a4 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.260512 Sep 01 05:09:45.797045 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2030/4050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:45 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:45.805616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:45.806573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:45.815318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.816517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.817515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:45.818530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:45.819477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:45.820213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:46.118814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:46.133793 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc26e566-9401-4521-ba05-312cd4429eeb tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.335027 Sep 01 05:09:46.134513 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2031/4051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:45 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:46.197842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:46.207193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:46.211520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:46.212873 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5562bb7-91da-4bfa-8d38-605f6840a41e tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.485489 Sep 01 05:09:46.213771 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2021/4052] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:45 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:46.684120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:46.684753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:46.691850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:46.700060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:46.700453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:46.701886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:46.702374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:46.702812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:46.802771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:46.804179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:46.819984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:46.821144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:46.821984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:46.823301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:46.824066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:46.824780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:47.083923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:47.095298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ad144b8-2c4d-41af-9652-31769a640538 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1528 microversion: 2.1 time: 0.414845 Sep 01 05:09:47.098726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2032/4053] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:46 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:47.109888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2ea64881-e908-4263-a548-67ad8e3d1d9d req-58ccc7f7-8817-4214-aa1a-d30e65ce1ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5011400-a2cb-4d80-83ad-87cb2c0684c3", "name": "network-vif-plugged", "status": "completed", "tag": "f5a9fb3b-ef45-43e7-835c-5885b17e514d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:47.126753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ea64881-e908-4263-a548-67ad8e3d1d9d req-58ccc7f7-8817-4214-aa1a-d30e65ce1ef9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:47.127312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ea64881-e908-4263-a548-67ad8e3d1d9d req-58ccc7f7-8817-4214-aa1a-d30e65ce1ef9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:47.127705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ea64881-e908-4263-a548-67ad8e3d1d9d req-58ccc7f7-8817-4214-aa1a-d30e65ce1ef9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:47.155712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:47.175203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fae29c71-3e4b-4e9f-9a9c-f306125fd7fe tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.377201 Sep 01 05:09:47.194402 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2ea64881-e908-4263-a548-67ad8e3d1d9d req-58ccc7f7-8817-4214-aa1a-d30e65ce1ef9 service nova] Creating event network-vif-plugged:f5a9fb3b-ef45-43e7-835c-5885b17e514d for instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 on n-h2-820368-37 Sep 01 05:09:47.196836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2022/4054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:46 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:47.209946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:47.212040 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2ea64881-e908-4263-a548-67ad8e3d1d9d req-58ccc7f7-8817-4214-aa1a-d30e65ce1ef9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109243 Sep 01 05:09:47.212666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2033/4055] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:47.213810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:47.222136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:47.223656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:47.224286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:47.225168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:47.225779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:47.226356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:47.239980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:47.240944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:47.258411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:47.259292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:47.260080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:47.260994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:47.261946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:47.262608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:47.565205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:47.577347 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee0380e1-7d07-4fb7-8485-56e81a35ec22 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.379270 Sep 01 05:09:47.578461 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2023/4056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:47 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:47.602378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:47.612177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:47.614160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:47.615534 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f65f723-1c7d-4a5e-a65a-b8ce387550f4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.380381 Sep 01 05:09:47.616111 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2034/4057] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:47 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:48.123523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:48.125237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:48.138314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:48.138818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:48.139403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:48.140278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:48.140734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:48.141154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:48.205760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:48.207144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:48.216751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:48.217518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:48.218194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:48.219396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:48.220060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:48.220652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:48.748950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:48.767499 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c78f270e-cfac-4c83-90d9-0f7906f03416 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.561935 Sep 01 05:09:48.768839 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2035/4058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:48 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:48.790570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:48.791745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:48.811121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:48.812576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:48.817508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:48.819466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:48.824639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:48.827900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:48.951352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:48.972003 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b8d7fb0-877e-417a-af78-fe675214a91a tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1528 microversion: 2.1 time: 0.854383 Sep 01 05:09:48.972859 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2024/4059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:48 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1528 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:48.986319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:48.987486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:49.021820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:49.023977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:49.024559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:49.025321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:49.025840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:49.027144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:49.780668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:49.803642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:49.805802 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92dc234d-71df-4581-83bb-00ff0d82a736 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 1.035208 Sep 01 05:09:49.811031 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2036/4060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:48 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:49.830642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:49.832604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:49.833883 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ec02815-2141-4b64-84af-6886945f21a5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.856640 Sep 01 05:09:49.839082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9ead0107-e187-4c21-af51-9271e2c86f2e req-792c4b8e-2c1a-48ba-a585-9dbef9789e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9400a56b-da9b-4a04-a8d0-46c36b063f4f", "name": "network-vif-plugged", "status": "completed", "tag": "7f8917f9-fcef-4ad7-a46c-6afd2816e151"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:49.840397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2025/4061] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:48 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:49.876196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:49.882294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9ead0107-e187-4c21-af51-9271e2c86f2e req-792c4b8e-2c1a-48ba-a585-9dbef9789e00 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:49.886594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9ead0107-e187-4c21-af51-9271e2c86f2e req-792c4b8e-2c1a-48ba-a585-9dbef9789e00 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:49.887113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9ead0107-e187-4c21-af51-9271e2c86f2e req-792c4b8e-2c1a-48ba-a585-9dbef9789e00 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:49.910553 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9ead0107-e187-4c21-af51-9271e2c86f2e req-792c4b8e-2c1a-48ba-a585-9dbef9789e00 service nova] Creating event network-vif-plugged:7f8917f9-fcef-4ad7-a46c-6afd2816e151 for instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f on n-h1-820368-37 Sep 01 05:09:49.934451 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9ead0107-e187-4c21-af51-9271e2c86f2e req-792c4b8e-2c1a-48ba-a585-9dbef9789e00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121519 Sep 01 05:09:49.938303 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2037/4062] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:49.945027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:49.946007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:49.954650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:49.955385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:49.956478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:49.957684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:49.965558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:49.966035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.151465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b49c156e-8b50-4768-8142-c3f406a026de req-6b17f21c-a440-4e55-b8c3-db830d61ca45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e236f6c-3e00-4700-acd1-e59a5c2ac9d7", "name": "network-vif-deleted", "tag": "df348702-1bef-4335-a01e-e64879329394"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:50.184554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b49c156e-8b50-4768-8142-c3f406a026de req-6b17f21c-a440-4e55-b8c3-db830d61ca45 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.185336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b49c156e-8b50-4768-8142-c3f406a026de req-6b17f21c-a440-4e55-b8c3-db830d61ca45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.186994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b49c156e-8b50-4768-8142-c3f406a026de req-6b17f21c-a440-4e55-b8c3-db830d61ca45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.233906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b49c156e-8b50-4768-8142-c3f406a026de req-6b17f21c-a440-4e55-b8c3-db830d61ca45 service nova] Creating event network-vif-deleted:df348702-1bef-4335-a01e-e64879329394 for instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 on n-h2-820368-37 Sep 01 05:09:50.240999 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b49c156e-8b50-4768-8142-c3f406a026de req-6b17f21c-a440-4e55-b8c3-db830d61ca45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399024 Sep 01 05:09:50.242087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2026/4063] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:50.247963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:50.248907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:50.255947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:50.258313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.259128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.260601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.261057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.261637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.262208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.301063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:50.310232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56e0b4e6-983e-4a56-8925-83b386675aed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1313 microversion: 2.1 time: 0.370490 Sep 01 05:09:50.314322 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2038/4064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:49 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:50.365386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:50.369489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:50.378548 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57b7cf5c-1cfe-4163-9785-15b60066ee37 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1486 microversion: 2.1 time: 0.135130 Sep 01 05:09:50.380732 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2027/4065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:50 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1486 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:50.842569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:50.843803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:50.869283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:50.869954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:50.872561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.874542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.878286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.881687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.888166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.888948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.891917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.892420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.892912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:50.893566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:50.894109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:50.894542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.335178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:51.354384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:51.368130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:51.374273 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5b431ff-7684-4607-acb6-e955793f7277 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.506985 Sep 01 05:09:51.376245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2028/4066] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:50 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:09:51.404104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:51.404877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:51.429145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.431559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.432275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.435271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.436016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.437803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.448894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:51.462640 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86e9dcf0-122e-46cf-9460-d772930cc7c3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1317 microversion: 2.1 time: 0.636594 Sep 01 05:09:51.463284 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2039/4067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:50 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:51.470846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:51.474477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:51.487726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.488440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.491195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.492200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.492839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.493649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.562998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.575770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.576503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.577174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lazy-loading 'fault' on Instance uuid 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:51.676188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:51.688202 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ef30215-ac26-49d4-ab0b-fff368bb6ffb tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 200 len: 1315 microversion: 2.1 time: 0.223433 Sep 01 05:09:51.703940 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2040/4068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:51 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:51.837529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:51.855116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ffe46a2-3f9f-4e09-8957-347f953ef30a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1500 microversion: 2.1 time: 0.472043 Sep 01 05:09:51.856057 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2029/4069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:51 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1500 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:51.878248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:51.880887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:51.892407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.893159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.893744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.894745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.895460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.896063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:51.954084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7e8e699e-d6b0-4912-b928-c7b51f937508 req-a517d956-cca8-49c4-b6a6-de16f639d2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292e8717-308e-4382-8cf1-c7f82a895082", "name": "network-vif-plugged", "status": "completed", "tag": "fc97ad5f-5552-4eb3-baf7-b26b19fceacd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:51.956268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lazy-loading 'flavor' on Instance uuid b5011400-a2cb-4d80-83ad-87cb2c0684c3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:51.975295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7e8e699e-d6b0-4912-b928-c7b51f937508 req-a517d956-cca8-49c4-b6a6-de16f639d2e5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:51.975783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7e8e699e-d6b0-4912-b928-c7b51f937508 req-a517d956-cca8-49c4-b6a6-de16f639d2e5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:51.976218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7e8e699e-d6b0-4912-b928-c7b51f937508 req-a517d956-cca8-49c4-b6a6-de16f639d2e5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.010190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7e8e699e-d6b0-4912-b928-c7b51f937508 req-a517d956-cca8-49c4-b6a6-de16f639d2e5 service nova] Creating event network-vif-plugged:fc97ad5f-5552-4eb3-baf7-b26b19fceacd for instance 292e8717-308e-4382-8cf1-c7f82a895082 on n-h2-820368-37 Sep 01 05:09:52.030850 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7e8e699e-d6b0-4912-b928-c7b51f937508 req-a517d956-cca8-49c4-b6a6-de16f639d2e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081702 Sep 01 05:09:52.031631 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2030/4070] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:09:52.169082 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-020abd38-4a8c-4cab-8efa-0d65d7b4e60e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "POST /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3/action" status: 200 len: 32 microversion: 2.1 time: 0.293435 Sep 01 05:09:52.169738 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2041/4071] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:09:51 2022] POST /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:09:52.188890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:52.190257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:52.216812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.220820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.228787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.232546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.233668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.235270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.421090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:52.423212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:52.440344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.440878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.441420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.442155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.442615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.443064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.628189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:52.640855 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4fb58e9-86d1-4240-a27e-34a0c1b00b5f tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.465031 Sep 01 05:09:52.657983 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2031/4072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:52 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:52.663430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:52.664050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:52.672073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.672562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.672994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.673749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.674200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.674616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.690145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:52.708604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:52.710064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:52.711278 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4fa2127-b2a3-495d-94c6-0a77963af119 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1361 microversion: 2.26 time: 0.295108 Sep 01 05:09:52.711850 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2042/4073] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:52 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:52.720836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:52.721445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:52.738687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.739198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.739633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.740332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:52.740778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:52.741194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:52.763143 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 HTTP/1.1 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e236f6c-3e00-4700-acd1-e59a5c2ac9d7'} Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:09:52.764801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:09:52.769631 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75f613e4-9eee-4214-84e2-7fb158dca36f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 404 len: 111 microversion: 2.1 time: 0.053407 Sep 01 05:09:52.776460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2043/4074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:52 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:09:52.943596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1777141483", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:52.962620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:52.972828 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dff3f4ad-10af-4b9c-a1f0-6d7680ce0eb3 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1507 microversion: 2.1 time: 0.313906 Sep 01 05:09:52.975485 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2032/4075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:52 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:53.002533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:53.003776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:53.015773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:53.017178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:53.020969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:53.021947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:53.022765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:53.042094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:53.044287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] validate_networks() for [('63ad42ce-ca8d-4f08-993f-e98e03c5e312', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:09:53.107614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:53.109016 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cd3c530-6f51-47cb-8381-88a3e8165535 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f/os-instance-actions/req-ba69d572-bc06-4d4d-85bf-12e5b9d47066" status: 200 len: 313 microversion: 2.1 time: 0.110949 Sep 01 05:09:53.110395 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2033/4076] 10.222.0.26 () {58 vars in 1419 bytes} [Thu Sep 1 05:09:52 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f/os-instance-actions/req-ba69d572-bc06-4d4d-85bf-12e5b9d47066 => generated 313 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:09:53.126573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:53.129599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:53.137681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:53.138454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:53.139015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:53.140112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:53.140664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:53.141182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:53.321665 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3c0a58b-3fcd-430e-a035-b23ccbaf1186 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "POST /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f/action" status: 202 len: 0 microversion: 2.1 time: 0.183309 Sep 01 05:09:53.322757 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2034/4077] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:09:53 2022] POST /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:09:53.335171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:53.336022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:53.362606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:53.363324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:53.363779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:53.378114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:53.379042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:53.381767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:54.208583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:54.221944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-365e9825-0f1d-4c93-81e6-0df4a488693a tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1509 microversion: 2.1 time: 0.891906 Sep 01 05:09:54.225308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2035/4078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:53 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1509 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:54.242794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:54.243894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:54.255514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:54.257603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:54.259875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:54.265836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:54.266590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:54.267407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.283149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:09:55.283705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:09:55.284043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:09:55.284445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:09:55.284933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:09:55.303695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.304196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.304634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.305391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.305848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.315394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.356828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for project cc9dddd7fe5040a68d289bade73e0232. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:09:55.374910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Getting quotas for user 512e22d177264c46982afa469c3446da and project cc9dddd7fe5040a68d289bade73e0232. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:09:55.390545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:09:55.393229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:09:55.450325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:55.464615 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9a6e908-1d47-4231-8705-79e396e90258 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.237852 Sep 01 05:09:55.466117 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2036/4079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:54 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:55.472927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:55.474065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:55.482389 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dca71c67-9869-4e83-b3fe-71e5782a1b6f tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.543557 Sep 01 05:09:55.483613 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2044/4080] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:09:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:09:55.492705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.495832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:55.496585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.498192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.499377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.500478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:55.501224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.503629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.517879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.518721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.522327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.529798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.529798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.529798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.810335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:55.822378 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bc92b38-c1e9-48dc-97d9-574fe8402539 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1509 microversion: 2.1 time: 0.337548 Sep 01 05:09:55.838277 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2045/4081] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:55 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:55.843840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76bc3863-d206-4518-93ee-0dadca0380a7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:55.844649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76bc3863-d206-4518-93ee-0dadca0380a7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:55.892929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:55.909941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:55.917844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:55.919162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ff36f19-26a5-411b-a7e2-c602f2b96924 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1546 microversion: 2.26 time: 0.451713 Sep 01 05:09:55.919744 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2037/4082] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:55 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1546 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:55.959451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75ae5ec10>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:55.989351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76bc3863-d206-4518-93ee-0dadca0380a7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:55.996311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:55.996902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:55.997452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:55.998077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.005462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.006219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.007573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.008641 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76bc3863-d206-4518-93ee-0dadca0380a7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1225 microversion: 2.1 time: 0.168921 Sep 01 05:09:56.010829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.011299 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2046/4083] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:55 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1225 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:56.012325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.012974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.071152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.071981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.072687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.088321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.090742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.091377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.162343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:56.204678 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4d48969-e0a4-4ad0-812b-75d8948e35a9 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1584223379" status: 201 len: 0 microversion: 2.26 time: 0.261018 Sep 01 05:09:56.211594 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2038/4084] 10.222.0.26 () {62 vars in 1380 bytes} [Thu Sep 1 05:09:55 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1584223379 => generated 0 bytes in 270 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 01 05:09:56.217081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-473452e4-c530-4c73-a2bc-b944284b4ec4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b17c3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.233928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-473452e4-c530-4c73-a2bc-b944284b4ec4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.234447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-473452e4-c530-4c73-a2bc-b944284b4ec4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.234930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-473452e4-c530-4c73-a2bc-b944284b4ec4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.281073 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-473452e4-c530-4c73-a2bc-b944284b4ec4 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1584223379" status: 204 len: 0 microversion: 2.26 time: 0.067658 Sep 01 05:09:56.282111 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2047/4085] 10.222.0.26 () {60 vars in 1361 bytes} [Thu Sep 1 05:09:56 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1584223379 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 05:09:56.292467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75ae5e820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.304333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.305050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.305738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.307108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.314690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.315597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.316466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.318251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.319306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.320042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.364328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.365141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.365826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.385956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:56.411131 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2cd687ce-5328-4d46-a575-a3585e61d95b tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 204 len: 0 microversion: 2.26 time: 0.123273 Sep 01 05:09:56.412471 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2039/4086] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Sep 1 05:09:56 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:56.423539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02415ce8-3341-4d47-aeed-ec4dacb7f811 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b253c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.433905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02415ce8-3341-4d47-aeed-ec4dacb7f811 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.434651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02415ce8-3341-4d47-aeed-ec4dacb7f811 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.435111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02415ce8-3341-4d47-aeed-ec4dacb7f811 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.445529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:56.448973 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02415ce8-3341-4d47-aeed-ec4dacb7f811 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 200 len: 12 microversion: 2.26 time: 0.030889 Sep 01 05:09:56.449739 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2048/4087] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 05:09:56 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 12 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:56.462208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75aea08b0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.476697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.477672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.478342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.479080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.487762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.488604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.489645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.490552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.491181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.491566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.491795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.492265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.507766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.508100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.508822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.509695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.510298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.510872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.571448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.573207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.573674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.597252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.597937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.598429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.626966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:56.663790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:56.690710 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7eed8d82-1b54-4f19-8cd3-d94d3197a6c2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1513519413" status: 201 len: 0 microversion: 2.26 time: 0.233530 Sep 01 05:09:56.691681 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2040/4088] 10.222.0.26 () {62 vars in 1380 bytes} [Thu Sep 1 05:09:56 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1513519413 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 01 05:09:56.709597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12e44b5a-4cb4-4908-9c6e-6fe3893467bc tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75ae5e940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.719166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12e44b5a-4cb4-4908-9c6e-6fe3893467bc tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.719574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12e44b5a-4cb4-4908-9c6e-6fe3893467bc tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.720008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12e44b5a-4cb4-4908-9c6e-6fe3893467bc tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.732313 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12e44b5a-4cb4-4908-9c6e-6fe3893467bc tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 200 len: 36 microversion: 2.26 time: 0.031551 Sep 01 05:09:56.736420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2041/4089] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 05:09:56 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 36 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:56.749034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa760208e50>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.759889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.760573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.761135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.761840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.767969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.768342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.768772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.769687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.770357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.770731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.780980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:56.793705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-894e6fff-8e2b-4233-a800-0802caa0cdca tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.307725 Sep 01 05:09:56.802108 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2049/4090] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:56 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:56.813182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.813628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.814108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.844651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.845266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.854252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:56.857837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.858364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.858869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.859515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.859967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.860383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.894505 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6886e8e3-51c7-4e78-8d97-92e6c57644f1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1513519413" status: 204 len: 0 microversion: 2.26 time: 0.152102 Sep 01 05:09:56.895815 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2042/4091] 10.222.0.26 () {60 vars in 1364 bytes} [Thu Sep 1 05:09:56 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1513519413 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:56.905287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a906820-e587-4a41-a4f9-83d02a8c6535 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b7bddc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.917963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a906820-e587-4a41-a4f9-83d02a8c6535 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.918775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a906820-e587-4a41-a4f9-83d02a8c6535 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.919712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a906820-e587-4a41-a4f9-83d02a8c6535 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.933353 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a906820-e587-4a41-a4f9-83d02a8c6535 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 200 len: 12 microversion: 2.26 time: 0.033065 Sep 01 05:09:56.934580 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2043/4092] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 05:09:56 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:56.951664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b6f5b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:56.962328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.963069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.963597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.964202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:56.970983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.971565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.972123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:56.972958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:56.973479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:56.973967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.023556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.024258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.024781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.037914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:57.074216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54d27e37-5183-4745-bf85-ed17fb6a8ff7 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 204 len: 0 microversion: 2.26 time: 0.131814 Sep 01 05:09:57.076101 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2044/4093] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Sep 1 05:09:56 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:57.090842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.092173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.106915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.109007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.110526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.111804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.114130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.115105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.119547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:57.132400 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2e49fd2-fa7a-44e5-b242-fc058346189e tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1507 microversion: 2.1 time: 0.291526 Sep 01 05:09:57.147350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2050/4094] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:56 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:57.154684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b253c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.170797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.171543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.172169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.172793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.180900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.182295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.183058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.184253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.184855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.185455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.218797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.220425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.221026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.231915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.232781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.233449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.270610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:57.278858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:57.280045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83fe8379-b928-4efd-beac-9ebb1c8fe70d tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1221 microversion: 2.1 time: 0.201742 Sep 01 05:09:57.284887 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2045/4095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:57 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1221 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:57.296131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '.version_select at 0x7fa75b6f5550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.296971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.317499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.317499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.317806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.318317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.322044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.322501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.323279 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c2f537e-3721-4872-87c3-46e4fce1b879 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-58364764" status: 201 len: 0 microversion: 2.26 time: 0.172338 Sep 01 05:09:57.325603 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2051/4096] 10.222.0.26 () {62 vars in 1374 bytes} [Thu Sep 1 05:09:57 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-58364764 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Sep 01 05:09:57.343533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b13dc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.369973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.370462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.370974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.371640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.397240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.399926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.401531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.402562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.403214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.403925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.406101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2a395fe-b457-4544-9d32-4c48c79fda8d tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.119745 Sep 01 05:09:57.406749 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2046/4097] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Sep 1 05:09:57 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:09:57.421231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.426333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.439544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.440626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.441376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.444166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.446846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.447343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.448078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.448538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.448959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.454026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.454875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.455488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.484598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:57.500545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:09:57.524762 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9aa42236-6999-4c11-b287-535c3919470c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1722294116" status: 201 len: 0 microversion: 2.26 time: 0.194089 Sep 01 05:09:57.526934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2052/4098] 10.222.0.26 () {62 vars in 1380 bytes} [Thu Sep 1 05:09:57 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-1722294116 => generated 0 bytes in 197 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 01 05:09:57.564207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b1ce9d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.628108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.632928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.648279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.652215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.654981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-408f9f9c-323f-4aad-ab11-03e67ca5dd67 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 204 len: 0 microversion: 2.1 time: 0.236966 Sep 01 05:09:57.661717 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2047/4099] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:09:57 2022] DELETE /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:09:57.673478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.673974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.679988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.680134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.680720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.680873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.682185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.682623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.700463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.701208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.704147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.704981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.705492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.705932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.710456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.711308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.712249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.744828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:57.768614 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6200cba-e9d9-42be-8920-e64cd67436be tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 204 len: 0 microversion: 2.26 time: 0.235673 Sep 01 05:09:57.769809 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2053/4100] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Sep 1 05:09:57 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:57.779112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14600e14-abb8-4055-88c2-f4262df0f6bf tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b2535e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.794743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14600e14-abb8-4055-88c2-f4262df0f6bf tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.795420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14600e14-abb8-4055-88c2-f4262df0f6bf tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.795982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14600e14-abb8-4055-88c2-f4262df0f6bf tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.808747 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14600e14-abb8-4055-88c2-f4262df0f6bf tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 200 len: 12 microversion: 2.26 time: 0.034365 Sep 01 05:09:57.816127 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2054/4101] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 05:09:57 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:09:57.822650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.824317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.833653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.834650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.835662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.837618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.838297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.838928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.914435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:57.927880 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2106f54f-4d4c-4a81-88d7-b160e77372d2 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1513 microversion: 2.1 time: 0.257694 Sep 01 05:09:57.931445 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2048/4102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:57 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:57.940592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b6f50d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:57.950074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.950699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.951267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.951949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:57.959465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.960097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.961105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:57.961429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:57.971511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:57.971511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.014799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.015496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.023745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.052133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:58.072932 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fbf3feb-4993-4c29-8d99-992c044dcf88 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 204 len: 0 microversion: 2.26 time: 0.139275 Sep 01 05:09:58.073899 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2049/4103] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Sep 1 05:09:57 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:58.099078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75af7a940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.115929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:58.116230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.116866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.117711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.118553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.126031 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7311be13-fe02-48fb-aa42-447345146002 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.306706 Sep 01 05:09:58.127122 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2055/4104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:57 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:58.135507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.136098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.136788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.137624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.139125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.140275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.177982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.178538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.179091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.199235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.199235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.200282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.249030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:58.271911 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15266bb1-110e-4097-b037-b9e054148aee tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-989547843" status: 201 len: 0 microversion: 2.26 time: 0.192232 Sep 01 05:09:58.278223 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2050/4105] 10.222.0.26 () {62 vars in 1377 bytes} [Thu Sep 1 05:09:58 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-989547843 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 01 05:09:58.285301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b124e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.298245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.299022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.300145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.300811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.311529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.312269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.312892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.313999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.314631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.315285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.324408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.325057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.333686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.334314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.334756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.335683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.336357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.337118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.360757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.361423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.361967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.375164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.375763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.376445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.417677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:58.419042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:58.436730 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecc4d28b-35df-42c7-820d-abec49dd3230 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1277 microversion: 2.1 time: 0.125484 Sep 01 05:09:58.437607 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2051/4106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:58 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:58.440694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61aa3ef2-3a5e-430e-a6dd-617482ead25f tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-582131814" status: 201 len: 0 microversion: 2.26 time: 0.161594 Sep 01 05:09:58.441655 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2056/4107] 10.222.0.26 () {62 vars in 1377 bytes} [Thu Sep 1 05:09:58 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags/tempest-tag-582131814 => generated 0 bytes in 163 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 01 05:09:58.453419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Action: 'update_all', calling method: .version_select at 0x7fa75aec6ee0>, body: {"tags": ["tempest-tag-1803244556", "tempest-tag-1120007678"]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:09:58.469516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.470314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.470833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.471506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.478868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.479629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.480161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.481041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.481682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.482204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.487361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:58.509837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.510478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.511004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.536994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:58.556714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7815d16-bf9f-4dde-a30e-42e513e0fdb1 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 200 len: 62 microversion: 2.26 time: 0.108196 Sep 01 05:09:58.562941 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2052/4108] 10.222.0.26 () {62 vars in 1312 bytes} [Thu Sep 1 05:09:58 2022] PUT /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 62 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:58.568722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d9663c2-4a34-44fb-bdd1-399551a0597c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75b2535e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.578682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d9663c2-4a34-44fb-bdd1-399551a0597c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.579591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d9663c2-4a34-44fb-bdd1-399551a0597c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.580660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d9663c2-4a34-44fb-bdd1-399551a0597c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.593549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d9663c2-4a34-44fb-bdd1-399551a0597c tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 200 len: 62 microversion: 2.26 time: 0.029538 Sep 01 05:09:58.594923 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2057/4109] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 1 05:09:58 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 62 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:58.609991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '.version_select at 0x7fa75ae5e550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.620743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.621233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.621670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.622153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.630240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.630726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.631187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.631892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.632346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.632770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.658929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.659411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.660114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.679740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lazy-loading 'flavor' on Instance uuid 292e8717-308e-4382-8cf1-c7f82a895082 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:09:58.703946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45c7c0ac-84dd-4f49-a2fe-2f2bbe761ab2 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags" status: 204 len: 0 microversion: 2.26 time: 0.099183 Sep 01 05:09:58.704990 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2053/4110] 10.222.0.26 () {60 vars in 1295 bytes} [Thu Sep 1 05:09:58 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:58.715624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.716265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.723879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.724379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.724817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.725525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.725991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.726407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.759757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:09:58.828003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:58.879999 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ca75078-5a21-415f-a9af-f855a0d1bb28 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 204 len: 0 microversion: 2.26 time: 0.167660 Sep 01 05:09:58.881007 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2058/4111] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:09:58 2022] DELETE /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:09:58.889742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.890361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.899371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.901071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.901974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.906471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.906471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.908053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.955333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:58.956609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:58.969940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.970743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.971530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:58.972476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:58.973188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:58.974158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:59.198589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:59.231120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:59.237871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:59.245233 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67ceb40d-a428-40f0-9918-4199728f41b5 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1552 microversion: 2.26 time: 0.358817 Sep 01 05:09:59.248284 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2054/4112] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:09:58 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1552 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:09:59.274228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:59.278597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:59.303440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:59.304663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:59.305102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:59.310856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:59.311501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:59.312268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:59.384721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:59.393634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37dbe9a6-48ec-4735-a9d2-ac50cffb1b08 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1513 microversion: 2.1 time: 0.445154 Sep 01 05:09:59.399762 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2059/4113] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:58 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:59.458274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:09:59.459161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:09:59.469377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:59.469880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:59.471336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:59.472140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:09:59.472611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:09:59.473049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:09:59.626910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:59.648732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:09:59.649279 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4112638f-356a-4da8-9c6c-d0d7ba2c78b7 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1295 microversion: 2.1 time: 0.193508 Sep 01 05:09:59.663012 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2060/4114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:59 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1295 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:09:59.664028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec81cb66-b3c0-471e-89e9-890287145428 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.411993 Sep 01 05:09:59.664668 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2055/4115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:09:59 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:00.278577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:00.279057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:00.291338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.292076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.295131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.295906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.296941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.296941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.310476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9b134b28-cb24-4b41-a29d-88cf4457f1c6 req-a4b7aabc-ac7c-4343-8af5-258011a2e6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9400a56b-da9b-4a04-a8d0-46c36b063f4f", "name": "network-vif-deleted", "tag": "7f8917f9-fcef-4ad7-a46c-6afd2816e151"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:00.332930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b134b28-cb24-4b41-a29d-88cf4457f1c6 req-a4b7aabc-ac7c-4343-8af5-258011a2e6bd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.333409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b134b28-cb24-4b41-a29d-88cf4457f1c6 req-a4b7aabc-ac7c-4343-8af5-258011a2e6bd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.352306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b134b28-cb24-4b41-a29d-88cf4457f1c6 req-a4b7aabc-ac7c-4343-8af5-258011a2e6bd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.407510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9b134b28-cb24-4b41-a29d-88cf4457f1c6 req-a4b7aabc-ac7c-4343-8af5-258011a2e6bd service nova] Creating event network-vif-deleted:7f8917f9-fcef-4ad7-a46c-6afd2816e151 for instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f on n-h1-820368-37 Sep 01 05:10:00.423652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9b134b28-cb24-4b41-a29d-88cf4457f1c6 req-a4b7aabc-ac7c-4343-8af5-258011a2e6bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114546 Sep 01 05:10:00.424992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2056/4116] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:00.437787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:00.440602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:00.475427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.478601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.480080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.481000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.481509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.481942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.589626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.591256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.594602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.595212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lazy-loading 'fault' on Instance uuid 9400a56b-da9b-4a04-a8d0-46c36b063f4f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:10:00.705269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26551f9bbbfd48d2b9998099e90310e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '232ef7bca1ca4a64847ca86ccc484b29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:00.709518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:00.727059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:00.727946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f565ee54-3522-4c1b-b00f-7f0346d290bc tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 200 len: 1307 microversion: 2.1 time: 0.301293 Sep 01 05:10:00.728549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2057/4117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:00 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:00.732592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:00.734431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d92692b-b8b2-4b19-a9da-47c2b262fe63 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1552 microversion: 2.26 time: 0.464597 Sep 01 05:10:00.735261 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2061/4118] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:10:00 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1552 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:10:00.738405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:00.739378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:00.758112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.760567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.761098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.762073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.763949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.764133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:00.765010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:00.765428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.803447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.809445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.810559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:00.812363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:00.813112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:00.817929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:01.237953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:01.261962 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccba5d6b-5821-4812-9dea-edbf21d9b7b0 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1283 microversion: 2.1 time: 0.531882 Sep 01 05:10:01.262498 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2058/4119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:00 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1283 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:01.475633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:01.485296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef95157e-a644-46e7-a1f4-fffa6e93cd65 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.747890 Sep 01 05:10:01.502341 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2062/4120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:00 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:01.776609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:01.778041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] [instance: 9400a56b-da9b-4a04-a8d0-46c36b063f4f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:01.781018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:01.782588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:01.800526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:01.802680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:01.803657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:01.805508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:01.807010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:01.807228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:01.808552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:01.810982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:01.813622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:01.819681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:01.822503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:01.823746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:01.937502 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] HTTP exception thrown: Instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f could not be found. Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Request method failure captured: Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f HTTP/1.1 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED6G4hCqpn1osDL7tknMoHa8NSuJmNioKOxJpUK46qWYPgAhd7XA1xRFyZ39BoaTM0q0YPSlLnkZz1JzohQNP1qkecfTI2gX7EvyS7XqSHS3Eu6vaBrfuu1Y8zGlNOw0iwFkRb7N7J_GqLPQkg1zw2dXStE1NagLV9tBFN9OIK-lOAc Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 232ef7bca1ca4a64847ca86ccc484b29 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceActionsTestJSON-1715223566 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/232ef7bca1ca4a64847ca86ccc484b29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/232ef7bca1ca4a64847ca86ccc484b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_232ef7bca1ca4a64847ca86ccc484b29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/232ef7bca1ca4a64847ca86ccc484b29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceActionsTestJSON-1715223566 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 232ef7bca1ca4a64847ca86ccc484b29 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1715223566 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceActionsTestJSON-1715223566-project Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 26551f9bbbfd48d2b9998099e90310e5 Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceActionsTestJSON-1715223566-project Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f could not be found. Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9400a56b-da9b-4a04-a8d0-46c36b063f4f'} Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f could not be found. Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f could not be found. Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:01.939334 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f could not be found. Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] Returning 404 to user: Instance 9400a56b-da9b-4a04-a8d0-46c36b063f4f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fec6a5c9-a042-44df-b21d-296983a75250 tempest-InstanceActionsTestJSON-1715223566 tempest-InstanceActionsTestJSON-1715223566-project] 10.222.0.26 "GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f" status: 404 len: 111 microversion: 2.1 time: 0.169516 Sep 01 05:10:01.944123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2059/4121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:01 2022] GET /compute/v2.1/servers/9400a56b-da9b-4a04-a8d0-46c36b063f4f => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:02.105812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:02.129564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:02.131378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f51cc3a3ad04ef9bdcbef6b05446a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8407d45fd3441ca29dd0ad5b76fbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:02.132808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35b89ac1-88e7-4b23-8525-bda4eafa86c8 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 200 len: 1510 microversion: 2.26 time: 0.360867 Sep 01 05:10:02.133898 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2063/4122] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:10:01 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:10:02.284264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:02.284906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:02.297389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:02.298142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:02.298708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:02.299781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:02.300004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:02.311500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:02.504241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f3a8177b-fe5e-4f1e-8fc5-9296e190e47a req-29e81585-9a19-414d-bea0-726f935a21cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292e8717-308e-4382-8cf1-c7f82a895082", "name": "network-vif-deleted", "tag": "fc97ad5f-5552-4eb3-baf7-b26b19fceacd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:02.524438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3a8177b-fe5e-4f1e-8fc5-9296e190e47a req-29e81585-9a19-414d-bea0-726f935a21cf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:02.525291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3a8177b-fe5e-4f1e-8fc5-9296e190e47a req-29e81585-9a19-414d-bea0-726f935a21cf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:02.525905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3a8177b-fe5e-4f1e-8fc5-9296e190e47a req-29e81585-9a19-414d-bea0-726f935a21cf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:02.554129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f3a8177b-fe5e-4f1e-8fc5-9296e190e47a req-29e81585-9a19-414d-bea0-726f935a21cf service nova] Creating event network-vif-deleted:fc97ad5f-5552-4eb3-baf7-b26b19fceacd for instance 292e8717-308e-4382-8cf1-c7f82a895082 on n-h2-820368-37 Sep 01 05:10:02.570499 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f3a8177b-fe5e-4f1e-8fc5-9296e190e47a req-29e81585-9a19-414d-bea0-726f935a21cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070292 Sep 01 05:10:02.571685 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2064/4123] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:10:02.576838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:02.582188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:02.594683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:02.600101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:02.600902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:02.601877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:02.602508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:02.603145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:03.242016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:03.267696 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae2f9ca2-bb88-41e2-b686-f57bbf797aba tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 0.987290 Sep 01 05:10:03.269999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2060/4124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:02 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:03.279822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:03.281085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] [instance: 292e8717-308e-4382-8cf1-c7f82a895082] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:03.293224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:03.294389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:03.295445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:03.296943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:03.297999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:03.299303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:03.328933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] HTTP exception thrown: Instance 292e8717-308e-4382-8cf1-c7f82a895082 could not be found. Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Request method failure captured: Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 HTTP/1.1 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED51P8Qf7UuSSR9wfmPRANiyFzKIjD8kcybWAdGWy3LPrnGZpeWLKUhiCqnITD-m9At_PJTl1zZciZ3vnIUUgS5t6ILspXb6J356_3ZkBEEYRIqfzEAGiRFMdgX4hEJXEueTYda_s3zhO32nM1NP7drCYwLEIVZRr-RN5BPKUxhFxTM Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.26 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 3d8407d45fd3441ca29dd0ad5b76fbc2 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerTagsTestJSON-1849409989 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d8407d45fd3441ca29dd0ad5b76fbc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3d8407d45fd3441ca29dd0ad5b76fbc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3d8407d45fd3441ca29dd0ad5b76fbc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3d8407d45fd3441ca29dd0ad5b76fbc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerTagsTestJSON-1849409989 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 3d8407d45fd3441ca29dd0ad5b76fbc2 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerTagsTestJSON-1849409989 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerTagsTestJSON-1849409989-project Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2f51cc3a3ad04ef9bdcbef6b05446a60 Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerTagsTestJSON-1849409989-project Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 292e8717-308e-4382-8cf1-c7f82a895082 could not be found. Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '292e8717-308e-4382-8cf1-c7f82a895082'} Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292e8717-308e-4382-8cf1-c7f82a895082 could not be found. Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292e8717-308e-4382-8cf1-c7f82a895082 could not be found. Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:03.332910 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292e8717-308e-4382-8cf1-c7f82a895082 could not be found. Sep 01 05:10:03.341462 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:03.352075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] Returning 404 to user: Instance 292e8717-308e-4382-8cf1-c7f82a895082 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:03.352075 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-267760de-1975-49bd-a7f0-13cc00c5fc39 tempest-ServerTagsTestJSON-1849409989 tempest-ServerTagsTestJSON-1849409989-project] 10.222.0.26 "GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082" status: 404 len: 111 microversion: 2.26 time: 0.073328 Sep 01 05:10:03.352851 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2061/4125] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:10:03 2022] GET /compute/v2.1/servers/292e8717-308e-4382-8cf1-c7f82a895082 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:10:03.361582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8d302a92-e7ae-4a95-8736-56a164008ae8 req-4425e596-ad01-4e07-957c-b6c9ecfe1a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac37edc0-8d1a-4d1b-ada5-305b30b38408", "tag": "28dcbb7d-77fa-4ed4-8b66-88eb8fd2d20d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:03.386391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8d302a92-e7ae-4a95-8736-56a164008ae8 req-4425e596-ad01-4e07-957c-b6c9ecfe1a8a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:03.390396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8d302a92-e7ae-4a95-8736-56a164008ae8 req-4425e596-ad01-4e07-957c-b6c9ecfe1a8a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:03.394562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8d302a92-e7ae-4a95-8736-56a164008ae8 req-4425e596-ad01-4e07-957c-b6c9ecfe1a8a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:03.419595 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8d302a92-e7ae-4a95-8736-56a164008ae8 req-4425e596-ad01-4e07-957c-b6c9ecfe1a8a service nova] Creating event network-changed:28dcbb7d-77fa-4ed4-8b66-88eb8fd2d20d for instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 on n-h1-820368-37 Sep 01 05:10:03.427160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8d302a92-e7ae-4a95-8736-56a164008ae8 req-4425e596-ad01-4e07-957c-b6c9ecfe1a8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071525 Sep 01 05:10:03.429123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2062/4126] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:03.569702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:03.586406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b28a3c5-a00e-4dcd-85b5-f56d0ceaa559 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.011782 Sep 01 05:10:03.589343 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2065/4127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:02 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:04.300310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:04.303018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:04.333258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:04.334479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:04.336800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:04.338394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:04.339441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:04.340754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:04.612828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:04.613592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:04.629941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:04.631069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:04.634605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:04.636947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:04.641040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:04.642517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:04.951562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:04.966728 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4582ffd3-26aa-4e7d-8bc3-a5bb64761644 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 0.678057 Sep 01 05:10:04.968095 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2063/4128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:04 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:05.127604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:05.137690 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-358e8f45-938d-429b-bb3b-a41003460530 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.528708 Sep 01 05:10:05.151153 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2066/4129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:04 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:05.998042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:05.998707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:06.001849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:06.031952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:06.032375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:06.033156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:06.033900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:06.034397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:06.037682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:06.168185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:06.169125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:06.178521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:06.182710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:06.191916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:06.193090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:06.201352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:06.201352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:06.201352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:06.201352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:07.094601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:07.110237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20eebe0d-ab70-4d16-9114-6efa6ded4d72 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 1.123924 Sep 01 05:10:07.111534 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2064/4130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:05 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:07.249103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:07.259400 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa84d2cd-9e56-4b56-9e40-a73efbcf9f69 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.096542 Sep 01 05:10:07.273498 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2067/4131] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:06 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:08.144752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:08.147478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:08.191497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:08.194184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:08.197398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:08.201038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:08.213132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:08.213924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:08.281731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:08.282592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:08.317964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:08.318818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:08.320050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:08.323817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:08.326087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:08.327232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:09.529309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:09.542748 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91e5974a-02cc-4a6c-a336-a57fc452fff2 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.265424 Sep 01 05:10:09.556382 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2068/4132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:08 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:09.609956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:09.625505 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41ca7364-a1c3-4346-a512-544949f2f734 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 1.492929 Sep 01 05:10:09.626193 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2065/4133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:08 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:10.572380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:10.574577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:10.604010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:10.611993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:10.613267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:10.619175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:10.622715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:10.624839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:10.671940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:10.672910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:10.684376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:10.684872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:10.685306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:10.686025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:10.686530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:10.694522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:11.258048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:11.269450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f397b80-dea1-4106-9452-1fd8e3529c3e tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 0.601178 Sep 01 05:10:11.270221 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2066/4134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:10 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:11.574060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:11.607532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-577f586c-9848-46ba-9473-d88402eea123 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.043943 Sep 01 05:10:11.608190 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2069/4135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:10 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:12.297757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:12.298710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:12.319954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:12.321033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:12.326086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:12.327352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:12.330020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:12.331012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:12.633194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:12.633820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:12.692858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:12.695734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:12.698847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:12.700200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:12.702527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:12.703404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:13.097967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:13.109708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9da6771d-e1fc-4770-a4b1-09d175537914 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 0.816677 Sep 01 05:10:13.111337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2067/4136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:12 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:13.277092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:13.290035 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cfd2e0e-9d12-46d7-86b7-a2a4ff4a962a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.663207 Sep 01 05:10:13.291440 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2070/4137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:12 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:13.590496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-01b278c3-0b64-46b5-a4d5-48f28a407e16 req-149894af-e5ab-4c68-83be-74f61562761b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac37edc0-8d1a-4d1b-ada5-305b30b38408", "name": "network-vif-plugged", "status": "completed", "tag": "28dcbb7d-77fa-4ed4-8b66-88eb8fd2d20d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:13.611238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01b278c3-0b64-46b5-a4d5-48f28a407e16 req-149894af-e5ab-4c68-83be-74f61562761b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:13.612735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01b278c3-0b64-46b5-a4d5-48f28a407e16 req-149894af-e5ab-4c68-83be-74f61562761b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:13.614293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01b278c3-0b64-46b5-a4d5-48f28a407e16 req-149894af-e5ab-4c68-83be-74f61562761b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:13.636684 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-01b278c3-0b64-46b5-a4d5-48f28a407e16 req-149894af-e5ab-4c68-83be-74f61562761b service nova] Creating event network-vif-plugged:28dcbb7d-77fa-4ed4-8b66-88eb8fd2d20d for instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 on n-h1-820368-37 Sep 01 05:10:13.644154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-01b278c3-0b64-46b5-a4d5-48f28a407e16 req-149894af-e5ab-4c68-83be-74f61562761b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059110 Sep 01 05:10:13.645084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2068/4138] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:10:14.152761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:14.156222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:14.165014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:14.206463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:14.210247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:14.211600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:14.214996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:14.217619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:14.219572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:14.328472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:14.329670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:14.341662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:14.342539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:14.343445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:14.344790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:14.345844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:14.346621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:14.662272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:14.681784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00b7dee9-d5bd-4a21-80b6-94bfe0696bac tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1325 microversion: 2.1 time: 0.543973 Sep 01 05:10:14.694923 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2071/4139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:14 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:14.706803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:14.716107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e7bf391-7bf9-4839-b62b-232f4ceb37ee tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.402988 Sep 01 05:10:14.716881 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2069/4140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:14 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:15.707717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:15.709386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:15.718278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:15.719171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:15.719930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:15.720897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:15.721546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:15.722339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:15.751323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:15.752615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:15.765745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:15.767338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:15.768911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:15.774568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:15.775174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:15.775621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:15.830261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:16.004640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:16.025717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f0f499f-c322-4275-83e8-b3636d025738 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1523 microversion: 2.1 time: 0.322406 Sep 01 05:10:16.049255 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2072/4141] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:15 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:16.056542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:16.065479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:16.079219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:16.080963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:16.083661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:16.085897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:16.086592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:16.088567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:16.156386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:10:16.157595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:16.168993 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47f762ad-7f89-4282-ac96-087272d60319 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.423397 Sep 01 05:10:16.169899 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2070/4142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:15 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:16.343083 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-599980e2-bb5a-490e-9869-870c7c19b996 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 204 len: 0 microversion: 2.1 time: 0.291172 Sep 01 05:10:16.344171 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2073/4143] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:10:16 2022] DELETE /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:10:16.361839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:16.362630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:16.382422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:16.387766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:16.388444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:16.389664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:16.390329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:16.393165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:16.590676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:16.604472 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c75fcf6-4445-4019-9a75-61a7c6374657 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1529 microversion: 2.1 time: 0.252816 Sep 01 05:10:16.619713 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2071/4144] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:16 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1529 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:17.194408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:17.195348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:17.208715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:17.209383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:17.211088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:17.211956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:17.215060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:17.215635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:17.268833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:17.611584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:17.627740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:17.628631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:17.632111 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23652e67-7041-4f76-9f83-66bce4de11ce tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.442561 Sep 01 05:10:17.634451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2074/4145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:17 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:17.658953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:17.658953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:17.658953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:17.659935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:17.660424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:17.660925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:17.990046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:18.004791 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05e802c5-9ab8-41a0-849b-9c25ca084bce tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1529 microversion: 2.1 time: 0.382709 Sep 01 05:10:18.013970 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2072/4146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:17 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1529 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:18.659518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:18.659518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:18.682768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:18.700106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:18.701790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:18.706977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:18.707803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:18.709837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:19.046260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:19.046868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:19.057135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:19.063990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:19.064470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:19.065832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:19.066483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:19.069131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:19.324273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512e22d177264c46982afa469c3446da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9dddd7fe5040a68d289bade73e0232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:19.334852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4eabef0c-db1f-4419-bbb1-f28d531bb0f9 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 200 len: 1487 microversion: 2.1 time: 0.292491 Sep 01 05:10:19.356900 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2073/4147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:19 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 1487 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:19.371300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-02341374-7aec-49a3-8858-0f8851c42f60 req-5adb6a2d-6581-4007-878c-784c6850e02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac37edc0-8d1a-4d1b-ada5-305b30b38408", "name": "network-vif-deleted", "tag": "28dcbb7d-77fa-4ed4-8b66-88eb8fd2d20d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:19.409395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02341374-7aec-49a3-8858-0f8851c42f60 req-5adb6a2d-6581-4007-878c-784c6850e02a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:19.411283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02341374-7aec-49a3-8858-0f8851c42f60 req-5adb6a2d-6581-4007-878c-784c6850e02a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:19.412927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-02341374-7aec-49a3-8858-0f8851c42f60 req-5adb6a2d-6581-4007-878c-784c6850e02a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:19.438098 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-02341374-7aec-49a3-8858-0f8851c42f60 req-5adb6a2d-6581-4007-878c-784c6850e02a service nova] Creating event network-vif-deleted:28dcbb7d-77fa-4ed4-8b66-88eb8fd2d20d for instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 on n-h1-820368-37 Sep 01 05:10:19.467429 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-02341374-7aec-49a3-8858-0f8851c42f60 req-5adb6a2d-6581-4007-878c-784c6850e02a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108871 Sep 01 05:10:19.472975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2074/4148] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:19.494569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:19.519806 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f6b37e3-035f-44f7-a3a0-e63118fcee29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.867882 Sep 01 05:10:19.524666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2075/4149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:18 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:20.357862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:20.358407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ac37edc0-8d1a-4d1b-ada5-305b30b38408] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:20.370484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:20.371010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:20.371667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:20.375718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:20.376372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:20.376988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:20.397042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1717812102", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "80118728-6700-44e4-a193-41b8bba2f079"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:20.416883 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 could not be found. Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 HTTP/1.1 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 could not be found. Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ac37edc0-8d1a-4d1b-ada5-305b30b38408'} Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 could not be found. Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 could not be found. Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.418840 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 could not be found. Sep 01 05:10:20.424233 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.425743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance ac37edc0-8d1a-4d1b-ada5-305b30b38408 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:20.426987 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fb4b046-20d0-4bc3-bba9-f9a6ab835131 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408" status: 404 len: 111 microversion: 2.1 time: 0.073141 Sep 01 05:10:20.431816 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2076/4150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:20 2022] GET /compute/v2.1/servers/ac37edc0-8d1a-4d1b-ada5-305b30b38408 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:20.437237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff1d9e15-e941-4984-9137-64f1527ac981 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '.version_select at 0x7fa76052cc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:20.468262 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ff1d9e15-e941-4984-9137-64f1527ac981 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Image not found. Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff1d9e15-e941-4984-9137-64f1527ac981 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6 HTTP/1.1 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'f496cff3-9936-4984-a43b-7a093455cea6'} Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f496cff3-9936-4984-a43b-7a093455cea6 to delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f496cff3-9936-4984-a43b-7a093455cea6 could not be found. Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.470203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff1d9e15-e941-4984-9137-64f1527ac981 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff1d9e15-e941-4984-9137-64f1527ac981 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6" status: 404 len: 62 microversion: 2.1 time: 0.038632 Sep 01 05:10:20.474489 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2077/4151] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:20 2022] DELETE /compute/v2.1/images/f496cff3-9936-4984-a43b-7a093455cea6 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:10:20.497057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:20.514266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:20.536722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:20.537345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:20.540037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:20.570003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:20.570318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] validate_networks() for [('80118728-6700-44e4-a193-41b8bba2f079', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:10:20.573140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:20.574010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:20.611506 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 HTTP/1.1 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e236f6c-3e00-4700-acd1-e59a5c2ac9d7'} Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:20.617402 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:20.622272 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:20.627912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:20.629551 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9669afb9-a20f-424f-9090-ea298b6a70b1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 404 len: 111 microversion: 2.1 time: 0.143179 Sep 01 05:10:20.630705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2078/4152] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:10:20 2022] DELETE /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:20.640407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:20.641376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:20.652775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:20.653721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:20.654672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:20.656329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:20.658420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:20.659678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:21.416085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:21.451915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd3f9060-ecbb-4971-9193-032ec509ef4b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 0.818462 Sep 01 05:10:21.454840 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2079/4153] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:20 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:21.471247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:21.479017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:21.488854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:21.489351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:21.489990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:21.491174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:21.493375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:21.494311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:21.546833 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 HTTP/1.1 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e236f6c-3e00-4700-acd1-e59a5c2ac9d7'} Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:21.551415 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance 0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:21.556386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86795a67-f3ad-49eb-83f1-4db5b145fcb6 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7" status: 404 len: 111 microversion: 2.1 time: 0.100185 Sep 01 05:10:21.558289 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2080/4154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:21 2022] GET /compute/v2.1/servers/0e236f6c-3e00-4700-acd1-e59a5c2ac9d7 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:21.568751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2755fb4e-7481-4501-b243-dee09a827b36 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '.version_select at 0x7fa75b0fe310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:21.622083 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2755fb4e-7481-4501-b243-dee09a827b36 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717998580" status: 202 len: 0 microversion: 2.1 time: 0.060253 Sep 01 05:10:21.622854 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2081/4155] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:10:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717998580 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:10:21.897454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:10:21.898559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:10:21.899402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:10:21.900052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:10:21.900583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:10:21.920345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:21.921912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:21.922876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:21.924033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:21.925045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:21.925768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:21.952266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Getting quotas for project 1b4cc69bc0c54f0e967d15d2f868f0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:10:21.978853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Getting quotas for user feb7312d8a144a6cbd7020f37a82dc93 and project 1b4cc69bc0c54f0e967d15d2f868f0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:10:22.038526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:10:22.045221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:10:22.238978 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d9448b29-9da5-4f8a-ad3d-e973b11490a2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.176459 Sep 01 05:10:22.242916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2075/4156] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:10:22.476752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:22.477514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:22.508999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:22.511528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:22.512226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:22.516259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:22.519543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:22.527400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:22.709692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1826756245", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "80118728-6700-44e4-a193-41b8bba2f079"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:22.832881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] validate_networks() for [('80118728-6700-44e4-a193-41b8bba2f079', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:10:24.491137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:24.511788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f85c9f55-9281-47ed-8b00-f52e7ee4fb06 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 2.037045 Sep 01 05:10:24.515079 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2082/4157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:22 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:24.873545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5949c4a-aa4f-4077-9a31-ea649f181633 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '.version_select at 0x7fa75b13d160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:24.915411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:10:24.916074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:10:24.916074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:10:24.916386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:10:24.916842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:10:24.928210 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b5949c4a-aa4f-4077-9a31-ea649f181633 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Image not found. Sep 01 05:10:24.932917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:24.933421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:24.933837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:24.934549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:24.935027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:24.935455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5949c4a-aa4f-4077-9a31-ea649f181633 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/0e925155-729e-439d-8dee-4a9f947b0e8a HTTP/1.1 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: exception: Image not found. Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '0e925155-729e-439d-8dee-4a9f947b0e8a'} Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0e925155-729e-439d-8dee-4a9f947b0e8a to delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0e925155-729e-439d-8dee-4a9f947b0e8a could not be found. Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:24.938188 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 01 05:10:24.944012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:24.948535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5949c4a-aa4f-4077-9a31-ea649f181633 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:24.952958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5949c4a-aa4f-4077-9a31-ea649f181633 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/images/0e925155-729e-439d-8dee-4a9f947b0e8a" status: 404 len: 62 microversion: 2.1 time: 0.086427 Sep 01 05:10:24.960626 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2083/4158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:24 2022] DELETE /compute/v2.1/images/0e925155-729e-439d-8dee-4a9f947b0e8a => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:10:24.975600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:24.976100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:24.990383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:24.990905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:24.991416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:24.992148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:24.992615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:24.997492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:25.040625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Getting quotas for project 1b4cc69bc0c54f0e967d15d2f868f0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:10:25.048271 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 HTTP/1.1 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76'} Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:25.059611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.064218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.066105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:25.067865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5e74383-1c80-40f2-8ce3-5ddc73f56ea8 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 404 len: 111 microversion: 2.1 time: 0.106165 Sep 01 05:10:25.068187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Getting quotas for user feb7312d8a144a6cbd7020f37a82dc93 and project 1b4cc69bc0c54f0e967d15d2f868f0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:10:25.069200 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2084/4159] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:10:24 2022] DELETE /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:25.080828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:25.081812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] [instance: ab2fd882-450d-47e3-85bd-57078b919b76] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:25.101370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:25.101869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:25.102305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:25.103054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:25.108190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:25.108653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:25.137564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:10:25.146324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:10:25.152369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] HTTP exception thrown: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Request method failure captured: Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 HTTP/1.1 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED4TghHjR19-JLixQVSCj-Q6ITA9BE5FgqDrLVJ6p7cCCYefIiuv2pLI-ez2xO08kbqkupXh-LZwTWCBfpbGQqtgQHXnEwRGJYKcw9ljh4XbksnHFbxNKfF0uCtb6w39zTOfTqBEg-SGICIEqRCq2EApQd1GYwey0NvGjr0upqzR74M Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc9dddd7fe5040a68d289bade73e0232"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cc9dddd7fe5040a68d289bade73e0232 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589 Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 512e22d177264c46982afa469c3446da Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1508284589-project Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ab2fd882-450d-47e3-85bd-57078b919b76'} Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.154339 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] Returning 404 to user: Instance ab2fd882-450d-47e3-85bd-57078b919b76 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:25.158710 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-236d0111-67e1-4ebf-a22e-caa9c03b9dc1 tempest-ImagesOneServerNegativeTestJSON-1508284589 tempest-ImagesOneServerNegativeTestJSON-1508284589-project] 10.222.0.26 "GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76" status: 404 len: 111 microversion: 2.1 time: 0.081705 Sep 01 05:10:25.161196 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2085/4160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:25 2022] GET /compute/v2.1/servers/ab2fd882-450d-47e3-85bd-57078b919b76 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:25.294928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a46c66ad-11bc-456c-82aa-f004e99e541e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.589844 Sep 01 05:10:25.304470 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2076/4161] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:10:25.502174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-947124917", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "451", "networks": [{"uuid": "80118728-6700-44e4-a193-41b8bba2f079"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:25.544557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:25.545962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:25.554818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:25.556155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:25.558325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:25.559335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:25.561813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:25.562469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:25.643196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] validate_networks() for [('80118728-6700-44e4-a193-41b8bba2f079', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:10:27.356803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:27.372032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-887c1876-471a-4a38-a0c1-c871357a602b tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1486 microversion: 2.1 time: 1.840830 Sep 01 05:10:27.374621 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2077/4162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:25 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1486 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:27.397335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:27.398701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:27.412969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:27.413592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:27.414165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:27.416348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:27.417662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:27.418170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:27.611376 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-014426b0-1768-4de5-8218-7a7bdb7f1078 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "POST /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3/action" status: 202 len: 0 microversion: 2.1 time: 0.217868 Sep 01 05:10:27.615746 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2078/4163] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:10:27 2022] POST /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:10:27.674004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:27.684473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:27.732753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:27.733305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:27.733751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:27.740852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:27.741357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:27.741799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:28.897281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:28.915054 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6d83b8a-a1df-49ff-a6a8-df7819809542 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1494 microversion: 2.1 time: 1.292281 Sep 01 05:10:28.918144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2079/4164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:27 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1494 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:29.719817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:10:29.720320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:10:29.720729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:10:29.721123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:10:29.721767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:10:29.753124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:29.753944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:29.756819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:29.758640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:29.765290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:29.768070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:29.855340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Getting quotas for project 1b4cc69bc0c54f0e967d15d2f868f0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:10:29.881002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Getting quotas for user feb7312d8a144a6cbd7020f37a82dc93 and project 1b4cc69bc0c54f0e967d15d2f868f0c5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:10:29.904973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:10:29.911040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:10:29.943703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:29.944268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:29.962211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:29.963568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:29.966640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:29.967736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:29.969276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:29.971293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:30.031566 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a6d4f17-ef58-4631-b18c-67d62351143b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.532413 Sep 01 05:10:30.040194 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2086/4165] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:10:30.045976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74e4bf47-233f-47e4-9520-7e01b109d966 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:30.048789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74e4bf47-233f-47e4-9520-7e01b109d966 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:30.415468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74e4bf47-233f-47e4-9520-7e01b109d966 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:30.458591 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74e4bf47-233f-47e4-9520-7e01b109d966 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1220 microversion: 2.1 time: 0.416425 Sep 01 05:10:30.465187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2087/4166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:30 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1220 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:30.573638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:30.591550 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da41e447-3b2c-4a5e-991a-335b56dd4a27 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1494 microversion: 2.1 time: 0.652248 Sep 01 05:10:30.592317 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2080/4167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:29 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1494 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:31.490981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dfcad712-4991-4dbe-a474-ee5fd979569c req-a2bdfd0e-29b7-4f11-b3ef-2916e40895e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c394a7a8-a66e-42d5-b446-0534352d9540", "tag": "25e01162-218b-4be4-b28b-d1d97f9903e5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:31.510811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:31.512904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:31.520997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dfcad712-4991-4dbe-a474-ee5fd979569c req-a2bdfd0e-29b7-4f11-b3ef-2916e40895e6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:31.524817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dfcad712-4991-4dbe-a474-ee5fd979569c req-a2bdfd0e-29b7-4f11-b3ef-2916e40895e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:31.526120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dfcad712-4991-4dbe-a474-ee5fd979569c req-a2bdfd0e-29b7-4f11-b3ef-2916e40895e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:31.545274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:31.545781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:31.546228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:31.547000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:31.553848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:31.554502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:31.570574 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dfcad712-4991-4dbe-a474-ee5fd979569c req-a2bdfd0e-29b7-4f11-b3ef-2916e40895e6 service nova] Creating event network-changed:25e01162-218b-4be4-b28b-d1d97f9903e5 for instance c394a7a8-a66e-42d5-b446-0534352d9540 on n-h1-820368-37 Sep 01 05:10:31.586461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dfcad712-4991-4dbe-a474-ee5fd979569c req-a2bdfd0e-29b7-4f11-b3ef-2916e40895e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099331 Sep 01 05:10:31.588751 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2081/4168] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:31.616840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:31.617759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:31.626740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:31.628278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:31.629025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:31.630763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:31.631527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:31.632118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:31.821151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:31.834913 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-891ea62b-d495-4bdd-8faa-1e3bfc5ef2e8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1224 microversion: 2.1 time: 0.347930 Sep 01 05:10:31.836999 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2088/4169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:31 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1224 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:32.027573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:32.041601 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7f4078b-da07-48d5-92c9-f9a4bc90c5ed tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1494 microversion: 2.1 time: 0.427749 Sep 01 05:10:32.042254 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2082/4170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:31 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1494 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:32.859285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:32.860316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:32.884563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:32.885081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:32.886986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:32.899461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:32.902656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:32.903390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:32.987774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:32.996736 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f4c38be-e515-446e-9866-51e38722c09c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1278 microversion: 2.1 time: 0.143975 Sep 01 05:10:33.013262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2089/4171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:32 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:33.066491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:33.067956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:33.077518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:33.078317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:33.082928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:33.084377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:33.085090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:33.085744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:33.429421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:33.438585 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a73d6f51-0750-4828-bda1-64e9b81b2fb1 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1500 microversion: 2.1 time: 0.376330 Sep 01 05:10:33.439901 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2083/4172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:33 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1500 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:33.466905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:33.467748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:33.474824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:33.475614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:33.476209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:33.477285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:33.477915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:33.478661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:33.511341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:10:33.673721 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f900f99a-ff45-4795-a11d-193bdbe822d5 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 204 len: 0 microversion: 2.1 time: 0.211061 Sep 01 05:10:33.682194 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2090/4173] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:10:33 2022] DELETE /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:10:33.696081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:33.696859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:33.705305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:33.706308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:33.707221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:33.708181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:33.708908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:33.709554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:34.023829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:34.024733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:34.039905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:34.040574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:34.042322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:34.049492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:34.053310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:34.053878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:34.954531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:34.964315 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1278 microversion: 2.1 time: 0.946087 Sep 01 05:10:34.965699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2091/4174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:34 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1278 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:34.980906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:35.112422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:35.138603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:35.155406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aeb1229c-de93-4b03-b1b4-015a65d6440a tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.471343 Sep 01 05:10:35.158403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2084/4175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:33 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:35.511223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:35.513682 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62475884-0cf0-4f5d-acc0-1e3a82a42a35 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002759 Sep 01 05:10:35.514815 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2092/4176] 10.222.0.26 () {56 vars in 886 bytes} [Thu Sep 1 05:10:35 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 01 05:10:35.991945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:35.993480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:36.011667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:36.012508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:36.013868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:36.023770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:36.024724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:36.025947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:36.183380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:36.184337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:36.198699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:36.199751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:36.202822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:36.203856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:36.206545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:36.207424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:38.091836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:38.105586 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d344743-b72b-498d-a733-66640d38a3ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1320 microversion: 2.1 time: 2.121890 Sep 01 05:10:38.120113 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2085/4177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:35 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1320 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:38.140792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1f26507c-a3db-48a0-8f1d-857bf438d9b6 req-e806d683-c55e-4529-838b-a5f199fd8164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22653959-56d1-4507-85b5-9305e0f8b1b5", "tag": "9c66b3ed-338e-434c-8fe3-ff73a09a64cb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:38.163852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:38.178658 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0937ae18-125f-40b8-98ed-53652999bb29 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.996457 Sep 01 05:10:38.180775 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2093/4178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:36 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:38.181648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:38.184820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1f26507c-a3db-48a0-8f1d-857bf438d9b6 req-e806d683-c55e-4529-838b-a5f199fd8164 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:38.189814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1f26507c-a3db-48a0-8f1d-857bf438d9b6 req-e806d683-c55e-4529-838b-a5f199fd8164 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:38.192886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1f26507c-a3db-48a0-8f1d-857bf438d9b6 req-e806d683-c55e-4529-838b-a5f199fd8164 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:38.247253 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1f26507c-a3db-48a0-8f1d-857bf438d9b6 req-e806d683-c55e-4529-838b-a5f199fd8164 service nova] Creating event network-changed:9c66b3ed-338e-434c-8fe3-ff73a09a64cb for instance 22653959-56d1-4507-85b5-9305e0f8b1b5 on n-h1-820368-37 Sep 01 05:10:38.263590 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1f26507c-a3db-48a0-8f1d-857bf438d9b6 req-e806d683-c55e-4529-838b-a5f199fd8164 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134880 Sep 01 05:10:38.264805 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2086/4179] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:39.141948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:39.142986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:39.168204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:39.177920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:39.180171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:39.192670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:39.212223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:39.213356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:39.214374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:39.215269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:39.228272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:39.229111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:39.229921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:39.231138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:39.232502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:39.246386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:39.806485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:40.442506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:40.760197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:40.778399 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9458b9b5-6ffa-4832-8455-5c2dd0f5fc4f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1320 microversion: 2.1 time: 1.640700 Sep 01 05:10:40.800725 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2094/4180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:39 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1320 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:40.813386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-47b9b7ed-da73-48c4-b23f-68fa8cfa0bf2 req-56afb599-b77f-46c7-b4a6-227c5ea97f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17123883-1925-4ca6-965f-5c1ac4ea2e88", "tag": "5b2a2d0a-4e7e-47e6-842d-8c4799493938"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:40.865348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47b9b7ed-da73-48c4-b23f-68fa8cfa0bf2 req-56afb599-b77f-46c7-b4a6-227c5ea97f3e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:40.866241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47b9b7ed-da73-48c4-b23f-68fa8cfa0bf2 req-56afb599-b77f-46c7-b4a6-227c5ea97f3e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:40.870288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47b9b7ed-da73-48c4-b23f-68fa8cfa0bf2 req-56afb599-b77f-46c7-b4a6-227c5ea97f3e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:40.914305 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-47b9b7ed-da73-48c4-b23f-68fa8cfa0bf2 req-56afb599-b77f-46c7-b4a6-227c5ea97f3e service nova] Creating event network-changed:5b2a2d0a-4e7e-47e6-842d-8c4799493938 for instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 on n-h2-820368-37 Sep 01 05:10:40.931236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-47b9b7ed-da73-48c4-b23f-68fa8cfa0bf2 req-56afb599-b77f-46c7-b4a6-227c5ea97f3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128722 Sep 01 05:10:40.935508 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2095/4181] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:40.959811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1fb6fecd-f9a1-4354-b68e-bb871a2d52c7 req-9ff270d9-ea2d-4661-acb9-c4b74cd056c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c394a7a8-a66e-42d5-b446-0534352d9540", "name": "network-vif-plugged", "status": "completed", "tag": "25e01162-218b-4be4-b28b-d1d97f9903e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:40.982049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:40.998235 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9397ffcb-3b77-4421-87f9-a914cef94cec tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1506 microversion: 2.1 time: 1.797171 Sep 01 05:10:40.999607 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2087/4182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:39 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1506 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:41.034791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1fb6fecd-f9a1-4354-b68e-bb871a2d52c7 req-9ff270d9-ea2d-4661-acb9-c4b74cd056c2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:41.035318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1fb6fecd-f9a1-4354-b68e-bb871a2d52c7 req-9ff270d9-ea2d-4661-acb9-c4b74cd056c2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:41.035879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1fb6fecd-f9a1-4354-b68e-bb871a2d52c7 req-9ff270d9-ea2d-4661-acb9-c4b74cd056c2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:41.060539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3e27a9f3-e0c9-4bef-a10a-cb477e46f438 req-ada1658a-f01c-4297-8507-d075261c3309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5011400-a2cb-4d80-83ad-87cb2c0684c3", "name": "network-vif-deleted", "tag": "f5a9fb3b-ef45-43e7-835c-5885b17e514d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:41.086011 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1fb6fecd-f9a1-4354-b68e-bb871a2d52c7 req-9ff270d9-ea2d-4661-acb9-c4b74cd056c2 service nova] Creating event network-vif-plugged:25e01162-218b-4be4-b28b-d1d97f9903e5 for instance c394a7a8-a66e-42d5-b446-0534352d9540 on n-h1-820368-37 Sep 01 05:10:41.091307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e27a9f3-e0c9-4bef-a10a-cb477e46f438 req-ada1658a-f01c-4297-8507-d075261c3309 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:41.095587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1fb6fecd-f9a1-4354-b68e-bb871a2d52c7 req-9ff270d9-ea2d-4661-acb9-c4b74cd056c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150974 Sep 01 05:10:41.098175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e27a9f3-e0c9-4bef-a10a-cb477e46f438 req-ada1658a-f01c-4297-8507-d075261c3309 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:41.100568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e27a9f3-e0c9-4bef-a10a-cb477e46f438 req-ada1658a-f01c-4297-8507-d075261c3309 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:41.113058 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2096/4183] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:41.142842 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3e27a9f3-e0c9-4bef-a10a-cb477e46f438 req-ada1658a-f01c-4297-8507-d075261c3309 service nova] Creating event network-vif-deleted:f5a9fb3b-ef45-43e7-835c-5885b17e514d for instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 on n-h2-820368-37 Sep 01 05:10:41.171442 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3e27a9f3-e0c9-4bef-a10a-cb477e46f438 req-ada1658a-f01c-4297-8507-d075261c3309 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114573 Sep 01 05:10:41.173310 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2088/4184] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:10:41.804202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:41.806933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:41.834997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:41.837760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:41.838517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:41.844876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:41.845647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:41.846360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:42.026553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:42.027338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:42.055328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:42.055826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:42.056390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:42.063454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:42.064262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:42.065046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:42.442618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:42.459248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-905cbda0-aec7-474d-b99e-cf9d70350213 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 200 len: 1298 microversion: 2.1 time: 0.437369 Sep 01 05:10:42.459890 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2089/4185] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:42 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 1298 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:42.542499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:42.577561 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1238b8ae-6200-4296-9630-4947520533f2 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1320 microversion: 2.1 time: 0.777685 Sep 01 05:10:42.591667 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2097/4186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:41 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1320 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:43.485122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:43.495191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: b5011400-a2cb-4d80-83ad-87cb2c0684c3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:43.544082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:43.549821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:43.554253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:43.580000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:43.584477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:43.585081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:43.606321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:43.608470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:43.623178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:43.626091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:43.626733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:43.630394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:43.631131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:43.634417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:43.684181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:43.692333 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] HTTP exception thrown: Instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 could not be found. Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Request method failure captured: Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 HTTP/1.1 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED5AlZ2oIyrS91qrjE77V3YcFOkmCS66v_iItxr2VKSrhgfqIIlx4GTLENmw2F1RvBjZYm57uDPk1haEElSuldG9H9b1qubGXW6TUeETaf45GPItal8t3l6WHaXaN24fggY43n4WySkeUIVA-Bdq8zcIXSp9jBxYor75V4SWhkKyGCU Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ae5596ad34e84c719aea37fdf7b730a4 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueTestJSON-754065900 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueTestJSON-754065900 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ae5596ad34e84c719aea37fdf7b730a4 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueTestJSON-754065900 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerRescueTestJSON-754065900-project Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7d8583adf5e64b4fbc7a9ed0e250d5e7 Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueTestJSON-754065900-project Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 could not be found. Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b5011400-a2cb-4d80-83ad-87cb2c0684c3'} Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 could not be found. Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 could not be found. Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:43.694525 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 could not be found. Sep 01 05:10:43.698669 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:43.701518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Returning 404 to user: Instance b5011400-a2cb-4d80-83ad-87cb2c0684c3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:43.702646 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7a14dad-7a9e-4117-8e53-12eb05bc1296 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3" status: 404 len: 111 microversion: 2.1 time: 0.224075 Sep 01 05:10:43.707481 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2090/4187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:43 2022] GET /compute/v2.1/servers/b5011400-a2cb-4d80-83ad-87cb2c0684c3 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:43.722290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:43.724660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:43.737687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:43.745751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:43.746932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:43.747894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:43.748520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:43.749117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:43.865696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:10:44.117628 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d6d8676-048c-4653-8335-2f83ef488b4e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 204 len: 0 microversion: 2.1 time: 0.397210 Sep 01 05:10:44.119593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2091/4188] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:10:43 2022] DELETE /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:10:44.143181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:44.144629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:44.164444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:44.165385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:44.167425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:44.169602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:44.172516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:44.173269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:44.602206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:44.610250 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86c33b6e-0e47-49e4-b119-c40df8fd9aa3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1320 microversion: 2.1 time: 1.008226 Sep 01 05:10:44.633777 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2098/4189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:43 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1320 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:44.907641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:44.928115 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02a9631d-c99e-46bc-93b7-2390d0885039 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1492 microversion: 2.1 time: 0.802512 Sep 01 05:10:44.932931 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2092/4190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:44 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1492 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:45.631891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:45.632701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:45.636371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:45.656386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:45.663487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:45.668107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:45.669143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:45.671351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:45.680604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:45.958392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:45.959793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:45.978796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:45.987999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:45.997413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:46.000151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:46.002582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:46.011560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:46.249882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:46.255288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:46.269344 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab26488-7ee1-4994-a7b6-ee2403f481b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1320 microversion: 2.1 time: 0.640378 Sep 01 05:10:46.273298 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2099/4191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:45 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1320 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:46.492048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:46.517276 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6a7d867-d0d6-40ec-b35b-4c8b2b300cd6 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1492 microversion: 2.1 time: 0.558459 Sep 01 05:10:46.518213 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2093/4192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:45 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1492 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:46.784077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-264236c9-551a-4e27-b399-d1b9c5b929c2 req-ffe4acff-88d8-4174-be0c-10ef8007e3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22653959-56d1-4507-85b5-9305e0f8b1b5", "name": "network-vif-plugged", "status": "completed", "tag": "9c66b3ed-338e-434c-8fe3-ff73a09a64cb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:46.831735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-264236c9-551a-4e27-b399-d1b9c5b929c2 req-ffe4acff-88d8-4174-be0c-10ef8007e3f9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:46.835881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-264236c9-551a-4e27-b399-d1b9c5b929c2 req-ffe4acff-88d8-4174-be0c-10ef8007e3f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:46.839987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-264236c9-551a-4e27-b399-d1b9c5b929c2 req-ffe4acff-88d8-4174-be0c-10ef8007e3f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:46.912562 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-264236c9-551a-4e27-b399-d1b9c5b929c2 req-ffe4acff-88d8-4174-be0c-10ef8007e3f9 service nova] Creating event network-vif-plugged:9c66b3ed-338e-434c-8fe3-ff73a09a64cb for instance 22653959-56d1-4507-85b5-9305e0f8b1b5 on n-h1-820368-37 Sep 01 05:10:46.973266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-264236c9-551a-4e27-b399-d1b9c5b929c2 req-ffe4acff-88d8-4174-be0c-10ef8007e3f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163038 Sep 01 05:10:46.976716 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2100/4193] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:47.299016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:47.300745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:47.317597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:47.318475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:47.320059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:47.328826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:47.329874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:47.331626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:47.547418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:47.548684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:47.572473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:47.574999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:47.575710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:47.577743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:47.579561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:47.584731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:47.967038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:47.994644 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da04870a-25b9-4de9-a985-cb47dbda9f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1320 microversion: 2.1 time: 0.701431 Sep 01 05:10:48.013603 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2094/4194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:47 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1320 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:48.109571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:48.125290 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08fd8091-8bf6-4796-8cc8-afa24a547c5e tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1492 microversion: 2.1 time: 0.588116 Sep 01 05:10:48.144091 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2101/4195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:47 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1492 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:49.017739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e9179ec2-6d95-414a-8258-da17009f5859 req-618b96bc-8218-45d5-91d8-f9d5e553f491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17123883-1925-4ca6-965f-5c1ac4ea2e88", "name": "network-vif-plugged", "status": "completed", "tag": "5b2a2d0a-4e7e-47e6-842d-8c4799493938"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:49.039955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e9179ec2-6d95-414a-8258-da17009f5859 req-618b96bc-8218-45d5-91d8-f9d5e553f491 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:49.043587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e9179ec2-6d95-414a-8258-da17009f5859 req-618b96bc-8218-45d5-91d8-f9d5e553f491 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:49.043835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:49.044026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e9179ec2-6d95-414a-8258-da17009f5859 req-618b96bc-8218-45d5-91d8-f9d5e553f491 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:49.044860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:49.059931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:49.061031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:49.061958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:49.066691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:49.068896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:49.070250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:49.072973 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e9179ec2-6d95-414a-8258-da17009f5859 req-618b96bc-8218-45d5-91d8-f9d5e553f491 service nova] Creating event network-vif-plugged:5b2a2d0a-4e7e-47e6-842d-8c4799493938 for instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 on n-h2-820368-37 Sep 01 05:10:49.083737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e9179ec2-6d95-414a-8258-da17009f5859 req-618b96bc-8218-45d5-91d8-f9d5e553f491 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070529 Sep 01 05:10:49.088305 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2095/4196] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:49.115780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0d90e84f-c607-4460-87cb-f6b624e627f0 req-40ca1a79-01a0-409a-82b0-27ae88d34cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53baf9c2-045b-4d46-afb3-af91989b1945", "name": "network-vif-deleted", "tag": "0f27d757-98c3-459e-8160-f804aa3b1851"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:49.130360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d90e84f-c607-4460-87cb-f6b624e627f0 req-40ca1a79-01a0-409a-82b0-27ae88d34cef service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:49.131303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d90e84f-c607-4460-87cb-f6b624e627f0 req-40ca1a79-01a0-409a-82b0-27ae88d34cef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:49.131953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d90e84f-c607-4460-87cb-f6b624e627f0 req-40ca1a79-01a0-409a-82b0-27ae88d34cef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:49.153291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0d90e84f-c607-4460-87cb-f6b624e627f0 req-40ca1a79-01a0-409a-82b0-27ae88d34cef service nova] Creating event network-vif-deleted:0f27d757-98c3-459e-8160-f804aa3b1851 for instance 53baf9c2-045b-4d46-afb3-af91989b1945 on n-h1-820368-37 Sep 01 05:10:49.162027 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0d90e84f-c607-4460-87cb-f6b624e627f0 req-40ca1a79-01a0-409a-82b0-27ae88d34cef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068469 Sep 01 05:10:49.164882 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2096/4197] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:49.173631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:49.177323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:49.187346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:49.188007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:49.188454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:49.189302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:49.190167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:49.190605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:49.488313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8583adf5e64b4fbc7a9ed0e250d5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5596ad34e84c719aea37fdf7b730a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:49.506928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fba58add-ff01-4c5a-9d3b-bba8da409d13 tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 200 len: 1285 microversion: 2.1 time: 0.337470 Sep 01 05:10:49.508418 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2097/4198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:49 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 1285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:49.957613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:49.971464 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbca38fa-df15-4f3c-b5ab-b21524481124 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1510 microversion: 2.1 time: 0.933408 Sep 01 05:10:49.975236 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2102/4199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:49 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1510 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:50.004879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:50.009330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:50.038746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:50.041375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:50.044339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:50.045568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:50.046272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:50.047174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:50.405745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c9be4b4-c17c-4d37-a629-6cc6011ddc5a tempest-ListImagesTestJSON-1303812136 tempest-ListImagesTestJSON-1303812136-project] Calling method '.version_select at 0x7fa75b7bba60>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:50.492867 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c9be4b4-c17c-4d37-a629-6cc6011ddc5a tempest-ListImagesTestJSON-1303812136 tempest-ListImagesTestJSON-1303812136-project] 10.222.0.26 "GET /compute/v2.1/images/a6ef865c-7f44-4aad-804f-11f5772882db" status: 200 len: 784 microversion: 2.1 time: 0.982579 Sep 01 05:10:50.493641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2098/4200] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:49 2022] GET /compute/v2.1/images/a6ef865c-7f44-4aad-804f-11f5772882db => generated 784 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:50.508956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b10d52ff-e1c8-4cd8-b39d-ff30b1d404ac tempest-ListImagesTestJSON-1303812136 tempest-ListImagesTestJSON-1303812136-project] Calling method '.version_select at 0x7fa75af7a430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:50.677375 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b10d52ff-e1c8-4cd8-b39d-ff30b1d404ac tempest-ListImagesTestJSON-1303812136 tempest-ListImagesTestJSON-1303812136-project] 10.222.0.26 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.171127 Sep 01 05:10:50.679798 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2099/4201] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:50 2022] GET /compute/v2.1/images => generated 445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:50.689149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:50.696273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] [instance: 53baf9c2-045b-4d46-afb3-af91989b1945] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:50.719441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:50.720851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:50.722862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:50.723911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:50.724533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:50.725137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:50.753776 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] HTTP exception thrown: Instance 53baf9c2-045b-4d46-afb3-af91989b1945 could not be found. Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Request method failure captured: Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 HTTP/1.1 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED5AlZ2oIyrS91qrjE77V3YcFOkmCS66v_iItxr2VKSrhgfqIIlx4GTLENmw2F1RvBjZYm57uDPk1haEElSuldG9H9b1qubGXW6TUeETaf45GPItal8t3l6WHaXaN24fggY43n4WySkeUIVA-Bdq8zcIXSp9jBxYor75V4SWhkKyGCU Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ae5596ad34e84c719aea37fdf7b730a4 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerRescueTestJSON-754065900 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ae5596ad34e84c719aea37fdf7b730a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerRescueTestJSON-754065900 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ae5596ad34e84c719aea37fdf7b730a4 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerRescueTestJSON-754065900 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerRescueTestJSON-754065900-project Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 7d8583adf5e64b4fbc7a9ed0e250d5e7 Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerRescueTestJSON-754065900-project Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 53baf9c2-045b-4d46-afb3-af91989b1945 could not be found. Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '53baf9c2-045b-4d46-afb3-af91989b1945'} Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53baf9c2-045b-4d46-afb3-af91989b1945 could not be found. Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53baf9c2-045b-4d46-afb3-af91989b1945 could not be found. Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:10:50.756222 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53baf9c2-045b-4d46-afb3-af91989b1945 could not be found. Sep 01 05:10:50.760965 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:10:50.764711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] Returning 404 to user: Instance 53baf9c2-045b-4d46-afb3-af91989b1945 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:10:50.772811 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8c1609d-bfa6-48c3-a18e-c1ae8435b0dd tempest-ServerRescueTestJSON-754065900 tempest-ServerRescueTestJSON-754065900-project] 10.222.0.26 "GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945" status: 404 len: 111 microversion: 2.1 time: 0.091807 Sep 01 05:10:50.774829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2100/4202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:50 2022] GET /compute/v2.1/servers/53baf9c2-045b-4d46-afb3-af91989b1945 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:50.800718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-beac1636-a572-4f50-a829-2f1f8257260a tempest-ListImagesTestJSON-1303812136 tempest-ListImagesTestJSON-1303812136-project] Calling method '.version_select at 0x7fa75af7a0d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:50.920256 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-beac1636-a572-4f50-a829-2f1f8257260a tempest-ListImagesTestJSON-1303812136 tempest-ListImagesTestJSON-1303812136-project] 10.222.0.26 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.144062 Sep 01 05:10:50.921076 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2101/4203] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 05:10:50 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:51.027370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:51.037420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-277796a3-dd6e-47ac-bf7c-c4eae23fb9a4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1511 microversion: 2.1 time: 1.042316 Sep 01 05:10:51.040951 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2103/4204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:49 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1511 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:51.063580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:51.064214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:51.088803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:51.092063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:51.092495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:51.095803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:51.102025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:51.102217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:51.645376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:51.654373 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3ca5da5-45b5-406f-ba09-83c19a269e68 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1321 microversion: 2.1 time: 0.596089 Sep 01 05:10:51.659719 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2102/4205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:51 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:52.689135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:52.693854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:52.713034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:52.714371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:52.715309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:52.716814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:52.718428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:52.719138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:53.144318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:53.160180 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bfa6dc9-ee98-462a-87e5-493a077f2e20 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1511 microversion: 2.1 time: 0.479056 Sep 01 05:10:53.163311 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2104/4206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:52 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:53.183652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:53.191629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:53.198760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:53.227065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:53.227664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:53.228115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:53.228833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:53.229287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:53.229892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:53.357239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:53.527715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:53.549823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:53.550770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:53.551436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:53.840657 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-349bc030-292d-4a91-a1b3-9f1b0cbe9bab tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.660947 Sep 01 05:10:53.842359 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2103/4207] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 1 05:10:53 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:53.866120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:53.877629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:53.879703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1717812102', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:53.896610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:53.900572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:53.902039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:53.903502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:53.905826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:53.907753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:54.043938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:54.153128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:54.161211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:54.162111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:54.162765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:54.525585 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-841556af-d3c5-47f2-bb0c-64af59db2b12 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1717812102" status: 200 len: 1514 microversion: 2.1 time: 0.663785 Sep 01 05:10:54.526195 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2105/4208] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:10:53 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1717812102 => generated 1514 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:54.549448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:54.561414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:54.564135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:54.580156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:54.581790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:54.583463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:54.585776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:54.586137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:54.586444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:54.701698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:54.819185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:54.840277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:54.841142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:54.841755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.210248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b851f9d5-a576-4bed-ada3-e47e4a2a84dd tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.665888 Sep 01 05:10:55.211116 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2104/4209] 10.222.0.26 () {58 vars in 1173 bytes} [Thu Sep 1 05:10:54 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:55.243345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:55.248394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:55.248834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Sep 01 05:10:55.249578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:55.274243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.274733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.284077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.284826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.288020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.288477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.382107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:55.392632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.399041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.399691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.633632 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-efadc13c-bda4-4f9f-acee-b24bab575eb3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.393862 Sep 01 05:10:55.633953 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2106/4210] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 05:10:55 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:55.661582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:55.668457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:55.670748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:55.687055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.688310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.690369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.691262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.692989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.693518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.767633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:55.835581 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-531aae27-5777-40ce-9bd8-d5007c4eb6d7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.178932 Sep 01 05:10:55.850826 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2105/4211] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:10:55 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:55.851760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:55.860229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:55.863198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Sep 01 05:10:55.863918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:55.878585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.885495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.886517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.887903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:55.889464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:55.890877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:55.980012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:56.026456 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f41c9311-8827-4a0a-9e54-f6720b50afd8 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.179774 Sep 01 05:10:56.027423 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2107/4212] 10.222.0.26 () {58 vars in 1150 bytes} [Thu Sep 1 05:10:55 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:56.040449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:56.045196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:56.045869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:56.062383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.062867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.063322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.068119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.068724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.070368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.115390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:56.184521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.148182 Sep 01 05:10:56.198196 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2106/4213] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 05:10:56 2022] GET /compute/v2.1/servers => generated 1011 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:10:56.203829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:56.210233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:56.210933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:56.241666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.241949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.242399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.243218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.243673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.244259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.382256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:56.383287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fee8d6eb-9513-47dc-b2a2-6598643faebc tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001335 Sep 01 05:10:56.383919 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2107/4214] 10.222.0.26 () {56 vars in 886 bytes} [Thu Sep 1 05:10:56 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 01 05:10:56.417034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:56.511056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dec68dec-6352-4d74-97ff-af490b08d4c5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.310983 Sep 01 05:10:56.511994 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2108/4215] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:10:56 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:56.524838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:56.529859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:56.530313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.servers [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Removing options 'limit' from query {{(pid=128862) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Sep 01 05:10:56.547391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:56.553815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.554651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.555393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.556297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.556938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.557362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.596416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6038bc22-86e0-4e93-97a5-1b49fb9d98ee tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.075226 Sep 01 05:10:56.598663 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2108/4216] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 1 05:10:56 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:56.613903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:56.631154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:56.632161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1717812102', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:10:56.651485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.651485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.651485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.651485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:56.651485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:56.651485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:56.845674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:10:57.371013 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e5454ee-85b4-43b5-bb3b-1a922e5eead1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1717812102" status: 200 len: 346 microversion: 2.1 time: 0.763819 Sep 01 05:10:57.372894 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2109/4217] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 05:10:56 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1717812102 => generated 346 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:10:57.386714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00007663-fc1c-420a-b970-aa7d6ee46945 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:10:57.397075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00007663-fc1c-420a-b970-aa7d6ee46945 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:57.399654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00007663-fc1c-420a-b970-aa7d6ee46945 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:57.401263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00007663-fc1c-420a-b970-aa7d6ee46945 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:57.477919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00007663-fc1c-420a-b970-aa7d6ee46945 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:10:57.593480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:57.694224 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00007663-fc1c-420a-b970-aa7d6ee46945 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "POST /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540/action" status: 202 len: 0 microversion: 2.1 time: 0.288680 Sep 01 05:10:57.696901 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2109/4218] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:10:57 2022] POST /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:10:57.706513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:57.707347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:57.732129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:57.733388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:57.742250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:57.744647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:57.745954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:57.747494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:58.094640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:58.162572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c57a9a28-bb30-407f-a0d1-cf39b3b487d6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.453602 Sep 01 05:10:58.163946 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2110/4219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:57 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:10:59.198465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:10:59.204489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:10:59.237103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:59.239122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:59.240302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:59.241997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:10:59.243455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:10:59.244697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:10:59.722174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:10:59.741403 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b62853cd-7805-4879-bd33-459e852119e9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.557206 Sep 01 05:10:59.742331 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2110/4220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:10:59 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:00.768302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:00.769858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:00.803168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:00.803660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:00.804096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:00.804882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:00.805284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:00.805698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:01.627982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:01.651854 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81fba0de-5b40-4590-acbe-4d91195ff48c tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.890426 Sep 01 05:11:01.669584 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2111/4221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:00 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:02.682210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:02.682781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:02.717308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:02.717797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:02.718218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:02.720709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:02.725662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:02.731096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:03.326978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:03.340152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57462bc3-2399-4852-831c-166816edfc52 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.663122 Sep 01 05:11:03.342126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2111/4222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:02 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:04.373216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:04.373920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:04.400895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:04.406131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:04.410265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:04.414746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:04.418545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:04.420997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:05.134552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:05.154103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3034efea-e1e8-4d4f-ae04-5131a56bd720 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.784393 Sep 01 05:11:05.157336 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2112/4223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:04 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:06.178760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:06.181218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:06.194325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:06.199839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:06.203113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:06.206112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:06.209799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:06.210636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:06.212483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:06.569509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:06.847215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:06.858849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e00948aa-fba4-4e1b-b517-527dc44867ef tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.684962 Sep 01 05:11:06.860949 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2112/4224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:06 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:07.890826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:07.898745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:07.915769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:07.928161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:07.947661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:07.948689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:07.949515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:07.950637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:07.951414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:07.958346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:08.812933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:08.836277 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd3fc53e-57df-4d2d-af6c-d1c206ae9647 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.956156 Sep 01 05:11:08.837235 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2113/4225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:07 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:09.872236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:09.873608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:09.889397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:09.891313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:09.900351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:09.904729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:09.909673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:09.910332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:09.912718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:10.556851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:10.570112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47e45b81-ae02-4168-90b2-0c5b6630ae95 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 0.701324 Sep 01 05:11:10.572347 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2113/4226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:09 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:11.615046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:11.616379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:11.625965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:11.632361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:11.633248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:11.636830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:11.639218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:11.642865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:12.800558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:12.822918 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eab9a746-528a-4099-baec-ad75d5f49f86 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1521 microversion: 2.1 time: 1.213109 Sep 01 05:11:12.826084 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2114/4227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:11 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1521 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:13.869252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:13.879402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:13.929187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:13.929924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:13.934079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:13.935666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:13.936472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:13.951407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:14.512904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Calling method '.version_select at 0x7fa75b0943a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:14.739814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 05:11:14.740436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Neutron security group f24b8345-544a-4f30-80cf-1d1f63099b19 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 05:11:14.741128 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] HTTP exception thrown: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.741128 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Request method failure captured: Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/f24b8345-544a-4f30-80cf-1d1f63099b19 HTTP/1.1 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED7xRD9C3YzmdtPmHC31AYtcvKidBAjBQN5uSzoiDntz7mh3XdaOkrumGgZ9Y0blklb5XtmcAOfnjiycoJfY2pnYCRVpadp6yj3BETYc8qlQ5cf4SR_eQKD40JiO8q-fwW6UiAmD5lZP3rRnFxqHs0FF1VDClrJDuj6w11K2wc9Xs6s Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: df87bedcec22445285a99decb1304c11 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'f24b8345-544a-4f30-80cf-1d1f63099b19'} Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 05:11:14.743606 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Returning 404 to user: Security group f24b8345-544a-4f30-80cf-1d1f63099b19 does not exist Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-9b6f39f4-7336-48a8-88c2-e24fa3e408fe'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99c798b7-48d9-4a67-a78d-301225c4aea8 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f24b8345-544a-4f30-80cf-1d1f63099b19" status: 404 len: 194 microversion: 2.1 time: 0.793514 Sep 01 05:11:14.748749 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2115/4228] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 05:11:13 2022] DELETE /compute/v2.1/os-security-groups/f24b8345-544a-4f30-80cf-1d1f63099b19 => generated 194 bytes in 795 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:14.771749 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96e4e056-5a3a-41fa-916f-2ba337b24e77 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.016352 Sep 01 05:11:14.773682 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2116/4229] 10.222.0.26 () {58 vars in 1164 bytes} [Thu Sep 1 05:11:14 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:11:14.785256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-150b8bde-4180-4802-ad55-ed393428c6a2 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Calling method '.version_select at 0x7fa75b0941f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:14.894250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:14.910709 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61a8b858-4618-4dc7-adcb-d6df2cf39129 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1498 microversion: 2.1 time: 1.052190 Sep 01 05:11:14.911377 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2114/4230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:13 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1498 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:14.966591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:14.975491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:14.978333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:14.993182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:14.997870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:14.998494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:14.999622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:15.000381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:15.000966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:15.066003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:15.145959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5052c627-b21a-41af-9f6a-369a4fe61e0b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.183868 Sep 01 05:11:15.148783 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2115/4231] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Sep 1 05:11:14 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:15.165424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8c154fa-9d47-4583-9a1a-b0571c4d2dbf tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:15.185124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8c154fa-9d47-4583-9a1a-b0571c4d2dbf tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:15.186838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8c154fa-9d47-4583-9a1a-b0571c4d2dbf tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:15.188164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8c154fa-9d47-4583-9a1a-b0571c4d2dbf tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:15.270799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8c154fa-9d47-4583-9a1a-b0571c4d2dbf tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Going to try to start instance {{(pid=128862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:11:15.421414 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8c154fa-9d47-4583-9a1a-b0571c4d2dbf tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "POST /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540/action" status: 202 len: 0 microversion: 2.1 time: 0.261058 Sep 01 05:11:15.441373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2116/4232] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:11:15 2022] POST /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:11:15.519121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:15.520030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:15.560850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:15.561346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:15.561784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:15.562516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:15.562995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:15.570331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:16.067961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-150b8bde-4180-4802-ad55-ed393428c6a2 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.287249 Sep 01 05:11:16.069117 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2117/4233] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 05:11:14 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:16.089114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa2d5231-796b-4086-a177-9027fdf381e7 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Calling method '.version_select at 0x7fa75b0fe3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:16.372799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:16.390436 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f16b778b-7f02-450a-8c8b-a04dc888b4f1 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1507 microversion: 2.1 time: 0.938570 Sep 01 05:11:16.391159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2117/4234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:15 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1507 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:17.417421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:17.418176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:17.439529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:17.440050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:17.440495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:17.441242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:17.441714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:17.442141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:18.019218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-fa2d5231-796b-4086-a177-9027fdf381e7 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 05:11:18.019944 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fa2d5231-796b-4086-a177-9027fdf381e7 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 01 05:11:18.019944 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa2d5231-796b-4086-a177-9027fdf381e7 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Request method failure captured: Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/5eb3d934-5d66-4f55-bc9c-1274d9185680 HTTP/1.1 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED7xRD9C3YzmdtPmHC31AYtcvKidBAjBQN5uSzoiDntz7mh3XdaOkrumGgZ9Y0blklb5XtmcAOfnjiycoJfY2pnYCRVpadp6yj3BETYc8qlQ5cf4SR_eQKD40JiO8q-fwW6UiAmD5lZP3rRnFxqHs0FF1VDClrJDuj6w11K2wc9Xs6s Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: df87bedcec22445285a99decb1304c11 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: exception: Insufficient rights for removing default security group. Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '5eb3d934-5d66-4f55-bc9c-1274d9185680'} Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 05:11:18.022043 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa2d5231-796b-4086-a177-9027fdf381e7 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-62af35d0-9554-4db6-bf20-bf13b0be638e'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:18.026873 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa2d5231-796b-4086-a177-9027fdf381e7 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5eb3d934-5d66-4f55-bc9c-1274d9185680" status: 400 len: 182 microversion: 2.1 time: 1.945467 Sep 01 05:11:18.031284 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2118/4235] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 05:11:16 2022] DELETE /compute/v2.1/os-security-groups/5eb3d934-5d66-4f55-bc9c-1274d9185680 => generated 182 bytes in 1952 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:11:18.037801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Calling method '.version_select at 0x7fa75b14d0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:18.116873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 05:11:18.117534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Neutron security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 05:11:18.118108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] HTTP exception thrown: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.118108 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Request method failure captured: Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-security-groups/9a1bd1e1-4f7a-4a70-a298-645961a80c9b HTTP/1.1 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED7xRD9C3YzmdtPmHC31AYtcvKidBAjBQN5uSzoiDntz7mh3XdaOkrumGgZ9Y0blklb5XtmcAOfnjiycoJfY2pnYCRVpadp6yj3BETYc8qlQ5cf4SR_eQKD40JiO8q-fwW6UiAmD5lZP3rRnFxqHs0FF1VDClrJDuj6w11K2wc9Xs6s Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: df87bedcec22445285a99decb1304c11 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9a1bd1e1-4f7a-4a70-a298-645961a80c9b'} Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 05:11:18.123370 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Returning 404 to user: Security group 9a1bd1e1-4f7a-4a70-a298-645961a80c9b does not exist Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-31a25891-321f-4822-8a1f-2ba4422fbfd6'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:18.128546 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aaa237f5-e70a-4454-810d-66220539ae98 tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/9a1bd1e1-4f7a-4a70-a298-645961a80c9b" status: 404 len: 194 microversion: 2.1 time: 0.092467 Sep 01 05:11:18.131421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2119/4236] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 05:11:18 2022] GET /compute/v2.1/os-security-groups/9a1bd1e1-4f7a-4a70-a298-645961a80c9b => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:18.138723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Action: 'update', calling method: .version_select at 0x7fa75b124ca0>, body: {"security_group": {"name": "tempest-sg-1025695782", "description": "tempest-description-1301138417"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:18.253075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:18.263494 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8ffd313-deda-4c25-ada6-2bf972c217b4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1507 microversion: 2.1 time: 0.850004 Sep 01 05:11:18.272821 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2118/4237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:17 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1507 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:18.396721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 01 05:11:18.397852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Neutron security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 01 05:11:18.398820 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] HTTP exception thrown: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.398820 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Request method failure captured: Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-security-groups/c4011df3-bb87-4eee-a3fd-6f582f8ade74 HTTP/1.1 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 102 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED7xRD9C3YzmdtPmHC31AYtcvKidBAjBQN5uSzoiDntz7mh3XdaOkrumGgZ9Y0blklb5XtmcAOfnjiycoJfY2pnYCRVpadp6yj3BETYc8qlQ5cf4SR_eQKD40JiO8q-fwW6UiAmD5lZP3rRnFxqHs0FF1VDClrJDuj6w11K2wc9Xs6s Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6a96bae1fad46708042be0bba0fe229"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f6a96bae1fad46708042be0bba0fe229 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-800239788 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: df87bedcec22445285a99decb1304c11 Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-800239788-project Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: {"security_group": {"name": "tempest-sg-1025695782", "description": "tempest-description-1301138417"}} Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: exception: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'c4011df3-bb87-4eee-a3fd-6f582f8ade74', 'body': {'security_group': {'name': 'tempest-sg-1025695782', 'description': 'tempest-description-1301138417'}}} Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 01 05:11:18.411008 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] Sep 01 05:11:18.415317 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:18.421593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] Returning 404 to user: Security group c4011df3-bb87-4eee-a3fd-6f582f8ade74 does not exist Sep 01 05:11:18.421593 n-d-820368-37 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-46c2363c-54d3-477f-8d52-55fcd5a1a38f'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:18.424264 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e18fa170-9c54-4eaa-be8c-8d1d4842effc tempest-SecurityGroupsNegativeTestJSON-800239788 tempest-SecurityGroupsNegativeTestJSON-800239788-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/c4011df3-bb87-4eee-a3fd-6f582f8ade74" status: 404 len: 194 microversion: 2.1 time: 0.291853 Sep 01 05:11:18.427941 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2120/4238] 10.222.0.26 () {60 vars in 1290 bytes} [Thu Sep 1 05:11:18 2022] PUT /compute/v2.1/os-security-groups/c4011df3-bb87-4eee-a3fd-6f582f8ade74 => generated 194 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:19.300682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:19.301418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:19.327081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:19.328862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:19.329900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:19.333994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:19.344121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:19.345290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:20.051656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:20.082558 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-187425da-f74f-412f-af53-a58b591556f3 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1511 microversion: 2.1 time: 0.787344 Sep 01 05:11:20.087113 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2119/4239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:19 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1511 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:20.146041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:20.165755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:20.177317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Sep 01 05:11:20.181547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:20.185140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:20.189512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:20.190525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:20.193283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:20.198085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:20.201001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:20.211346 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10227900-9482-4671-8203-c36a9cdfa6ae tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.079547 Sep 01 05:11:20.213717 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2121/4240] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 1 05:11:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:11:20.226443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:20.227103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:20.244682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:20.245267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:20.245783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:20.246516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:20.247091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:20.247569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:21.052894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:21.081880 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53b27590-f85d-43e4-bd7f-abfc19c43004 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1511 microversion: 2.1 time: 0.858147 Sep 01 05:11:21.102661 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2120/4241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:20 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1511 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:21.108788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:21.109524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:21.126935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:21.126935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:21.126935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:21.128725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:21.129536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:21.133821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:21.560927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:21.578284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cf760b2-0bd9-4844-bb12-f05bcad6a898 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1511 microversion: 2.1 time: 0.473356 Sep 01 05:11:21.581528 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2121/4242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:21 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1511 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:21.625136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=37 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:21.625670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:21.630009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:21.666574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:21.668045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:21.673740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:21.675360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:21.675886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:21.676330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:22.062878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:22.062878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9fb53ec-7c8e-477f-a108-26ff3771c578 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1510 microversion: 2.1 time: 0.461914 Sep 01 05:11:22.062878 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2122/4243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:21 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:22.126475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:22.132797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:22.134005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'ip': '172.20.0.7', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:22.193342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1845078475", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:22.319371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:11:22.477941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:22.478502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:22.479071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:22.480206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:22.480865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:22.481492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:22.767690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:22.814462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:22.977242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cf45ecc-4fd6-45dc-a3a7-7c01e8e0c8d5 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0.7" status: 200 len: 346 microversion: 2.1 time: 0.856130 Sep 01 05:11:22.980829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2123/4244] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:11:22 2022] GET /compute/v2.1/servers?ip=172.20.0.7 => generated 346 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:22.995173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:22.996979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:23.012033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:23.012739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:23.013371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:23.014296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:23.014959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:23.015556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:23.027023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:23.781108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:23.797669 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d708fff8-2337-4669-9693-825e86a50901 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1511 microversion: 2.1 time: 0.805831 Sep 01 05:11:23.800968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2124/4245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:22 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1511 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:23.844097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:23.844984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:23.853298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:23.854252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:23.855099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:23.856581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:23.857365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:23.858052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:24.667652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:11:24.669606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:11:24.670395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:11:24.671522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:11:24.672251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:11:24.728695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:24.730030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:24.731559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:24.733068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:24.734169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:24.735431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:24.741033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:24.757545 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-347e6245-9929-4d8a-ae98-f26da1c0187f tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1511 microversion: 2.1 time: 0.916425 Sep 01 05:11:24.763683 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2125/4246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:23 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1511 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:24.792337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:24.792968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:24.822240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:24.822752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:24.823232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:24.823955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:24.824410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:24.824852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:24.845110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:11:24.867356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:11:24.949907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:11:24.957258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:11:25.055710 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c1b2cde-3de8-4407-b190-609dd6e60eb2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.009536 Sep 01 05:11:25.057146 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2122/4247] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:11:25.069732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05a63e96-d970-4654-abd9-2f2640cda2c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:25.070397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05a63e96-d970-4654-abd9-2f2640cda2c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:26.066677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:26.100802 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-327e6863-5b44-4175-88d2-0b69b09ef838 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1510 microversion: 2.1 time: 1.319043 Sep 01 05:11:26.106404 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2126/4248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:24 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1510 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:26.131540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:26.149776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:26.150630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:26.156494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05a63e96-d970-4654-abd9-2f2640cda2c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:26.172623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:26.185919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05a63e96-d970-4654-abd9-2f2640cda2c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1193 microversion: 2.1 time: 1.111354 Sep 01 05:11:26.186059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:26.186059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:26.186059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:26.186059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:26.186876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:26.195033 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2123/4249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:25 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1193 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:26.363607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:26.450773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:26.479912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:26.489796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:26.490382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:26.943814 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2abf3f80-e88d-4f4d-af4d-ba63633435d4 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.823221 Sep 01 05:11:26.944698 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2127/4250] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:11:26 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:26.975869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:26.984069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:26.985210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:27.206873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:27.207963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:27.240388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:27.240988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:27.243037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:27.244822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:27.248057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:27.248949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:27.301841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:27.303000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:27.303700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:27.305457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:27.306190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:27.306849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:27.495747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:27.516127 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25ff5f12-fed8-43c5-a3e4-972ccccb7185 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1245 microversion: 2.1 time: 0.316743 Sep 01 05:11:27.527625 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2128/4251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:27 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1245 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:27.654003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:27.849393 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d147762b-bf3e-4810-9294-2e713468973e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.878703 Sep 01 05:11:27.867656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:27.869461 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2124/4252] 10.222.0.26 () {58 vars in 1150 bytes} [Thu Sep 1 05:11:26 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:27.904761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:27.909287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:27.930731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:27.931531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:27.931968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:27.936735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:27.937227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:27.937725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:28.294824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:28.541627 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9e2ff25-538f-44f1-bfb2-cdafa111eeb6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.680556 Sep 01 05:11:28.551901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:28.553185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:28.560516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2129/4253] 10.222.0.26 () {58 vars in 1212 bytes} [Thu Sep 1 05:11:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:28.577772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:28.579486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:28.582391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:28.583474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:28.585883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:28.586534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:28.586653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:28.633094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:28.635398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:28.679817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:28.682164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:28.684320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:28.689555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:28.695681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:28.697272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:28.916759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:29.010427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:29.062325 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c54d8775-704f-4a56-9c40-e7fa5e840190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1251 microversion: 2.1 time: 0.522232 Sep 01 05:11:29.063784 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2125/4254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:28 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1251 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:29.199699 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4361e6e2-b9bb-4fac-bc3f-b8be9abfbe00 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.632720 Sep 01 05:11:29.207880 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2130/4255] 10.222.0.26 () {58 vars in 1196 bytes} [Thu Sep 1 05:11:28 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:29.225518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:29.236008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:29.243910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': '1717812102', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:29.266174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:29.267564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:29.271742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:29.273868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:29.276435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:29.278044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:29.669494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:29.811055 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fbc1d3d-b09b-4007-a14c-0e55869bbeb9 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?name=1717812102" status: 200 len: 346 microversion: 2.1 time: 0.595132 Sep 01 05:11:29.812849 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2126/4256] 10.222.0.26 () {58 vars in 1156 bytes} [Thu Sep 1 05:11:29 2022] GET /compute/v2.1/servers?name=1717812102 => generated 346 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:11:29.841342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:29.849260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:29.852624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:29.876285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:29.880086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:29.884570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:29.887231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:29.889265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:29.889983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:30.091430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:30.092242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:30.101856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:30.107185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:30.107807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:30.108680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:30.109266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:30.109867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:30.235712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:30.355292 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc359296-fdd0-4b1a-9c77-3adf5680c4fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.528349 Sep 01 05:11:30.357575 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2131/4257] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Sep 1 05:11:29 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:30.381827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:30.391223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:30.392086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-171781210', 'deleted': False, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:11:30.397500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:30.404135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:30.404641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:30.405183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:30.406049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:30.407187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:30.409997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:30.414012 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcee709d-0c6c-4492-9990-565ad3939052 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1251 microversion: 2.1 time: 0.327284 Sep 01 05:11:30.421282 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2127/4258] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:30 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1251 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:30.690538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:11:30.931104 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04add207-128a-4427-9273-fcb32cd1c2cb tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-171781210" status: 200 len: 346 microversion: 2.1 time: 0.563657 Sep 01 05:11:30.938419 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2132/4259] 10.222.0.26 () {58 vars in 1228 bytes} [Thu Sep 1 05:11:30 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-171781210 => generated 346 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:30.959388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:30.960488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:30.990470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:31.016756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:31.017573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:31.020707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:31.021360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:31.022962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:31.095273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:11:31.309023 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-101d2e42-6364-417a-9952-5deab8b68996 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 204 len: 0 microversion: 2.1 time: 0.361657 Sep 01 05:11:31.312668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2128/4260] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:11:30 2022] DELETE /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:11:31.321624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:31.323451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:31.333061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:31.337702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:31.338318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:31.339238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:31.350851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:31.369511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:31.460749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:31.461477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:31.482096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:31.482611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:31.483099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:31.483817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:31.485391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:31.487325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:32.094346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:32.122505 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd5f066b-af19-4043-93e0-812fa49ff7f4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.660130 Sep 01 05:11:32.122505 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2129/4261] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:31 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:32.229922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:32.248628 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63f70c35-a7ff-4e77-a2b0-49a1eee7824d tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1516 microversion: 2.1 time: 0.930990 Sep 01 05:11:32.257392 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2133/4262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:31 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1516 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:33.150417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:33.151224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:33.167706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:33.168349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:33.168846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:33.169695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:33.173443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:33.174013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:33.304632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:33.305728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:33.345870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:33.346655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:33.347417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:33.348651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:33.349376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:33.368249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:34.148735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:34.186103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cc66508-9e8b-437b-92e5-98f8a61eae34 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 1.040176 Sep 01 05:11:34.187395 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2130/4263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:33 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:34.222653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2105596d-ada7-4c2b-ad60-97aaa91e3836 req-05bc4fec-4dd6-4ba1-88ea-4655bf825857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f560fa-34b7-43ca-829e-e073aaca19f3", "tag": "ce1a91af-90a6-44a3-9050-942e17bca3a7"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:34.248765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2105596d-ada7-4c2b-ad60-97aaa91e3836 req-05bc4fec-4dd6-4ba1-88ea-4655bf825857 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:34.249767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2105596d-ada7-4c2b-ad60-97aaa91e3836 req-05bc4fec-4dd6-4ba1-88ea-4655bf825857 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:34.250382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2105596d-ada7-4c2b-ad60-97aaa91e3836 req-05bc4fec-4dd6-4ba1-88ea-4655bf825857 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:34.283907 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2105596d-ada7-4c2b-ad60-97aaa91e3836 req-05bc4fec-4dd6-4ba1-88ea-4655bf825857 service nova] Creating event network-changed:ce1a91af-90a6-44a3-9050-942e17bca3a7 for instance e9f560fa-34b7-43ca-829e-e073aaca19f3 on n-h2-820368-37 Sep 01 05:11:34.297517 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2105596d-ada7-4c2b-ad60-97aaa91e3836 req-05bc4fec-4dd6-4ba1-88ea-4655bf825857 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108405 Sep 01 05:11:34.298823 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2131/4264] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:34.367085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-af5cb3d3-8ddd-4268-8452-a76f856b5fd8 req-9c61e6fc-4b3e-4600-8569-191ea120c59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22653959-56d1-4507-85b5-9305e0f8b1b5", "name": "network-vif-deleted", "tag": "9c66b3ed-338e-434c-8fe3-ff73a09a64cb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:34.401094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-af5cb3d3-8ddd-4268-8452-a76f856b5fd8 req-9c61e6fc-4b3e-4600-8569-191ea120c59d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:34.404573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-af5cb3d3-8ddd-4268-8452-a76f856b5fd8 req-9c61e6fc-4b3e-4600-8569-191ea120c59d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:34.406989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-af5cb3d3-8ddd-4268-8452-a76f856b5fd8 req-9c61e6fc-4b3e-4600-8569-191ea120c59d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:34.448303 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-af5cb3d3-8ddd-4268-8452-a76f856b5fd8 req-9c61e6fc-4b3e-4600-8569-191ea120c59d service nova] Creating event network-vif-deleted:9c66b3ed-338e-434c-8fe3-ff73a09a64cb for instance 22653959-56d1-4507-85b5-9305e0f8b1b5 on n-h1-820368-37 Sep 01 05:11:34.460916 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-af5cb3d3-8ddd-4268-8452-a76f856b5fd8 req-9c61e6fc-4b3e-4600-8569-191ea120c59d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098734 Sep 01 05:11:34.476656 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2132/4265] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:34.674506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:34.714382 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae446419-fd04-4b95-862f-89661a845f2e tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 200 len: 1516 microversion: 2.1 time: 1.425328 Sep 01 05:11:34.731519 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2134/4266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:33 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 1516 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:35.209972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:35.210834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:35.266776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:35.268896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:35.271828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:35.273905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:35.275038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:35.277816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:35.740629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:35.742359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 22653959-56d1-4507-85b5-9305e0f8b1b5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:35.770663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:35.774142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:35.776031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:35.779347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:35.780068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:35.783012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:35.844756 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] HTTP exception thrown: Instance 22653959-56d1-4507-85b5-9305e0f8b1b5 could not be found. Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Request method failure captured: Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 HTTP/1.1 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED66GfSzBhGm6XFvlEzH176__DjiADZ55Z62jNQndaV8tpuYCacygmtqijU8630gJDrp4gF6MufsgcBzbM4OV1_nJAgj8hcOIGWWqnkdigMGxpCksNt26nmOB5dr0CJiheIrW1_lfanauUWmrER81DEIdNj0kcEwbxbyKt9P29FN4Kg Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1b4cc69bc0c54f0e967d15d2f868f0c5 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1b4cc69bc0c54f0e967d15d2f868f0c5 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ListServerFiltersTestJSON-629368320-project Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: feb7312d8a144a6cbd7020f37a82dc93 Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ListServerFiltersTestJSON-629368320-project Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 22653959-56d1-4507-85b5-9305e0f8b1b5 could not be found. Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '22653959-56d1-4507-85b5-9305e0f8b1b5'} Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22653959-56d1-4507-85b5-9305e0f8b1b5 could not be found. Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22653959-56d1-4507-85b5-9305e0f8b1b5 could not be found. Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:35.849296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22653959-56d1-4507-85b5-9305e0f8b1b5 could not be found. Sep 01 05:11:35.855173 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:11:35.880127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Returning 404 to user: Instance 22653959-56d1-4507-85b5-9305e0f8b1b5 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:35.882377 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ed88cec-9182-4cb2-be2d-3952d4fca8fa tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5" status: 404 len: 111 microversion: 2.1 time: 0.149180 Sep 01 05:11:35.883711 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2135/4267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:35 2022] GET /compute/v2.1/servers/22653959-56d1-4507-85b5-9305e0f8b1b5 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:35.934271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:35.934810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:35.947475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:35.948804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:35.953625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:35.956435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:35.957182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:35.958144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:36.017470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:11:36.165411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:36.175632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:36.185943 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73c4c805-4ec1-41ad-83f5-7ae971615ae8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.980274 Sep 01 05:11:36.195573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2133/4268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:35 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:36.330484 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db1fc774-0608-46f8-b5aa-09afb0da0467 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 204 len: 0 microversion: 2.1 time: 0.414589 Sep 01 05:11:36.332517 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2136/4269] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:11:35 2022] DELETE /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:11:36.340501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:36.341134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:36.384186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:36.384794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:36.385254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:36.386007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:36.386466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:36.386967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:36.762734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:36.775781 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ea0e3fd-9064-419a-86a1-972a976fd4ad tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1517 microversion: 2.1 time: 0.440351 Sep 01 05:11:36.777342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2134/4270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:36 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1517 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:37.241876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:37.243042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:37.255442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:37.268444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:37.268958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:37.269394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:37.270120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:37.270535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:37.271174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:37.439055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:37.450189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:37.456161 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-224d22dc-cf24-44a3-b1ff-8640881bf58f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.218398 Sep 01 05:11:37.457879 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2137/4271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:37 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:37.799172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:37.800548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:37.813686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:37.814649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:37.815625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:37.816647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:37.817524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:37.818273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:38.116878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:38.138080 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-188259c1-7246-47e8-a75e-4bb514ffcee6 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1517 microversion: 2.1 time: 0.343559 Sep 01 05:11:38.139420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2135/4272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:37 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:38.482188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:38.483099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:38.504315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:38.505222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:38.505882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:38.506955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:38.507637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:38.508280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:38.730276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:38.742468 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32b348a8-2958-4b2f-93ff-46dd652b6fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.263834 Sep 01 05:11:38.743795 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2138/4273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:38 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:39.161561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:39.162976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:39.175489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:39.180766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:39.181418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:39.182358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:39.183242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:39.183867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:39.422692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:39.448063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:39.469874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36c289f6-596f-4c4d-b530-cbfc53f7ac98 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1517 microversion: 2.1 time: 0.313683 Sep 01 05:11:39.475535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2136/4274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:39 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1517 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:39.772737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:39.773265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:39.784406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:39.790522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:39.792021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:39.792949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:39.793830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:39.795257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:40.267573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:40.288238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3956a69e-5149-423d-987c-300379f1e5a3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.519276 Sep 01 05:11:40.303400 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2139/4275] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:39 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:40.506677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:40.507838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:40.526785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:40.530408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:40.531150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:40.534787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:40.536679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:40.537885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:41.075495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:41.099994 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90495e28-a44b-4d71-aa61-a17407680687 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1517 microversion: 2.1 time: 0.605796 Sep 01 05:11:41.100612 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2137/4276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:40 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1517 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:41.310387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:41.311024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:41.324079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:41.326509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:41.342224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:41.346519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:41.347759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:41.354151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:41.356499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:41.359664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:41.810328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d7d96610-2047-4f23-84da-6f4c9f3446a5 req-38a5e355-5007-4f27-bd53-7bab9c07d9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17123883-1925-4ca6-965f-5c1ac4ea2e88", "name": "network-vif-deleted", "tag": "5b2a2d0a-4e7e-47e6-842d-8c4799493938"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:41.864483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d7d96610-2047-4f23-84da-6f4c9f3446a5 req-38a5e355-5007-4f27-bd53-7bab9c07d9e6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:41.865568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d7d96610-2047-4f23-84da-6f4c9f3446a5 req-38a5e355-5007-4f27-bd53-7bab9c07d9e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:41.868347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d7d96610-2047-4f23-84da-6f4c9f3446a5 req-38a5e355-5007-4f27-bd53-7bab9c07d9e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:41.928821 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d7d96610-2047-4f23-84da-6f4c9f3446a5 req-38a5e355-5007-4f27-bd53-7bab9c07d9e6 service nova] Creating event network-vif-deleted:5b2a2d0a-4e7e-47e6-842d-8c4799493938 for instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 on n-h2-820368-37 Sep 01 05:11:41.949376 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d7d96610-2047-4f23-84da-6f4c9f3446a5 req-38a5e355-5007-4f27-bd53-7bab9c07d9e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151087 Sep 01 05:11:41.975339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2138/4277] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:42.012059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:42.027914 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49f93eea-aa17-45c5-b2fd-a02a3033e081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.722015 Sep 01 05:11:42.028531 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2140/4278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:41 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:42.122934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:42.123983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:42.148134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:42.152489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:42.152683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:42.156148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:42.160353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:42.163600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:42.201825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b71a2c24-90be-43ed-a38e-1b708519e973 req-3ca4be1a-d86f-47bd-9460-a11b09167fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f560fa-34b7-43ca-829e-e073aaca19f3", "name": "network-vif-plugged", "status": "completed", "tag": "ce1a91af-90a6-44a3-9050-942e17bca3a7"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:42.232259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b71a2c24-90be-43ed-a38e-1b708519e973 req-3ca4be1a-d86f-47bd-9460-a11b09167fcd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:42.233179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b71a2c24-90be-43ed-a38e-1b708519e973 req-3ca4be1a-d86f-47bd-9460-a11b09167fcd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:42.238314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b71a2c24-90be-43ed-a38e-1b708519e973 req-3ca4be1a-d86f-47bd-9460-a11b09167fcd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:42.306787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b71a2c24-90be-43ed-a38e-1b708519e973 req-3ca4be1a-d86f-47bd-9460-a11b09167fcd service nova] Creating event network-vif-plugged:ce1a91af-90a6-44a3-9050-942e17bca3a7 for instance e9f560fa-34b7-43ca-829e-e073aaca19f3 on n-h2-820368-37 Sep 01 05:11:42.320881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:42.321294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:42.325817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b71a2c24-90be-43ed-a38e-1b708519e973 req-3ca4be1a-d86f-47bd-9460-a11b09167fcd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130098 Sep 01 05:11:42.326497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:42.327034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lazy-loading 'fault' on Instance uuid 17123883-1925-4ca6-965f-5c1ac4ea2e88 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:11:42.333633 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2141/4279] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:11:42.347572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:42.460134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:42.470553 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9ac2208-37c7-4b8c-be22-ffc982cbab01 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 200 len: 1311 microversion: 2.1 time: 0.352865 Sep 01 05:11:42.492186 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2139/4280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:42 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 1311 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:43.051654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:43.052781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:43.073214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:43.074048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:43.074723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:43.076414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:43.077519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:43.080183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:43.368513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:43.382205 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1864b95-e0af-48eb-a933-e31115d230c2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.335171 Sep 01 05:11:43.404211 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2142/4281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:43 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:43.502931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:43.503840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: 17123883-1925-4ca6-965f-5c1ac4ea2e88] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:43.521337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:43.524639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:43.525331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:43.526081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:43.528585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:43.530550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:43.589397 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] HTTP exception thrown: Instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 could not be found. Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Request method failure captured: Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 HTTP/1.1 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED66GfSzBhGm6XFvlEzH176__DjiADZ55Z62jNQndaV8tpuYCacygmtqijU8630gJDrp4gF6MufsgcBzbM4OV1_nJAgj8hcOIGWWqnkdigMGxpCksNt26nmOB5dr0CJiheIrW1_lfanauUWmrER81DEIdNj0kcEwbxbyKt9P29FN4Kg Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 1b4cc69bc0c54f0e967d15d2f868f0c5 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 1b4cc69bc0c54f0e967d15d2f868f0c5 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListServerFiltersTestJSON-629368320-project Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: feb7312d8a144a6cbd7020f37a82dc93 Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListServerFiltersTestJSON-629368320-project Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 could not be found. Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '17123883-1925-4ca6-965f-5c1ac4ea2e88'} Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 could not be found. Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 could not be found. Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:43.592711 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 could not be found. Sep 01 05:11:43.598386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:43.604856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Returning 404 to user: Instance 17123883-1925-4ca6-965f-5c1ac4ea2e88 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:43.607220 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2069ea19-1d7a-4939-b87e-6943a864400b tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88" status: 404 len: 111 microversion: 2.1 time: 0.108567 Sep 01 05:11:43.609514 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2140/4282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:43 2022] GET /compute/v2.1/servers/17123883-1925-4ca6-965f-5c1ac4ea2e88 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:43.617794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:43.618288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:43.628041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:43.630803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:43.631879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:43.633517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:43.646712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:43.649716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:43.709309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:11:43.972076 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4b9af9f-26e5-4fc1-8d0b-bbb39356ea2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 204 len: 0 microversion: 2.1 time: 0.355373 Sep 01 05:11:43.975572 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2143/4283] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:11:43 2022] DELETE /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:11:43.985149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:43.985939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:44.009895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:44.014346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:44.015237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:44.019790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:44.020998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:44.024264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:44.389186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:44.406585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:44.407321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:44.407874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9e7e6f4-b5ee-4166-a6a4-3915957f09ce tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1517 microversion: 2.1 time: 0.419280 Sep 01 05:11:44.426151 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2141/4284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:43 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1517 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:44.428184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:44.428693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:44.429117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:44.429840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:44.430291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:44.430715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:44.780509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:44.791219 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37255d05-2488-4010-93ba-63330398d9a2 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1293 microversion: 2.1 time: 0.389131 Sep 01 05:11:44.792629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2144/4285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:44 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1293 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:45.432871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:45.434972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:45.445125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:45.446251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:45.447487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:45.448718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:45.449731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:45.450328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:45.817371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:45.818063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:45.834129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:45.834530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:45.834994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:45.844100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:45.854650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:45.855199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:45.855767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:45.873899 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c91adff7-429b-4e27-86a8-983456482ea7 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1517 microversion: 2.1 time: 0.446917 Sep 01 05:11:45.887456 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2142/4286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:45 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1517 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:46.151096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:46.165933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23633b90-b2b6-462d-b085-b74f71866478 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1475 microversion: 2.1 time: 0.353143 Sep 01 05:11:46.167123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2145/4287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:45 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:46.510718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1733165811", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:46.653136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:11:46.896874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:46.897497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:46.910988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:46.911483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:46.923495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:46.923495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:46.923495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:46.923495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:47.587202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7312d8a144a6cbd7020f37a82dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4cc69bc0c54f0e967d15d2f868f0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:47.597591 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10eb73d5-fa9f-4df3-8a7a-936f79395f2a tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 200 len: 1517 microversion: 2.1 time: 0.705807 Sep 01 05:11:47.601742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2146/4288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:46 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 1517 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:47.733427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-242077a7-cac6-4221-8270-2267593cac71 req-c260bff0-e352-4bfa-9919-c00a243c419f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c394a7a8-a66e-42d5-b446-0534352d9540", "name": "network-vif-deleted", "tag": "25e01162-218b-4be4-b28b-d1d97f9903e5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:47.790722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-242077a7-cac6-4221-8270-2267593cac71 req-c260bff0-e352-4bfa-9919-c00a243c419f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:47.793721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-242077a7-cac6-4221-8270-2267593cac71 req-c260bff0-e352-4bfa-9919-c00a243c419f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:47.796237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-242077a7-cac6-4221-8270-2267593cac71 req-c260bff0-e352-4bfa-9919-c00a243c419f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:47.841744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-242077a7-cac6-4221-8270-2267593cac71 req-c260bff0-e352-4bfa-9919-c00a243c419f service nova] Creating event network-vif-deleted:25e01162-218b-4be4-b28b-d1d97f9903e5 for instance c394a7a8-a66e-42d5-b446-0534352d9540 on n-h1-820368-37 Sep 01 05:11:47.858465 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-242077a7-cac6-4221-8270-2267593cac71 req-c260bff0-e352-4bfa-9919-c00a243c419f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146556 Sep 01 05:11:47.863271 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2147/4289] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:11:48.302668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:11:48.303381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:11:48.303696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:11:48.304307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:11:48.304730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:11:48.334628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:48.335822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:48.336455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:48.337386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:48.338005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:48.338586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:48.396531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:11:48.411207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:11:48.455251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:11:48.455251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:11:48.548860 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2035ae07-f5ab-490b-bdde-dd2e1102d31e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.042659 Sep 01 05:11:48.550350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2143/4290] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:11:48.562698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-023934c7-0d2b-43ca-aa0c-be545f363081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:48.563547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-023934c7-0d2b-43ca-aa0c-be545f363081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:48.630567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:48.642188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] [instance: c394a7a8-a66e-42d5-b446-0534352d9540] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:48.656122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-023934c7-0d2b-43ca-aa0c-be545f363081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:11:48.687518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:48.695001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:48.698674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:48.700896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:48.701672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:48.703599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:48.757388 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] HTTP exception thrown: Instance c394a7a8-a66e-42d5-b446-0534352d9540 could not be found. Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Request method failure captured: Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 HTTP/1.1 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED66GfSzBhGm6XFvlEzH176__DjiADZ55Z62jNQndaV8tpuYCacygmtqijU8630gJDrp4gF6MufsgcBzbM4OV1_nJAgj8hcOIGWWqnkdigMGxpCksNt26nmOB5dr0CJiheIrW1_lfanauUWmrER81DEIdNj0kcEwbxbyKt9P29FN4Kg Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 1b4cc69bc0c54f0e967d15d2f868f0c5 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b4cc69bc0c54f0e967d15d2f868f0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 1b4cc69bc0c54f0e967d15d2f868f0c5 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-629368320 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ListServerFiltersTestJSON-629368320-project Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: feb7312d8a144a6cbd7020f37a82dc93 Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ListServerFiltersTestJSON-629368320-project Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance c394a7a8-a66e-42d5-b446-0534352d9540 could not be found. Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'c394a7a8-a66e-42d5-b446-0534352d9540'} Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c394a7a8-a66e-42d5-b446-0534352d9540 could not be found. Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c394a7a8-a66e-42d5-b446-0534352d9540 could not be found. Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:48.759673 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c394a7a8-a66e-42d5-b446-0534352d9540 could not be found. Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:48.766238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] Returning 404 to user: Instance c394a7a8-a66e-42d5-b446-0534352d9540 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:48.768797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8804f918-d147-4ca0-b125-bc8507382f90 tempest-ListServerFiltersTestJSON-629368320 tempest-ListServerFiltersTestJSON-629368320-project] 10.222.0.26 "GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540" status: 404 len: 111 microversion: 2.1 time: 0.144368 Sep 01 05:11:48.769997 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2144/4291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:48 2022] GET /compute/v2.1/servers/c394a7a8-a66e-42d5-b446-0534352d9540 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:49.564165 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.scheduler.client.report [None req-023934c7-0d2b-43ca-aa0c-be545f363081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Deleted allocations for instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf Sep 01 05:11:49.571602 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-023934c7-0d2b-43ca-aa0c-be545f363081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] Instance Mapping does not exist while attempting local delete cleanup. Sep 01 05:11:49.573103 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-023934c7-0d2b-43ca-aa0c-be545f363081 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf" status: 204 len: 0 microversion: 2.1 time: 1.015561 Sep 01 05:11:49.577031 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2148/4292] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:11:48 2022] DELETE /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:11:49.583066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94c3723f-2d17-4ae2-88af-783a726516f1 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:49.584121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94c3723f-2d17-4ae2-88af-783a726516f1 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:49.592824 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-94c3723f-2d17-4ae2-88af-783a726516f1 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94c3723f-2d17-4ae2-88af-783a726516f1 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf HTTP/1.1 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf'} Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:11:49.597790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94c3723f-2d17-4ae2-88af-783a726516f1 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94c3723f-2d17-4ae2-88af-783a726516f1 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf" status: 404 len: 111 microversion: 2.1 time: 0.020560 Sep 01 05:11:49.602968 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2145/4293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:49 2022] GET /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:50.168746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1827478735", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:50.374322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:11:51.824394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:11:51.824895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:11:51.825343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:11:51.825815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:11:51.826301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:11:51.858574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:51.861097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:51.861899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:51.864491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:51.871065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:51.872926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:51.968944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:11:51.986291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:11:52.042320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:11:52.053840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:11:52.161334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-080f0766-e1a3-4374-b6b5-656cfdfb3a86 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002998 Sep 01 05:11:52.170540 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2149/4294] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:11:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:11:52.174823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-744354f9-c607-4054-b43f-d848c168a078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:52.175519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-744354f9-c607-4054-b43f-d848c168a078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:52.185031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:52.339337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-744354f9-c607-4054-b43f-d848c168a078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:52.356897 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-744354f9-c607-4054-b43f-d848c168a078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1221 microversion: 2.1 time: 0.184209 Sep 01 05:11:52.367247 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2146/4295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:52 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:53.379092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:53.380412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:53.393591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:53.401137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:53.401748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:53.403434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:53.403912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:53.404350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:53.562712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4ae62356-b43e-4130-a5a4-025182ca4dbd tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Action: 'create', calling method: .version_select at 0x7fa75bc41700>, body: {"keypair": {"name": "tempest-keypair-977911901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaZlBAhwzGasrQ0jzmcy9igUM9xocLYGbpRsiy45oznFO5RQ7kysbhdON2Isc0QG+9xBJNDwT5TfzK9Ya9E5v6lTH9FJPtRbzJXjg3IrEDPimKLZokS2XzbjvzLPbzl6A=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:53.614757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ae62356-b43e-4130-a5a4-025182ca4dbd tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Getting quotas for project 0e05207c3eac4610b5ba400ce1ebc015. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:11:53.625097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4ae62356-b43e-4130-a5a4-025182ca4dbd tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Getting quotas for user f88c717d3cb8499584ad95febdf7d93b and project 0e05207c3eac4610b5ba400ce1ebc015. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:11:53.633860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:53.649075 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69466bd0-e366-47e5-87cb-1109246602b9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1217 microversion: 2.1 time: 0.275219 Sep 01 05:11:53.659192 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2147/4296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:53 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:53.697772 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4ae62356-b43e-4130-a5a4-025182ca4dbd tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.083895 Sep 01 05:11:53.699055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2150/4297] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:11:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:11:54.674537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:54.675809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:54.687241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:54.687956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:54.688458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:54.689508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:54.700067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:54.703334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:54.918206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:54.929163 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61d5efef-4de8-4be7-b3a9-0a8dd771419d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1279 microversion: 2.1 time: 0.259058 Sep 01 05:11:54.943749 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2148/4298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:54 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1279 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:55.953498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:55.954200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:55.976733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:55.977235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:55.977668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:55.984776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:55.985631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:55.986235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:56.196355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:56.207523 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93d96d61-7e1a-40b1-8da4-b48c46de84c9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1279 microversion: 2.1 time: 0.258804 Sep 01 05:11:56.225539 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2151/4299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:55 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1279 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:11:57.239437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:57.241133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:57.291378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:57.293073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:57.293944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:57.302374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:57.308430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:57.309495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:58.050810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:58.085210 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74c83c39-04ca-4ab1-bafd-ae27a263885c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 0.843419 Sep 01 05:11:58.085210 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2149/4300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:57 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:59.110039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:11:59.116730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:11:59.148679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:59.149576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:59.150374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:59.151980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:59.159467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:59.168078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:59.573944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1696270344", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "21ee84cb-fc74-4547-9672-8e325bb9e261"}], "security_groups": [{"name": "tempest-securitygroup--199173198"}], "key_name": "tempest-keypair-977911901", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:59.709704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:59.716560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:11:59.730849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b6abb93-49ac-4d02-8c65-da4a7cf922b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 0.627686 Sep 01 05:11:59.750391 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2152/4301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:11:59 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:11:59.764815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4534cf91-988a-44f6-9e8f-1fd02dac9335 req-282edc55-b29f-4a30-9206-20f013690ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50", "tag": "6fbe8fb0-de54-4053-bcdc-0a7485e8abbb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:11:59.796623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4534cf91-988a-44f6-9e8f-1fd02dac9335 req-282edc55-b29f-4a30-9206-20f013690ea2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:11:59.800027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4534cf91-988a-44f6-9e8f-1fd02dac9335 req-282edc55-b29f-4a30-9206-20f013690ea2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:11:59.800787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4534cf91-988a-44f6-9e8f-1fd02dac9335 req-282edc55-b29f-4a30-9206-20f013690ea2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:11:59.852279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4534cf91-988a-44f6-9e8f-1fd02dac9335 req-282edc55-b29f-4a30-9206-20f013690ea2 service nova] Creating event network-changed:6fbe8fb0-de54-4053-bcdc-0a7485e8abbb for instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 on n-h1-820368-37 Sep 01 05:11:59.865200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4534cf91-988a-44f6-9e8f-1fd02dac9335 req-282edc55-b29f-4a30-9206-20f013690ea2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106079 Sep 01 05:11:59.868212 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2153/4302] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:12:00.056364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] validate_networks() for [('21ee84cb-fc74-4547-9672-8e325bb9e261', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:12:00.804334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:00.812578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:00.861095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:00.869534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:00.870074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:00.870845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:00.878960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:00.880109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:01.923521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:02.346289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:02.378623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:02.388042 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7437f0ae-a380-4767-9c7a-8e6411a1a143 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 1.632154 Sep 01 05:12:02.402987 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2154/4303] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:00 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:03.199929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Getting quotas for project 0e05207c3eac4610b5ba400ce1ebc015. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:03.231378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Getting quotas for user f88c717d3cb8499584ad95febdf7d93b and project 0e05207c3eac4610b5ba400ce1ebc015. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:03.276946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:12:03.284408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:12:03.289816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:12:03.295282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:12:03.297255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:12:03.351057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:03.352064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:03.359141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:03.360361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:03.372068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:03.373405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:03.426763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:03.428164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:03.434170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Getting quotas for project 0e05207c3eac4610b5ba400ce1ebc015. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:03.446863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:03.447416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:03.450829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Getting quotas for user f88c717d3cb8499584ad95febdf7d93b and project 0e05207c3eac4610b5ba400ce1ebc015. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:03.452471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:03.455190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:03.455701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:03.460105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:03.521276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:12:03.543141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:03.649789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:03.707047 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0314a53-571e-457f-8990-90c47269eb16 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.151131 Sep 01 05:12:03.717594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2150/4304] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:11:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 4163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:12:03.729178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4836c3eb-0295-4ee4-9d48-b7dc9e25fe61 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:03.736629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4836c3eb-0295-4ee4-9d48-b7dc9e25fe61 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:04.413165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4836c3eb-0295-4ee4-9d48-b7dc9e25fe61 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:04.447216 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4836c3eb-0295-4ee4-9d48-b7dc9e25fe61 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1277 microversion: 2.1 time: 0.716298 Sep 01 05:12:04.455854 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2151/4305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:03 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1277 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:04.505731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:04.550286 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ab9e03d-d9cf-4d84-a422-a5d60044bec3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 1.128143 Sep 01 05:12:04.572785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2155/4306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:03 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:05.477792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:05.478442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:05.490480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:05.498296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:05.499792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:05.508911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:05.510252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:05.512102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:05.608483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:05.612193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:05.663107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:05.665404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:05.669733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:05.673683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:05.679823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:05.681434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:05.963648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:05.988958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4dbf5e8-2dee-4e80-8b13-8b7f53c4ca3a tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1273 microversion: 2.1 time: 0.515410 Sep 01 05:12:05.993661 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2152/4307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:05 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1273 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:06.486408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:06.514253 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a31fb61-1af5-490a-b5fe-a3b818850cac tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 0.924660 Sep 01 05:12:06.521338 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2156/4308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:05 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:07.017707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:07.019209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:07.034220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:07.037334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:07.039008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:07.045867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:07.047192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:07.048151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:07.553031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:07.556830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:07.597639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:07.598558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:07.599354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:07.602199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:07.604362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:07.605589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:07.677438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:08.334166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:08.376727 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c21a4237-d3e4-4a38-908e-8e1fc1de0ab9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1335 microversion: 2.1 time: 1.366622 Sep 01 05:12:08.399446 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2153/4309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:07 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1335 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:09.283735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:09.299239 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42cdfa02-08e8-409b-bd79-f814b7c909ae tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 1.754687 Sep 01 05:12:09.299878 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2157/4310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:07 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:09.402571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:09.405801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:09.439350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:09.443636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:09.445152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:09.452377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:09.454255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:09.455029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:09.832252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:09.857897 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1379372-cbaf-48fa-b092-59d25bd9db6c tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1335 microversion: 2.1 time: 0.460814 Sep 01 05:12:09.858834 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2154/4311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:09 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1335 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:10.330703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:10.331712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:10.353038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:10.353782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:10.355613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:10.361042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:10.361578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:10.362145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:10.519824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ae16cff6-3d46-408d-9842-0635dacd239b req-2d0b47ff-48b8-4006-a68c-ff7bc9dab6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50", "name": "network-vif-plugged", "status": "completed", "tag": "6fbe8fb0-de54-4053-bcdc-0a7485e8abbb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:10.541072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ae16cff6-3d46-408d-9842-0635dacd239b req-2d0b47ff-48b8-4006-a68c-ff7bc9dab6bf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:10.548866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ae16cff6-3d46-408d-9842-0635dacd239b req-2d0b47ff-48b8-4006-a68c-ff7bc9dab6bf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:10.550012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ae16cff6-3d46-408d-9842-0635dacd239b req-2d0b47ff-48b8-4006-a68c-ff7bc9dab6bf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:10.584128 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ae16cff6-3d46-408d-9842-0635dacd239b req-2d0b47ff-48b8-4006-a68c-ff7bc9dab6bf service nova] Creating event network-vif-plugged:6fbe8fb0-de54-4053-bcdc-0a7485e8abbb for instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 on n-h1-820368-37 Sep 01 05:12:10.613671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ae16cff6-3d46-408d-9842-0635dacd239b req-2d0b47ff-48b8-4006-a68c-ff7bc9dab6bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099161 Sep 01 05:12:10.619826 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2155/4312] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:12:10.884932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:10.886568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:10.905736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:10.918136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:10.918136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:10.918136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:10.918136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:10.918136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:11.275680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:11.287676 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48f5bf44-09f5-4213-8f7e-483c23e2b3fc tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1335 microversion: 2.1 time: 0.407667 Sep 01 05:12:11.288315 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2156/4313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:10 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1335 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:11.331127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:11.346802 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de46c855-d9f3-4e69-9fd0-09bc93a40672 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1321 microversion: 2.1 time: 1.023973 Sep 01 05:12:11.363062 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2158/4314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:10 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1321 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:12.309247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:12.309869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:12.321196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:12.321693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:12.328789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:12.332098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:12.332678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:12.333138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:12.371135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:12.371818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:12.380936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:12.388486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=69 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:12.398222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:12.402858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:12.405973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:12.408809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:12.410090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:12.412050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:13.168927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:13.182427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-870e97c2-941f-4859-8669-da5b2a7982a9 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 0.877652 Sep 01 05:12:13.194917 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2157/4315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:12 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:13.251858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:13.262139 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea903372-0778-4a52-ab2c-d6f7346ffa99 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1502 microversion: 2.1 time: 0.895733 Sep 01 05:12:13.262752 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2159/4316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:12 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1502 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:13.286992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:13.289655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:13.307189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:13.309655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:13.310211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:13.310829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:13.311321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:13.315974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:13.404229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:13.889220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:13.905938 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ca55004-cac1-4164-bff4-e88552428f05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1502 microversion: 2.1 time: 0.623554 Sep 01 05:12:13.907705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2158/4317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:13 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1502 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:13.931119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:13.931744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:13.946526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:13.951151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:13.952015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:13.952966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:13.953622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:13.954294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:14.058613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:12:14.213210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:14.213842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:14.234012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:14.243692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:14.251711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:14.252807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:14.253502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:14.256131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:14.329697 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-763e2aea-2ee4-4c8b-a031-1a4e69cb3213 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 204 len: 0 microversion: 2.1 time: 0.401665 Sep 01 05:12:14.331347 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2160/4318] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:12:13 2022] DELETE /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:12:14.354312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:14.356420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:14.381780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:14.382274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:14.386560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:14.392201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:14.393151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:14.393602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:14.439912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:14.859962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:14.876969 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa8a1245-543c-4e22-b9b1-6100386869ed tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 0.669443 Sep 01 05:12:14.878830 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2159/4319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:14 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:14.884955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:14.900288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b20b4cda-373b-4c43-8f07-53e366d3d178 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1508 microversion: 2.1 time: 0.564131 Sep 01 05:12:14.903909 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2161/4320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:14 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:15.473638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e86d3a98-2ad2-4309-bf26-37adcbee86b5 req-a710d834-35cc-4b8f-87a8-448e47c6ab0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d41fae1-7569-4a7e-a003-d77c24e20dd7", "tag": "e84fb235-3dd8-4b22-8ebc-56d27be3c977"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:15.524546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e86d3a98-2ad2-4309-bf26-37adcbee86b5 req-a710d834-35cc-4b8f-87a8-448e47c6ab0d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:15.525365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e86d3a98-2ad2-4309-bf26-37adcbee86b5 req-a710d834-35cc-4b8f-87a8-448e47c6ab0d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:15.525805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e86d3a98-2ad2-4309-bf26-37adcbee86b5 req-a710d834-35cc-4b8f-87a8-448e47c6ab0d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:15.565047 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e86d3a98-2ad2-4309-bf26-37adcbee86b5 req-a710d834-35cc-4b8f-87a8-448e47c6ab0d service nova] Creating event network-changed:e84fb235-3dd8-4b22-8ebc-56d27be3c977 for instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 on n-h2-820368-37 Sep 01 05:12:15.583241 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e86d3a98-2ad2-4309-bf26-37adcbee86b5 req-a710d834-35cc-4b8f-87a8-448e47c6ab0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565437 Sep 01 05:12:15.583934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2160/4321] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:15.898664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:15.899363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:15.917923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:15.918813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:15.926911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:15.927919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:15.931881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:15.936061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:15.939520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:15.940215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:15.953175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:15.954089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:15.955981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:15.958928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:15.963941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:15.964664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:16.399652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:16.421902 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cfb83efd-86c0-4953-9e2f-749f923ba09c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1508 microversion: 2.1 time: 0.500500 Sep 01 05:12:16.431030 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2161/4322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:15 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:16.505521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:16.516264 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d34d85e3-5df5-4fd5-80e7-f711edd7e84f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 0.621939 Sep 01 05:12:16.518269 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2162/4323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:15 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:16.930772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0479ffe0-ca9f-4c0f-8723-1467d71539d4 req-d82d1a18-1986-4ec4-a468-dfc8bba641b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50", "name": "network-vif-deleted", "tag": "6fbe8fb0-de54-4053-bcdc-0a7485e8abbb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:16.976911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0479ffe0-ca9f-4c0f-8723-1467d71539d4 req-d82d1a18-1986-4ec4-a468-dfc8bba641b4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:16.978159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0479ffe0-ca9f-4c0f-8723-1467d71539d4 req-d82d1a18-1986-4ec4-a468-dfc8bba641b4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:16.978909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0479ffe0-ca9f-4c0f-8723-1467d71539d4 req-d82d1a18-1986-4ec4-a468-dfc8bba641b4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:16.996598 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0479ffe0-ca9f-4c0f-8723-1467d71539d4 req-d82d1a18-1986-4ec4-a468-dfc8bba641b4 service nova] Creating event network-vif-deleted:6fbe8fb0-de54-4053-bcdc-0a7485e8abbb for instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 on n-h1-820368-37 Sep 01 05:12:17.003743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0479ffe0-ca9f-4c0f-8723-1467d71539d4 req-d82d1a18-1986-4ec4-a468-dfc8bba641b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077447 Sep 01 05:12:17.005517 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2162/4324] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:17.457125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:17.457871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:17.458360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-442640718", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b1a9d49c-5f6f-4708-b9ef-d2922fc0d78e"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:17.473367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:17.474105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:17.474870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:17.475806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:17.476644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:17.477844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:17.559672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:17.560165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:17.560602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:17.561054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lazy-loading 'fault' on Instance uuid 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:12:17.574492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] validate_networks() for [('b1a9d49c-5f6f-4708-b9ef-d2922fc0d78e', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:12:17.730710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:17.748409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b12a8676-f43f-4236-b992-168e2e13a57b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 200 len: 1311 microversion: 2.1 time: 0.303207 Sep 01 05:12:17.751449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2163/4325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:17 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:17.774666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:17.775371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:17.802444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:17.804926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:17.808439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:17.809456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:17.809913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:17.810328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.242725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:18.263836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d551c26d-af93-4c51-ad48-8c66a2af4dad tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 0.510417 Sep 01 05:12:18.266982 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2164/4326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:17 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:18.452006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:12:18.452429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:12:18.452895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:12:18.453294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:12:18.453697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:12:18.466217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.467528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.468181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.469129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.469859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.470539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.493555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Getting quotas for project aa67803e6a5c481dbe7d79a85f6c0bf5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:18.500513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Getting quotas for user 611be14d99d747c8878e9f7ef151de87 and project aa67803e6a5c481dbe7d79a85f6c0bf5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:18.517080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Going to run 2 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:12:18.519813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 70478a9d-b186-46c3-8ba6-def37d45dad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:18.600976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=70478a9d-b186-46c3-8ba6-def37d45dad5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:18.754764 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f003d5a-1dbe-4c10-b84a-914f2ab03126 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.559237 Sep 01 05:12:18.761232 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2163/4327] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:12:18.766755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:18.773527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:18.775661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:18.776626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Searching by: {'deleted': False, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:12:18.779087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:18.789589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.799243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.800131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.801055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.804085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.814841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.833767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.835876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.838682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.844025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:18.847098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:18.847863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:18.874633 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 HTTP/1.1 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50'} Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:12:18.876821 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:12:18.881737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8611f41f-1ed5-4210-8255-5d4eca0552fe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 404 len: 111 microversion: 2.1 time: 0.106880 Sep 01 05:12:18.888756 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2164/4328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:18 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:12:18.902748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a009bcb9-5401-44a6-a378-87f275b2e41d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: .version_select at 0x7fa75b123940>, body: {"keypair": {"name": "tempest-key-1760197992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs7KMeHKrZDSWhu5Ki/SuSxHsVf4CnSnu1Evmk04i7fkNjkUm72WjlEZMjVDHRedmpxGLhppAz9+1WmoMKNfdwaSiWpP4akRZqMZIyZDytHs+vbn3WUjbPTT63FmotOWw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:18.950146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4765e43-da47-4e51-8284-7f55f01bbbd7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.184933 Sep 01 05:12:18.960305 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2165/4329] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 05:12:18 2022] GET /compute/v2.1/servers => generated 675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:12:18.986391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a009bcb9-5401-44a6-a378-87f275b2e41d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:18.998497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07d2e906-a4e0-4748-b504-a3f7387d8a6d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:19.001302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07d2e906-a4e0-4748-b504-a3f7387d8a6d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:19.008844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a009bcb9-5401-44a6-a378-87f275b2e41d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:19.091651 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a009bcb9-5401-44a6-a378-87f275b2e41d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.195467 Sep 01 05:12:19.092304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2165/4330] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:12:18 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:19.117709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1695f668-7481-4c45-a899-05d5814f6078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '.version_select at 0x7fa75ba8f160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:19.130554 n-d-820368-37 devstack@n-api.service[128862]: WARNING oslo_db.sqlalchemy.utils [None req-1695f668-7481-4c45-a899-05d5814f6078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 01 05:12:19.149422 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1695f668-7481-4c45-a899-05d5814f6078 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.046653 Sep 01 05:12:19.152441 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2166/4331] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 05:12:19 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:19.230478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-07d2e906-a4e0-4748-b504-a3f7387d8a6d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:19.240213 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07d2e906-a4e0-4748-b504-a3f7387d8a6d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1219 microversion: 2.1 time: 0.278649 Sep 01 05:12:19.245219 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2166/4332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:18 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1219 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:19.290528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:19.291478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:19.305723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:19.307817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:19.309226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:19.310135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:19.312216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:19.312957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:19.525314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-445709520", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-key-1760197992", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:19.672687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:12:19.961810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:19.984544 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-871beda2-d667-40a2-bbd6-65185767f5da tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 0.698467 Sep 01 05:12:19.985846 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2167/4333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:19 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:20.265516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-583f5663-4237-41c8-a8c4-8918328a9ef3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:20.266227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-583f5663-4237-41c8-a8c4-8918328a9ef3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:21.100648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-583f5663-4237-41c8-a8c4-8918328a9ef3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:21.109288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-583f5663-4237-41c8-a8c4-8918328a9ef3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1219 microversion: 2.1 time: 0.848017 Sep 01 05:12:21.115396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2168/4334] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:20 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1219 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:21.120409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:21.127908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:21.154119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:21.154923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:21.155542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:21.156428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:21.164505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:21.165117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:22.430169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:22.449701 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a995240-2498-4e35-a7a1-39fec931e7de tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 1.332942 Sep 01 05:12:22.459214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2169/4335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:21 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:22.503554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:22.507933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:22.540032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:22.541965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:22.542482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:22.543354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:22.544249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:22.546120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:22.658802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:12:22.665636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:12:22.667078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:12:22.668191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:12:22.670745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:12:22.679873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:22.729806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:22.730665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:22.731156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:22.734752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:22.737187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:22.737911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:22.812695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:22.825358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:22.830624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:22.847217 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ec19d3e-01d5-4f63-966c-5b608a37a7c3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1277 microversion: 2.1 time: 0.357465 Sep 01 05:12:22.847843 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2170/4336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:22 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1277 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:22.863735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cadbaeaf-2743-4fb0-b705-fae27f78f711 req-a1e0a2a9-3a80-4df6-9eff-98401116ef58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d41fae1-7569-4a7e-a003-d77c24e20dd7", "name": "network-vif-plugged", "status": "completed", "tag": "e84fb235-3dd8-4b22-8ebc-56d27be3c977"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:22.871673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:12:22.876012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:22.899121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cadbaeaf-2743-4fb0-b705-fae27f78f711 req-a1e0a2a9-3a80-4df6-9eff-98401116ef58 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:22.899604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cadbaeaf-2743-4fb0-b705-fae27f78f711 req-a1e0a2a9-3a80-4df6-9eff-98401116ef58 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:22.903257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cadbaeaf-2743-4fb0-b705-fae27f78f711 req-a1e0a2a9-3a80-4df6-9eff-98401116ef58 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:22.944325 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cadbaeaf-2743-4fb0-b705-fae27f78f711 req-a1e0a2a9-3a80-4df6-9eff-98401116ef58 service nova] Creating event network-vif-plugged:e84fb235-3dd8-4b22-8ebc-56d27be3c977 for instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 on n-h2-820368-37 Sep 01 05:12:22.965027 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cadbaeaf-2743-4fb0-b705-fae27f78f711 req-a1e0a2a9-3a80-4df6-9eff-98401116ef58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112735 Sep 01 05:12:22.965658 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2171/4337] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:22.991073 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9266401c-088e-4a5e-9492-cf5e8fc6d2b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.470129 Sep 01 05:12:22.992548 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2167/4338] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:12:23.006945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53b14df8-c71c-49a0-94c4-a9e6b83cf580 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:23.007847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53b14df8-c71c-49a0-94c4-a9e6b83cf580 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:23.477004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53b14df8-c71c-49a0-94c4-a9e6b83cf580 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:23.488109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:23.488887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:23.489565 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53b14df8-c71c-49a0-94c4-a9e6b83cf580 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1228 microversion: 2.1 time: 0.489989 Sep 01 05:12:23.495169 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2172/4339] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:22 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1228 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:23.522597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:23.524680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:23.525152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:23.525927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:23.528424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:23.529807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:23.870098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:23.871002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:23.879229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:23.892923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:23.893635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:23.894708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:23.897292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:23.897959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:24.352448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:24.368835 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c93a7f8-a317-4991-b87b-88daf78d76b2 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1402 microversion: 2.1 time: 0.886633 Sep 01 05:12:24.369444 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2168/4340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:23 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1402 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:24.517714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:24.518322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:24.532246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:24.536996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:24.537894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:24.538512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:24.538999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:24.539438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:24.716494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:24.744118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18a0849d-f7a9-4149-91da-a45abb0e4bcf tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1319 microversion: 2.1 time: 0.876714 Sep 01 05:12:24.748549 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2173/4341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:23 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1319 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:24.902593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:24.926003 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-772223cc-ad0d-4fe9-9723-b269cb1a6eb8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1232 microversion: 2.1 time: 0.404075 Sep 01 05:12:24.952797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2169/4342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:24 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1232 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:25.395427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:25.396154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:25.447300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:25.457885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:25.459419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:25.461274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:25.462364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:25.464715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:25.783671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:25.784383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:25.797268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:25.798434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:25.798434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:25.798962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:25.799422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:25.800351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:26.815278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:26.829633 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-026e7cb2-83bf-4268-9740-be0bbc5e8e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1589 microversion: 2.1 time: 1.438780 Sep 01 05:12:26.835593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2174/4343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:25 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1589 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:26.851306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:26.852220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:26.872783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:26.873678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:26.874267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:26.875794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:26.876908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:26.877646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:27.223709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:27.239829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:27.252486 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52504282-90e0-4233-8ada-ab482ea15e75 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1319 microversion: 2.1 time: 1.481829 Sep 01 05:12:27.256310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18635184-4d26-4bb6-9c49-088f1ca60f75 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1286 microversion: 2.1 time: 0.417727 Sep 01 05:12:27.274343 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2175/4344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:26 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1286 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:27.274462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2170/4345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:25 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1319 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:27.276449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:27.285169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:27.302617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cd64c104-44ff-4452-9f4b-944146a94bc8 req-9d93ea61-c532-4fd6-b85c-1d6b79589f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fd6819-81b9-4250-a50f-2a04901f5684", "tag": "4b3f760f-b82e-4849-b8fe-422119f3455e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:27.307494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:27.315854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:27.316521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:27.317286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:27.317757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:27.326444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:27.360571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd64c104-44ff-4452-9f4b-944146a94bc8 req-9d93ea61-c532-4fd6-b85c-1d6b79589f82 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:27.361114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd64c104-44ff-4452-9f4b-944146a94bc8 req-9d93ea61-c532-4fd6-b85c-1d6b79589f82 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:27.366536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd64c104-44ff-4452-9f4b-944146a94bc8 req-9d93ea61-c532-4fd6-b85c-1d6b79589f82 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:27.402295 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cd64c104-44ff-4452-9f4b-944146a94bc8 req-9d93ea61-c532-4fd6-b85c-1d6b79589f82 service nova] Creating event network-changed:4b3f760f-b82e-4849-b8fe-422119f3455e for instance 61fd6819-81b9-4250-a50f-2a04901f5684 on n-h1-820368-37 Sep 01 05:12:27.425448 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cd64c104-44ff-4452-9f4b-944146a94bc8 req-9d93ea61-c532-4fd6-b85c-1d6b79589f82 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147917 Sep 01 05:12:27.427666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2171/4346] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:27.771287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f36b42d3-d6ac-4c4e-9e97-4e238ea955e0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.506736 Sep 01 05:12:27.772437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2176/4347] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:12:27 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7/os-interface => generated 284 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:28.280745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:28.281873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:28.284011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:28.284939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:28.301719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:28.306258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:28.308502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:28.310535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:28.312223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:28.315630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:28.316792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:28.317065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:28.317799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:28.322345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:28.329758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:28.330477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:28.523416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:28.725490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:28.735719 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b3dd28b-5b34-43f3-be34-0a0318383edd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1286 microversion: 2.1 time: 0.458622 Sep 01 05:12:28.752697 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2177/4348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:28 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1286 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:29.065837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:29.083953 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc1b53ac-4202-4698-9b83-f70fcea880f7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1319 microversion: 2.1 time: 0.807035 Sep 01 05:12:29.085361 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2172/4349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:28 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1319 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:29.765040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:29.767899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:29.784195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:29.785620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:29.786625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:29.788301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:29.789363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:29.790334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:30.025329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:30.029753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:30.045556 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9be6979-6942-41c8-aac8-43e7fe518de0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1286 microversion: 2.1 time: 0.289857 Sep 01 05:12:30.052811 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2178/4350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:29 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1286 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:30.117661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:30.118923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:30.144884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:30.145988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:30.145988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:30.147607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:30.148262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:30.148851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:31.124663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:31.131578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:31.197640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:31.209617 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05658331-cd35-4514-8086-93f010f92e5d tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1319 microversion: 2.1 time: 1.099159 Sep 01 05:12:31.212891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2173/4351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:30 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1319 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:31.219926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b17c7f78-c0c6-423a-8343-837427a4e902 req-c9b7e535-7183-4162-9190-102c1d04a8cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70478a9d-b186-46c3-8ba6-def37d45dad5", "tag": "151cede3-20f2-4c0a-ba40-5e32bfe85e5c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:31.249085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b17c7f78-c0c6-423a-8343-837427a4e902 req-c9b7e535-7183-4162-9190-102c1d04a8cd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:31.249636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b17c7f78-c0c6-423a-8343-837427a4e902 req-c9b7e535-7183-4162-9190-102c1d04a8cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:31.254530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b17c7f78-c0c6-423a-8343-837427a4e902 req-c9b7e535-7183-4162-9190-102c1d04a8cd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:31.271594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:31.271958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:31.279214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:31.283926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:31.291299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:31.291799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:31.308068 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b17c7f78-c0c6-423a-8343-837427a4e902 req-c9b7e535-7183-4162-9190-102c1d04a8cd service nova] Creating event network-changed:151cede3-20f2-4c0a-ba40-5e32bfe85e5c for instance 70478a9d-b186-46c3-8ba6-def37d45dad5 on n-h1-820368-37 Sep 01 05:12:31.324611 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b17c7f78-c0c6-423a-8343-837427a4e902 req-c9b7e535-7183-4162-9190-102c1d04a8cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109970 Sep 01 05:12:31.326457 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2174/4352] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:31.892663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1728312459", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "3783ba2a-aea1-4007-8ee7-137ceb2adc5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:32.027426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] validate_networks() for [('3783ba2a-aea1-4007-8ee7-137ceb2adc5b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:12:32.478861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:32.493089 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dceb7fcb-077b-4938-bfd1-9dacb84fca90 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 1.417862 Sep 01 05:12:32.494387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2179/4353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:31 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:32.500829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:32.501874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:32.509480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:32.510410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:32.511109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:32.517916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:32.518749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:32.519262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:32.775959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:32.866342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:33.247219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:33.267063 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8976e12-856d-432b-ad08-c6785b332a0b tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1319 microversion: 2.1 time: 0.770666 Sep 01 05:12:33.282075 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2180/4354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:32 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1319 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:33.296612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:33.297693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:33.308345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:33.309176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:33.309869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:33.310872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:33.311555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:33.312203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:33.487638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:34.699655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:34.713042 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46493fe8-d41d-46f5-b839-7e611b3a71cf tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1589 microversion: 2.1 time: 1.425077 Sep 01 05:12:34.716825 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2181/4355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:33 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1589 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:34.727277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:34.730070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:34.743470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:34.746615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:34.748298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:34.749018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:12:34.749479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:12:34.749901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:12:34.750326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:12:34.751063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:12:34.752249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:34.755213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:34.756855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:34.769062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:34.769553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:34.769985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:34.770704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:34.776750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:34.777275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:34.840592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Getting quotas for project 44d4d0afdb1f48cca5b43c2469ba33ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:34.848497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Getting quotas for user efd853a20dc94d2b9f2d080a903c046b and project 44d4d0afdb1f48cca5b43c2469ba33ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:34.867063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:12:34.871013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:34.945648 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc0bd8ac-969a-4f13-baac-52326a2edb67 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.063993 Sep 01 05:12:34.948802 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2175/4356] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:12:34.960976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8b135e99-9884-4182-b723-beece0af75b3 req-39b05fc1-4b7d-4762-b4e5-36aa7af5f098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d41fae1-7569-4a7e-a003-d77c24e20dd7", "tag": "e84fb235-3dd8-4b22-8ebc-56d27be3c977"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:35.009222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b135e99-9884-4182-b723-beece0af75b3 req-39b05fc1-4b7d-4762-b4e5-36aa7af5f098 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:35.017196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b135e99-9884-4182-b723-beece0af75b3 req-39b05fc1-4b7d-4762-b4e5-36aa7af5f098 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:35.017970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b135e99-9884-4182-b723-beece0af75b3 req-39b05fc1-4b7d-4762-b4e5-36aa7af5f098 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:35.053235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8b135e99-9884-4182-b723-beece0af75b3 req-39b05fc1-4b7d-4762-b4e5-36aa7af5f098 service nova] Creating event network-changed:e84fb235-3dd8-4b22-8ebc-56d27be3c977 for instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 on n-h2-820368-37 Sep 01 05:12:35.077390 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8b135e99-9884-4182-b723-beece0af75b3 req-39b05fc1-4b7d-4762-b4e5-36aa7af5f098 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111976 Sep 01 05:12:35.079226 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2176/4357] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:35.087498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8ff87da0-fce2-4a4f-bc64-dc546f9ecd88 req-b83e31e9-b33e-422c-92b6-4e585f7fc926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fd6819-81b9-4250-a50f-2a04901f5684", "name": "network-vif-plugged", "status": "completed", "tag": "4b3f760f-b82e-4849-b8fe-422119f3455e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:35.108163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8ff87da0-fce2-4a4f-bc64-dc546f9ecd88 req-b83e31e9-b33e-422c-92b6-4e585f7fc926 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:35.109975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8ff87da0-fce2-4a4f-bc64-dc546f9ecd88 req-b83e31e9-b33e-422c-92b6-4e585f7fc926 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:35.110768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8ff87da0-fce2-4a4f-bc64-dc546f9ecd88 req-b83e31e9-b33e-422c-92b6-4e585f7fc926 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:35.166200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8ff87da0-fce2-4a4f-bc64-dc546f9ecd88 req-b83e31e9-b33e-422c-92b6-4e585f7fc926 service nova] Creating event network-vif-plugged:4b3f760f-b82e-4849-b8fe-422119f3455e for instance 61fd6819-81b9-4250-a50f-2a04901f5684 on n-h1-820368-37 Sep 01 05:12:35.176392 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8ff87da0-fce2-4a4f-bc64-dc546f9ecd88 req-b83e31e9-b33e-422c-92b6-4e585f7fc926 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092222 Sep 01 05:12:35.179634 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2177/4358] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:35.185045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:35.185751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:35.212390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:35.212889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:35.213332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:35.214050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:35.214513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:35.214970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:35.299459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:35.307605 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bce11446-0986-4cf4-b5a2-32e15a6f13e5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.589315 Sep 01 05:12:35.308534 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2182/4359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:34 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:35.336027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57ca60da-0c6e-4cb3-bc31-50809274b684 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:35.336646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57ca60da-0c6e-4cb3-bc31-50809274b684 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:35.921108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57ca60da-0c6e-4cb3-bc31-50809274b684 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:35.963690 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57ca60da-0c6e-4cb3-bc31-50809274b684 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1219 microversion: 2.1 time: 0.631521 Sep 01 05:12:35.965245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2183/4360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:35 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1219 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:36.329917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:36.330832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:36.357762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:36.358902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:36.360359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:36.364781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:36.368669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:36.369457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:36.446801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:36.464605 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06b97dd8-81dc-44bc-afab-4e871f5d2bbe tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1319 microversion: 2.1 time: 1.283561 Sep 01 05:12:36.468462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2178/4361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:35 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1319 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:36.883014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:36.903162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b0c5077-322b-46a6-9b8c-00781f840d33 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.570325 Sep 01 05:12:36.918834 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2184/4362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:36 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:36.985903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:36.986804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:36.998406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:36.999210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:36.999808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:37.014747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:37.017966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:37.018617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:37.121334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-971deda0-5be8-4430-9de6-9b1acff3ba82 req-98fd83dd-89b6-4c7a-918b-8970fd540d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8", "tag": "f98475ab-5c22-4f66-befe-737e27f6d0c9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:37.143146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-971deda0-5be8-4430-9de6-9b1acff3ba82 req-98fd83dd-89b6-4c7a-918b-8970fd540d16 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:37.143738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-971deda0-5be8-4430-9de6-9b1acff3ba82 req-98fd83dd-89b6-4c7a-918b-8970fd540d16 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:37.144177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-971deda0-5be8-4430-9de6-9b1acff3ba82 req-98fd83dd-89b6-4c7a-918b-8970fd540d16 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:37.176285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-971deda0-5be8-4430-9de6-9b1acff3ba82 req-98fd83dd-89b6-4c7a-918b-8970fd540d16 service nova] Creating event network-changed:f98475ab-5c22-4f66-befe-737e27f6d0c9 for instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 on n-h2-820368-37 Sep 01 05:12:37.186662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-971deda0-5be8-4430-9de6-9b1acff3ba82 req-98fd83dd-89b6-4c7a-918b-8970fd540d16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069012 Sep 01 05:12:37.190961 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2185/4363] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:37.408128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:37.436109 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a8409a4-8104-4c4d-b6fc-5648c2a12d0d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1215 microversion: 2.1 time: 0.453881 Sep 01 05:12:37.438653 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2179/4364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:36 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1215 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:37.495634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:37.498355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:37.523364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:37.523829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:37.524270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:37.527320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:37.527962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:37.529263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:37.932795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:37.933818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:37.959227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:37.965857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:37.966831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:37.972116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:37.978139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:37.978697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:38.610141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:38.622087 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35f3ec63-946a-4539-9fdc-8120b6b4f6f2 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 200 len: 1508 microversion: 2.1 time: 1.136150 Sep 01 05:12:38.633319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2186/4365] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:37 2022] GET /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 1508 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:38.637401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:38.643715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:38.683526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:38.683526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:38.683526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:38.683526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:38.683526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:38.683526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:38.874115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:38.877794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:38.898585 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69679f44-328f-48f1-84d3-28184e51320a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.971125 Sep 01 05:12:38.914915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2180/4366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:37 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:38.943503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:38.953080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 70478a9d-b186-46c3-8ba6-def37d45dad5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:38.979031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:38.979926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:38.980600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:38.981566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:38.983612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:38.984318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:39.006638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:39.030367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2dffd34e-d473-4d4c-9239-1eefcccf17f3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1277 microversion: 2.1 time: 0.398474 Sep 01 05:12:39.034539 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2187/4367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:38 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1277 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:39.296140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:39.323790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa7b6ef6-69e4-4f97-b3df-64680e8f7942 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5" status: 200 len: 1319 microversion: 2.1 time: 0.409982 Sep 01 05:12:39.326878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2181/4368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:38 2022] GET /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:39.472381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8510a917-e864-46a6-8153-baa85899a572 req-b00c1a36-edcf-44b7-924e-39ac51797157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70478a9d-b186-46c3-8ba6-def37d45dad5", "name": "network-vif-plugged", "status": "completed", "tag": "151cede3-20f2-4c0a-ba40-5e32bfe85e5c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:39.486111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8510a917-e864-46a6-8153-baa85899a572 req-b00c1a36-edcf-44b7-924e-39ac51797157 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:39.486730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8510a917-e864-46a6-8153-baa85899a572 req-b00c1a36-edcf-44b7-924e-39ac51797157 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:39.487393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8510a917-e864-46a6-8153-baa85899a572 req-b00c1a36-edcf-44b7-924e-39ac51797157 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:39.514316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8510a917-e864-46a6-8153-baa85899a572 req-b00c1a36-edcf-44b7-924e-39ac51797157 service nova] Creating event network-vif-plugged:151cede3-20f2-4c0a-ba40-5e32bfe85e5c for instance 70478a9d-b186-46c3-8ba6-def37d45dad5 on n-h1-820368-37 Sep 01 05:12:39.521918 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8510a917-e864-46a6-8153-baa85899a572 req-b00c1a36-edcf-44b7-924e-39ac51797157 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058313 Sep 01 05:12:39.523990 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2188/4369] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:39.929569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:39.931104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:39.940775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:39.962283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:39.962283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:39.962283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:39.969320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:39.970027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:39.970529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.206251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:40.214641 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e89ca312-611a-4c4c-9207-906014df65e8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.292908 Sep 01 05:12:40.215725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2189/4370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:39 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:40.223381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:40.224273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:40.231322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.232309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.232797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.233656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.234120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.234962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.352955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Calling method '.version_select at 0x7fa75b238d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:40.355354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.355955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.356639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.382500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.383051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.383496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.395763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.396259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.396723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.405694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5cad030-467a-4487-8dc3-9c5c7969a795 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1497298548-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.486662 Sep 01 05:12:40.406781 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2182/4371] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:12:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:40.415558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:40.416949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 70478a9d-b186-46c3-8ba6-def37d45dad5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:40.425627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.426423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.427097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.428207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:40.428905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:40.429932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:40.513517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:40.545158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52e09a24-c4d9-4818-8110-63ced6111d3d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1319 microversion: 2.1 time: 0.328122 Sep 01 05:12:40.546618 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2190/4372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:40 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:40.724223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:40.736790 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5fb5ff15-6a1e-477f-9927-53209f977c52 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5" status: 200 len: 1319 microversion: 2.1 time: 0.326808 Sep 01 05:12:40.737451 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2183/4373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:40 2022] GET /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:41.203710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1fdcbfb8-6303-480f-8d38-35f878950dd7 req-c112e1ac-d4d0-45c1-9cb0-bd41b02a08db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "592288da-ac4d-4eb7-ad8a-f6a505e803bd", "tag": "d486cd19-00e4-4e8f-9ec8-76a14699627e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:41.214932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fdcbfb8-6303-480f-8d38-35f878950dd7 req-c112e1ac-d4d0-45c1-9cb0-bd41b02a08db service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:41.215367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fdcbfb8-6303-480f-8d38-35f878950dd7 req-c112e1ac-d4d0-45c1-9cb0-bd41b02a08db service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:41.216058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fdcbfb8-6303-480f-8d38-35f878950dd7 req-c112e1ac-d4d0-45c1-9cb0-bd41b02a08db service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:41.237238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:41.238159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:41.243540 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1fdcbfb8-6303-480f-8d38-35f878950dd7 req-c112e1ac-d4d0-45c1-9cb0-bd41b02a08db service nova] Creating event network-changed:d486cd19-00e4-4e8f-9ec8-76a14699627e for instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd on n-h1-820368-37 Sep 01 05:12:41.249685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:41.252003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:41.252734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:41.254037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:41.255586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:41.256003 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1fdcbfb8-6303-480f-8d38-35f878950dd7 req-c112e1ac-d4d0-45c1-9cb0-bd41b02a08db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055394 Sep 01 05:12:41.257633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:41.257888 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2191/4374] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:41.594786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:41.597924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:41.620815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:41.623793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:41.624432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:41.625237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:41.626058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:41.626629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:42.101093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:42.118314 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da85aea2-2d46-4007-80de-020ca650c1e7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.885664 Sep 01 05:12:42.119239 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2184/4375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:41 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:42.132490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:42.134425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 70478a9d-b186-46c3-8ba6-def37d45dad5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:42.144540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:42.145359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:42.146435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:42.147451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:42.148258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:42.148842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:42.273588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:42.288002 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce6d51d9-e642-47ad-ab54-bce2d9d1d1ad tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1319 microversion: 2.1 time: 0.720498 Sep 01 05:12:42.292250 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2192/4376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:41 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:42.545661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:42.563574 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b48c5c9c-5b17-4797-9936-64aa79f2c4c7 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5" status: 200 len: 1507 microversion: 2.1 time: 0.438643 Sep 01 05:12:42.564906 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2185/4377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:42 2022] GET /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5 => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:42.596718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:42.597568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 70478a9d-b186-46c3-8ba6-def37d45dad5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:42.607437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:42.608454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:42.609613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:42.611780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:42.612520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:42.613860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:42.708118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 70478a9d-b186-46c3-8ba6-def37d45dad5] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:12:42.950979 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5ae6daa-1373-40f8-b284-cfaa33fc75b3 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "DELETE /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5" status: 204 len: 0 microversion: 2.1 time: 0.358553 Sep 01 05:12:42.960131 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2193/4378] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:12:42 2022] DELETE /compute/v2.1/servers/70478a9d-b186-46c3-8ba6-def37d45dad5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:12:42.973075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:42.973075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:42.992734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:42.995695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:42.997324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:42.998229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:43.003310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:43.013154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:43.092497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 61fd6819-81b9-4250-a50f-2a04901f5684] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:12:43.166739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:43.177478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:43.201628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:43.202526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:43.203549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:43.204893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:43.212897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:43.223598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:43.315318 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71ca95c1-0d79-427a-b51b-b349470a56a0 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684" status: 204 len: 0 microversion: 2.1 time: 0.348608 Sep 01 05:12:43.317380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2186/4379] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:12:42 2022] DELETE /compute/v2.1/servers/61fd6819-81b9-4250-a50f-2a04901f5684 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:12:43.346130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:43.346965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:43.354042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:43.354781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:43.355074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:43.355887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:43.356689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:43.357351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:43.709203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:43.737284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e280c9a-3bc3-41fd-b8ce-e6ade6104485 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.575931 Sep 01 05:12:43.745386 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2194/4380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:43 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:43.758183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1244895619", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b1a9d49c-5f6f-4708-b9ef-d2922fc0d78e"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:43.790654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:43.805429 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d634aea-dd05-4578-b0e4-1fd842bd4473 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1319 microversion: 2.1 time: 0.472073 Sep 01 05:12:43.808645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2187/4381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:43 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:43.895983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] validate_networks() for [('b1a9d49c-5f6f-4708-b9ef-d2922fc0d78e', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:12:44.010767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b5abc270-b1c9-4473-a656-459a03bd7361 req-7f2b4dab-496e-407b-a2b4-a02e37d11728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8", "name": "network-vif-plugged", "status": "completed", "tag": "f98475ab-5c22-4f66-befe-737e27f6d0c9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:44.036332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b5abc270-b1c9-4473-a656-459a03bd7361 req-7f2b4dab-496e-407b-a2b4-a02e37d11728 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:44.037110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b5abc270-b1c9-4473-a656-459a03bd7361 req-7f2b4dab-496e-407b-a2b4-a02e37d11728 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:44.037712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b5abc270-b1c9-4473-a656-459a03bd7361 req-7f2b4dab-496e-407b-a2b4-a02e37d11728 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:44.059103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b5abc270-b1c9-4473-a656-459a03bd7361 req-7f2b4dab-496e-407b-a2b4-a02e37d11728 service nova] Creating event network-vif-plugged:f98475ab-5c22-4f66-befe-737e27f6d0c9 for instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 on n-h2-820368-37 Sep 01 05:12:44.082664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b5abc270-b1c9-4473-a656-459a03bd7361 req-7f2b4dab-496e-407b-a2b4-a02e37d11728 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084801 Sep 01 05:12:44.086560 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2188/4382] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 01 05:12:44.768570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:44.770103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:44.781561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:44.783157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:44.785505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:44.786476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:44.787200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:44.787856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:44.804859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:12:44.805447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:12:44.805739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:12:44.806146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:12:44.806565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:12:44.820579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:44.821070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:44.822865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:44.823718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:44.824515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:44.824976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:44.830030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:44.861229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:44.876788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Getting quotas for project aa67803e6a5c481dbe7d79a85f6c0bf5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:44.883731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Getting quotas for user 611be14d99d747c8878e9f7ef151de87 and project aa67803e6a5c481dbe7d79a85f6c0bf5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:44.967326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Going to run 2 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:12:44.971566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:45.055134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=49813a21-ab54-4e5e-a566-c2558eb0475d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:45.120503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:45.132804 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39f91978-5b95-4aeb-a3fa-e38efad1f7ca tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1328 microversion: 2.1 time: 0.370587 Sep 01 05:12:45.136201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2189/4383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:44 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:45.169704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:45.170769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:45.187699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:45.190482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:45.191309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:45.193575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:45.195360 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39be4b44-d4ba-40a2-a4c4-5511c46dbf3c tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.447251 Sep 01 05:12:45.195684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:45.197015 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2195/4384] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:12:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1451 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 01 05:12:45.197221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:45.218302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:45.243935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:45.253174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Searching by: {'deleted': False, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:12:45.336904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:45.343552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:45.347371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:45.349311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:45.353220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:45.358264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:45.442399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:12:45.552542 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c97425c7-6f6b-46d9-8d80-34451e080714 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.346352 Sep 01 05:12:45.555123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2196/4385] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 05:12:45 2022] GET /compute/v2.1/servers => generated 1335 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:45.569864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b24764c0-d504-4863-94df-c361adac820e tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:45.574302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b24764c0-d504-4863-94df-c361adac820e tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:45.939862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b24764c0-d504-4863-94df-c361adac820e tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:45.948406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b24764c0-d504-4863-94df-c361adac820e tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1218 microversion: 2.1 time: 0.383697 Sep 01 05:12:45.949209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2197/4386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:45 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1218 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:46.156759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:46.158015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:46.169608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:46.174609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:46.175008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:46.175760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:46.176214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:46.184036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:46.187389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:46.194494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:46.207061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1acdd461-ca66-43e5-8d1e-2da6c9e6a9ca tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1319 microversion: 2.1 time: 1.058938 Sep 01 05:12:46.212756 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2190/4387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:45 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1319 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:46.763385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:46.778213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43533cdf-f811-4c16-8962-a2127dc0ff41 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1510 microversion: 2.1 time: 0.625647 Sep 01 05:12:46.778820 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2198/4388] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:46 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1510 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:46.800332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:46.800855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:46.808557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:46.809319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:46.809922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:46.811382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:46.812261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:46.813110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:46.969868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:46.970579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:46.977623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:46.978275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:46.978721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:46.979531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:46.980168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:46.980759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:47.117761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:47.128163 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9bc4910-5bd1-42de-af82-013f05a2f089 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1270 microversion: 2.1 time: 0.162381 Sep 01 05:12:47.131922 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2199/4389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:46 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:47.173496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:47.183132 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fefd97a2-d20d-4ff5-adc2-705fb45c83fc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1510 microversion: 2.1 time: 0.386850 Sep 01 05:12:47.190939 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2191/4390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:46 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:47.216765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:47.217299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:47.238680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:47.239328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:47.253090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:47.254217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:47.254825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:47.255765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:47.257468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:47.258590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:47.261112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:47.262300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:47.262948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:47.264032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:47.264773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:47.265434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:47.336103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:12:47.539106 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4baf306c-3a1b-4938-b0b3-d9591d1dc844 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 204 len: 0 microversion: 2.1 time: 0.335136 Sep 01 05:12:47.550163 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2200/4391] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:12:47 2022] DELETE /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:12:47.565962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:47.567059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:47.577401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:47.578667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:47.579511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:47.580458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:47.581079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:47.582679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:48.052515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:48.071769 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2694eb1f-d170-48cd-83a7-cf69ca946c31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1319 microversion: 2.1 time: 0.838488 Sep 01 05:12:48.073949 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2192/4392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:47 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:48.088559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5623a7ce-83a1-43a4-a733-3bc91c4c43fa req-3e7a59e6-a666-4aa1-ac1e-56380c45230e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592288da-ac4d-4eb7-ad8a-f6a505e803bd", "name": "network-vif-plugged", "status": "completed", "tag": "d486cd19-00e4-4e8f-9ec8-76a14699627e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:48.103606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:48.118975 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d71392d-82b8-426a-98cc-ff4432dd3701 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1516 microversion: 2.1 time: 0.562484 Sep 01 05:12:48.121850 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2201/4393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:47 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1516 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:48.123054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5623a7ce-83a1-43a4-a733-3bc91c4c43fa req-3e7a59e6-a666-4aa1-ac1e-56380c45230e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:48.124354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5623a7ce-83a1-43a4-a733-3bc91c4c43fa req-3e7a59e6-a666-4aa1-ac1e-56380c45230e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:48.127127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5623a7ce-83a1-43a4-a733-3bc91c4c43fa req-3e7a59e6-a666-4aa1-ac1e-56380c45230e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:48.132514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-116fde71-0bd3-4abc-9ff5-628966d8ddb0 req-fef057a8-b77f-4fb9-8700-bba224f3ca44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fd6819-81b9-4250-a50f-2a04901f5684", "name": "network-vif-deleted", "tag": "4b3f760f-b82e-4849-b8fe-422119f3455e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:48.158706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5623a7ce-83a1-43a4-a733-3bc91c4c43fa req-3e7a59e6-a666-4aa1-ac1e-56380c45230e service nova] Creating event network-vif-plugged:d486cd19-00e4-4e8f-9ec8-76a14699627e for instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd on n-h1-820368-37 Sep 01 05:12:48.159100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-116fde71-0bd3-4abc-9ff5-628966d8ddb0 req-fef057a8-b77f-4fb9-8700-bba224f3ca44 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:48.160069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-116fde71-0bd3-4abc-9ff5-628966d8ddb0 req-fef057a8-b77f-4fb9-8700-bba224f3ca44 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:48.160509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-116fde71-0bd3-4abc-9ff5-628966d8ddb0 req-fef057a8-b77f-4fb9-8700-bba224f3ca44 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:48.166375 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5623a7ce-83a1-43a4-a733-3bc91c4c43fa req-3e7a59e6-a666-4aa1-ac1e-56380c45230e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088492 Sep 01 05:12:48.167778 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2193/4394] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:48.175165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:48.176537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:48.183588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:48.185297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:48.186044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:48.187336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:48.188229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:48.189080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:48.206870 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-116fde71-0bd3-4abc-9ff5-628966d8ddb0 req-fef057a8-b77f-4fb9-8700-bba224f3ca44 service nova] Creating event network-vif-deleted:4b3f760f-b82e-4849-b8fe-422119f3455e for instance 61fd6819-81b9-4250-a50f-2a04901f5684 on n-h1-820368-37 Sep 01 05:12:48.221738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-116fde71-0bd3-4abc-9ff5-628966d8ddb0 req-fef057a8-b77f-4fb9-8700-bba224f3ca44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095726 Sep 01 05:12:48.222406 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2202/4395] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:48.737431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:48.750577 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-891ae4ea-b0f9-42a9-b949-6cd1129967ae tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1276 microversion: 2.1 time: 0.581230 Sep 01 05:12:48.765144 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2194/4396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:48 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1276 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:49.098697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:49.099431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:49.114870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:49.116916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:49.117461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:49.119431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:49.121408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:49.123041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:49.142630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:49.143401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:49.154753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:49.161772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:49.162399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:49.163343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:49.163935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:49.164518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:49.926869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:49.939678 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-858281aa-ea61-470c-a780-7ae2bbf1855e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1319 microversion: 2.1 time: 0.847692 Sep 01 05:12:49.941255 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2203/4397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:49 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1319 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:49.963934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:49.965323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:49.971112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:49.988585 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e1b9b79-819f-4392-a5b4-0d4ba2561869 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1516 microversion: 2.1 time: 0.850610 Sep 01 05:12:49.992029 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2195/4398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:49 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1516 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:49.995344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:49.996206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:50.007619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:50.022534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:50.024158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:50.024881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:50.539253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:50.563450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60f2146b-62ea-4370-96fd-a1f52fb239ca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 0.620314 Sep 01 05:12:50.577935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2204/4399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:49 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:50.669556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1d130bfe-a828-4845-8526-3713e24965da req-9e81e33d-78ac-4af7-9094-55f4ca47c0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70478a9d-b186-46c3-8ba6-def37d45dad5", "name": "network-vif-deleted", "tag": "151cede3-20f2-4c0a-ba40-5e32bfe85e5c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:50.692874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d130bfe-a828-4845-8526-3713e24965da req-9e81e33d-78ac-4af7-9094-55f4ca47c0db service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:50.693372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d130bfe-a828-4845-8526-3713e24965da req-9e81e33d-78ac-4af7-9094-55f4ca47c0db service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:50.693864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d130bfe-a828-4845-8526-3713e24965da req-9e81e33d-78ac-4af7-9094-55f4ca47c0db service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:50.714760 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1d130bfe-a828-4845-8526-3713e24965da req-9e81e33d-78ac-4af7-9094-55f4ca47c0db service nova] Creating event network-vif-deleted:151cede3-20f2-4c0a-ba40-5e32bfe85e5c for instance 70478a9d-b186-46c3-8ba6-def37d45dad5 on n-h1-820368-37 Sep 01 05:12:50.724652 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1d130bfe-a828-4845-8526-3713e24965da req-9e81e33d-78ac-4af7-9094-55f4ca47c0db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058326 Sep 01 05:12:50.725791 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2196/4400] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:50.883359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f48977c0-60e2-40d2-8ed4-d79d7c6469fa req-6f19b1b5-66d7-4b3d-bd48-788ae1725e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923fcb6c-100e-49b8-9255-7a38ddcc78ef", "tag": "8c393208-ade5-41ec-bee2-154e92d10b3e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:50.898963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f48977c0-60e2-40d2-8ed4-d79d7c6469fa req-6f19b1b5-66d7-4b3d-bd48-788ae1725e26 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:50.901707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f48977c0-60e2-40d2-8ed4-d79d7c6469fa req-6f19b1b5-66d7-4b3d-bd48-788ae1725e26 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:50.902497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f48977c0-60e2-40d2-8ed4-d79d7c6469fa req-6f19b1b5-66d7-4b3d-bd48-788ae1725e26 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:50.930746 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f48977c0-60e2-40d2-8ed4-d79d7c6469fa req-6f19b1b5-66d7-4b3d-bd48-788ae1725e26 service nova] Creating event network-changed:8c393208-ade5-41ec-bee2-154e92d10b3e for instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef on n-h1-820368-37 Sep 01 05:12:50.935979 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f48977c0-60e2-40d2-8ed4-d79d7c6469fa req-6f19b1b5-66d7-4b3d-bd48-788ae1725e26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056761 Sep 01 05:12:50.937176 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2205/4401] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:12:50.964953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:50.965981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:50.974578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:50.976439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:50.977109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:50.979500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:50.981246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:50.982294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:51.015035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:51.016053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:51.025149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:51.026049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:51.026671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:51.027597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:51.029376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:51.030198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:51.234043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:51.245254 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80a20595-22c5-459a-8d58-98078b1bbca0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1474 microversion: 2.1 time: 0.234434 Sep 01 05:12:51.246773 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2206/4402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:51 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:51.585805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:51.586548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:51.597173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:51.597677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:51.598124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:51.598828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:51.599323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:51.599747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:51.602098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:51.604775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:51.612744 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce5b8a7e-58ce-48fb-9fa9-373b7353924e tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1508 microversion: 2.1 time: 0.654120 Sep 01 05:12:51.623830 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2197/4403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:50 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1508 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:51.996419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:52.011916 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38dea28a-c7e4-4921-a04e-08c004b8df41 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 0.430224 Sep 01 05:12:52.012724 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2207/4404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:51 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:52.269175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:52.269967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:52.286822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:52.287349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:52.287788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:52.288495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:52.288946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:52.289362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:52.367990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:52.370247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:52.371835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:52.372619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lazy-loading 'fault' on Instance uuid e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:12:52.825716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-da4fc4d0-6d10-487a-9408-29fe72272490 req-0387ebce-c857-4b34-b74b-2c0b2f4c1b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8", "name": "network-vif-deleted", "tag": "f98475ab-5c22-4f66-befe-737e27f6d0c9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:52.852303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-da4fc4d0-6d10-487a-9408-29fe72272490 req-0387ebce-c857-4b34-b74b-2c0b2f4c1b54 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:52.855573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-da4fc4d0-6d10-487a-9408-29fe72272490 req-0387ebce-c857-4b34-b74b-2c0b2f4c1b54 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:52.860738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-da4fc4d0-6d10-487a-9408-29fe72272490 req-0387ebce-c857-4b34-b74b-2c0b2f4c1b54 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:52.884266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:52.893113 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71db7232-a9d0-4b7e-87b9-21710aa4c58c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 200 len: 1318 microversion: 2.1 time: 0.629501 Sep 01 05:12:52.893717 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2198/4405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:52 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:52.912926 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-da4fc4d0-6d10-487a-9408-29fe72272490 req-0387ebce-c857-4b34-b74b-2c0b2f4c1b54 service nova] Creating event network-vif-deleted:f98475ab-5c22-4f66-befe-737e27f6d0c9 for instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 on n-h2-820368-37 Sep 01 05:12:52.919766 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-da4fc4d0-6d10-487a-9408-29fe72272490 req-0387ebce-c857-4b34-b74b-2c0b2f4c1b54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098691 Sep 01 05:12:52.921154 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2208/4406] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:12:53.039096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:53.041265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:53.043646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:53.063031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:53.065988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:53.066845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:53.067814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:53.068453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:53.069089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:53.400929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:53.412698 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41a223e3-6b7d-48c9-9a70-dd407567abca tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 0.380790 Sep 01 05:12:53.427079 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2199/4407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:53 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:53.931292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:53.933839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:53.951411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:53.960218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:53.961461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:53.994266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:53.995665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:53.996329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:54.038252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 HTTP/1.1 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8'} Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:12:54.049865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:12:54.055007 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a64992d0-3929-4d1d-b1b4-072840d701c8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 404 len: 111 microversion: 2.1 time: 0.135413 Sep 01 05:12:54.060768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82e94b46-9fd3-4bd5-8270-bb01aa8304fa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '.version_select at 0x7fa75b3b33a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:54.067231 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82e94b46-9fd3-4bd5-8270-bb01aa8304fa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:12:54.070479 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2209/4408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:53 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:12:54.452450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:54.454194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:54.469586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:54.470305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:54.471003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:54.472150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:54.473877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:54.474520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:55.061554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:55.076737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cbc2346-b1b0-40a1-9595-e355479238dc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 0.646180 Sep 01 05:12:55.077832 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2210/4409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:54 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:55.080301 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-82e94b46-9fd3-4bd5-8270-bb01aa8304fa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48846. Sep 01 05:12:55.082933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5311b516-7406-449d-9a11-6ac0ab1b06dc req-edc5d728-4bd7-49a2-94aa-e2cc8b36f3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49813a21-ab54-4e5e-a566-c2558eb0475d", "tag": "cf1c3a54-a3c4-4062-9831-5fcec207d6d1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:55.107954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5311b516-7406-449d-9a11-6ac0ab1b06dc req-edc5d728-4bd7-49a2-94aa-e2cc8b36f3c3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:55.108712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5311b516-7406-449d-9a11-6ac0ab1b06dc req-edc5d728-4bd7-49a2-94aa-e2cc8b36f3c3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:55.108889 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82e94b46-9fd3-4bd5-8270-bb01aa8304fa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-key-1760197992" status: 202 len: 0 microversion: 2.1 time: 1.051597 Sep 01 05:12:55.109380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5311b516-7406-449d-9a11-6ac0ab1b06dc req-edc5d728-4bd7-49a2-94aa-e2cc8b36f3c3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:55.112174 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2200/4410] 10.222.0.26 () {58 vars in 1209 bytes} [Thu Sep 1 05:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1760197992 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:12:55.133262 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5311b516-7406-449d-9a11-6ac0ab1b06dc req-edc5d728-4bd7-49a2-94aa-e2cc8b36f3c3 service nova] Creating event network-changed:cf1c3a54-a3c4-4062-9831-5fcec207d6d1 for instance 49813a21-ab54-4e5e-a566-c2558eb0475d on n-h2-820368-37 Sep 01 05:12:55.152810 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5311b516-7406-449d-9a11-6ac0ab1b06dc req-edc5d728-4bd7-49a2-94aa-e2cc8b36f3c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073405 Sep 01 05:12:55.153438 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2211/4411] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:55.317398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-425191524", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:55.420309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:12:56.095312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:56.096775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:56.102338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:56.103403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:56.124050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:56.124802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:56.125528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:56.126467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:56.127143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:56.127730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:56.374949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:12:56.375826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:12:56.376519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:12:56.377031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:12:56.377686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:12:56.393907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:56.404513 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e5f14bc-e003-46d5-93e2-43c6663eef1a tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 0.310370 Sep 01 05:12:56.408045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2212/4412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:56 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:56.426457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:56.427515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:56.431536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:56.434351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:56.436042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:56.439058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:56.484396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:12:56.497181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:12:56.523990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:12:56.526948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:12:56.623613 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-702b6f71-1468-4b58-b0bd-d73380afc190 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310642 Sep 01 05:12:56.625243 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2201/4413] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:12:56.636441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-553f8843-3f61-4375-8f1d-9080f90271f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:56.637053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-553f8843-3f61-4375-8f1d-9080f90271f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:56.733197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-553f8843-3f61-4375-8f1d-9080f90271f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:56.743124 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-553f8843-3f61-4375-8f1d-9080f90271f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1208 microversion: 2.1 time: 0.110710 Sep 01 05:12:56.743727 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2213/4414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:56 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1208 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:57.429354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:57.429965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:57.451355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:57.452104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:57.452547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:57.453663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:57.454104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:57.454524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:57.770100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:57.771761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:57.795217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:57.796909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:57.797646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:57.798761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:57.799481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:57.801301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:58.067421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:58.081575 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5318fca5-5e36-4b8c-b30b-0565eca7b145 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1204 microversion: 2.1 time: 0.317985 Sep 01 05:12:58.086566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2214/4415] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:57 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1204 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:12:58.483877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:58.486558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8e12e198-e3e0-4d59-b2aa-73ec33810781 req-02a51c78-8778-453a-aab0-efe2c42bef64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923fcb6c-100e-49b8-9255-7a38ddcc78ef", "name": "network-vif-plugged", "status": "completed", "tag": "8c393208-ade5-41ec-bee2-154e92d10b3e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:12:58.497887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8ae8e97-0a31-4c33-b797-c5903f48a4fc tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 1.073268 Sep 01 05:12:58.506957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e12e198-e3e0-4d59-b2aa-73ec33810781 req-02a51c78-8778-453a-aab0-efe2c42bef64 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:58.507221 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2202/4416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:57 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:58.509628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e12e198-e3e0-4d59-b2aa-73ec33810781 req-02a51c78-8778-453a-aab0-efe2c42bef64 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:58.511145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8e12e198-e3e0-4d59-b2aa-73ec33810781 req-02a51c78-8778-453a-aab0-efe2c42bef64 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:58.545605 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8e12e198-e3e0-4d59-b2aa-73ec33810781 req-02a51c78-8778-453a-aab0-efe2c42bef64 service nova] Creating event network-vif-plugged:8c393208-ade5-41ec-bee2-154e92d10b3e for instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef on n-h1-820368-37 Sep 01 05:12:58.554489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8e12e198-e3e0-4d59-b2aa-73ec33810781 req-02a51c78-8778-453a-aab0-efe2c42bef64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338254 Sep 01 05:12:58.561899 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2215/4417] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:12:59.110187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:59.111092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:59.143475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:59.143983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:59.144419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:59.145882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:59.147050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:59.151073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:59.401233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:12:59.420369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3c5c334-5547-4a2b-b07e-8aa0415decc5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1278 microversion: 2.1 time: 0.314662 Sep 01 05:12:59.422228 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2203/4418] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:59 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1278 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:12:59.521849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:12:59.522559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:12:59.534061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:59.539433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:59.540233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:12:59.541334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:12:59.543128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:12:59.543735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:00.105723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:00.148256 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-646afd3c-b2df-4065-a8f4-45fca6446dfb tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1318 microversion: 2.1 time: 0.630137 Sep 01 05:13:00.169947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2216/4419] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:12:59 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:00.448032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:00.448976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:00.472271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:00.478301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:00.479099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:00.480007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:00.480799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:00.481262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:01.101180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:01.117209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2125e934-f072-483b-bf97-2cae2ce91006 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1266 microversion: 2.1 time: 0.676293 Sep 01 05:13:01.121022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2204/4420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:00 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1266 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:01.180288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:01.180913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:01.191382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:01.191876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:01.197884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:01.199063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:01.200573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:01.201034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:01.530101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:01.549327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93a66b1c-15d0-4e6e-b87d-adf42a497255 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 200 len: 1507 microversion: 2.1 time: 0.373923 Sep 01 05:13:01.553150 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2205/4421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:01 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:01.578773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:01.580519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:01.600963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:01.602132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:01.602790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:01.603996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:01.605206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:01.606032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:01.653263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-277f4a14-63de-489f-bd5b-81ab8d3802db tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Action: 'create', calling method: .version_select at 0x7fa75b1194c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-943614427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr6Ax1AGCiR2xNbymLch0hPjg1erDKC6zA4L9mzWATVY0VIftXhw+tt9sdTDdnl4lKZUBuED9tXMwy4oe9/Ah9M7YjcuuqK53vKU3c3SAT1zuktdBw9Y+s81MhfC4SvWQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:01.710244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-277f4a14-63de-489f-bd5b-81ab8d3802db tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Getting quotas for project 6734c36a2f9d454b94c60f5d3531188f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:13:01.729399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-277f4a14-63de-489f-bd5b-81ab8d3802db tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Getting quotas for user 4341d4d25da94a2389be456b80c645f5 and project 6734c36a2f9d454b94c60f5d3531188f. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:13:01.768699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:01.793513 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-277f4a14-63de-489f-bd5b-81ab8d3802db tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.838044 Sep 01 05:13:01.794131 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2217/4422] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:13:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:02.016408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:02.047282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41b28557-57c5-44ef-9c00-6337dec971d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1318 microversion: 2.1 time: 0.472071 Sep 01 05:13:02.053259 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2206/4423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:01 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:02.153221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:02.153863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:02.173277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:02.173776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:02.174209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:02.184056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:02.184056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:02.184056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:02.452890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7ef8c666-2fe6-4c23-9516-e0b770036149 req-d1eb3abd-b530-46af-ae56-b4c2f5eef88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49813a21-ab54-4e5e-a566-c2558eb0475d", "name": "network-vif-plugged", "status": "completed", "tag": "cf1c3a54-a3c4-4062-9831-5fcec207d6d1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:02.470581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ef8c666-2fe6-4c23-9516-e0b770036149 req-d1eb3abd-b530-46af-ae56-b4c2f5eef88c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:02.471109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ef8c666-2fe6-4c23-9516-e0b770036149 req-d1eb3abd-b530-46af-ae56-b4c2f5eef88c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:02.473992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ef8c666-2fe6-4c23-9516-e0b770036149 req-d1eb3abd-b530-46af-ae56-b4c2f5eef88c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:02.518017 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7ef8c666-2fe6-4c23-9516-e0b770036149 req-d1eb3abd-b530-46af-ae56-b4c2f5eef88c service nova] Creating event network-vif-plugged:cf1c3a54-a3c4-4062-9831-5fcec207d6d1 for instance 49813a21-ab54-4e5e-a566-c2558eb0475d on n-h2-820368-37 Sep 01 05:13:02.535493 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7ef8c666-2fe6-4c23-9516-e0b770036149 req-d1eb3abd-b530-46af-ae56-b4c2f5eef88c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086470 Sep 01 05:13:02.537187 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2207/4424] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:13:02.842544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:02.860642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4efec9be-c687-48d8-9dde-17fe48a37123 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.713764 Sep 01 05:13:02.880598 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2218/4425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:02 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:03.087496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:03.088227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:03.101731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:03.102242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:03.102688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:03.106922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:03.107896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:03.108541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:03.473008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:03.557330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50ba1039-33f9-4886-9f74-3502dea79b90 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1318 microversion: 2.1 time: 0.473632 Sep 01 05:13:03.560886 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2208/4426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:03 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:03.577018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6499a3db-7d48-4db4-b94e-0e8164f261ab req-4e57b257-b5f1-485f-b693-7855dccdd7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a05a5e-33ca-4fd3-91ea-edd84ddd69bd", "tag": "1ba7242f-b695-46ed-8249-823e3e2e0f25"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:03.619465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6499a3db-7d48-4db4-b94e-0e8164f261ab req-4e57b257-b5f1-485f-b693-7855dccdd7d6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:03.620484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6499a3db-7d48-4db4-b94e-0e8164f261ab req-4e57b257-b5f1-485f-b693-7855dccdd7d6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:03.621597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6499a3db-7d48-4db4-b94e-0e8164f261ab req-4e57b257-b5f1-485f-b693-7855dccdd7d6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:03.632401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:03.656276 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6499a3db-7d48-4db4-b94e-0e8164f261ab req-4e57b257-b5f1-485f-b693-7855dccdd7d6 service nova] Creating event network-changed:1ba7242f-b695-46ed-8249-823e3e2e0f25 for instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd on n-h2-820368-37 Sep 01 05:13:03.670807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6499a3db-7d48-4db4-b94e-0e8164f261ab req-4e57b257-b5f1-485f-b693-7855dccdd7d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102579 Sep 01 05:13:03.673688 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2219/4427] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:03.896390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:03.900580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:03.921508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:03.923308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:03.924591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:03.927778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:03.928984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:03.930049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:04.427644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:04.447446 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-693fcc66-9e6f-472c-ae15-2dae8afede87 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.564995 Sep 01 05:13:04.448365 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2209/4428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:03 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:04.595112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:04.596821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:04.610860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:04.612896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:04.614050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:04.615474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:04.617277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:04.621798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:04.955638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:04.970181 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdede1a5-6722-40c8-9990-8e896b46ea6f tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1507 microversion: 2.1 time: 0.379811 Sep 01 05:13:04.971186 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2220/4429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:04 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:05.010530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:05.014514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:05.028237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.028895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.029617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.030598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.031439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.032545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.078381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:13:05.208478 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65e9a1d9-5888-4253-9020-205d36db60ff tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 204 len: 0 microversion: 2.1 time: 0.199757 Sep 01 05:13:05.217509 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2210/4430] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:13:05 2022] DELETE /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:13:05.234681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:05.236459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:05.254717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.255711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.256783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.258396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.259239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.260189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.318966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:13:05.449861 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-816daaad-3d02-44a2-b131-167c25304178 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "DELETE /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 204 len: 0 microversion: 2.1 time: 0.226618 Sep 01 05:13:05.451143 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2221/4431] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:13:05 2022] DELETE /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:13:05.463173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:05.464275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:05.471561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.472343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.472940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.473843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.474649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.475420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.476771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:05.478001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:05.489439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.490689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.491629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.492703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:05.493435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:05.494666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:05.717771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:05.733325 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0da325ec-d77e-4d24-be27-c8d1af242b40 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1513 microversion: 2.1 time: 0.275038 Sep 01 05:13:05.758298 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2211/4432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:05 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:05.774748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:05.790154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9677e8aa-4bcb-466a-a54e-778d26bd23bd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.322033 Sep 01 05:13:05.791175 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2222/4433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:05 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:06.771400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:06.773152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:06.785109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:06.786593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:06.799631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:06.800452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:06.801161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:06.802663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:06.804044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:06.805088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:06.827356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:06.830871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:06.847456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:06.849920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:06.851591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:06.854106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:06.855779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:06.856987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:07.375719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:07.397099 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bebd7670-2c66-46ca-9b91-0f91317b761c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.578177 Sep 01 05:13:07.398824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2223/4434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:06 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:07.466662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:07.513522 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2390510-0b08-45b9-8d8a-e3ec96daae95 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1513 microversion: 2.1 time: 0.750669 Sep 01 05:13:07.540164 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2212/4435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:06 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1513 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:08.434179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:08.435938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:08.448420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:08.450646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:08.452079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:08.457417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:08.458255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:08.461118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:08.549596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-34ad9e7a-6138-4fd0-a739-1640214e5507 req-73de432c-5f1c-4db3-bee8-f39d894b7d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923fcb6c-100e-49b8-9255-7a38ddcc78ef", "name": "network-vif-deleted", "tag": "8c393208-ade5-41ec-bee2-154e92d10b3e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:08.653676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-34ad9e7a-6138-4fd0-a739-1640214e5507 req-73de432c-5f1c-4db3-bee8-f39d894b7d23 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:08.656023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-34ad9e7a-6138-4fd0-a739-1640214e5507 req-73de432c-5f1c-4db3-bee8-f39d894b7d23 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:08.656991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-34ad9e7a-6138-4fd0-a739-1640214e5507 req-73de432c-5f1c-4db3-bee8-f39d894b7d23 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:08.717916 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-34ad9e7a-6138-4fd0-a739-1640214e5507 req-73de432c-5f1c-4db3-bee8-f39d894b7d23 service nova] Creating event network-vif-deleted:8c393208-ade5-41ec-bee2-154e92d10b3e for instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef on n-h1-820368-37 Sep 01 05:13:08.741839 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-34ad9e7a-6138-4fd0-a739-1640214e5507 req-73de432c-5f1c-4db3-bee8-f39d894b7d23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198724 Sep 01 05:13:08.751122 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2213/4436] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:08.760939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:08.766018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:08.794704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:08.799392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:08.804633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:08.805490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:08.805991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:08.806443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:09.224129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:09.240630 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0270fe9f-ac66-4fc6-ac53-b527c8b130b8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.816039 Sep 01 05:13:09.242401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2224/4437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:08 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:10.012433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:10.036134 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42754525-1880-4f75-84fa-3ac7bb4e3107 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1513 microversion: 2.1 time: 1.281517 Sep 01 05:13:10.053458 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2214/4438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:08 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1513 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:10.283253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:10.284428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:10.298543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:10.301458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:10.301911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:10.306665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:10.308432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:10.313204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:10.917346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:10.945369 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-989dfe8f-1e24-4c86-8cd2-1a26e3f03488 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.659972 Sep 01 05:13:10.946233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2225/4439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:10 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:11.061805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:11.062536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:11.076336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:11.085587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:11.088126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:11.090042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:11.092112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:11.095016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:11.155224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:11.467632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:11.503250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-765f29c1-b14e-435c-b01b-4165aef8c1bf req-ac35d252-984e-4d09-a385-3ec0ca5e447b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49813a21-ab54-4e5e-a566-c2558eb0475d", "name": "network-vif-deleted", "tag": "cf1c3a54-a3c4-4062-9831-5fcec207d6d1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:11.525353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-765f29c1-b14e-435c-b01b-4165aef8c1bf req-ac35d252-984e-4d09-a385-3ec0ca5e447b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:11.526157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-765f29c1-b14e-435c-b01b-4165aef8c1bf req-ac35d252-984e-4d09-a385-3ec0ca5e447b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:11.526780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-765f29c1-b14e-435c-b01b-4165aef8c1bf req-ac35d252-984e-4d09-a385-3ec0ca5e447b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:11.542940 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-765f29c1-b14e-435c-b01b-4165aef8c1bf req-ac35d252-984e-4d09-a385-3ec0ca5e447b service nova] Creating event network-vif-deleted:cf1c3a54-a3c4-4062-9831-5fcec207d6d1 for instance 49813a21-ab54-4e5e-a566-c2558eb0475d on n-h2-820368-37 Sep 01 05:13:11.550837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-765f29c1-b14e-435c-b01b-4165aef8c1bf req-ac35d252-984e-4d09-a385-3ec0ca5e447b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056206 Sep 01 05:13:11.552159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2226/4440] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:11.598298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-536b9a95-519c-4a98-b747-7bb381f7d4d6 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1471 microversion: 2.1 time: 0.534594 Sep 01 05:13:11.633192 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2215/4441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:11 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1471 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:11.974738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:11.980171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:11.980913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:11.994144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:11.995633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:11.997867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:11.998868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:11.999694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:12.000446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:12.270073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:12.287281 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b2a9681-712e-4048-a505-b1a2fd55b085 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.316176 Sep 01 05:13:12.300750 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2227/4442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:11 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:12.439464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8b240f43-5446-49aa-b440-0742c84ebfec req-59c95be6-a627-43e5-8b29-9056ccb74f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a05a5e-33ca-4fd3-91ea-edd84ddd69bd", "name": "network-vif-plugged", "status": "completed", "tag": "1ba7242f-b695-46ed-8249-823e3e2e0f25"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:12.472200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b240f43-5446-49aa-b440-0742c84ebfec req-59c95be6-a627-43e5-8b29-9056ccb74f1c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:12.473151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b240f43-5446-49aa-b440-0742c84ebfec req-59c95be6-a627-43e5-8b29-9056ccb74f1c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:12.473762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b240f43-5446-49aa-b440-0742c84ebfec req-59c95be6-a627-43e5-8b29-9056ccb74f1c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:12.498771 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8b240f43-5446-49aa-b440-0742c84ebfec req-59c95be6-a627-43e5-8b29-9056ccb74f1c service nova] Creating event network-vif-plugged:1ba7242f-b695-46ed-8249-823e3e2e0f25 for instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd on n-h2-820368-37 Sep 01 05:13:12.520665 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8b240f43-5446-49aa-b440-0742c84ebfec req-59c95be6-a627-43e5-8b29-9056ccb74f1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084062 Sep 01 05:13:12.521771 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2216/4443] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:12.647769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:12.648610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:12.664610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:12.665861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:12.666972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:12.668171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:12.668893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:12.669781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:12.722403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:12.722951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:12.723743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:12.724207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lazy-loading 'fault' on Instance uuid 49813a21-ab54-4e5e-a566-c2558eb0475d {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:13:12.816253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611be14d99d747c8878e9f7ef151de87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa67803e6a5c481dbe7d79a85f6c0bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:12.830416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49032e85-1e64-4cf3-9d39-4f008009f4d5 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 200 len: 1308 microversion: 2.1 time: 0.191907 Sep 01 05:13:12.831831 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2228/4444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:12 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:13.310201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:13.311657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:13.325039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:13.327995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:13.332023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:13.335919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:13.336599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:13.337171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:13.872450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:13.873757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 49813a21-ab54-4e5e-a566-c2558eb0475d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:13.887613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:13.893529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:13.894314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:13.895353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:13.896054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:13.896773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:13.926537 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] HTTP exception thrown: Instance 49813a21-ab54-4e5e-a566-c2558eb0475d could not be found. Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Request method failure captured: Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d HTTP/1.1 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED8wYz3QdJLuFsYnSVVieV5sYs_4OLAlsYK6gMCcOTEAy5wr2We6OO4EnjFog_nVuIKwSWaD1JbLOyvUqnuqq6H3wNkGClFeOT7goXVJ7_tVYGIiqibg0CeRunncx0Jy40RS0KSxHFKbQQAss0JzNCf10N4atVlcXhD-jRq-nuMz5Uo Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: aa67803e6a5c481dbe7d79a85f6c0bf5 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateTestJSON-1500818478 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-797206976", "name": "tempest-service-753981336", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateTestJSON-1500818478 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: aa67803e6a5c481dbe7d79a85f6c0bf5 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1500818478 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateTestJSON-1500818478-project Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 611be14d99d747c8878e9f7ef151de87 Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateTestJSON-1500818478-project Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 49813a21-ab54-4e5e-a566-c2558eb0475d could not be found. Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '49813a21-ab54-4e5e-a566-c2558eb0475d'} Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49813a21-ab54-4e5e-a566-c2558eb0475d could not be found. Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49813a21-ab54-4e5e-a566-c2558eb0475d could not be found. Sep 01 05:13:13.930573 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49813a21-ab54-4e5e-a566-c2558eb0475d could not be found. Sep 01 05:13:13.938829 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:13.945475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Returning 404 to user: Instance 49813a21-ab54-4e5e-a566-c2558eb0475d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:13:13.948015 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d7e9931-a1cf-4905-a4e1-c621425c7bad tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d" status: 404 len: 111 microversion: 2.1 time: 0.078727 Sep 01 05:13:13.949230 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2229/4445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:13 2022] GET /compute/v2.1/servers/49813a21-ab54-4e5e-a566-c2558eb0475d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:13:13.964457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:13.965682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] [instance: 923fcb6c-100e-49b8-9255-7a38ddcc78ef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:13.975848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:13.976915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:13.977547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:13.978564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:13.979244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:13.980699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:14.008703 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] HTTP exception thrown: Instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef could not be found. Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Request method failure captured: Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef HTTP/1.1 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED8wYz3QdJLuFsYnSVVieV5sYs_4OLAlsYK6gMCcOTEAy5wr2We6OO4EnjFog_nVuIKwSWaD1JbLOyvUqnuqq6H3wNkGClFeOT7goXVJ7_tVYGIiqibg0CeRunncx0Jy40RS0KSxHFKbQQAss0JzNCf10N4atVlcXhD-jRq-nuMz5Uo Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: aa67803e6a5c481dbe7d79a85f6c0bf5 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-MultipleCreateTestJSON-1500818478 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "tempest-type-797206976", "name": "tempest-service-753981336", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa67803e6a5c481dbe7d79a85f6c0bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-MultipleCreateTestJSON-1500818478 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: aa67803e6a5c481dbe7d79a85f6c0bf5 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1500818478 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-MultipleCreateTestJSON-1500818478-project Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 611be14d99d747c8878e9f7ef151de87 Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-MultipleCreateTestJSON-1500818478-project Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef could not be found. Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '923fcb6c-100e-49b8-9255-7a38ddcc78ef'} Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef could not be found. Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef could not be found. Sep 01 05:13:14.013430 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef could not be found. Sep 01 05:13:14.019452 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:14.022188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] Returning 404 to user: Instance 923fcb6c-100e-49b8-9255-7a38ddcc78ef could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:13:14.023854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7ec295b-5c27-4478-804c-2ff973d73460 tempest-MultipleCreateTestJSON-1500818478 tempest-MultipleCreateTestJSON-1500818478-project] 10.222.0.26 "GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef" status: 404 len: 111 microversion: 2.1 time: 0.067820 Sep 01 05:13:14.024979 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2230/4446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:13 2022] GET /compute/v2.1/servers/923fcb6c-100e-49b8-9255-7a38ddcc78ef => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:13:14.064121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:14.079554 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db5f6add-6377-45de-85b9-40edddfccd78 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1308 microversion: 2.1 time: 0.774410 Sep 01 05:13:14.080165 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2217/4447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:13 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:15.105012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:15.106752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:15.115170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:15.116123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:15.116874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:15.117741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:15.118559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:15.119159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:15.564191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:15.577919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-067f1a85-5615-411f-be2d-b06f3ffedb30 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1489 microversion: 2.1 time: 0.477074 Sep 01 05:13:15.597849 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2231/4448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:15 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1489 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:15.797526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-425191524", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:15.905582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:13:18.270498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:13:18.270498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:13:18.271153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:13:18.271353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:13:18.272054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:13:18.299265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:18.308393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:18.309388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:18.310505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:18.311259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:18.311890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:18.364036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:13:18.378641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:13:18.413322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:13:18.415880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:13:18.539125 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0e9ada7-040b-4f19-a71b-c65310ab48b5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.745946 Sep 01 05:13:18.547813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2218/4449] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:13:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:13:18.554435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f708d36a-58de-4617-bd82-9be0993b771c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:18.555826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f708d36a-58de-4617-bd82-9be0993b771c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:19.117677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f708d36a-58de-4617-bd82-9be0993b771c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:19.135964 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f708d36a-58de-4617-bd82-9be0993b771c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1208 microversion: 2.1 time: 0.585520 Sep 01 05:13:19.152292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2232/4450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:18 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1208 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:20.161370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:20.164076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:20.189505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:20.190643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:20.192704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:20.197494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:20.198637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:20.199682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:20.334936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:20.351205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb62910d-64e4-4fdd-af33-da62a8876aa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1268 microversion: 2.1 time: 0.194279 Sep 01 05:13:20.366302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2219/4451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:20 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:21.388993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:21.392859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:21.414841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:21.417133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:21.418447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:21.420521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:21.421054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:21.424777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:21.556328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:21.571561 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e635fc8-da77-43e4-9b6b-81c5dca88330 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1266 microversion: 2.1 time: 0.201519 Sep 01 05:13:21.583337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2233/4452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:21 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:22.559696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1674321278-access_point-1974905467", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "d2bfe2a0-6ec2-477b-afff-ea2605a137e6"}], "key_name": "tempest-TestSecurityGroupsBasicOps-943614427", "security_groups": [{"name": "tempest-secgroup_access--284409082"}, {"name": "tempest-secgroup_general--464912549"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:22.597247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:22.597951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:22.623343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:22.627945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:22.629376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:22.631865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:22.634715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:22.639780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:22.997663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:23.019007 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efe6ed5e-ddf9-40e0-816a-f3583d0bee36 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1266 microversion: 2.1 time: 0.417200 Sep 01 05:13:23.020424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2234/4453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:22 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:23.252912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] validate_networks() for [('d2bfe2a0-6ec2-477b-afff-ea2605a137e6', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:13:23.778925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:24.040997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:24.041631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:24.056352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:24.056882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:24.058701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:24.061631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:24.064454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:24.065254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:24.343919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:13:24.345500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:13:24.346575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:13:24.348069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:13:24.349907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:13:24.378022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:24.379018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:24.379630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:24.380538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:24.386363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:24.387425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:24.435674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Getting quotas for project 6734c36a2f9d454b94c60f5d3531188f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:13:24.450179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Getting quotas for user 4341d4d25da94a2389be456b80c645f5 and project 6734c36a2f9d454b94c60f5d3531188f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:13:24.480829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:13:24.483092 n-d-820368-37 devstack@n-api.service[128863]: WARNING nova.utils [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1674321278-access_point-1974905467 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1674321278-ac Sep 01 05:13:24.484102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:13:24.534587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:24.551285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12af4a9b-f63b-4104-be5f-bc92ad907873 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 0.514212 Sep 01 05:13:24.552529 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2235/4454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:24 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:24.558305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb037ebf-4d11-43f1-b23a-8e6976ae0e59", "device": "/dev/sdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:24.562171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:24.573564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:24.576368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:24.580295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:24.588642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:24.591120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:24.591773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:24.625615 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-baf1ce84-13b2-4c92-8824-e499bc8c2426 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.071012 Sep 01 05:13:24.626375 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2220/4455] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:13:22 2022] POST /compute/v2.1/servers => generated 456 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:13:24.650154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65dc33b0-cc2f-4ed0-a663-7193523947f2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:24.656853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65dc33b0-cc2f-4ed0-a663-7193523947f2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:24.894278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65dc33b0-cc2f-4ed0-a663-7193523947f2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:24.931498 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65dc33b0-cc2f-4ed0-a663-7193523947f2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1294 microversion: 2.1 time: 0.293755 Sep 01 05:13:24.947096 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2221/4456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:24 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1294 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:25.185579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:25.224975 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-142ebb15-35a1-458c-b31c-54ab4023fbfc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "POST /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670703 Sep 01 05:13:25.226079 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2236/4457] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:13:24 2022] POST /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd/os-volume_attachments => generated 194 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:25.589647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:25.589647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:25.605666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:25.608655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:25.609184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:25.610059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:25.610675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:25.611003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:25.907061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:25.924404 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-608aed7d-546a-4918-975d-52461a090f73 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 0.339917 Sep 01 05:13:25.925924 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2222/4458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:25 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:25.954215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:25.955226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:25.981507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:25.998355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:25.998807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:26.000386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:26.000386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:26.000624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:26.183668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:26.201334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f0b36ff-6a85-4222-901f-075e54f48fe2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1290 microversion: 2.1 time: 0.250972 Sep 01 05:13:26.205117 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2237/4459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:25 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1290 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:26.950659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:26.952501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:26.975005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:26.975523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:26.975976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:26.976719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:26.977205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:26.977728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:27.242523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:27.244645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:27.272556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:27.275357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:27.276257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:27.277982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:27.280097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:27.281131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:27.409359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:27.421224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb36b05a-27d5-4446-9d89-4919a4201271 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 0.475944 Sep 01 05:13:27.423654 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2223/4460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:26 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:27.459815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:27.477218 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d99081e-6571-4022-b4e2-05a2fdd93c77 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1352 microversion: 2.1 time: 0.249455 Sep 01 05:13:27.479577 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2238/4461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:27 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:28.296445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6cbe8dcf-7cd6-4bd0-b61d-09922db32d7d req-b523972c-e759-4c06-9236-24a73d4edfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea", "tag": "bb681f80-24a6-4a36-97dc-4ab8c1d5cdec"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:28.316105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6cbe8dcf-7cd6-4bd0-b61d-09922db32d7d req-b523972c-e759-4c06-9236-24a73d4edfb8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:28.318501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6cbe8dcf-7cd6-4bd0-b61d-09922db32d7d req-b523972c-e759-4c06-9236-24a73d4edfb8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:28.319180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6cbe8dcf-7cd6-4bd0-b61d-09922db32d7d req-b523972c-e759-4c06-9236-24a73d4edfb8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:28.349347 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6cbe8dcf-7cd6-4bd0-b61d-09922db32d7d req-b523972c-e759-4c06-9236-24a73d4edfb8 service nova] Creating event network-changed:bb681f80-24a6-4a36-97dc-4ab8c1d5cdec for instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea on n-h1-820368-37 Sep 01 05:13:28.358352 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6cbe8dcf-7cd6-4bd0-b61d-09922db32d7d req-b523972c-e759-4c06-9236-24a73d4edfb8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066257 Sep 01 05:13:28.359372 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2224/4462] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:28.450242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:28.450829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:28.464859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:28.468250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:28.469323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:28.470576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:28.471855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:28.473788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:28.502247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:28.503390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:28.525103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:28.526027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:28.526665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:28.527648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:28.528303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:28.528912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:29.128073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:29.900259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:29.914532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c541391-c4a8-414e-89c6-96f429eec939 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 1.469041 Sep 01 05:13:29.915790 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2239/4463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:28 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:29.982865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:30.050566 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6301569-5b76-4146-bab6-8abdb2618be9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 1.547846 Sep 01 05:13:30.053557 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2225/4464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:28 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:30.954355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:30.955378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:30.973239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:30.973848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:30.974298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:30.977813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:30.978529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:30.979219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:31.085176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:31.086660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:31.119035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:31.123359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:31.123941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:31.124822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:31.125325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:31.125765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:32.318172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:32.328517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e58de23b-86e9-49ef-b2b9-2e70754eac13 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 1.379157 Sep 01 05:13:32.347716 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2240/4465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:30 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:33.252082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:33.272062 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9b96af5-c264-4431-91a2-dd94c969503f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 2.189372 Sep 01 05:13:33.273528 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2226/4466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:31 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:33.354497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:33.355855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:33.361648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:33.375023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:33.376175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:33.376634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:33.377442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:33.381459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:33.381635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:34.211767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c1183e63-64c0-40e9-bc2a-1c707d1610ac req-4771b552-e53e-4689-928f-64bb328e9d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66563c2c-1ed6-48e1-acc8-c99f29b124e9", "tag": "1e61b969-ca27-42f2-894e-c9d99e47ea9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:34.238290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1183e63-64c0-40e9-bc2a-1c707d1610ac req-4771b552-e53e-4689-928f-64bb328e9d45 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:34.241440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1183e63-64c0-40e9-bc2a-1c707d1610ac req-4771b552-e53e-4689-928f-64bb328e9d45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:34.244144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1183e63-64c0-40e9-bc2a-1c707d1610ac req-4771b552-e53e-4689-928f-64bb328e9d45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:34.292289 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c1183e63-64c0-40e9-bc2a-1c707d1610ac req-4771b552-e53e-4689-928f-64bb328e9d45 service nova] Creating event network-changed:1e61b969-ca27-42f2-894e-c9d99e47ea9f for instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 on n-h2-820368-37 Sep 01 05:13:34.310044 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c1183e63-64c0-40e9-bc2a-1c707d1610ac req-4771b552-e53e-4689-928f-64bb328e9d45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101353 Sep 01 05:13:34.311965 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2227/4467] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:34.324067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:34.326111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:34.347463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:34.348334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:34.349263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:34.351372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:34.353426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:34.354109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:34.419359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:34.771937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:34.784156 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae1e44f6-de2f-4024-8556-a3fee4fd294f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 1.433678 Sep 01 05:13:34.800057 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2241/4468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:33 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:34.914743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:35.461419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:35.477332 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cad39831-1121-44c2-b19f-0447c6bc58a9 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 1.163967 Sep 01 05:13:35.477991 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2228/4469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:34 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:35.809372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:35.810660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:35.826732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:35.828014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:35.828877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:35.835864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:35.836597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:35.837351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:35.994525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8fc2d9b0-c413-4a41-ac56-3659c10a2805 req-12fa17df-b8da-4689-b5af-7e632253eb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea", "name": "network-vif-plugged", "status": "completed", "tag": "bb681f80-24a6-4a36-97dc-4ab8c1d5cdec"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:36.024952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8fc2d9b0-c413-4a41-ac56-3659c10a2805 req-12fa17df-b8da-4689-b5af-7e632253eb39 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:36.028838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8fc2d9b0-c413-4a41-ac56-3659c10a2805 req-12fa17df-b8da-4689-b5af-7e632253eb39 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:36.029389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8fc2d9b0-c413-4a41-ac56-3659c10a2805 req-12fa17df-b8da-4689-b5af-7e632253eb39 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:36.066121 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8fc2d9b0-c413-4a41-ac56-3659c10a2805 req-12fa17df-b8da-4689-b5af-7e632253eb39 service nova] Creating event network-vif-plugged:bb681f80-24a6-4a36-97dc-4ab8c1d5cdec for instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea on n-h1-820368-37 Sep 01 05:13:36.072601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8fc2d9b0-c413-4a41-ac56-3659c10a2805 req-12fa17df-b8da-4689-b5af-7e632253eb39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085456 Sep 01 05:13:36.073896 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2229/4470] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:13:36.505193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:36.506797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:36.513772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:36.514639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:36.515517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:36.516497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:36.517210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:36.517866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:36.666278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:36.677030 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbda2d5d-1baf-47c6-8e51-8ff9d8c8078d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 0.872862 Sep 01 05:13:36.693593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2242/4471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:35 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:36.941643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:36.953370 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-645de897-281b-4ae5-94f8-00d47a19c367 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 0.453654 Sep 01 05:13:36.954176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2230/4472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:36 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:37.707308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:37.708990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:37.730645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:37.731702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:37.733018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:37.735162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:37.735944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:37.742418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:37.865319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:37.873246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:37.875285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Searching by: {'deleted': False, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:13:37.886382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:37.893131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:37.894724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:37.898397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:37.901011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:37.902284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:37.934376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:13:38.039768 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0b78ccc-0cf5-47c7-8fca-4db804ba0024 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.182274 Sep 01 05:13:38.050264 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2231/4473] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 05:13:37 2022] GET /compute/v2.1/servers => generated 340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:38.058249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:38.059799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:38.067752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:38.068664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:38.069796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:38.070762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:38.071438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:38.072038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:38.511209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:38.522162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b09de6ae-a86a-4862-9961-376d0e9e4852 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1308 microversion: 2.1 time: 0.824151 Sep 01 05:13:38.536225 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2243/4474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:37 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1308 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:38.544932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:38.552716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:38.553910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Searching by: {'deleted': False, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:13:38.561791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:38.564111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:38.564749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:38.566159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:38.567006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:38.567620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:38.604489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:13:38.628102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:38.641108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-364827f8-73d1-4329-85a8-2a5a7f4f9481 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 0.587847 Sep 01 05:13:38.644643 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2232/4475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:38 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:38.668795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:38.678416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:38.679342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:38.679853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:38.821862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcea5eb6-a675-4339-bed2-aa6bc112a667 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'create', calling method: .version_select at 0x7fa75bf3f550>, body: {"keypair": {"name": "tempest-keypair-313200635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3U1o/FYAQ9Suq3+rbke+xvuox1ibpcSWE88pWpEje5wZD6VBaNmr7aol6gSLr9SLOG4NvbUYn87bFz2d9tvO89Z0BLwZsO6hQmuGah9yBh8tPWCFvGCJ+26jS1G8pB6g=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:38.839741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dcea5eb6-a675-4339-bed2-aa6bc112a667 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for project 73595708b0aa4675b02e05947383d8d9. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:13:38.846491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dcea5eb6-a675-4339-bed2-aa6bc112a667 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for user 87f4f3bcd603448d856a7471120a42af and project 73595708b0aa4675b02e05947383d8d9. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:13:38.884840 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcea5eb6-a675-4339-bed2-aa6bc112a667 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238644 Sep 01 05:13:38.888337 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2233/4476] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:13:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:38.962244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5155eb5-88af-47c5-9d81-65f7d658938f tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.424342 Sep 01 05:13:38.963807 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2244/4477] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:13:38 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:38.989167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77cac945-f6ad-47e3-a8cf-e3f872f9fe3b tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:39.006778 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77cac945-f6ad-47e3-a8cf-e3f872f9fe3b tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022490 Sep 01 05:13:39.010163 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2234/4478] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 05:13:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:39.375953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:39.376460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:39.388799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:39.389310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:39.389874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:39.395451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:39.396333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:39.397685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:39.445813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:13:39.549545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:39.550491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:39.560395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:39.567904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:39.568646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:39.569572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:39.570288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:39.570927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:39.701736 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7e8bd63-cad3-4f16-ba06-d98d56803ea7 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 204 len: 0 microversion: 2.1 time: 0.330527 Sep 01 05:13:39.702706 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2245/4479] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:13:39 2022] DELETE /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:13:39.710141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:39.710850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:39.727472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:39.729872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:39.731463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:39.732817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:39.733677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:39.734332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.074545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:40.092676 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c70e96bf-947b-47fc-ac4c-8c404d2e3431 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1490 microversion: 2.1 time: 0.548512 Sep 01 05:13:40.097044 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2235/4480] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:39 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1490 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:40.130588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:40.131727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:40.148840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:40.152121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:40.153913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.155025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:40.157266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:40.162590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.165773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:40.176248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7154f50-0f12-4659-8081-cd1e9d14c8ae tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 0.471873 Sep 01 05:13:40.179770 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2246/4481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:39 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:40.188706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:40.191903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:40.207404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:40.207907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:40.209730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.210643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:40.211314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:40.211935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.502531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:40.513883 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a19442d-3475-4a1a-bb19-0abdcbed2518 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1489 microversion: 2.1 time: 0.332722 Sep 01 05:13:40.525420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2247/4482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:40 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1489 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:40.539264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:40.540162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:40.552500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:40.555341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:40.556766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:40.557280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.558108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:40.558506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:40.558998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:40.569557 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ef92280-3129-4014-90de-da7c94cb3e6d tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1714 microversion: 2.1 time: 0.467045 Sep 01 05:13:40.572408 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2236/4483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:40 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1714 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:41.167722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:41.202555 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11c11451-b588-44fb-852a-5334d425d7b7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1490 microversion: 2.1 time: 0.669460 Sep 01 05:13:41.209092 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2248/4484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:40 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1490 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:41.224749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:41.225379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:41.234099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:41.237728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:41.241634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:41.242234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:41.243399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:41.245889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:41.247196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:41.248254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:41.277478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:41.281277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:41.286853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:41.288401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:41.291525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:41.293801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:41.307789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=90 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:41.386191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:13:41.498034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:41.708803 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef2697b9-514a-4c6f-8e24-b81f58b82c08 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 204 len: 0 microversion: 2.1 time: 0.476612 Sep 01 05:13:41.710795 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2249/4485] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:13:41 2022] DELETE /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:13:41.736545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:41.740422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:41.778608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:41.788672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:41.788672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:41.788672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:41.790110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:41.790621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:42.461705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:42.478644 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4de59261-e47a-47fa-b36f-02fbbec21d49 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1714 microversion: 2.1 time: 0.763317 Sep 01 05:13:42.487038 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2250/4486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:41 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1714 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:42.506912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:42.507985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:42.530948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:42.532379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:42.534793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:42.535928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:42.536616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:42.537478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:43.028234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:43.040249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e863477-d014-4703-bf6c-abb0152f6d32 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 1.837870 Sep 01 05:13:43.045558 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2237/4487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:41 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:43.124663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:43.132952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5b7262c-c083-4862-882f-09b72de6ee12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1496 microversion: 2.1 time: 0.635718 Sep 01 05:13:43.148157 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2251/4488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:42 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1496 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:43.506532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:43.507315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:43.525134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:43.525779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:43.526417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:43.527475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:43.528168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:43.528883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:44.065689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:44.066493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:44.075560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:44.080231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:44.083308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:44.084286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:44.084924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:44.086476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:44.442488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:44.452379 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01542298-f8cf-423d-8174-440502d19bfe tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 0.390610 Sep 01 05:13:44.470074 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2252/4489] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:44 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:44.483433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:44.487512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:44.517379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:44.518677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:44.520140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:44.521403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:44.522644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:44.523923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:44.732996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:44.746656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27c0c4d5-7db8-4810-bbe9-76e32c5809d8 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1714 microversion: 2.1 time: 1.244365 Sep 01 05:13:44.748225 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2238/4490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:43 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1714 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:44.748801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:44.757619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-784ddabb-e386-4b6f-a891-8b9da66cd659 req-82a70e53-c9d8-479e-9589-0c8bdbb1f727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66563c2c-1ed6-48e1-acc8-c99f29b124e9", "name": "network-vif-plugged", "status": "completed", "tag": "1e61b969-ca27-42f2-894e-c9d99e47ea9f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:44.760767 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9bcc4419-ee9c-4776-bafc-62c549f04ddd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1454 microversion: 2.1 time: 0.288931 Sep 01 05:13:44.761811 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2253/4491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:44 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1454 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:44.814597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-784ddabb-e386-4b6f-a891-8b9da66cd659 req-82a70e53-c9d8-479e-9589-0c8bdbb1f727 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:44.816353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-784ddabb-e386-4b6f-a891-8b9da66cd659 req-82a70e53-c9d8-479e-9589-0c8bdbb1f727 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:44.816847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-784ddabb-e386-4b6f-a891-8b9da66cd659 req-82a70e53-c9d8-479e-9589-0c8bdbb1f727 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:44.842354 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-784ddabb-e386-4b6f-a891-8b9da66cd659 req-82a70e53-c9d8-479e-9589-0c8bdbb1f727 service nova] Creating event network-vif-plugged:1e61b969-ca27-42f2-894e-c9d99e47ea9f for instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 on n-h2-820368-37 Sep 01 05:13:44.848347 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-784ddabb-e386-4b6f-a891-8b9da66cd659 req-82a70e53-c9d8-479e-9589-0c8bdbb1f727 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098396 Sep 01 05:13:44.849839 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2239/4492] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:44.880513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2010334181", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc7e6109-f10c-46fb-98ac-ddd7a9c9df15"}], "security_groups": [{"name": "tempest-securitygroup--1019141676"}], "key_name": "tempest-keypair-313200635", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:45.233662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] validate_networks() for [('dc7e6109-f10c-46fb-98ac-ddd7a9c9df15', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:13:45.474941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:45.475652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:45.493903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:45.495881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:45.496376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:45.497137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:45.500987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:45.501519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.007731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:46.016972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c54ce603-fee1-4f5f-ae3e-579bafb0606d tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1470 microversion: 2.1 time: 0.546621 Sep 01 05:13:46.030562 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2240/4493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:45 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:46.036256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ec331254-7b0d-46a9-b0c0-85ba88d2dae1 req-44871262-194b-4f20-8920-eac353a8f1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea", "name": "network-vif-deleted", "tag": "bb681f80-24a6-4a36-97dc-4ab8c1d5cdec"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:46.046464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec331254-7b0d-46a9-b0c0-85ba88d2dae1 req-44871262-194b-4f20-8920-eac353a8f1a2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.047479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec331254-7b0d-46a9-b0c0-85ba88d2dae1 req-44871262-194b-4f20-8920-eac353a8f1a2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.048154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec331254-7b0d-46a9-b0c0-85ba88d2dae1 req-44871262-194b-4f20-8920-eac353a8f1a2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.064644 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ec331254-7b0d-46a9-b0c0-85ba88d2dae1 req-44871262-194b-4f20-8920-eac353a8f1a2 service nova] Creating event network-vif-deleted:bb681f80-24a6-4a36-97dc-4ab8c1d5cdec for instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea on n-h1-820368-37 Sep 01 05:13:46.072650 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ec331254-7b0d-46a9-b0c0-85ba88d2dae1 req-44871262-194b-4f20-8920-eac353a8f1a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040254 Sep 01 05:13:46.073721 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2241/4494] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:46.080881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:46.081828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:46.089664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.090713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.091400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.092458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.093178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.093960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.216698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:46.225922 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-735e1209-e991-4cb6-a700-3f6d1c98e60e tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1647 microversion: 2.1 time: 0.150735 Sep 01 05:13:46.241520 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2242/4495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:46 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1647 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:46.247034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:46.248016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:46.255395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.256280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.257127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.258121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.258798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.259426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.280347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:13:46.281259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:13:46.281476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:13:46.282021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:13:46.282432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:13:46.309466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.310083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.310596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.311791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.312472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.312633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:46.313456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:46.314071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.314718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lazy-loading 'fault' on Instance uuid dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:13:46.318316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:46.349426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:13:46.363074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for user 87f4f3bcd603448d856a7471120a42af and project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:13:46.371905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:46.381847 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dccff9d8-bd0b-4969-8078-2005d66ced35 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 200 len: 1298 microversion: 2.1 time: 0.138641 Sep 01 05:13:46.382565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:13:46.385457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:13:46.397906 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2243/4496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:46 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:46.448178 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cec6e07b-1fbc-4b1e-8270-df00ac79f852 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.576824 Sep 01 05:13:46.454581 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2254/4497] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:13:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:13:46.472201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45a697ac-3615-4e4b-9d05-46601f8cf832 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:46.472810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45a697ac-3615-4e4b-9d05-46601f8cf832 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:46.662944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45a697ac-3615-4e4b-9d05-46601f8cf832 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:46.673020 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45a697ac-3615-4e4b-9d05-46601f8cf832 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1238 microversion: 2.1 time: 0.217042 Sep 01 05:13:46.688228 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2244/4498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:46 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1238 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:47.040216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:47.041213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:47.055356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.056151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.057518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.059090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.062299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.063823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.253220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:47.256039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:47.317731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.318475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.319268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.331261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.332150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.332918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.410382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:47.436041 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c3f695d-8a91-4242-918d-b7804d9f3405 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1642 microversion: 2.1 time: 0.399375 Sep 01 05:13:47.447043 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2255/4499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:47 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1642 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:47.465869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:47.472136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:47.491626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.493545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.494185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.496513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.499060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.499728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.506381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.506603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.508810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.509879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lazy-loading 'fault' on Instance uuid 9d41fae1-7569-4a7e-a003-d77c24e20dd7 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:13:47.547773 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea HTTP/1.1 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea'} Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:47.554224 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:13:47.560023 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:47.564202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:13:47.565174 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9715a0a2-bb7b-4490-876b-10ae4053157d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 404 len: 111 microversion: 2.1 time: 0.116152 Sep 01 05:13:47.566147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2256/4500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:47 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:13:47.580048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:47.581220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:47.615454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.615454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.616537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.617847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.618464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.619458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.803570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88c717d3cb8499584ad95febdf7d93b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e05207c3eac4610b5ba400ce1ebc015', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:47.854825 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12e1fd8a-6f99-4781-b60d-c11a932b36b0 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 200 len: 1367 microversion: 2.1 time: 0.606330 Sep 01 05:13:47.857845 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2245/4501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:47 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 1367 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:47.873985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:47.876127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:47.901069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.902249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.903851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.906408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:47.907709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:47.909831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:47.919718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:47.982840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:13:48.156007 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60ca033f-e91a-4e00-9703-496e10f4e184 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 204 len: 0 microversion: 2.1 time: 0.292377 Sep 01 05:13:48.157178 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2246/4502] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:13:47 2022] DELETE /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:13:48.173496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:48.176529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:48.196258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.197132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.197911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:48.198820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.200512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.203293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:48.377935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:48.388195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:48.391394 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-239c751c-38b5-4fb9-9b2f-c42d2af4feb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1290 microversion: 2.1 time: 0.230690 Sep 01 05:13:48.393903 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2247/4503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:48 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1290 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:48.399580 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a70c883c-5e23-4fa7-a9f2-df259b7ab19b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1642 microversion: 2.1 time: 0.831938 Sep 01 05:13:48.402636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2257/4504] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:47 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1642 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:48.404694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0ce59d4f-6997-4991-94b6-5e4bc058eae4 req-25076230-a94b-4ed3-8209-3f16a611e48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d41fae1-7569-4a7e-a003-d77c24e20dd7", "name": "network-vif-deleted", "tag": "e84fb235-3dd8-4b22-8ebc-56d27be3c977"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:48.415953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:48.417940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:48.434131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ce59d4f-6997-4991-94b6-5e4bc058eae4 req-25076230-a94b-4ed3-8209-3f16a611e48d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.434616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ce59d4f-6997-4991-94b6-5e4bc058eae4 req-25076230-a94b-4ed3-8209-3f16a611e48d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.435078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ce59d4f-6997-4991-94b6-5e4bc058eae4 req-25076230-a94b-4ed3-8209-3f16a611e48d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:48.441615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.442581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.443406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:48.444318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.445763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.447096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:48.458410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0ce59d4f-6997-4991-94b6-5e4bc058eae4 req-25076230-a94b-4ed3-8209-3f16a611e48d service nova] Creating event network-vif-deleted:e84fb235-3dd8-4b22-8ebc-56d27be3c977 for instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 on n-h2-820368-37 Sep 01 05:13:48.477806 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0ce59d4f-6997-4991-94b6-5e4bc058eae4 req-25076230-a94b-4ed3-8209-3f16a611e48d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081663 Sep 01 05:13:48.482691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2248/4505] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:48.496537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:48.497252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:48.515756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.516257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.516697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:48.517444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:48.517902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:48.518329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:49.324249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-519d0bf8-163e-4be0-a0a5-2c4c65d9c9ac tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1795 microversion: 2.1 time: 0.837679 Sep 01 05:13:49.325264 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2249/4506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:48 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1795 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:49.338757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:49.340963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] [instance: 9d41fae1-7569-4a7e-a003-d77c24e20dd7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:49.358970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:49.359481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:49.360018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:49.360746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:49.361204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:49.361630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:49.389984 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] HTTP exception thrown: Instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 could not be found. Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Request method failure captured: Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 HTTP/1.1 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED8YveCDxaB0LGCS9wskkzg9Za2VLdRvOBpdL1JU_x3iDp1HBPtNz-tiN7zbe_6N74DQON4o_v6SO0Iae9PK9O5NOO2nCjT5-iBX1N8gvxtKlndr2e_U3oY7J_7qoOqvoULaJ9rZu51SOvz4jvN9tSXIm9aeznApzTE-sGZceKDLLv4 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0e05207c3eac4610b5ba400ce1ebc015 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestManualDisk-2115609309 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0e05207c3eac4610b5ba400ce1ebc015"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0e05207c3eac4610b5ba400ce1ebc015"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0e05207c3eac4610b5ba400ce1ebc015"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0e05207c3eac4610b5ba400ce1ebc015"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestManualDisk-2115609309 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0e05207c3eac4610b5ba400ce1ebc015 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestManualDisk-2115609309 Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestManualDisk-2115609309-project Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: f88c717d3cb8499584ad95febdf7d93b Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestManualDisk-2115609309-project Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 could not be found. Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9d41fae1-7569-4a7e-a003-d77c24e20dd7'} Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 could not be found. Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 could not be found. Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:49.392842 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 could not be found. Sep 01 05:13:49.397465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:13:49.400447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Returning 404 to user: Instance 9d41fae1-7569-4a7e-a003-d77c24e20dd7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:13:49.401665 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b71b67a9-b703-48b2-870e-dd9f970a2819 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7" status: 404 len: 111 microversion: 2.1 time: 0.075167 Sep 01 05:13:49.407472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2250/4507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:49 2022] GET /compute/v2.1/servers/9d41fae1-7569-4a7e-a003-d77c24e20dd7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:13:49.422574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69502798-2b19-4461-950f-7324858a74c1 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] Calling method '.version_select at 0x7fa75bf245e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:49.444317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:49.468829 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69502798-2b19-4461-950f-7324858a74c1 tempest-ServersTestManualDisk-2115609309 tempest-ServersTestManualDisk-2115609309-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-977911901" status: 202 len: 0 microversion: 2.1 time: 0.058006 Sep 01 05:13:49.476555 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2251/4508] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:13:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-977911901 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:13:49.488922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:49.503460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:49.522761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:49.523590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:49.525172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:49.527496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:49.529279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:49.529987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:49.704860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:49.734992 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49e23ad7-0951-45a5-ba33-b29c877af239 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1296 microversion: 2.1 time: 0.256809 Sep 01 05:13:49.754312 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2252/4509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:49 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1296 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:50.041138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:50.051601 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e600599-de69-480d-8883-f5b486b8f04f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1495 microversion: 2.1 time: 1.647645 Sep 01 05:13:50.052215 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2258/4510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:48 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1495 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:50.758155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:50.758768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:50.766443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:50.767321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:50.767999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:50.768748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:50.769212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:50.769818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:50.935244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:50.955414 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8046b5c-5a9b-433f-962c-8424725a042f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1296 microversion: 2.1 time: 0.201043 Sep 01 05:13:50.956387 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2253/4511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:50 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1296 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:51.085871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:51.087632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:51.113378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:51.118736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:51.123787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:51.124734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:51.125284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:51.125733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:51.839048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:51.880951 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d3c57f3-da7a-49f0-b889-bcf66c0de016 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1495 microversion: 2.1 time: 0.780120 Sep 01 05:13:51.882140 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2259/4512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:51 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1495 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:51.981865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:51.983884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:51.998460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:52.008167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:52.008919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:52.009988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:52.010725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:52.011358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:52.049794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a57fa19c-22bf-4153-abc9-46faa23c03d6 req-87406dc7-f2a4-4e6d-b496-1695eebf7feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a05a5e-33ca-4fd3-91ea-edd84ddd69bd", "name": "network-vif-deleted", "tag": "1ba7242f-b695-46ed-8249-823e3e2e0f25"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:52.079254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a57fa19c-22bf-4153-abc9-46faa23c03d6 req-87406dc7-f2a4-4e6d-b496-1695eebf7feb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:52.080887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a57fa19c-22bf-4153-abc9-46faa23c03d6 req-87406dc7-f2a4-4e6d-b496-1695eebf7feb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:52.082028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a57fa19c-22bf-4153-abc9-46faa23c03d6 req-87406dc7-f2a4-4e6d-b496-1695eebf7feb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:52.116514 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a57fa19c-22bf-4153-abc9-46faa23c03d6 req-87406dc7-f2a4-4e6d-b496-1695eebf7feb service nova] Creating event network-vif-deleted:1ba7242f-b695-46ed-8249-823e3e2e0f25 for instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd on n-h2-820368-37 Sep 01 05:13:52.146704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a57fa19c-22bf-4153-abc9-46faa23c03d6 req-87406dc7-f2a4-4e6d-b496-1695eebf7feb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165327 Sep 01 05:13:52.149723 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2260/4513] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:13:52.629436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:52.638154 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-febdbb64-6d01-4bcc-92db-697a7352908f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 0.663234 Sep 01 05:13:52.652076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2254/4514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:51 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:52.904327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:52.905370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:52.922431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:52.924060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:52.924551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:52.927913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:52.928669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:52.929395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:53.035378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:53.037309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:53.038418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:53.039357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lazy-loading 'fault' on Instance uuid 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:13:53.205574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:53.219408 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ea4f6b5-a414-4c49-bd01-5ce4c3142413 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 200 len: 1298 microversion: 2.1 time: 0.319671 Sep 01 05:13:53.220373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2261/4515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:52 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 1298 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:53.662497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:53.663893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:53.673007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:53.673916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:53.674588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:53.675576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:53.678655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:53.679501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:54.242049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:54.242805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:54.254930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:54.260200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:54.263546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:54.264754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:54.267713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:54.268302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:54.273765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:54.282792 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02df5967-a981-4738-8044-63af9c1a79c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 0.624377 Sep 01 05:13:54.284833 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2255/4516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:53 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:54.324168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd HTTP/1.1 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '33a05a5e-33ca-4fd3-91ea-edd84ddd69bd'} Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:13:54.326284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d86fcb98-57a8-43bd-9b45-6e28bc8b2bc4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 404 len: 111 microversion: 2.1 time: 0.090709 Sep 01 05:13:54.333802 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2262/4517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:54 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:13:54.465559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-665634021", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:54.530710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:13:54.553168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ca1b876f-04fd-4d89-9119-d6a12211aaab req-0bdd6af7-6295-445f-8f5a-13436f166127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:54.566269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca1b876f-04fd-4d89-9119-d6a12211aaab req-0bdd6af7-6295-445f-8f5a-13436f166127 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:54.566920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca1b876f-04fd-4d89-9119-d6a12211aaab req-0bdd6af7-6295-445f-8f5a-13436f166127 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:54.567503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ca1b876f-04fd-4d89-9119-d6a12211aaab req-0bdd6af7-6295-445f-8f5a-13436f166127 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:54.581062 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ca1b876f-04fd-4d89-9119-d6a12211aaab req-0bdd6af7-6295-445f-8f5a-13436f166127 service nova] Creating event network-changed:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:13:54.587725 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ca1b876f-04fd-4d89-9119-d6a12211aaab req-0bdd6af7-6295-445f-8f5a-13436f166127 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037789 Sep 01 05:13:54.589127 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2263/4518] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:13:55.320177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:55.320882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:55.334387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:55.337930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:55.339590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:55.344143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:55.345341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:55.346738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:56.123971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:56.144280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7a1d8f9-ea96-4c22-895c-4b287f50ea0f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 0.838367 Sep 01 05:13:56.146009 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2264/4519] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:55 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:56.474034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:13:56.475397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:13:56.475931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:13:56.476540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:13:56.477304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:13:56.490095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:56.490677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:56.491389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:56.492195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:56.492720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:56.493212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:56.502878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:56.527141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:13:56.534285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:13:56.549480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:13:56.552744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:13:56.616110 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b954969-99bf-4121-823c-745f1c72cbbe tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.154949 Sep 01 05:13:56.617329 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2256/4520] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:13:56.628731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ca60166-12ad-4ead-948f-85a8ef1fe864 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:56.635290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ca60166-12ad-4ead-948f-85a8ef1fe864 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:56.638273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:56.641016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:57.029840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ca60166-12ad-4ead-948f-85a8ef1fe864 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:57.042269 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ca60166-12ad-4ead-948f-85a8ef1fe864 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1208 microversion: 2.1 time: 0.417399 Sep 01 05:13:57.045416 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2265/4521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:56 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1208 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:57.169176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:57.170179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:57.186211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:57.187579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:57.188241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:57.190382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:57.191903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:57.194066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:57.225145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ac24b09c-e36f-4c3a-a2d3-dbf4256a02cc req-e3a4b57b-9d05-4a77-a81b-9e7f7c3e9c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66563c2c-1ed6-48e1-acc8-c99f29b124e9", "tag": "1e61b969-ca27-42f2-894e-c9d99e47ea9f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:13:57.254194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ac24b09c-e36f-4c3a-a2d3-dbf4256a02cc req-e3a4b57b-9d05-4a77-a81b-9e7f7c3e9c2c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:57.255418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ac24b09c-e36f-4c3a-a2d3-dbf4256a02cc req-e3a4b57b-9d05-4a77-a81b-9e7f7c3e9c2c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:57.256642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ac24b09c-e36f-4c3a-a2d3-dbf4256a02cc req-e3a4b57b-9d05-4a77-a81b-9e7f7c3e9c2c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:57.283461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ac24b09c-e36f-4c3a-a2d3-dbf4256a02cc req-e3a4b57b-9d05-4a77-a81b-9e7f7c3e9c2c service nova] Creating event network-changed:1e61b969-ca27-42f2-894e-c9d99e47ea9f for instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 on n-h2-820368-37 Sep 01 05:13:57.294484 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ac24b09c-e36f-4c3a-a2d3-dbf4256a02cc req-e3a4b57b-9d05-4a77-a81b-9e7f7c3e9c2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085941 Sep 01 05:13:57.296409 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2266/4522] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:13:58.068046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:58.069621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:58.087870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:58.090610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:58.092482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:58.094708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:58.096183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:58.112508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:58.422913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:58.451636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-305b46b6-a4ce-453c-bb8c-6fb61a4d1849 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1260 microversion: 2.1 time: 0.388236 Sep 01 05:13:58.473414 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2267/4523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:58 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1260 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:13:59.031931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:59.057330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33e5fc97-9169-4c97-ba11-6b15fe45060c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 1.893176 Sep 01 05:13:59.068840 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2257/4524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:57 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:13:59.504985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:13:59.506440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:13:59.524514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:59.528019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:59.530030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:59.530861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:13:59.531546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:13:59.532523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:13:59.752124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:13:59.766977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0af12268-f36f-4905-bed8-4eda061db53b tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1266 microversion: 2.1 time: 0.267920 Sep 01 05:13:59.771077 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2268/4525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:13:59 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:00.106841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:00.109674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:00.133825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:00.135580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:00.138445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:00.139681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:00.141183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:00.143450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:00.144386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:00.145565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:00.157927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:00.159622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:00.161354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:00.163534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:00.166787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:00.168186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:00.351908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lazy-loading 'services' on Instance uuid 592288da-ac4d-4eb7-ad8a-f6a505e803bd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:14:00.357563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:00.470663 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89c2a789-a0ad-4145-b85c-efd62e3474ef tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "DELETE /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd/os-volume_attachments/eb037ebf-4d11-43f1-b23a-8e6976ae0e59" status: 202 len: 0 microversion: 2.1 time: 0.334469 Sep 01 05:14:00.472271 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2269/4526] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:14:00 2022] DELETE /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd/os-volume_attachments/eb037ebf-4d11-43f1-b23a-8e6976ae0e59 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:14:00.593458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:00.605549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab7bfeec-5cf4-40df-9477-547aa03aa326 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 0.507436 Sep 01 05:14:00.625542 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2258/4527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:00 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:00.804239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:00.807400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:00.823011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:00.824339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:00.825457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:00.827743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:00.828700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:00.829673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:00.971149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:00.981641 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c4c5fd0-ca53-4cb3-ba8c-9bf324502a31 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1266 microversion: 2.1 time: 0.190299 Sep 01 05:14:00.995106 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2270/4528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:00 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:01.634308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:01.635020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:01.653104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:01.653637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:01.658084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:01.659430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:01.660295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:01.660740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:02.006400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:02.007613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:02.021377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:02.024933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:02.031367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:02.034798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:02.039638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:02.040354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:03.060049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:03.062564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:03.074782 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22c7db79-d15d-4eab-882a-d550314ab4ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 1.447112 Sep 01 05:14:03.077514 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2259/4529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:01 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:03.082353 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4de6bc95-ce2b-4957-99aa-8ae159ef285a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 1.079940 Sep 01 05:14:03.083807 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2271/4530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:02 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:03.112081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5b1d6246-e780-438a-81c0-2a3f6bf4667f req-7f47a662-1000-4a0e-9062-6e6d325255e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-plugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:03.135747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b1d6246-e780-438a-81c0-2a3f6bf4667f req-7f47a662-1000-4a0e-9062-6e6d325255e5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:03.136634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b1d6246-e780-438a-81c0-2a3f6bf4667f req-7f47a662-1000-4a0e-9062-6e6d325255e5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:03.156800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b1d6246-e780-438a-81c0-2a3f6bf4667f req-7f47a662-1000-4a0e-9062-6e6d325255e5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:03.177753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b1d6246-e780-438a-81c0-2a3f6bf4667f req-7f47a662-1000-4a0e-9062-6e6d325255e5 service nova] Creating event network-vif-plugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:14:03.194427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5b1d6246-e780-438a-81c0-2a3f6bf4667f req-7f47a662-1000-4a0e-9062-6e6d325255e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109153 Sep 01 05:14:03.220485 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2260/4531] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:04.107289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:04.107941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:04.109646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:04.114016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:04.115723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:04.134604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:04.137087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:04.143882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:04.144880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:04.145710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:04.146560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:04.148352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:04.148560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:04.149219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:04.149863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:04.150498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:04.151144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:04.557187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:04.569118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-160b5b6c-9aa6-4230-9754-ee5015bbda27 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 0.467902 Sep 01 05:14:04.573851 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2261/4532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:04 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:04.592019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:04.608197 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c1c6ea3-c127-43cb-aee4-741f4f651c62 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1364 microversion: 2.1 time: 0.511549 Sep 01 05:14:04.613301 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2272/4533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:04 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1364 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:04.801420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dcba8bfc-7330-4f42-9961-840b5f207d5d req-5bd5a57f-b8c2-48b5-930a-3abc443d9363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fdf17d3-e18d-42ba-b271-470d48aa3c2d", "tag": "5068635d-08ce-4886-a13c-1d3c59ae1a0f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:04.826929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dcba8bfc-7330-4f42-9961-840b5f207d5d req-5bd5a57f-b8c2-48b5-930a-3abc443d9363 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:04.832625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dcba8bfc-7330-4f42-9961-840b5f207d5d req-5bd5a57f-b8c2-48b5-930a-3abc443d9363 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:04.833076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dcba8bfc-7330-4f42-9961-840b5f207d5d req-5bd5a57f-b8c2-48b5-930a-3abc443d9363 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:04.861006 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dcba8bfc-7330-4f42-9961-840b5f207d5d req-5bd5a57f-b8c2-48b5-930a-3abc443d9363 service nova] Creating event network-changed:5068635d-08ce-4886-a13c-1d3c59ae1a0f for instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d on n-h2-820368-37 Sep 01 05:14:04.875918 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dcba8bfc-7330-4f42-9961-840b5f207d5d req-5bd5a57f-b8c2-48b5-930a-3abc443d9363 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116226 Sep 01 05:14:04.877978 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2262/4534] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:05.596314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:05.597205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:05.620707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:05.621952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:05.624814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:05.629508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:05.631362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:05.632552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:05.635717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:05.644571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:05.657965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:05.659241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:05.659872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:05.660791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:05.661426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:05.662028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:05.985220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:05.996973 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db4ab89c-2dd3-4036-8e36-29c2264ef634 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1551 microversion: 2.1 time: 0.366382 Sep 01 05:14:06.014477 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2263/4535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:05 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1551 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:06.019772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:06.020844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:06.028952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:06.029680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:06.030395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:06.032274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:06.032756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:06.033191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:06.047382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:06.075216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59e3b3b3-3dbf-41a8-b0b0-965b567260d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 0.483770 Sep 01 05:14:06.092504 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2273/4536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:05 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:06.169189 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b9943ec-c4a0-43ec-9c3d-da45d7075dde tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153030 Sep 01 05:14:06.170860 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2264/4537] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:14:06 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:07.125425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:07.128617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:07.174642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:07.188519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:07.189870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:07.191792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:07.206168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:07.206168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:07.206168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:08.270555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:08.292324 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cb2945c-036c-4cc5-b47d-d48bfdfc0a96 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 1.177847 Sep 01 05:14:08.293954 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2274/4538] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:07 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:08.572828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:08.575831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:08.587891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:08.589375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:08.606817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:08.608813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:08.609904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:08.611883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:08.613021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:08.615031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:08.749552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:14:08.971177 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d2d2c3a-eb6c-470a-b340-4aee3607b83c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "DELETE /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 204 len: 0 microversion: 2.1 time: 0.397073 Sep 01 05:14:08.979715 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2265/4539] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:14:08 2022] DELETE /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:14:08.987702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:08.989092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:09.004852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:09.005715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:09.006433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:09.012007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:09.014108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:09.015210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:09.157230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a2d6bd15-1a8b-4e43-b465-01c4a6d1fc8c req-df5ccbda-d273-41d8-a554-9ce497eb2a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:09.205084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a2d6bd15-1a8b-4e43-b465-01c4a6d1fc8c req-df5ccbda-d273-41d8-a554-9ce497eb2a8a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:09.206325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a2d6bd15-1a8b-4e43-b465-01c4a6d1fc8c req-df5ccbda-d273-41d8-a554-9ce497eb2a8a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:09.207363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a2d6bd15-1a8b-4e43-b465-01c4a6d1fc8c req-df5ccbda-d273-41d8-a554-9ce497eb2a8a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:09.230458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a2d6bd15-1a8b-4e43-b465-01c4a6d1fc8c req-df5ccbda-d273-41d8-a554-9ce497eb2a8a service nova] Creating event network-changed:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:14:09.236183 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a2d6bd15-1a8b-4e43-b465-01c4a6d1fc8c req-df5ccbda-d273-41d8-a554-9ce497eb2a8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089133 Sep 01 05:14:09.237456 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2266/4540] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:09.318323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:09.320079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:09.337296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:09.338105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:09.338722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:09.339716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:09.340371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:09.341798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:10.038148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:10.052639 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8511554-92c2-4d5e-a68a-ad8ef94cffb0 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1514 microversion: 2.1 time: 1.072831 Sep 01 05:14:10.063671 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2275/4541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:08 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1514 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:10.179880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:10.220869 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50d987ae-e305-4bb0-ae59-32a2ca91afa7 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 0.908764 Sep 01 05:14:10.235119 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2267/4542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:09 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:10.918117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a4867a80-83fb-41cd-8610-b0c692dde680 req-10861a71-afc8-4a8d-b8f0-1b1977356983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdf17d3-e18d-42ba-b271-470d48aa3c2d", "name": "network-vif-plugged", "status": "completed", "tag": "5068635d-08ce-4886-a13c-1d3c59ae1a0f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:10.945022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4867a80-83fb-41cd-8610-b0c692dde680 req-10861a71-afc8-4a8d-b8f0-1b1977356983 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:10.950798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4867a80-83fb-41cd-8610-b0c692dde680 req-10861a71-afc8-4a8d-b8f0-1b1977356983 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:10.951417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4867a80-83fb-41cd-8610-b0c692dde680 req-10861a71-afc8-4a8d-b8f0-1b1977356983 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:10.972119 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a4867a80-83fb-41cd-8610-b0c692dde680 req-10861a71-afc8-4a8d-b8f0-1b1977356983 service nova] Creating event network-vif-plugged:5068635d-08ce-4886-a13c-1d3c59ae1a0f for instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d on n-h2-820368-37 Sep 01 05:14:10.988308 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a4867a80-83fb-41cd-8610-b0c692dde680 req-10861a71-afc8-4a8d-b8f0-1b1977356983 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074521 Sep 01 05:14:11.000338 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2276/4543] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:14:11.093932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:11.096781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:11.135320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:11.138778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:11.144243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:11.145932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:11.146859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:11.148107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:11.244063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:11.245804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:11.263200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:11.263712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:11.264154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:11.265029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:11.265485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:11.265910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:11.733412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:11.748000 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9f37043-106b-4449-9a6b-163886d11071 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1514 microversion: 2.1 time: 0.663697 Sep 01 05:14:11.759127 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2268/4544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:11 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1514 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:11.811440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:11.825957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89ee5267-b155-428f-9d7e-b29bd9331706 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 0.586065 Sep 01 05:14:11.828831 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2277/4545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:11 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:12.188849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c8c306c0-de2e-49c1-b919-23eeeeff824b req-f0442974-5b3b-4265-872e-05551f79197e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "592288da-ac4d-4eb7-ad8a-f6a505e803bd", "name": "network-vif-deleted", "tag": "d486cd19-00e4-4e8f-9ec8-76a14699627e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:12.205615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c8c306c0-de2e-49c1-b919-23eeeeff824b req-f0442974-5b3b-4265-872e-05551f79197e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:12.206654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c8c306c0-de2e-49c1-b919-23eeeeff824b req-f0442974-5b3b-4265-872e-05551f79197e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:12.207419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c8c306c0-de2e-49c1-b919-23eeeeff824b req-f0442974-5b3b-4265-872e-05551f79197e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:12.242648 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c8c306c0-de2e-49c1-b919-23eeeeff824b req-f0442974-5b3b-4265-872e-05551f79197e service nova] Creating event network-vif-deleted:d486cd19-00e4-4e8f-9ec8-76a14699627e for instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd on n-h1-820368-37 Sep 01 05:14:12.249738 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c8c306c0-de2e-49c1-b919-23eeeeff824b req-f0442974-5b3b-4265-872e-05551f79197e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070053 Sep 01 05:14:12.251596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2269/4546] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:12.785598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:12.790260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:12.811206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:12.813929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:12.815118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:12.817181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:12.819583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:12.820535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:12.868031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:12.871075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:12.888863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:12.890918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:12.892253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:12.895906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:12.897238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:12.898282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:12.918761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:12.919300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:12.923222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:12.924054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lazy-loading 'fault' on Instance uuid 592288da-ac4d-4eb7-ad8a-f6a505e803bd {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:14:13.112423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:13.124439 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d2247e9-9b05-4408-b162-eec679bd7a6f tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 200 len: 1309 microversion: 2.1 time: 0.349236 Sep 01 05:14:13.142126 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2278/4547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:12 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:13.237234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:13.246006 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-446c0ca5-35ef-4c3a-84bf-be5b82a669f5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1308 microversion: 2.1 time: 0.387151 Sep 01 05:14:13.254463 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2270/4548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:12 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:14.148960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:14.149864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 592288da-ac4d-4eb7-ad8a-f6a505e803bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:14.158310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.159179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.159646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.160585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.161074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.161506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.177888 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] HTTP exception thrown: Instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd could not be found. Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Request method failure captured: Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd HTTP/1.1 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED7IuY_w8D1wp0Q_rhERuc5du9AN6r_DsXCudIKatyibocSYaWIY20_4oy4l5D3atnEpiu-_IX2GqbJr_EngDZQh_PwSvHsiXF6nL6r4sqMBfYnSXjoZTLdYGqj9ZWUfpECXT470HR863ALynjhuR3HlaUSpJamSVSPHkkvVvo_a4J4 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 44d4d0afdb1f48cca5b43c2469ba33ae Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1479911689 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesSnapshotTestJSON-1479911689 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 44d4d0afdb1f48cca5b43c2469ba33ae Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1479911689 Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesSnapshotTestJSON-1479911689-project Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: efd853a20dc94d2b9f2d080a903c046b Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesSnapshotTestJSON-1479911689-project Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd could not be found. Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '592288da-ac4d-4eb7-ad8a-f6a505e803bd'} Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd could not be found. Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd could not be found. Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:14.179727 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd could not be found. Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Returning 404 to user: Instance 592288da-ac4d-4eb7-ad8a-f6a505e803bd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d8b1d2c-6979-4c06-8633-96cc611842dc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd" status: 404 len: 111 microversion: 2.1 time: 0.036651 Sep 01 05:14:14.186854 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2279/4549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:14 2022] GET /compute/v2.1/servers/592288da-ac4d-4eb7-ad8a-f6a505e803bd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:14.269704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:14.270600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:14.280117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.280956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.281825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.283191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.284133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.285089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.507765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:14.518827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53fc5d89-745b-4581-abbf-94a737f530fb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1489 microversion: 2.1 time: 0.254910 Sep 01 05:14:14.520494 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2271/4550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:14 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1489 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:14.543253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:14.546621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:14.553950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.554787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.555433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.556539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.557295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.557879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.654101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e989899f-ccb3-4aaa-9048-cc60345b7b24 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "PUT /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1084 microversion: 2.1 time: 0.114028 Sep 01 05:14:14.663266 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2280/4551] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:14:14 2022] PUT /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1084 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:14.690298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:14.695439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:14.717964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.719576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.721753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.724923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:14.726461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:14.729662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:14.985325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:14.997902 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57cef702-30ff-48f1-89f1-f0f841082141 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1510 microversion: 2.1 time: 0.321028 Sep 01 05:14:15.001634 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2272/4552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:14 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:15.024934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:15.026025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:15.032755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:15.033566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:15.034475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:15.035568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:15.036236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:15.036655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:15.223056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:15.259448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c66397ea-8260-4d65-af4a-902ecc551b05 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1510 microversion: 2.1 time: 0.238206 Sep 01 05:14:15.269051 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2281/4553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:15 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:15.313230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:15.316152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:15.330303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:15.331607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:15.333624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:15.335200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:15.336299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:15.338030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:15.394010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:14:15.478654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:15.637495 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9d381a6-9c80-4e94-9f2c-7a1889739cfd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 204 len: 0 microversion: 2.1 time: 0.333341 Sep 01 05:14:15.638586 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2273/4554] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:14:15 2022] DELETE /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:14:15.648158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:15.648934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:15.661253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:15.662168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:15.664276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:15.665568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:15.667462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:15.669334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:16.107793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:16.116599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b815490e-613c-4c46-aa43-d8655d4822cf tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1516 microversion: 2.1 time: 0.472826 Sep 01 05:14:16.117603 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2282/4555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:15 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1516 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:17.143945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:17.145468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:17.153223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:17.154141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:17.155375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:17.157386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:17.158137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:17.158690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:17.512816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:17.531603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89184eed-c70f-4e73-891d-b67c935eda3d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1516 microversion: 2.1 time: 0.392507 Sep 01 05:14:17.546104 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2274/4556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:17 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1516 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:18.340847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bcfa8aa0-bc00-4e16-8fd5-89828b28bdd0 req-cbcaf3e6-d489-457c-8aaf-6a0e7e6e9094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdf17d3-e18d-42ba-b271-470d48aa3c2d", "name": "network-vif-deleted", "tag": "5068635d-08ce-4886-a13c-1d3c59ae1a0f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:18.391985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bcfa8aa0-bc00-4e16-8fd5-89828b28bdd0 req-cbcaf3e6-d489-457c-8aaf-6a0e7e6e9094 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:18.393530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bcfa8aa0-bc00-4e16-8fd5-89828b28bdd0 req-cbcaf3e6-d489-457c-8aaf-6a0e7e6e9094 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:18.395753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bcfa8aa0-bc00-4e16-8fd5-89828b28bdd0 req-cbcaf3e6-d489-457c-8aaf-6a0e7e6e9094 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:18.460534 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bcfa8aa0-bc00-4e16-8fd5-89828b28bdd0 req-cbcaf3e6-d489-457c-8aaf-6a0e7e6e9094 service nova] Creating event network-vif-deleted:5068635d-08ce-4886-a13c-1d3c59ae1a0f for instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d on n-h2-820368-37 Sep 01 05:14:18.471877 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bcfa8aa0-bc00-4e16-8fd5-89828b28bdd0 req-cbcaf3e6-d489-457c-8aaf-6a0e7e6e9094 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136485 Sep 01 05:14:18.473764 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2283/4557] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:18.565040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:18.568150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:18.586622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:18.587467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:18.588149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:18.589127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:18.589809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:18.590451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:18.683938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:18.684739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:18.687883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:18.689165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lazy-loading 'fault' on Instance uuid 9fdf17d3-e18d-42ba-b271-470d48aa3c2d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:14:18.785688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:18.813395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09253acb-a5b3-485e-8098-df18a00acfa6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 200 len: 1319 microversion: 2.1 time: 0.257864 Sep 01 05:14:18.819539 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2275/4558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:18 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:19.838247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:19.839129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:19.860625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:19.861444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:19.862070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:19.863121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:19.863781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:19.864387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:19.907652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d HTTP/1.1 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9fdf17d3-e18d-42ba-b271-470d48aa3c2d'} Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:19.909939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:14:19.915477 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:19.927874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:19.929046 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2bf57f01-bc0e-4e77-9c3c-c8032a1453cd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 404 len: 111 microversion: 2.1 time: 0.096362 Sep 01 05:14:19.929828 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2284/4559] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:19 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:14:20.180290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1346555732", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "ddc91797-7687-4516-8f1f-8d6243722661"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:20.215924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:20.330992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] validate_networks() for [('ddc91797-7687-4516-8f1f-8d6243722661', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:21.076971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:21.078205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:21.079396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:21.080072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:21.080788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:21.090524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:21.091035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:21.091674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:21.092433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:21.092893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:21.093322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:21.128810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:21.135783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Getting quotas for user 2b99c7e610e94d3781c3890e296a2cfe and project c5919b7ff63b442097d0fb4784fbb505. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:21.167974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:21.171037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:21.244118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed39a38d-85b6-424e-a49d-1e011b9a03e6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071518 Sep 01 05:14:21.255268 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2276/4560] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:21.257805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b75ab342-bee8-468f-8a06-77e4a315bc09 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:21.258444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b75ab342-bee8-468f-8a06-77e4a315bc09 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:21.360050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b75ab342-bee8-468f-8a06-77e4a315bc09 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:21.375518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b75ab342-bee8-468f-8a06-77e4a315bc09 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1209 microversion: 2.1 time: 0.121682 Sep 01 05:14:21.378552 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2285/4561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:21 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:22.397561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:22.398267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:22.406487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:22.407334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:22.407770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:22.408713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:22.409724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:22.410167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:22.503777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:22.520155 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8140a1dc-0278-4802-9290-2a6e29643cc3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1205 microversion: 2.1 time: 0.126394 Sep 01 05:14:22.532260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2277/4562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:22 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1205 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:22.670612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1727226614", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "3783ba2a-aea1-4007-8ee7-137ceb2adc5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:22.738624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] validate_networks() for [('3783ba2a-aea1-4007-8ee7-137ceb2adc5b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:23.432786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:23.433701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:23.434930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:23.436842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:23.437737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:23.456302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:23.457163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:23.457924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:23.459694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:23.460683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:23.461464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:23.497875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Getting quotas for project 44d4d0afdb1f48cca5b43c2469ba33ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:23.509486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Getting quotas for user efd853a20dc94d2b9f2d080a903c046b and project 44d4d0afdb1f48cca5b43c2469ba33ae. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:23.541694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:23.547316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:23.562101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:23.563279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:23.588544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:23.589514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:23.593591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:23.596154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:23.608212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:23.609624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:23.636819 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0bc7739-ceb8-423a-9c72-3bfb91852dd4 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970490 Sep 01 05:14:23.638664 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2286/4563] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:23.663229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-989f9d8c-e58f-4757-9b3b-704701e2e6c3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:23.663843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-989f9d8c-e58f-4757-9b3b-704701e2e6c3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:23.826726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989f9d8c-e58f-4757-9b3b-704701e2e6c3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:23.836015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:23.837502 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-989f9d8c-e58f-4757-9b3b-704701e2e6c3 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1219 microversion: 2.1 time: 0.179986 Sep 01 05:14:23.839252 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2287/4564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:23 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:23.871298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4188b7e1-89b8-4580-a459-b4da10059fe9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1267 microversion: 2.1 time: 0.316155 Sep 01 05:14:23.883631 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2278/4565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:23 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:24.877277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:24.878553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:24.893623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:24.896305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:24.905864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:24.907174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:24.911968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:24.916886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:24.917378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:24.918098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:24.918693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:24.925288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:24.928854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:24.929618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:24.930085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:24.930511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:25.199515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:25.211975 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d72f7f2-b6cd-456f-ba8f-2c51c1762a2c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1215 microversion: 2.1 time: 0.337736 Sep 01 05:14:25.213034 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2288/4566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:24 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1215 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:25.483701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1583299114", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2849f3fe-f409-495a-9ff7-be7140947b98"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:25.563025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:25.586956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-099c282f-2291-4f0c-ae7c-3d8cbe0aad52 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.681310 Sep 01 05:14:25.590137 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2279/4567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:24 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:25.599754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] validate_networks() for [('2849f3fe-f409-495a-9ff7-be7140947b98', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:14:26.265075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:26.273782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:26.321500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:26.322759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:26.324503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:26.328038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:26.329617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:26.330749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:26.547394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:26.564097 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80c4c23d-c2ba-4b1b-88c4-4745ed3ffd96 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1277 microversion: 2.1 time: 0.321168 Sep 01 05:14:26.566691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2280/4568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:26 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:26.615566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:26.617021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:26.627827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:26.628667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:26.629275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:26.630193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:26.630842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:26.631462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:27.157516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:27.173980 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06d111e3-2836-4dd1-a974-e3dd17f43ee6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.563221 Sep 01 05:14:27.176705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2281/4569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:26 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:27.339806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:14:27.341608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:14:27.343241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:14:27.343852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:14:27.344866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:14:27.356627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:27.357505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:27.358352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:27.359342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:27.359994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:27.360663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:27.391417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Getting quotas for project 0b9e5632f01f48debdab46922ae66db8. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:14:27.404668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Getting quotas for user 102acc7e0bfb4d0c93e3f6a23b850783 and project 0b9e5632f01f48debdab46922ae66db8. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:14:27.438654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:14:27.445643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:14:27.576510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-333efb27-bea0-4081-8352-bd01e085500a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.360286 Sep 01 05:14:27.592154 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2289/4570] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:14:27.592770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:27.593628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:27.609675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:27.610192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:27.610649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:27.611432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:27.611905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:27.612342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:27.643056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20f67335-949b-495b-b343-b019e9241614 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:27.644799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20f67335-949b-495b-b343-b019e9241614 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:27.928516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20f67335-949b-495b-b343-b019e9241614 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:27.952805 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20f67335-949b-495b-b343-b019e9241614 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1225 microversion: 2.1 time: 0.355264 Sep 01 05:14:27.959781 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2290/4571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:27 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1225 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:27.986254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b30426a7-67dd-4323-a3f1-4d087b39d9f7 req-bd36595b-119c-42a8-b910-62d9493a6404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb50fe2a-bf2c-4f0e-9546-406ae7e6880f", "tag": "1caca118-7320-4cf7-ac84-33d0e75faf02"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:28.013755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b30426a7-67dd-4323-a3f1-4d087b39d9f7 req-bd36595b-119c-42a8-b910-62d9493a6404 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:28.014807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b30426a7-67dd-4323-a3f1-4d087b39d9f7 req-bd36595b-119c-42a8-b910-62d9493a6404 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:28.020661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b30426a7-67dd-4323-a3f1-4d087b39d9f7 req-bd36595b-119c-42a8-b910-62d9493a6404 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:28.050906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b30426a7-67dd-4323-a3f1-4d087b39d9f7 req-bd36595b-119c-42a8-b910-62d9493a6404 service nova] Creating event network-changed:1caca118-7320-4cf7-ac84-33d0e75faf02 for instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f on n-h2-820368-37 Sep 01 05:14:28.060596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b30426a7-67dd-4323-a3f1-4d087b39d9f7 req-bd36595b-119c-42a8-b910-62d9493a6404 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087944 Sep 01 05:14:28.061944 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2291/4572] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:28.199231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:28.200404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:28.215274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:28.216210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:28.216847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:28.218941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:28.221290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:28.222254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:28.321511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:28.351925 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3a3a046-b88d-4d7d-9802-c605d967cbc6 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.762712 Sep 01 05:14:28.353607 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2282/4573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:27 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:28.691951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:28.704983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:28.735502 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aad99c47-1a76-44bc-b7f0-f94f760b1390 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.541480 Sep 01 05:14:28.736880 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2292/4574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:28 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:29.006717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:29.007549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:29.035451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.036112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.036665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.037714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.039335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.041015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.381231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:29.381779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:29.397245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.398200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.399313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.400632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.401496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.402309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.490571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:29.501580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0f36ee2-a255-48a2-b795-9caf475a3a64 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1277 microversion: 2.1 time: 0.511317 Sep 01 05:14:29.503124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2283/4575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:28 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1277 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:29.766731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:29.768619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:29.783500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.784619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.787136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.790388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:29.791321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:29.793014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:29.829766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:29.844854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13690ded-7542-41e3-b445-95b7590671bc tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.474290 Sep 01 05:14:29.845466 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2293/4576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:29 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:30.136086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:30.147889 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-642adcf1-266b-447f-baf7-3e6f4e6784d6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.385528 Sep 01 05:14:30.149419 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2284/4577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:29 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:30.415058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ba0c63aa-bf8d-4a48-985b-706f97be3aab req-923b89d6-8c1e-4097-833f-f9faa763992e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f57b447-ff92-4235-9b7b-a9cada0162a8", "tag": "7c3a7095-2844-4ae1-b663-68126d2b9dbf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:30.427114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0c63aa-bf8d-4a48-985b-706f97be3aab req-923b89d6-8c1e-4097-833f-f9faa763992e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:30.427589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0c63aa-bf8d-4a48-985b-706f97be3aab req-923b89d6-8c1e-4097-833f-f9faa763992e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:30.428012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ba0c63aa-bf8d-4a48-985b-706f97be3aab req-923b89d6-8c1e-4097-833f-f9faa763992e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:30.440357 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ba0c63aa-bf8d-4a48-985b-706f97be3aab req-923b89d6-8c1e-4097-833f-f9faa763992e service nova] Creating event network-changed:7c3a7095-2844-4ae1-b663-68126d2b9dbf for instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 on n-h1-820368-37 Sep 01 05:14:30.446281 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ba0c63aa-bf8d-4a48-985b-706f97be3aab req-923b89d6-8c1e-4097-833f-f9faa763992e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034813 Sep 01 05:14:30.447932 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2294/4578] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:30.526127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:30.527021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:30.533736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:30.535872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:30.536992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:30.537142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:30.537559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:30.538196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:30.607343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:30.616116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bd3fad4-146a-4b76-9ec8-f67b5ab4c04c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1283 microversion: 2.1 time: 0.094760 Sep 01 05:14:30.616733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2285/4579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:30 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:30.883361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:30.884144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:30.894033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:30.894033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:30.894033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:30.894484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:30.894952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:30.895590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.119967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:31.130956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-403b2e92-2056-4f8c-8828-3dc0a75637ae tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.250488 Sep 01 05:14:31.131302 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2295/4580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:30 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:31.170536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:31.171844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:31.173689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:31.175077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:31.180237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:31.180732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:31.181270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.182073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:31.182456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:31.183145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.441151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:31.451212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8073677-267d-4047-bbaf-d42a28336704 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.284717 Sep 01 05:14:31.452081 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2286/4581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:31 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:31.637790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:31.638275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:31.646419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:31.646952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:31.647393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.648318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:31.648806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:31.649383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:31.756536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:31.765775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80b10e4a-2780-40a5-826b-24d4aedab3c9 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1283 microversion: 2.1 time: 0.132016 Sep 01 05:14:31.779101 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2296/4582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:31 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:32.152284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:32.152925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:32.162391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:32.163377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:32.164024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:32.164969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:32.165713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:32.166354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:32.413851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:32.425080 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b4498cc-7ec4-4988-a741-696b3ebcea13 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.276145 Sep 01 05:14:32.426917 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2287/4583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:32 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:32.475551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:32.476979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:32.487816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:32.488336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:32.489940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:32.491288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:32.492013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:32.492709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:32.744623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:32.766944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c36ef9c5-3450-400e-99f6-e6428050b033 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.297074 Sep 01 05:14:32.782144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2297/4584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:32 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:32.788339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:32.789546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:32.796246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:32.796909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:32.797459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:32.798494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:32.799784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:32.800460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:32.910552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:32.931966 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbfe1d62-1e60-4cbf-8699-f461f507ee1b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1283 microversion: 2.1 time: 0.148093 Sep 01 05:14:32.935193 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2288/4585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:32 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1283 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:33.449148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:33.450108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:33.458803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:33.459710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:33.460962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:33.461981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:33.462772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:33.463581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:33.684924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:33.698825 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54d055b8-c950-431c-971d-bec2305e4e4c tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.254044 Sep 01 05:14:33.710720 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2298/4586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:33 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:33.791994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:33.792723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:33.801247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:33.802347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:33.803112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:33.804209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:33.804974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:33.805620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:33.964670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:33.965814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:33.978531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:33.979625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:33.980462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:33.981892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:33.982922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:33.983578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:34.064686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:34.081951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33c5f9b7-c66f-4ef8-b0e6-ba8875be1464 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.293769 Sep 01 05:14:34.082911 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2289/4587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:33 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:34.108584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:34.121909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d0764f2-6bd2-42e5-a969-1c7f092b200c tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1283 microversion: 2.1 time: 0.165760 Sep 01 05:14:34.140447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2299/4588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:33 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1283 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:34.729566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:34.732077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:34.774010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:34.775246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:34.776888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:34.781803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:34.783631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:34.787586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:34.804655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:35.112677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:35.113909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:35.131383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:35.132968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:35.133459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:35.134104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.135087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:35.135738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:35.136333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.394492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:35.403435 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56abda3e-a1d0-42bd-a1fe-b412bce760af tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.683384 Sep 01 05:14:35.404167 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2290/4589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:34 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:35.409567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:35.410540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:35.428755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:35.429411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:35.430206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.431197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:35.431715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:35.432270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:35.640741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:35.670200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85d4b83c-a5cb-4d10-90d9-faf4cbc2b29f tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.569169 Sep 01 05:14:35.695564 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2300/4590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:35 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:35.830190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:35.848707 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cced697-8861-49e0-b6b6-64e9ccc4e79e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.442637 Sep 01 05:14:35.850417 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2291/4591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:35 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:36.437736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9d6fd25e-6355-42b2-b51e-66840a1e0772 req-4a70db2e-9360-43ea-90a6-11018e9a82c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f57b447-ff92-4235-9b7b-a9cada0162a8", "name": "network-vif-plugged", "status": "completed", "tag": "7c3a7095-2844-4ae1-b663-68126d2b9dbf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:36.448282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:36.456256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:36.478522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d6fd25e-6355-42b2-b51e-66840a1e0772 req-4a70db2e-9360-43ea-90a6-11018e9a82c0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:36.480724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d6fd25e-6355-42b2-b51e-66840a1e0772 req-4a70db2e-9360-43ea-90a6-11018e9a82c0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:36.481860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d6fd25e-6355-42b2-b51e-66840a1e0772 req-4a70db2e-9360-43ea-90a6-11018e9a82c0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:36.496592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:36.498494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:36.499801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:36.503395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:36.505016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:36.506337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:36.553269 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9d6fd25e-6355-42b2-b51e-66840a1e0772 req-4a70db2e-9360-43ea-90a6-11018e9a82c0 service nova] Creating event network-vif-plugged:7c3a7095-2844-4ae1-b663-68126d2b9dbf for instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 on n-h1-820368-37 Sep 01 05:14:36.562636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9d6fd25e-6355-42b2-b51e-66840a1e0772 req-4a70db2e-9360-43ea-90a6-11018e9a82c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133573 Sep 01 05:14:36.568022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2292/4592] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:14:36.574035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a9125bac-87a2-4fef-8e18-cde67162d925 req-dfc2e63b-a2bc-4e63-8c3b-d376e1b5b083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974", "tag": "8a665f06-b35c-4f78-a802-aa158245bbeb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:36.601919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a9125bac-87a2-4fef-8e18-cde67162d925 req-dfc2e63b-a2bc-4e63-8c3b-d376e1b5b083 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:36.602684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a9125bac-87a2-4fef-8e18-cde67162d925 req-dfc2e63b-a2bc-4e63-8c3b-d376e1b5b083 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:36.603344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a9125bac-87a2-4fef-8e18-cde67162d925 req-dfc2e63b-a2bc-4e63-8c3b-d376e1b5b083 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:36.626229 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a9125bac-87a2-4fef-8e18-cde67162d925 req-dfc2e63b-a2bc-4e63-8c3b-d376e1b5b083 service nova] Creating event network-changed:8a665f06-b35c-4f78-a802-aa158245bbeb for instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 on n-h2-820368-37 Sep 01 05:14:36.641064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a9125bac-87a2-4fef-8e18-cde67162d925 req-dfc2e63b-a2bc-4e63-8c3b-d376e1b5b083 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071161 Sep 01 05:14:36.642022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2293/4593] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:36.714946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:36.715957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:36.730380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:36.731374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:36.732188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:36.733591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:36.734607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:36.735448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:36.973329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:36.983314 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f218bee4-1d29-45f3-90b6-5afb93bb336d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.554066 Sep 01 05:14:36.984280 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2301/4594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:36 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:36.991650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:36.992669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:37.001412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:37.002125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:37.002634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:37.003486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:37.004109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:37.004971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:37.094550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:37.103810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2d1e71c-2ce6-4340-9c91-28ee7d4e9444 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.393277 Sep 01 05:14:37.120098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2294/4595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:36 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:37.228203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:37.237031 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3042b9f0-60af-4299-9c5e-c0f7851e9734 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.251390 Sep 01 05:14:37.251609 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2302/4596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:36 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:38.023059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:38.023739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:38.031688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.032176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.032808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.037320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.037320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.037320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.126805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:38.127684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:38.129976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:38.135263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=18 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:38.146115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.146618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.149712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.150847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.156046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.156920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.292916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.304791 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bee1de2b-5335-478f-a046-4a2ce72b99b9 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1319 microversion: 2.1 time: 0.296054 Sep 01 05:14:38.305554 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2295/4597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:38 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:38.315247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:38.315247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:38.321788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.322044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.322533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.323381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.323952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.324562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.469151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.484491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9be4b109-47b7-41b0-889e-715defd4b258 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.361494 Sep 01 05:14:38.499929 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2303/4598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:38 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:38.554080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:38.574840 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa8068b6-1664-46f8-a804-3cfdde325668 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.267791 Sep 01 05:14:38.575497 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2296/4599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:38 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:38.678206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-29804898-5749-4a32-a0a6-13859bcb7216 req-ca2fd00f-2068-4988-bcdd-9c8ddc59754b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb50fe2a-bf2c-4f0e-9546-406ae7e6880f", "name": "network-vif-plugged", "status": "completed", "tag": "1caca118-7320-4cf7-ac84-33d0e75faf02"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:38.705045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-29804898-5749-4a32-a0a6-13859bcb7216 req-ca2fd00f-2068-4988-bcdd-9c8ddc59754b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:38.710157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-29804898-5749-4a32-a0a6-13859bcb7216 req-ca2fd00f-2068-4988-bcdd-9c8ddc59754b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:38.711121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-29804898-5749-4a32-a0a6-13859bcb7216 req-ca2fd00f-2068-4988-bcdd-9c8ddc59754b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:38.731785 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-29804898-5749-4a32-a0a6-13859bcb7216 req-ca2fd00f-2068-4988-bcdd-9c8ddc59754b service nova] Creating event network-vif-plugged:1caca118-7320-4cf7-ac84-33d0e75faf02 for instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f on n-h2-820368-37 Sep 01 05:14:38.738769 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-29804898-5749-4a32-a0a6-13859bcb7216 req-ca2fd00f-2068-4988-bcdd-9c8ddc59754b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067308 Sep 01 05:14:38.739865 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2304/4600] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:39.334616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:39.335863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:39.348564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:39.352474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:39.355120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:39.357268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:39.358797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:39.359605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:39.510630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:39.512233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:39.523724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:39.524004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:39.524467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:39.525170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:39.525818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:39.526235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:39.571646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:39.584080 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea01b3d3-f60d-4fef-9e4a-a745710511e1 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1507 microversion: 2.1 time: 0.259670 Sep 01 05:14:39.584683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2297/4601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:39 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:39.602690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:39.603715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:39.615521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:39.616394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:39.617069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:39.618059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:39.618787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:39.619473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:40.310545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:40.320029 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6dc5cfb5-0e97-409e-b719-d53788abf916 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.815032 Sep 01 05:14:40.330925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2305/4602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:39 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:40.330925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77ac65ea-5711-4a13-87d5-800f57d8f1c0", "device": "/dev/sdb"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:40.330925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:40.335893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:40.336693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:40.337320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:40.338330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:40.338990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:40.339590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:40.391944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:40.416538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e864278d-0b4f-4360-92cd-5ef7a44b1c8a tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.822869 Sep 01 05:14:40.423756 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2298/4603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:39 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:40.767282 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38cf2627-3a1b-48d3-95f4-8f8d82e6a614 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "POST /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444929 Sep 01 05:14:40.768789 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2306/4604] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:14:40 2022] POST /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:41.350973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:41.352273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:41.374514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.375495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.376192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.377372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.378065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.378727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.452210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:41.453073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:41.472562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.473052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.473707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:41.474773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:41.475561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:41.475988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:42.035723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:42.048415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72690a78-04f9-4cbd-a6e7-43cf3f3b465e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.701669 Sep 01 05:14:42.050630 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2299/4605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:41 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:42.083354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:42.128971 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c133b71-3032-4c3f-8e5e-fbfc7fa7a203 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.681296 Sep 01 05:14:42.151079 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2307/4606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:41 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:43.053095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:43.054809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:43.088866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.090312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:43.091105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.091281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:43.091492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.092276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.096075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.098621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.110328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.110860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.111332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.112081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.112541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.112972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.621868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:43.630292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:43.660458 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b9cc2a3-d226-40e2-b303-189533c6479d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1491 microversion: 2.1 time: 0.573885 Sep 01 05:14:43.662387 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87c0a75d-7d55-49f6-9168-582a5cbfa99d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.617355 Sep 01 05:14:43.665597 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2300/4607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:43 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:43.672418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:43.673104 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2308/4608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:43 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1491 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:43.680192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-47c8c21f-fc28-41d7-947f-9c5eb098c378 req-c843143d-3c5e-438a-9a46-d6ceaf829947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974", "name": "network-vif-plugged", "status": "completed", "tag": "8a665f06-b35c-4f78-a802-aa158245bbeb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:43.683592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:43.705650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.706561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.707911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.713255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.717963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.719418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-47c8c21f-fc28-41d7-947f-9c5eb098c378 req-c843143d-3c5e-438a-9a46-d6ceaf829947 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.722324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-47c8c21f-fc28-41d7-947f-9c5eb098c378 req-c843143d-3c5e-438a-9a46-d6ceaf829947 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.723120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.723990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-47c8c21f-fc28-41d7-947f-9c5eb098c378 req-c843143d-3c5e-438a-9a46-d6ceaf829947 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.793243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-47c8c21f-fc28-41d7-947f-9c5eb098c378 req-c843143d-3c5e-438a-9a46-d6ceaf829947 service nova] Creating event network-vif-plugged:8a665f06-b35c-4f78-a802-aa158245bbeb for instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 on n-h2-820368-37 Sep 01 05:14:43.815704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-47c8c21f-fc28-41d7-947f-9c5eb098c378 req-c843143d-3c5e-438a-9a46-d6ceaf829947 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140665 Sep 01 05:14:43.825846 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2309/4609] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:43.837494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-976977357"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:43.841912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:43.892546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.893226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.894073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.895061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:43.900594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:43.901743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:43.934876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:44.181744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:44.196741 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b456077d-2bb2-4a82-9157-5fb0d5d5b22b tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.529448 Sep 01 05:14:44.202968 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2301/4610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:43 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:44.214856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:44.216946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:44.234411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.235395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.242706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.244139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.244810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.245428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.247091 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db562be6-c0b5-4bd2-a376-c5ddaca9db50 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "PUT /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1075 microversion: 2.1 time: 0.419120 Sep 01 05:14:44.249662 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2310/4611] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:14:43 2022] PUT /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1075 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:44.287055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:44.289187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:44.327706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.329393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.332834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.334528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.338695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.339472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.590616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:44.599129 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1bc6826-cf72-4acb-989d-18f72fda201f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.394387 Sep 01 05:14:44.599730 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2302/4612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:44 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:44.648379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:44.649644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:44.652842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:44.661723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.662734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.664331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.665428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.666602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.667704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.674866 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f8583043-0e7d-4ea7-bf9d-b2025496b499 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1501 microversion: 2.1 time: 0.394731 Sep 01 05:14:44.676647 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2311/4613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:44 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:44.721308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:44.722324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:44.734941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.736717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.737722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:44.739308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:44.740186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:44.741838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.024713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.040686 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a3bc1d0-673f-4a3a-aa2c-0ec7d865acb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.404265 Sep 01 05:14:45.051908 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2303/4614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:44 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:45.074596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1764495888"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:45.077962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:45.079616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.089628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.091218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.092484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.093556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.094400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.095126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.100261 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f5c6a86-db7f-4ccf-b3c0-51050ef10e83 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1501 microversion: 2.1 time: 0.396022 Sep 01 05:14:45.103233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2312/4615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:44 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1501 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:45.127566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d833f15-b216-48c6-b713-6f8785ea7301 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:45.163665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d833f15-b216-48c6-b713-6f8785ea7301 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.164838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d833f15-b216-48c6-b713-6f8785ea7301 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.165481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d833f15-b216-48c6-b713-6f8785ea7301 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.235533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d833f15-b216-48c6-b713-6f8785ea7301 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:14:45.337735 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d833f15-b216-48c6-b713-6f8785ea7301 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "POST /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f/action" status: 202 len: 0 microversion: 2.1 time: 0.214321 Sep 01 05:14:45.339711 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2313/4616] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:14:45 2022] POST /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:14:45.353905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:45.372270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:45.399744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.400404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.400853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.401597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.402064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.402490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.465341 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be755f62-e0fc-44b5-a188-af079e01e210 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.394685 Sep 01 05:14:45.472193 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2304/4617] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:14:45 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 01 05:14:45.482206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:45.484464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:45.515913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.519477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.520451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.521506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:45.522483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:45.526298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:45.871874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.885832 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bcc5b700-bf68-4498-8200-3ee85687f0b6 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1325 microversion: 2.1 time: 0.536247 Sep 01 05:14:45.894838 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2314/4618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:45 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:45.919178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:45.981476 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80ed5629-b822-48bb-b22e-fa33bf7809ea tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.502802 Sep 01 05:14:45.982830 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2305/4619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:45 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:46.914652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:46.915456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:46.935968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:46.937844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:46.939592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:46.940482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:46.942521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:46.943116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.005926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.007549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.024866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.025780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.026404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.027541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.028196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.028627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.244008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.257567 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e75d626-bb35-4693-a2e2-fd5ab21f3084 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1522 microversion: 2.1 time: 0.351225 Sep 01 05:14:47.262705 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2315/4620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:46 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:47.295439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.296540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.311514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.312293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.312960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.314509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.316639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.317568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.377331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.385046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:47.392193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9052d89d-0e1c-4065-b782-5bd1168573c0 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.389598 Sep 01 05:14:47.394040 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2306/4621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:46 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:47.400599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] HTTP exception thrown: Action 999 not found Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Request method failure captured: Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974/os-instance-actions/999 HTTP/1.1 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED-wITltN6WFX0ABKp4gZoMRREqGWfgdMCkqk34vtYNq1B7lUeIfB9NUyVfX0bxV9la5CgzatbpHABQ0QJA3xN9JB5QP3M5fyhJwO_O_b7m5HoV9pUDjd6Auk20kGGbWU1JiEJSm9FGQqmDX7tc1Aid_6n1a3FfqirCDRBTn3Md9dm0 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0b9e5632f01f48debdab46922ae66db8 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0b9e5632f01f48debdab46922ae66db8 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceActionsNegativeTestJSON-1953363645-project Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 102acc7e0bfb4d0c93e3f6a23b850783 Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1953363645-project Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: exception: Action 999 not found Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974', 'id': '999'} Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 01 05:14:47.411149 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.416219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Returning 404 to user: Action 999 not found {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:47.416219 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e61641d6-a456-4bda-b4e2-a186dbd2bb0f tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.126269 Sep 01 05:14:47.416219 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2316/4622] 10.222.0.26 () {58 vars in 1308 bytes} [Thu Sep 1 05:14:47 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974/os-instance-actions/999 => generated 66 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:14:47.426638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adb98a5e-2dee-42bb-90ce-9d4ccf4ef7c3 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '.version_select at 0x7fa75bc46310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.427953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-adb98a5e-2dee-42bb-90ce-9d4ccf4ef7c3 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: a21e5cf5-386f-4461-960f-e4fe135ac775] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.434562 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-adb98a5e-2dee-42bb-90ce-9d4ccf4ef7c3 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] HTTP exception thrown: Instance a21e5cf5-386f-4461-960f-e4fe135ac775 could not be found. Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adb98a5e-2dee-42bb-90ce-9d4ccf4ef7c3 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Request method failure captured: Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a21e5cf5-386f-4461-960f-e4fe135ac775/os-instance-actions HTTP/1.1 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED-wITltN6WFX0ABKp4gZoMRREqGWfgdMCkqk34vtYNq1B7lUeIfB9NUyVfX0bxV9la5CgzatbpHABQ0QJA3xN9JB5QP3M5fyhJwO_O_b7m5HoV9pUDjd6Auk20kGGbWU1JiEJSm9FGQqmDX7tc1Aid_6n1a3FfqirCDRBTn3Md9dm0 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0b9e5632f01f48debdab46922ae66db8 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0b9e5632f01f48debdab46922ae66db8 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-InstanceActionsNegativeTestJSON-1953363645-project Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 102acc7e0bfb4d0c93e3f6a23b850783 Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1953363645-project Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a21e5cf5-386f-4461-960f-e4fe135ac775 could not be found. Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'server_id': 'a21e5cf5-386f-4461-960f-e4fe135ac775'} Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21e5cf5-386f-4461-960f-e4fe135ac775 could not be found. Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:14:47.436855 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21e5cf5-386f-4461-960f-e4fe135ac775 could not be found. Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21e5cf5-386f-4461-960f-e4fe135ac775 could not be found. Sep 01 05:14:47.442160 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:14:47.444914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adb98a5e-2dee-42bb-90ce-9d4ccf4ef7c3 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Returning 404 to user: Instance a21e5cf5-386f-4461-960f-e4fe135ac775 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:47.446006 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-adb98a5e-2dee-42bb-90ce-9d4ccf4ef7c3 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e5cf5-386f-4461-960f-e4fe135ac775/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024730 Sep 01 05:14:47.447097 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2307/4623] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Sep 1 05:14:47 2022] GET /compute/v2.1/servers/a21e5cf5-386f-4461-960f-e4fe135ac775/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:47.456338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.456854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.465704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.466203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.466663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.470440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.477728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.478214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.537852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:14:47.741787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4032a930-ec7c-4c67-9e14-0c1ddfb51726 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 204 len: 0 microversion: 2.1 time: 0.287979 Sep 01 05:14:47.743567 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2317/4624] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:14:47 2022] DELETE /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:14:47.752636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:47.754184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:47.764072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.764980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.765636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.766357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:47.766818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:47.767278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:47.934105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:47.942737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cc9ff3c-a40d-431b-a457-316ef8e8fb00 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1528 microversion: 2.1 time: 0.194799 Sep 01 05:14:47.945043 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2308/4625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:47 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1528 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:48.416653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:48.418054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:48.426157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.426637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.427340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.428237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.428884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.429323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.741175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:48.752506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e1a310b-aa6e-44fc-bbd7-fe07ecc953d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.340420 Sep 01 05:14:48.753118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2318/4626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:48 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:48.967381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:48.968761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:48.976229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.976824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.977144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:48.977879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:48.978340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:48.978765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.167569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:49.177197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6dd15d3b-d43d-4f08-b73c-f2c24692af7e tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1528 microversion: 2.1 time: 0.215223 Sep 01 05:14:49.188455 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2309/4627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:48 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1528 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:49.778521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:49.779223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:49.796674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.797346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.798024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:49.798969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:49.799882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:49.800488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.202929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:50.205099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:50.223180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:50.223688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:50.224135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.236522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:50.236884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:50.237358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:50.597396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.606428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89058878-a2ea-40cb-b7e6-50ebdf2376dd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.834758 Sep 01 05:14:50.616037 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2319/4628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:49 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:50.840976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:50.856991 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f183f84e-90f5-4c35-8a67-bc48b7c684a2 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1528 microversion: 2.1 time: 0.660150 Sep 01 05:14:50.857628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2310/4629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:50 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1528 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:51.642867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:51.661526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:51.676261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-245d184a-b219-4cfd-8d0a-e27b737cc5d0 req-451627d0-f144-4bfc-bdb8-2d09a30a95a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974", "name": "network-vif-deleted", "tag": "8a665f06-b35c-4f78-a802-aa158245bbeb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:51.708594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.717662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.721252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.723422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:51.727147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.728595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-245d184a-b219-4cfd-8d0a-e27b737cc5d0 req-451627d0-f144-4bfc-bdb8-2d09a30a95a0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:51.728595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-245d184a-b219-4cfd-8d0a-e27b737cc5d0 req-451627d0-f144-4bfc-bdb8-2d09a30a95a0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.729589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-245d184a-b219-4cfd-8d0a-e27b737cc5d0 req-451627d0-f144-4bfc-bdb8-2d09a30a95a0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.735999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:51.740104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:51.790873 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-245d184a-b219-4cfd-8d0a-e27b737cc5d0 req-451627d0-f144-4bfc-bdb8-2d09a30a95a0 service nova] Creating event network-vif-deleted:8a665f06-b35c-4f78-a802-aa158245bbeb for instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 on n-h2-820368-37 Sep 01 05:14:51.836449 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-245d184a-b219-4cfd-8d0a-e27b737cc5d0 req-451627d0-f144-4bfc-bdb8-2d09a30a95a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179873 Sep 01 05:14:51.844242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2311/4630] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:14:51.916541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:51.941347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:52.008483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.021775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.022358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.027586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.031517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.037401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.193006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.194740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.196388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.198022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lazy-loading 'fault' on Instance uuid 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:14:52.401020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102acc7e0bfb4d0c93e3f6a23b850783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9e5632f01f48debdab46922ae66db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:52.414821 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b83ae51-2593-45f5-b855-16c6401074bd tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 200 len: 1315 microversion: 2.1 time: 0.531650 Sep 01 05:14:52.429131 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2312/4631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:51 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:52.484841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:52.494492 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae2ab639-d701-44da-bf1d-7c3782abfbf6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.857530 Sep 01 05:14:52.497238 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2320/4632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:51 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:52.720178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-250eaa6c-5b4a-4da7-89bc-b6ac82d38f30 req-00fdd566-1f64-4ce3-9f0f-128fdffe8c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-plugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:14:52.755737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-250eaa6c-5b4a-4da7-89bc-b6ac82d38f30 req-00fdd566-1f64-4ce3-9f0f-128fdffe8c1b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:52.756762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-250eaa6c-5b4a-4da7-89bc-b6ac82d38f30 req-00fdd566-1f64-4ce3-9f0f-128fdffe8c1b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:52.757373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-250eaa6c-5b4a-4da7-89bc-b6ac82d38f30 req-00fdd566-1f64-4ce3-9f0f-128fdffe8c1b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:52.775830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-250eaa6c-5b4a-4da7-89bc-b6ac82d38f30 req-00fdd566-1f64-4ce3-9f0f-128fdffe8c1b service nova] Creating event network-vif-plugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:14:52.782693 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-250eaa6c-5b4a-4da7-89bc-b6ac82d38f30 req-00fdd566-1f64-4ce3-9f0f-128fdffe8c1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066973 Sep 01 05:14:52.783794 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2313/4633] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:14:53.446361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:53.447133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] [instance: 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:53.471592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.476321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.477272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.479591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.480288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.483600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.518488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:53.519533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:53.538573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.545618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.546026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] HTTP exception thrown: Instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 could not be found. Sep 01 05:14:53.547873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Request method failure captured: Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 HTTP/1.1 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED-wITltN6WFX0ABKp4gZoMRREqGWfgdMCkqk34vtYNq1B7lUeIfB9NUyVfX0bxV9la5CgzatbpHABQ0QJA3xN9JB5QP3M5fyhJwO_O_b7m5HoV9pUDjd6Auk20kGGbWU1JiEJSm9FGQqmDX7tc1Aid_6n1a3FfqirCDRBTn3Md9dm0 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0b9e5632f01f48debdab46922ae66db8 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b9e5632f01f48debdab46922ae66db8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0b9e5632f01f48debdab46922ae66db8 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1953363645 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-InstanceActionsNegativeTestJSON-1953363645-project Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 102acc7e0bfb4d0c93e3f6a23b850783 Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1953363645-project Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 could not be found. Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974'} Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 could not be found. Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 could not be found. Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.550378 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 could not be found. Sep 01 05:14:53.555814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:14:53.556551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:53.557486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] Returning 404 to user: Instance 88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:14:53.559409 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5341814-dfff-44af-9b56-7fc6f592d6d1 tempest-InstanceActionsNegativeTestJSON-1953363645 tempest-InstanceActionsNegativeTestJSON-1953363645-project] 10.222.0.26 "GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974" status: 404 len: 111 microversion: 2.1 time: 0.118714 Sep 01 05:14:53.564581 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2321/4634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:53 2022] GET /compute/v2.1/servers/88e7bc7a-cdee-4fcd-8d52-4ecad6a2c974 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:53.572271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:53.579495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:54.144938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:54.192027 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed79ff86-6d2a-4b54-ad38-76d4e712a665 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.677417 Sep 01 05:14:54.210004 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2314/4635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:53 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:14:55.227637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:55.228307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:55.246742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.250986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.251451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.252230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:55.252712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:55.253143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:55.921815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:55.956897 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4e52b1b-609a-4084-8ca1-356c8363b8d9 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.733690 Sep 01 05:14:55.968320 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2322/4636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:55 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:57.003601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:57.006583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:57.038398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.049028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.052899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.056046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:57.061369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:57.064857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:57.752463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:57.790674 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1e66acf-a7cf-4787-88fa-4ae057142179 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.779784 Sep 01 05:14:57.794128 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2315/4637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:56 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:14:58.827723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:14:58.830525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:14:58.845160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.854245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.855154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:58.856539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:14:58.857572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:14:58.858298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:14:59.289655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:14:59.308912 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a83a4bbe-f24c-443a-8143-13906607f28c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.496727 Sep 01 05:14:59.312911 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2323/4638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:14:58 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:00.361710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:00.362714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:00.399059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.400658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.401670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.404299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:00.406221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:00.407901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:00.868661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:00.890284 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22883165-e73a-44f9-8c42-0dfeec0eeb7e tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.538291 Sep 01 05:15:00.892082 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2316/4639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:00 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:01.922296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:01.925355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:01.942402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.947327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.951160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.954062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:01.956374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:01.958804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:01.973643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:03.007031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:03.027934 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35fe2a94-c7bd-4065-8420-b9ba771d9cec tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 1.117131 Sep 01 05:15:03.039363 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2324/4640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:01 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:04.062774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:04.063509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:04.071154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.072585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.073865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.092350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:04.092865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:04.093314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:04.464300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:04.480421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9feb1a33-e5c8-424d-9d03-09976b025622 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.421335 Sep 01 05:15:04.481377 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2317/4641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:04 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:05.504037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:05.504767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:05.508369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:05.525855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:05.526740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:05.527542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:05.530480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:05.531485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:05.532907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:06.236411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:06.265721 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e28a0f85-30bf-41b1-8d99-cacdade3fd85 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.762868 Sep 01 05:15:06.277510 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2325/4642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:05 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:07.301490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:07.302380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:07.315332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.316874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.318028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.320164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:07.324096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:07.326401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:07.988497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:08.009385 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1937273-6ff2-4638-9bca-99d399693228 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.711756 Sep 01 05:15:08.028252 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2318/4643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:07 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:09.033581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:09.034519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:09.051640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:09.052162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:09.052583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:09.053308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:09.053763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:09.054186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:09.832720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:09.841630 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e5cc3f2-5d4b-4806-87be-20ee0bf24af6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1511 microversion: 2.1 time: 0.812422 Sep 01 05:15:09.851699 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2326/4644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:09 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1511 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:10.875025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:10.875933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:10.896123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.907835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.908319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:10.913786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:10.914457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:10.914934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.882493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:12.892656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b52abe8-b33c-4aed-b257-027917d2efbd tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1488 microversion: 2.1 time: 2.021835 Sep 01 05:15:12.899844 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2319/4645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:10 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1488 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:12.924169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-236360404"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:12.929713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:12.950451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.951842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.952539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:12.953539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:12.954201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:12.955533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:13.120717 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03aae085-bdce-4df5-98c9-4e8972b55976 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "PUT /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1061 microversion: 2.1 time: 0.200999 Sep 01 05:15:13.124020 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2327/4646] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:15:12 2022] PUT /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1061 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:13.147007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:13.147993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:13.161286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:13.171795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:13.172590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:13.173721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:13.174360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:13.175002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:13.956408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:13.987881 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42d1c048-364e-4bc1-9fa0-1ef1b681f019 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1488 microversion: 2.1 time: 0.845846 Sep 01 05:15:13.992069 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2320/4647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:13 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1488 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:14.027603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:14.028095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:14.045859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:14.050322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:14.050977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:14.055332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:14.058348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:14.058864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:14.912614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:14.941835 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-976a5f89-fe24-43a6-bbbe-e7b69ef23db5 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1488 microversion: 2.1 time: 0.930413 Sep 01 05:15:14.963253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2328/4648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:14 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1488 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:14.968283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:14.968852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:14.992806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:14.994274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:14.997044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.000240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.000795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.001251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.134497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:15:15.345649 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7c3f550-9e7b-4f99-8d17-a000f8180822 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 204 len: 0 microversion: 2.1 time: 0.382538 Sep 01 05:15:15.347408 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2321/4649] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:14 2022] DELETE /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:15:15.356367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:15.359331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:15.392230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.394842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.395630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.396671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:15.398360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:15.400710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:15.910575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:15.923286 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e313724c-ef30-42d2-bd85-77c9c48d7e66 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1494 microversion: 2.1 time: 0.571244 Sep 01 05:15:15.925966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2329/4650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:15 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1494 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:16.726159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:16.727472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:16.750287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.751064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.751676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.752591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.758214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.759019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.946317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:16.948112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:16.948753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lazy-loading 'services' on Instance uuid 3f57b447-ff92-4235-9b7b-a9cada0162a8 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:16.957386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.957938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.958256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:16.959520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:16.960972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:16.961573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:17.082463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8590965d-12d8-4e3a-8bbd-c111b2e5cb49 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8/os-volume_attachments/77ac65ea-5711-4a13-87d5-800f57d8f1c0" status: 202 len: 0 microversion: 2.1 time: 0.360392 Sep 01 05:15:17.083964 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2322/4651] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:15:16 2022] DELETE /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8/os-volume_attachments/77ac65ea-5711-4a13-87d5-800f57d8f1c0 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:15:17.437222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:17.454011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bebd7f11-f7e3-439e-871a-3e54b13ea238 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1494 microversion: 2.1 time: 0.510954 Sep 01 05:15:17.456494 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2330/4652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:16 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1494 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:17.503257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1495210160", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "62c2f98e-6b5b-4625-865a-c1d646269a0b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-943614427", "security_groups": []}, "os:scheduler_hints": {"different_host": ["66563c2c-1ed6-48e1-acc8-c99f29b124e9"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:17.587299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] validate_networks() for [('62c2f98e-6b5b-4625-865a-c1d646269a0b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:15:17.640741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:17.642145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:17.674040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:17.678255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:17.680103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:17.681435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:17.683839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:17.684684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:18.711218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:18.733652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d02bc04a-fb5b-4350-8307-f73fa14820e8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 1.096782 Sep 01 05:15:18.736784 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2331/4653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:17 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:18.744669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:18.751222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:18.771742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:18.772382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:18.773130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:18.774065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:18.777453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:18.778200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.847920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:19.864567 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55ea7850-c161-4bba-a1ae-bb4d09f8d6aa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1494 microversion: 2.1 time: 1.126183 Sep 01 05:15:19.880484 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2332/4654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:18 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1494 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:19.896005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2106372330"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:19.907597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:19.921548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:19.925015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:19.925801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:19.926772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:19.928265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:19.929673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.013841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:15:20.015416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:15:20.016242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:15:20.017140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:15:20.017817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:15:20.057925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.059016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.065871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.067439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.070458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.072201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.100876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:20.146720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Getting quotas for project 6734c36a2f9d454b94c60f5d3531188f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:15:20.157058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Getting quotas for user 4341d4d25da94a2389be456b80c645f5 and project 6734c36a2f9d454b94c60f5d3531188f. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:15:20.197015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:15:20.200446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:15:20.348623 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c9e3703-f8d8-463d-9a97-9448f6ae8f7a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.858459 Sep 01 05:15:20.360440 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2323/4655] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:15:17 2022] POST /compute/v2.1/servers => generated 361 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:15:20.375475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e407d407-a16b-4bae-9d8a-d554e3776e1c req-e09fadd6-04ae-4c1b-a8ca-a850907ddb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb50fe2a-bf2c-4f0e-9546-406ae7e6880f", "name": "network-vif-deleted", "tag": "1caca118-7320-4cf7-ac84-33d0e75faf02"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:20.417360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e407d407-a16b-4bae-9d8a-d554e3776e1c req-e09fadd6-04ae-4c1b-a8ca-a850907ddb6a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.423735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e407d407-a16b-4bae-9d8a-d554e3776e1c req-e09fadd6-04ae-4c1b-a8ca-a850907ddb6a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.424387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e407d407-a16b-4bae-9d8a-d554e3776e1c req-e09fadd6-04ae-4c1b-a8ca-a850907ddb6a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.471327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e407d407-a16b-4bae-9d8a-d554e3776e1c req-e09fadd6-04ae-4c1b-a8ca-a850907ddb6a service nova] Creating event network-vif-deleted:1caca118-7320-4cf7-ac84-33d0e75faf02 for instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f on n-h2-820368-37 Sep 01 05:15:20.508561 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e407d407-a16b-4bae-9d8a-d554e3776e1c req-e09fadd6-04ae-4c1b-a8ca-a850907ddb6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145719 Sep 01 05:15:20.509190 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2324/4656] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:20.527027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8036f727-d947-4250-a994-34471e98f73b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:20.545091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8036f727-d947-4250-a994-34471e98f73b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:20.739085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba985880-b89f-4554-9674-1a3a1871e820 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.796532 Sep 01 05:15:20.751970 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2333/4657] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:15:19 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 01 05:15:20.891118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:20.892196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:20.925527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.944266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.944723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:20.945485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:20.963656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:20.964226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:21.140618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:21.142998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:21.143750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:21.145064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lazy-loading 'fault' on Instance uuid fb50fe2a-bf2c-4f0e-9546-406ae7e6880f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:21.369737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8036f727-d947-4250-a994-34471e98f73b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:21.378469 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8036f727-d947-4250-a994-34471e98f73b tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1241 microversion: 2.1 time: 0.861427 Sep 01 05:15:21.391826 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2325/4658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:20 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1241 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:21.485467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:21.497421 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74d9c3c5-8459-4934-b5d4-44de2f4b1b9d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 200 len: 1309 microversion: 2.1 time: 0.614801 Sep 01 05:15:21.512836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2334/4659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:20 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 1309 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:22.416550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.417356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.426553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:22.440910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.449133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.449971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.451245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.451952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.455024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.522518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.523251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.541034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.541835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.542392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.543501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.543924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.545411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.583212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f HTTP/1.1 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'fb50fe2a-bf2c-4f0e-9546-406ae7e6880f'} Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.586067 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4903d404-d240-4057-874c-1a2c6510ef25 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 404 len: 111 microversion: 2.1 time: 0.070168 Sep 01 05:15:22.592389 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2335/4660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:22 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:22.610521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.611056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.627441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.627697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.628272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.629009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.629558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.629983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.666555 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f HTTP/1.1 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'fb50fe2a-bf2c-4f0e-9546-406ae7e6880f'} Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:22.668530 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-abcef161-b33a-4d80-99a3-57e892264afa tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 404 len: 111 microversion: 2.1 time: 0.065392 Sep 01 05:15:22.674299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2336/4661] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:22 2022] DELETE /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:22.679653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.680283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: fb50fe2a-bf2c-4f0e-9546-406ae7e6880f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.687572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.688075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.688514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.689687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.690149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.690571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.707276 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f HTTP/1.1 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'fb50fe2a-bf2c-4f0e-9546-406ae7e6880f'} Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.708803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance fb50fe2a-bf2c-4f0e-9546-406ae7e6880f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0d750fd-e5da-4f65-bd6f-16a68022d47a tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f" status: 404 len: 111 microversion: 2.1 time: 0.035698 Sep 01 05:15:22.715154 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2337/4662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:22 2022] GET /compute/v2.1/servers/fb50fe2a-bf2c-4f0e-9546-406ae7e6880f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:22.728891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.729665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.750421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.750959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.751408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.752157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.753271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.753752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.787317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d HTTP/1.1 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9fdf17d3-e18d-42ba-b271-470d48aa3c2d'} Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:22.789748 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d257bb00-b2f9-4209-9413-68688749b99d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 404 len: 111 microversion: 2.1 time: 0.075461 Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2338/4663] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:22 2022] DELETE /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:22.850644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 9fdf17d3-e18d-42ba-b271-470d48aa3c2d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:22.853990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:22.856482 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2dfa96c-ec66-437f-be33-f184b2826928 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1237 microversion: 2.1 time: 0.444438 Sep 01 05:15:22.861715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.862238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.862682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.867222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:22.867762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:22.869704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:22.871826 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2326/4664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:22 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1237 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:22.992860 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d HTTP/1.1 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9fdf17d3-e18d-42ba-b271-470d48aa3c2d'} Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.005135 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 9fdf17d3-e18d-42ba-b271-470d48aa3c2d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b187222e-b30f-4167-941b-6933c8a31da6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d" status: 404 len: 111 microversion: 2.1 time: 0.209528 Sep 01 05:15:23.010318 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2339/4665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:22 2022] GET /compute/v2.1/servers/9fdf17d3-e18d-42ba-b271-470d48aa3c2d => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:23.025682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.026180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.040681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.041161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.041610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.042369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.042820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.043329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.111797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea HTTP/1.1 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea'} Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.129595 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.132603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed121052-d81f-43da-8255-f9102f98cfeb tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 404 len: 111 microversion: 2.1 time: 0.119896 Sep 01 05:15:23.135855 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2327/4666] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:23 2022] DELETE /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.140467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.142052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.153899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.154411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.155094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.155863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.161449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.164732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.213009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea HTTP/1.1 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea'} Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.214586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.217995 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5a21add-dfd7-4787-946c-776cecc1b375 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea" status: 404 len: 111 microversion: 2.1 time: 0.079694 Sep 01 05:15:23.224799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.225300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.239647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.240171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.240615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.241356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.241812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.242288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2340/4667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/dc7e2adb-8d2d-48b5-837d-cc95c6bb5eea => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.243163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.289135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd HTTP/1.1 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '33a05a5e-33ca-4fd3-91ea-edd84ddd69bd'} Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.291732 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.295892 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.297739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.299524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8cf5ff9-b9a0-4f81-8166-afaa50bd59b3 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 404 len: 111 microversion: 2.1 time: 0.077893 Sep 01 05:15:23.312701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.315447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.328256 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2328/4668] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:23 2022] DELETE /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:23.333336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.338015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.338701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.339694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.340376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.341029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.378517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd HTTP/1.1 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '33a05a5e-33ca-4fd3-91ea-edd84ddd69bd'} Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.380656 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. Sep 01 05:15:23.383878 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.391382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 33a05a5e-33ca-4fd3-91ea-edd84ddd69bd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.393709 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d98dae48-ca54-4566-b0d8-a56336355264 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd" status: 404 len: 111 microversion: 2.1 time: 0.087573 Sep 01 05:15:23.402818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.403872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.408428 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2341/4669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/33a05a5e-33ca-4fd3-91ea-edd84ddd69bd => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.417548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.418656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.419386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.421141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.424173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.424801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.480059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 HTTP/1.1 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8'} Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.483854 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.487646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.489300 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83e5557d-5394-4eb4-a2ec-96fc3ea438d4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 404 len: 111 microversion: 2.1 time: 0.090535 Sep 01 05:15:23.492276 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2329/4670] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:23 2022] DELETE /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.501523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.502303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.515083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.519676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.520459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.521400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.523598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.527170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.587929 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 HTTP/1.1 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8'} Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.589900 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. Sep 01 05:15:23.594586 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.598757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.603670 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-149563c7-2ad6-475f-9323-4a5a7f95ca67 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8" status: 404 len: 111 microversion: 2.1 time: 0.107829 Sep 01 05:15:23.605166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2342/4671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/e2d0c9ea-e3eb-4b40-aa7f-22f76be5fce8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.618802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.622033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.644512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.645280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.647146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.648378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.650941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.659715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.694612 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 HTTP/1.1 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50'} Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.699623 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.703181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.707359 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49a3d6c0-39dd-428b-b686-c115c4334076 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 404 len: 111 microversion: 2.1 time: 0.094427 Sep 01 05:15:23.708095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2330/4672] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:23 2022] DELETE /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.719175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.720109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.737312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.738728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.739900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.740808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.741636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.742218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.788218 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 HTTP/1.1 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50'} Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.790074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. Sep 01 05:15:23.794810 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.798318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance 17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.802210 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4486e6e1-8e6c-4409-a4e2-aaf7c1013c12 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50" status: 404 len: 111 microversion: 2.1 time: 0.089627 Sep 01 05:15:23.803526 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2343/4673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/17df2ab5-fbe1-4ef4-b4ce-59f4e24aab50 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.815876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01b3d59c-216f-4c7b-ad08-c1d2499e121c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.816888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01b3d59c-216f-4c7b-ad08-c1d2499e121c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.833809 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-01b3d59c-216f-4c7b-ad08-c1d2499e121c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01b3d59c-216f-4c7b-ad08-c1d2499e121c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf HTTP/1.1 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf'} Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.835404 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.838465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01b3d59c-216f-4c7b-ad08-c1d2499e121c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.853802 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01b3d59c-216f-4c7b-ad08-c1d2499e121c tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf" status: 404 len: 111 microversion: 2.1 time: 0.043793 Sep 01 05:15:23.864619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e04e887-675b-4a5c-bb18-5065461f364d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.865647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e04e887-675b-4a5c-bb18-5065461f364d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.886029 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2331/4674] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:23 2022] DELETE /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.894185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4e04e887-675b-4a5c-bb18-5065461f364d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e04e887-675b-4a5c-bb18-5065461f364d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf HTTP/1.1 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf'} Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:23.896068 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:23.899402 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:23.899402 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:23.899402 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:23.899402 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. Sep 01 05:15:23.899402 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:23.913581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e04e887-675b-4a5c-bb18-5065461f364d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:23.914492 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e04e887-675b-4a5c-bb18-5065461f364d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf" status: 404 len: 111 microversion: 2.1 time: 0.055501 Sep 01 05:15:23.918024 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2344/4675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/ac42e2ef-06fd-4c0d-91a2-0bd5242c77bf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:23.918798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:23.923991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:23.948845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a1d2ccab-82d3-4f2b-a19d-74615af2836d req-859d5fa8-2998-48cd-978e-46b829622d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-unplugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:23.958770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.959295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.959738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:23.971259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:23.973348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:23.973834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.010038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a1d2ccab-82d3-4f2b-a19d-74615af2836d req-859d5fa8-2998-48cd-978e-46b829622d97 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.010525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a1d2ccab-82d3-4f2b-a19d-74615af2836d req-859d5fa8-2998-48cd-978e-46b829622d97 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.039299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a1d2ccab-82d3-4f2b-a19d-74615af2836d req-859d5fa8-2998-48cd-978e-46b829622d97 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.083754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a1d2ccab-82d3-4f2b-a19d-74615af2836d req-859d5fa8-2998-48cd-978e-46b829622d97 service nova] Creating event network-vif-unplugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:15:24.114263 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a1d2ccab-82d3-4f2b-a19d-74615af2836d req-859d5fa8-2998-48cd-978e-46b829622d97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197409 Sep 01 05:15:24.115975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2345/4676] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:24.124106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:24.130710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:24.152803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.154061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.159435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.162925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.163786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.164560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.190255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:24.285802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:15:24.298451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:24.321066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e553095-29ea-4d04-b602-01773705b1f0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1311 microversion: 2.1 time: 0.431047 Sep 01 05:15:24.327104 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2332/4677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:23 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:24.491854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b69b19f6-2ea5-4bec-a700-36f6bdd0b1b6 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 204 len: 0 microversion: 2.1 time: 0.372005 Sep 01 05:15:24.495679 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2346/4678] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:24 2022] DELETE /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:15:24.509006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:24.509820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:24.531101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.533606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.535515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:24.539785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:24.540500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:24.541767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.276189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:25.300709 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-262e471b-ed4c-4264-b4c1-935f0bf4fdcc tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1481 microversion: 2.1 time: 0.796938 Sep 01 05:15:25.303201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2333/4679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:24 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1481 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:25.359972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:25.361340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:25.380922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.383360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.387495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.389541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:25.390234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:25.393726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:25.697022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:25.712339 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50be1521-d417-41ba-9741-32f30b34897a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.367860 Sep 01 05:15:25.717180 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2347/4680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:25 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:26.331892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:26.337152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:26.369428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.370338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.374315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.377521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.378802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.380347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.741905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:26.746151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:26.791053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.799837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.804291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:26.827343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:26.828732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:26.839676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.088357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:27.136905 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d4a65f0-6b04-4851-b542-a571884c013f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.399397 Sep 01 05:15:27.153318 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2348/4681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:26 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:27.190520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:27.211366 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75a01fa5-e6ad-4f32-bbdf-87837e670bf8 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1481 microversion: 2.1 time: 0.891564 Sep 01 05:15:27.212750 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2334/4682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:26 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1481 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:27.641660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:27.643682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:27.669586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.670694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.671579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.677145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:27.678233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:27.679158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:27.807284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:15:28.144589 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5fa48754-e09c-47ed-9b0e-63f9d87231f8 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 204 len: 0 microversion: 2.1 time: 0.509640 Sep 01 05:15:28.148395 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2349/4683] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:27 2022] DELETE /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:15:28.160377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:28.161137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:28.168872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:28.175057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:28.179059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.192753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.193593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.195805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.198188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.198854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.207003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.214856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.216007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:28.217380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:28.218202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:28.219033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:29.139788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:29.149237 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2eb83e85-45c7-44ef-8b48-ea668e7245c8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.991050 Sep 01 05:15:29.150108 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2350/4684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:28 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:29.156607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:29.158515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:29.166041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:29.166955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:29.167527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:29.168436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:29.169184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:29.169865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:29.443260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:29.463594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9b55988-16d9-4369-99b7-4f6688b0435d tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1513 microversion: 2.1 time: 1.310684 Sep 01 05:15:29.465217 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2335/4685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:28 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1513 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:29.829029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:29.844926 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea1b8eac-d147-425a-b5bd-0e4a44420c5d tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1481 microversion: 2.1 time: 0.692460 Sep 01 05:15:29.850183 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2351/4686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:29 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1481 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:30.175140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:30.175731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:30.177953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.197273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.197783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.198234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.213240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.214229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.214877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.489753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:30.490386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:30.508373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.508912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.509368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.510115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.510652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.511113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.878360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:30.900290 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad657bba-09a5-4337-8314-ec43fbdfecd2 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.729452 Sep 01 05:15:30.926149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2336/4687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:30 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:30.931318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:30.941613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:30.964449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.968134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.969922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:30.976129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:30.983791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:30.984722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:31.374983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:31.961565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b99c7e610e94d3781c3890e296a2cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5919b7ff63b442097d0fb4784fbb505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:31.981232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-350d5541-00d1-41f8-8e71-5484d62e8373 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 200 len: 1278 microversion: 2.1 time: 1.053591 Sep 01 05:15:32.001147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2337/4688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:30 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 1278 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:32.012180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a1e86f55-a590-4ca9-9665-40558386f2b2 req-bc021e33-25d5-4035-82e1-b4d172f5507f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f560fa-34b7-43ca-829e-e073aaca19f3", "name": "network-vif-deleted", "tag": "ce1a91af-90a6-44a3-9050-942e17bca3a7"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:32.043895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1e86f55-a590-4ca9-9665-40558386f2b2 req-bc021e33-25d5-4035-82e1-b4d172f5507f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.045027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1e86f55-a590-4ca9-9665-40558386f2b2 req-bc021e33-25d5-4035-82e1-b4d172f5507f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.046497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1e86f55-a590-4ca9-9665-40558386f2b2 req-bc021e33-25d5-4035-82e1-b4d172f5507f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.075757 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a1e86f55-a590-4ca9-9665-40558386f2b2 req-bc021e33-25d5-4035-82e1-b4d172f5507f service nova] Creating event network-vif-deleted:ce1a91af-90a6-44a3-9050-942e17bca3a7 for instance e9f560fa-34b7-43ca-829e-e073aaca19f3 on n-h2-820368-37 Sep 01 05:15:32.086533 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a1e86f55-a590-4ca9-9665-40558386f2b2 req-bc021e33-25d5-4035-82e1-b4d172f5507f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083095 Sep 01 05:15:32.088381 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2338/4689] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:32.273929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:32.284539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e197637f-1cd3-4ed3-bd64-a5756a71282b tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1513 microversion: 2.1 time: 1.800814 Sep 01 05:15:32.303131 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2352/4690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:30 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1513 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:32.318781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:32.319977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:32.331691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.334842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.336966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.340358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.341268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.341882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:32.398698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-674438056", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "92eb1ea3-e4ea-45b4-ba05-eb50c912d42b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:32.483191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] validate_networks() for [('92eb1ea3-e4ea-45b4-ba05-eb50c912d42b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:15:32.820982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:32.834787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec2af15b-ee6b-4a82-a37c-010c3e92a39e tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.530102 Sep 01 05:15:32.840105 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2353/4691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:32 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:32.949295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a0c3156e-a0e7-41ed-97ab-680368cec8ff req-c72ab931-2b69-477b-ad3c-e53a96c5808a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77927c1-4eea-4306-9594-4268d28beaef", "tag": "19c33921-51ca-420b-b3be-d6e924864ad0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:32.970555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a0c3156e-a0e7-41ed-97ab-680368cec8ff req-c72ab931-2b69-477b-ad3c-e53a96c5808a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:32.971141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a0c3156e-a0e7-41ed-97ab-680368cec8ff req-c72ab931-2b69-477b-ad3c-e53a96c5808a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:32.971576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a0c3156e-a0e7-41ed-97ab-680368cec8ff req-c72ab931-2b69-477b-ad3c-e53a96c5808a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.009943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a0c3156e-a0e7-41ed-97ab-680368cec8ff req-c72ab931-2b69-477b-ad3c-e53a96c5808a service nova] Creating event network-changed:19c33921-51ca-420b-b3be-d6e924864ad0 for instance a77927c1-4eea-4306-9594-4268d28beaef on n-h1-820368-37 Sep 01 05:15:33.031505 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a0c3156e-a0e7-41ed-97ab-680368cec8ff req-c72ab931-2b69-477b-ad3c-e53a96c5808a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188809 Sep 01 05:15:33.033505 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2354/4692] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:33.055362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:33.056458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] [instance: e9f560fa-34b7-43ca-829e-e073aaca19f3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:33.066980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.067729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.068349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.069234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.069838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.070413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.108238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] HTTP exception thrown: Instance e9f560fa-34b7-43ca-829e-e073aaca19f3 could not be found. Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Request method failure captured: Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 HTTP/1.1 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED74P0JgF-U-igXSiefBlO9GZKEZTj1y4_VLFwabO3cuPlIgd76fH8moD55nje0sYugT2sc3zPATQntMdybSBTUcMhIZJ40QCD87M-eH1hgVzV0FGF3uLrMuS1MsrSi9cAJZQmWvsKHhqWCPKFm4hGrqry3girWOiTkF9X9-nCrieBw Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5919b7ff63b442097d0fb4784fbb505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersTestJSON-1219426096 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c5919b7ff63b442097d0fb4784fbb505 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersTestJSON-1219426096 Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2b99c7e610e94d3781c3890e296a2cfe Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersTestJSON-1219426096-project Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e9f560fa-34b7-43ca-829e-e073aaca19f3 could not be found. Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e9f560fa-34b7-43ca-829e-e073aaca19f3'} Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f560fa-34b7-43ca-829e-e073aaca19f3 could not be found. Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f560fa-34b7-43ca-829e-e073aaca19f3 could not be found. Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:33.109967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f560fa-34b7-43ca-829e-e073aaca19f3 could not be found. Sep 01 05:15:33.113752 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:15:33.116004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] Returning 404 to user: Instance e9f560fa-34b7-43ca-829e-e073aaca19f3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:33.116428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb4b238c-f95b-46cc-9c7f-f59e79ff92e4 tempest-ServersTestJSON-1219426096 tempest-ServersTestJSON-1219426096-project] 10.222.0.26 "GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3" status: 404 len: 111 microversion: 2.1 time: 0.080122 Sep 01 05:15:33.119513 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2355/4693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:33 2022] GET /compute/v2.1/servers/e9f560fa-34b7-43ca-829e-e073aaca19f3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:33.616645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:33.617403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:33.629392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.630088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.633533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:33.634486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:33.635181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:33.635912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.460307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:34.471872 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04b96075-3ad8-4252-8152-09e2f444cfa2 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1513 microversion: 2.1 time: 1.167624 Sep 01 05:15:34.472733 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2356/4694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:33 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1513 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:34.478101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-318c029f-1322-4b73-921a-2f07ffee8e8e req-2c104736-a386-4f05-86f5-d812a6749fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-plugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:34.491400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-318c029f-1322-4b73-921a-2f07ffee8e8e req-2c104736-a386-4f05-86f5-d812a6749fae service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.492226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-318c029f-1322-4b73-921a-2f07ffee8e8e req-2c104736-a386-4f05-86f5-d812a6749fae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.492879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-318c029f-1322-4b73-921a-2f07ffee8e8e req-2c104736-a386-4f05-86f5-d812a6749fae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.516249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-318c029f-1322-4b73-921a-2f07ffee8e8e req-2c104736-a386-4f05-86f5-d812a6749fae service nova] Creating event network-vif-plugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:15:34.532109 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-318c029f-1322-4b73-921a-2f07ffee8e8e req-2c104736-a386-4f05-86f5-d812a6749fae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057527 Sep 01 05:15:34.557925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2357/4695] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:34.597576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:34.598624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:34.614632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.617865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.623355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:34.624428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:34.625121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:34.627916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.386004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:35.403197 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5663f4e9-6af8-4dfd-a1ac-c2d3f79a0c35 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.838799 Sep 01 05:15:35.405623 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2358/4696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:34 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:35.493937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:35.495393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:35.516923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.517543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.518061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:35.518928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:35.519473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:35.520044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.278296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:36.313677 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-138350ee-cc92-49b1-8471-91c4aab17b31 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1471 microversion: 2.1 time: 0.820113 Sep 01 05:15:36.317029 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2359/4697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:35 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1471 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:36.390189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-868bf3dd-604a-49e0-8474-5069d523b23e req-74123976-8f74-4228-a60b-82b23fe81afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f57b447-ff92-4235-9b7b-a9cada0162a8", "name": "network-vif-deleted", "tag": "7c3a7095-2844-4ae1-b663-68126d2b9dbf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:36.397277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:36.439557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-868bf3dd-604a-49e0-8474-5069d523b23e req-74123976-8f74-4228-a60b-82b23fe81afd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.443557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-868bf3dd-604a-49e0-8474-5069d523b23e req-74123976-8f74-4228-a60b-82b23fe81afd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.448010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-868bf3dd-604a-49e0-8474-5069d523b23e req-74123976-8f74-4228-a60b-82b23fe81afd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.520302 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-868bf3dd-604a-49e0-8474-5069d523b23e req-74123976-8f74-4228-a60b-82b23fe81afd service nova] Creating event network-vif-deleted:7c3a7095-2844-4ae1-b663-68126d2b9dbf for instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 on n-h1-820368-37 Sep 01 05:15:36.531843 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-868bf3dd-604a-49e0-8474-5069d523b23e req-74123976-8f74-4228-a60b-82b23fe81afd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146925 Sep 01 05:15:36.532477 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2360/4698] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:36.577550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:36.582318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:36.602045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.602966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.605038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:36.606805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:36.608972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:36.611452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.032330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:15:37.032821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:15:37.033979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:15:37.034944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:15:37.035634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:15:37.069908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:37.079113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.080919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27bd0d3d-c710-4d2c-a4ff-8e7ae6ba0f52 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.542659 Sep 01 05:15:37.081593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2361/4699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:36 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:37.082968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.083363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.103657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.107584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.108063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.177552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Getting quotas for project 97adc27942a848ceb61acc1348260e62. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:15:37.198180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Getting quotas for user cd3801fcb04046c3a022c45436262e9a and project 97adc27942a848ceb61acc1348260e62. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:15:37.245362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:15:37.255331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:15:37.343424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:37.344779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:37.358278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.369665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.370147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.371014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.371478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.371901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.401640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:37.429228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8e299a1-711c-422e-a852-eb367e8b17cc tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.339162 Sep 01 05:15:37.449917 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2339/4700] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 5357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:15:37.473986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-624a6a56-01db-4ae2-8061-c7298d53c5f7 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:37.476758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-624a6a56-01db-4ae2-8061-c7298d53c5f7 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:37.568730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:37.570781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:37.583489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:37.585050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lazy-loading 'fault' on Instance uuid 3f57b447-ff92-4235-9b7b-a9cada0162a8 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:15:37.712563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-624a6a56-01db-4ae2-8061-c7298d53c5f7 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:37.721720 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-624a6a56-01db-4ae2-8061-c7298d53c5f7 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1216 microversion: 2.1 time: 0.270070 Sep 01 05:15:37.727423 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2340/4701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:37 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:37.782775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd853a20dc94d2b9f2d080a903c046b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d4d0afdb1f48cca5b43c2469ba33ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:37.792194 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd2307b9-8ee1-4da6-be44-cdb0ad99e662 tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 200 len: 1309 microversion: 2.1 time: 0.455085 Sep 01 05:15:37.793720 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2362/4702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:37 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 1309 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:38.101816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:38.103244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:38.113104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.117749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.118441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.119412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.120029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.127890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.612566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:38.624524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a08d831f-8b1d-426b-9ec1-f775dd13b377 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.526574 Sep 01 05:15:38.626719 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2341/4703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:38 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:38.753969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:38.755520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:38.773482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.774228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.776635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.780613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.795462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.795946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.817480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:38.818478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] [instance: 3f57b447-ff92-4235-9b7b-a9cada0162a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:38.832847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.836786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.837598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.838638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:38.844150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:38.844825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:38.887731 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] HTTP exception thrown: Instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 could not be found. Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Request method failure captured: Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 HTTP/1.1 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED7IuY_w8D1wp0Q_rhERuc5du9AN6r_DsXCudIKatyibocSYaWIY20_4oy4l5D3atnEpiu-_IX2GqbJr_EngDZQh_PwSvHsiXF6nL6r4sqMBfYnSXjoZTLdYGqj9ZWUfpECXT470HR863ALynjhuR3HlaUSpJamSVSPHkkvVvo_a4J4 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 44d4d0afdb1f48cca5b43c2469ba33ae Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1479911689 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44d4d0afdb1f48cca5b43c2469ba33ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesSnapshotTestJSON-1479911689 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 44d4d0afdb1f48cca5b43c2469ba33ae Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1479911689 Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesSnapshotTestJSON-1479911689-project Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: efd853a20dc94d2b9f2d080a903c046b Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesSnapshotTestJSON-1479911689-project Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 could not be found. Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '3f57b447-ff92-4235-9b7b-a9cada0162a8'} Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 could not be found. Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 could not be found. Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:38.892712 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 could not be found. Sep 01 05:15:38.896661 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:38.898408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] Returning 404 to user: Instance 3f57b447-ff92-4235-9b7b-a9cada0162a8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:38.902485 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c1f6464-9aad-4264-98cd-756ee8cc94fa tempest-VolumesSnapshotTestJSON-1479911689 tempest-VolumesSnapshotTestJSON-1479911689-project] 10.222.0.26 "GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8" status: 404 len: 111 microversion: 2.1 time: 0.086620 Sep 01 05:15:38.907063 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2342/4704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:38 2022] GET /compute/v2.1/servers/3f57b447-ff92-4235-9b7b-a9cada0162a8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:15:38.968397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:38.986869 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-145dd493-735f-477e-abf0-000f17bbca16 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1212 microversion: 2.1 time: 0.239241 Sep 01 05:15:38.992705 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2363/4705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:38 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1212 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:39.649145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:39.650417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:39.662730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.663606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.664355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.665341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.666051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.666690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.818157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9defb9a3-9c6f-4990-b2ff-baac482f1ffa req-6b43dfae-6efc-4582-8519-781a703a1076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77927c1-4eea-4306-9594-4268d28beaef", "name": "network-vif-plugged", "status": "completed", "tag": "19c33921-51ca-420b-b3be-d6e924864ad0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:39.851283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9defb9a3-9c6f-4990-b2ff-baac482f1ffa req-6b43dfae-6efc-4582-8519-781a703a1076 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:39.851911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9defb9a3-9c6f-4990-b2ff-baac482f1ffa req-6b43dfae-6efc-4582-8519-781a703a1076 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:39.852997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9defb9a3-9c6f-4990-b2ff-baac482f1ffa req-6b43dfae-6efc-4582-8519-781a703a1076 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:39.907993 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9defb9a3-9c6f-4990-b2ff-baac482f1ffa req-6b43dfae-6efc-4582-8519-781a703a1076 service nova] Creating event network-vif-plugged:19c33921-51ca-420b-b3be-d6e924864ad0 for instance a77927c1-4eea-4306-9594-4268d28beaef on n-h1-820368-37 Sep 01 05:15:39.921762 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9defb9a3-9c6f-4990-b2ff-baac482f1ffa req-6b43dfae-6efc-4582-8519-781a703a1076 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107090 Sep 01 05:15:39.923765 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2364/4706] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:15:40.023848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:40.024558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:40.054557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:40.055139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:40.055576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:40.057469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:40.057950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:40.058385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:40.413839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:40.427884 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a26af862-cc3e-4afe-afbc-402df8bbc70d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1274 microversion: 2.1 time: 0.414671 Sep 01 05:15:40.428880 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2365/4707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:40 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1274 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:40.441827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:40.458286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3db85590-3ccb-48a3-babe-d6c207126e64 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1299 microversion: 2.1 time: 0.812685 Sep 01 05:15:40.460640 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2343/4708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:39 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1299 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:41.451484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:41.452113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:41.475332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:41.476271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:41.476865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:41.477799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:41.483335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:41.484734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:41.485764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:41.486474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:41.515290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:41.517406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:41.521896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:41.523159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:41.524813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:41.526478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.091076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:42.106086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e36e268a-5814-4429-8cef-dbff9963dfa5 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1471 microversion: 2.1 time: 0.625594 Sep 01 05:15:42.111392 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2344/4709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:41 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1471 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:42.135965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:42.136612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:42.157341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.157585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:42.157846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.158461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.159746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.160577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.161188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.167072 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7931187f-cfd9-4230-8e9c-2159e723db77 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1274 microversion: 2.1 time: 0.720995 Sep 01 05:15:42.188296 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2366/4710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:41 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1274 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:42.736907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:42.745343 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a4dc882-7c75-4347-95ab-0e18de148f09 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1471 microversion: 2.1 time: 0.613208 Sep 01 05:15:42.757812 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2345/4711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:42 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1471 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:42.808166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:42.810168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:42.827222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.828073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.828761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:42.837141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:42.837782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:42.838382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.182799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40ef5280-65a9-43e4-af5e-abccb26d1e10 tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1624 microversion: 2.1 time: 0.386684 Sep 01 05:15:43.188330 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2367/4712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:42 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1624 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:43.207476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:43.208584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:43.208860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:43.209474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:43.221345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.224912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.225910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.227563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.230039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.230655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.243717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.244211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.262814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.264858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:43.266156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:43.267900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:43.461153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:43.470646 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-474e9835-21d0-4c4f-b189-c5cd89d52a4d tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1274 microversion: 2.1 time: 0.267323 Sep 01 05:15:43.474334 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2368/4713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:43 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:44.516044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:44.519863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:44.596525 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a90b6fa-2270-4dd1-8555-7ffb0c9ee05f tempest-TestSecurityGroupsBasicOps-696069427 tempest-TestSecurityGroupsBasicOps-696069427-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1914 microversion: 2.1 time: 1.391533 Sep 01 05:15:44.597167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.597265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.597681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.599569 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2346/4714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:43 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1914 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:44.601103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.602605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.604011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.818412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:44.818946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:44.832844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.833356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.833804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.834530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:44.852598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:44.853303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:44.978586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:15:45.092980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:45.119857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:45.131351 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a643c4de-cfc5-4a59-a513-20290cb28e27 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 0.641035 Sep 01 05:15:45.132807 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2369/4715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:44 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:45.216030 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5dc11f5-b677-4a07-a170-2f6f49f7e1b8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 204 len: 0 microversion: 2.1 time: 0.401231 Sep 01 05:15:45.224829 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2347/4716] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:15:44 2022] DELETE /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:15:45.236915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:45.237572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:45.254107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:45.254606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:45.255081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:45.256970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:45.257502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:45.258232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:45.545978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:45.570195 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72832546-2866-4995-8f79-f776786733b0 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1477 microversion: 2.1 time: 0.331973 Sep 01 05:15:45.571245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2370/4717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:45 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:46.155941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:46.156814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:46.173384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.175735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.179795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.187196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.187861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.188371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.609382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:46.611258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:46.622394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.624183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.625128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:46.626658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:46.627657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:46.628346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:47.078051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:47.092146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-664f3488-fcd1-4e19-a017-ecf1658670fb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1477 microversion: 2.1 time: 0.489001 Sep 01 05:15:47.096990 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2371/4718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:46 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:47.147512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:47.247777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:47.265816 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a2a06d5-8e5d-4293-9890-57bb0db6b1b9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 1.116378 Sep 01 05:15:47.266418 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2348/4719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:46 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:48.079209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-35192e04-1b10-4239-b29e-af8095fb1cd5 req-173dace1-d3ac-422d-bdd2-fc8161708a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64b8498-4bbb-462d-928b-1e5749629afe", "tag": "050578dc-7c3f-49c4-b5ea-5333502bae10"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:48.115718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35192e04-1b10-4239-b29e-af8095fb1cd5 req-173dace1-d3ac-422d-bdd2-fc8161708a6a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.126059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:48.126945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:48.130535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:48.132742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35192e04-1b10-4239-b29e-af8095fb1cd5 req-173dace1-d3ac-422d-bdd2-fc8161708a6a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.133752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-35192e04-1b10-4239-b29e-af8095fb1cd5 req-173dace1-d3ac-422d-bdd2-fc8161708a6a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.150116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.150753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.151092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.151820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.152294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.152728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.158154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-35192e04-1b10-4239-b29e-af8095fb1cd5 req-173dace1-d3ac-422d-bdd2-fc8161708a6a service nova] Creating event network-changed:050578dc-7c3f-49c4-b5ea-5333502bae10 for instance d64b8498-4bbb-462d-928b-1e5749629afe on n-h2-820368-37 Sep 01 05:15:48.172707 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-35192e04-1b10-4239-b29e-af8095fb1cd5 req-173dace1-d3ac-422d-bdd2-fc8161708a6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097738 Sep 01 05:15:48.174128 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2372/4720] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:15:48.289960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:48.290678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:48.308747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.309318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.309758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:48.310569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:48.311155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:48.311582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:49.064565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:49.118927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e11cba97-af4c-4d4e-bde2-81600211b1ee tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1477 microversion: 2.1 time: 0.993992 Sep 01 05:15:49.137409 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2349/4721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:48 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1477 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:49.722334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:49.740352 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-459d3ed6-9151-4631-b64f-f630a451e595 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 1.454850 Sep 01 05:15:49.744580 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2373/4722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:48 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:50.143515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:50.144720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:50.155589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.163396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.164084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.165000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.165627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.166207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.383219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5952dbc2-7883-4dbc-a6d8-cd60d15dbe6e req-c982d3a4-32d3-43ba-8a10-917c960b65ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77927c1-4eea-4306-9594-4268d28beaef", "name": "network-vif-deleted", "tag": "19c33921-51ca-420b-b3be-d6e924864ad0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:50.437548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:50.448511 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2618bf42-b231-4956-83db-237353c6f7bb tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 200 len: 1477 microversion: 2.1 time: 0.309064 Sep 01 05:15:50.451053 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2350/4723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:50 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 1477 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:50.463017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5952dbc2-7883-4dbc-a6d8-cd60d15dbe6e req-c982d3a4-32d3-43ba-8a10-917c960b65ff service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.463527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5952dbc2-7883-4dbc-a6d8-cd60d15dbe6e req-c982d3a4-32d3-43ba-8a10-917c960b65ff service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.467303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5952dbc2-7883-4dbc-a6d8-cd60d15dbe6e req-c982d3a4-32d3-43ba-8a10-917c960b65ff service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.573234 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5952dbc2-7883-4dbc-a6d8-cd60d15dbe6e req-c982d3a4-32d3-43ba-8a10-917c960b65ff service nova] Creating event network-vif-deleted:19c33921-51ca-420b-b3be-d6e924864ad0 for instance a77927c1-4eea-4306-9594-4268d28beaef on n-h1-820368-37 Sep 01 05:15:50.588061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5952dbc2-7883-4dbc-a6d8-cd60d15dbe6e req-c982d3a4-32d3-43ba-8a10-917c960b65ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204149 Sep 01 05:15:50.595397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2374/4724] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:15:50.766525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:50.767432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:50.780227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.783055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.783534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.785809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:50.787483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:50.789304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:50.854733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1696865034", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:51.037388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:15:51.038075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:15:51.038699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:15:51.039442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:15:51.040133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:15:51.061758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.062250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.062755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.069081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.070256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.075285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.125270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Getting quotas for project 7aecd7315c494dcb91ae0fb826200c56. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:15:51.142588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:51.152065 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a08a0c48-0a28-4a13-84f2-aaa228a44294 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 0.390705 Sep 01 05:15:51.152674 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2375/4725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:50 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:15:51.166496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Getting quotas for user 6ff2422e5cef4726aba04684ce7ab757 and project 7aecd7315c494dcb91ae0fb826200c56. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:15:51.183222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:15:51.193846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:15:51.286998 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9f0ac7c-2710-4620-8e6b-c7242f5da711 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.774084 Sep 01 05:15:51.287743 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2351/4726] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:15:51.299891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3abc435a-544a-44c9-94b8-3a267d01cb07 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:51.301393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3abc435a-544a-44c9-94b8-3a267d01cb07 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:51.478836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:51.480975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: a77927c1-4eea-4306-9594-4268d28beaef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:51.513664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.514663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.515739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.518465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:51.524640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3abc435a-544a-44c9-94b8-3a267d01cb07 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:51.544517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:51.547042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:51.548328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3abc435a-544a-44c9-94b8-3a267d01cb07 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:51.557291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3abc435a-544a-44c9-94b8-3a267d01cb07 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:51.560293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3abc435a-544a-44c9-94b8-3a267d01cb07 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1278 microversion: 2.54 time: 0.265296 Sep 01 05:15:51.565392 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2376/4727] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:51 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:51.596015 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] HTTP exception thrown: Instance a77927c1-4eea-4306-9594-4268d28beaef could not be found. Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Request method failure captured: Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef HTTP/1.1 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED9Z2q1XRV66SoQ7ctzrMSi9fFs6zma0ZxKHQ2-x15bv0pdyRamGLdcfwxQeuSXMAl-iRNOkBb-5wibX4M2nCv6qIZLRFApcTRk-rap0Fv0L4g0f7WBp819JhKUbuUmtizAU-2PXHMi3lykf9dM949agXrOyOKtwzPw8CtK9qqZJ5tY Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6734c36a2f9d454b94c60f5d3531188f Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1674321278 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1674321278 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6734c36a2f9d454b94c60f5d3531188f Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1674321278 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestSecurityGroupsBasicOps-1674321278-project Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 4341d4d25da94a2389be456b80c645f5 Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1674321278-project Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a77927c1-4eea-4306-9594-4268d28beaef could not be found. Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a77927c1-4eea-4306-9594-4268d28beaef'} Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77927c1-4eea-4306-9594-4268d28beaef could not be found. Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77927c1-4eea-4306-9594-4268d28beaef could not be found. Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:51.598964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77927c1-4eea-4306-9594-4268d28beaef could not be found. Sep 01 05:15:51.602583 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:15:51.604922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Returning 404 to user: Instance a77927c1-4eea-4306-9594-4268d28beaef could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:15:51.606604 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6250faa4-0f2d-4f27-ab01-1d197589c12a tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef" status: 404 len: 111 microversion: 2.1 time: 0.134807 Sep 01 05:15:51.609124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2352/4728] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:51 2022] GET /compute/v2.1/servers/a77927c1-4eea-4306-9594-4268d28beaef => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:52.174651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:52.175907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:52.194828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.200068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.201854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.208801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.209315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.209763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.590873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:52.592738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:52.603480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:52.623993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.632345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.633322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:52.637725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:52.638432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:52.641535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:53.694226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:53.709300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:53.716068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:53.722420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebfbc3d8-6369-455f-b7ea-a40d85fe44dd tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1274 microversion: 2.54 time: 1.138089 Sep 01 05:15:53.724347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2353/4729] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:52 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1274 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:54.314214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:54.332048 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a3fccb6-c649-4a7d-991c-2783284bc9db tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 2.155069 Sep 01 05:15:54.347367 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2377/4730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:52 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:54.775990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:54.783146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:54.833601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:54.834901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:54.838374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:54.852328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:54.865045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:54.877478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:55.292490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:55.316785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:55.329093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:55.334146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ca51c65-551c-4303-9222-8cb69052893d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1336 microversion: 2.54 time: 0.566283 Sep 01 05:15:55.366413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:55.367703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:55.375324 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2354/4731] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:54 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1336 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:55.390657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:55.393383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:55.393907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:55.398670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:55.399989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:55.401929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.386213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:56.390417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:56.405259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:56.410227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:56.410948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.411945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:56.415614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:56.416361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:56.884867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:56.902099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:56.909130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:56.914912 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d399c84-249d-4a7e-849b-daf32de31659 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1357 microversion: 2.54 time: 0.538101 Sep 01 05:15:56.916681 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2355/4732] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:56 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1357 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:56.955456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:56.961271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b13c43d-2abf-4e0b-bae5-60fca2da8bfc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Action: 'create', calling method: .version_select at 0x7fa75be685e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1718545138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw1nxkC3KWFXPmRXUtBdQCtpNR9O3i6pFfXc0vJ5uAnbAp2UL7+dAj5IcoDnTxhy6dMhjRjWBB9/CdXcxhxYCgzHf+G5r4e74Q7MssVgvoOkLA3MaUg3f9/0NbgjVfePg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:56.978024 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28da8d64-7df7-40a3-af97-2a8b3b64b7a5 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 1.621389 Sep 01 05:15:56.986106 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2378/4733] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:55 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:56.989120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3b13c43d-2abf-4e0b-bae5-60fca2da8bfc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Getting quotas for project 7aecd7315c494dcb91ae0fb826200c56. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:15:57.062800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3b13c43d-2abf-4e0b-bae5-60fca2da8bfc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Getting quotas for user 6ff2422e5cef4726aba04684ce7ab757 and project 7aecd7315c494dcb91ae0fb826200c56. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:15:57.110364 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b13c43d-2abf-4e0b-bae5-60fca2da8bfc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:15:58.044971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:58.049031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:58.098056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.101453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.102489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.108854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.109675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.111063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.121512 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b13c43d-2abf-4e0b-bae5-60fca2da8bfc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 51794. Sep 01 05:15:58.169980 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b13c43d-2abf-4e0b-bae5-60fca2da8bfc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 1.211267 Sep 01 05:15:58.175888 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2356/4734] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 05:15:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 1219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:15:58.193908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1718545138", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:58.206434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:58.225930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.226684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.228483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.231685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.232380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.243747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.466453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:15:58.475438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:15:58.478972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:15:58.479769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:15:58.480374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:15:58.773851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:58.812911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.817035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.820847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.826113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.828840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.832775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.895272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:58.904873 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05cfd75a-acaa-47e8-8b96-f0da8e522fb0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 0.864951 Sep 01 05:15:58.929299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2379/4735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:58 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:15:58.941275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:58.944210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:58.959993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.964519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.965285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:58.967123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:58.969290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:58.970101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.010414 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95b3c29c-cb36-457c-bfe1-accffb7fe039 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "POST /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36/action" status: 202 len: 1140 microversion: 2.54 time: 0.824591 Sep 01 05:15:59.035946 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2357/4736] 10.222.0.26 () {62 vars in 1320 bytes} [Thu Sep 1 05:15:58 2022] POST /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36/action => generated 1140 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 01 05:15:59.058320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-95172fc4-d924-44c2-bd86-014040cd18af req-e5886ef8-ffcf-4f0f-8ad5-34dc8fda38c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64b8498-4bbb-462d-928b-1e5749629afe", "name": "network-vif-plugged", "status": "completed", "tag": "050578dc-7c3f-49c4-b5ea-5333502bae10"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:15:59.098259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-95172fc4-d924-44c2-bd86-014040cd18af req-e5886ef8-ffcf-4f0f-8ad5-34dc8fda38c8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.098789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-95172fc4-d924-44c2-bd86-014040cd18af req-e5886ef8-ffcf-4f0f-8ad5-34dc8fda38c8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.102017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-95172fc4-d924-44c2-bd86-014040cd18af req-e5886ef8-ffcf-4f0f-8ad5-34dc8fda38c8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.134240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-95172fc4-d924-44c2-bd86-014040cd18af req-e5886ef8-ffcf-4f0f-8ad5-34dc8fda38c8 service nova] Creating event network-vif-plugged:050578dc-7c3f-49c4-b5ea-5333502bae10 for instance d64b8498-4bbb-462d-928b-1e5749629afe on n-h2-820368-37 Sep 01 05:15:59.148080 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-95172fc4-d924-44c2-bd86-014040cd18af req-e5886ef8-ffcf-4f0f-8ad5-34dc8fda38c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110157 Sep 01 05:15:59.150712 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2358/4737] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:15:59.165947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:59.166701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:59.199158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.200846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.201321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.205831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.206600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.207876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.555178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:59.571191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:59.573658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:15:59.580234 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d305a4e-71c7-4d6f-8cdf-b8cd8a5d3ca3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.426476 Sep 01 05:15:59.593895 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2359/4738] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:15:59 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:15:59.940434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:15:59.941385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:15:59.959729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.963673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.964316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:15:59.965981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:15:59.971576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:15:59.974800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.022426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.034954 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d92d2504-53a9-42f5-bd0d-c8d3f40a43a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 1.101101 Sep 01 05:16:00.038520 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2380/4739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:58 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:00.059197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-155636435"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:00.062190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:00.069187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.069995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.070642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.071607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.072348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.072997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.093016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:00.320303 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5eac1a5-12fd-4afa-a2e2-ce5f7b6ba3fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.264918 Sep 01 05:16:00.325754 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2381/4740] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:16:00 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 01 05:16:00.338030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:00.342204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:00.358586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.359400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.362313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.363336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.366468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.369928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.636537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.652531 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75d8beb2-18b4-4632-bac0-683617a914d4 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1316 microversion: 2.1 time: 0.719964 Sep 01 05:16:00.670680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2360/4741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:15:59 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1316 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:00.677714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:00.678692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:00.691408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.693591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.694936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.697612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:00.698334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:00.699004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:00.835917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.850044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.856618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.858203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-930f94f7-6207-4e67-b3d7-85270f0e898f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.186108 Sep 01 05:16:00.859083 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2361/4742] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:00 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:00.971644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:00.990247 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0752219-345b-4c03-a089-39287c8c9538 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.657847 Sep 01 05:16:00.991577 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2382/4743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:00 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:01.678000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:01.679246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:01.688296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:01.693226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.699309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.700164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:01.701298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.701961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.702617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:01.900431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:01.902233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:01.913275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:01.918771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.920800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.921465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:01.923766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:01.924673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:01.925947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.184247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.202424 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e050500-62f1-4294-be55-9683bc2e44d3 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1506 microversion: 2.1 time: 0.528165 Sep 01 05:16:02.212848 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2362/4744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:01 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:02.212848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.212848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.220357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.222717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.232851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.233985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.235346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.236989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.239400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.240184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.243256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.246074 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a89b471-cdc3-4b14-82d7-978f08da7e72 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.359815 Sep 01 05:16:02.249817 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2383/4745] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:01 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:02.263068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.263863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.272096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.273846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.274580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.275579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.276148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.276646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.311740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13ab16f1-eb3d-44e1-a6a0-dd37a26b586c tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe/ips" status: 200 len: 110 microversion: 2.1 time: 0.060155 Sep 01 05:16:02.314094 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2384/4746] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:16:02 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe/ips => generated 110 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:02.326250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.326848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.341098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.342450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.342917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.344979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.345452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.345890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.389770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-697b1768-ebd5-4554-956c-29fb0cbe9ef9 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe/ips" status: 200 len: 110 microversion: 2.1 time: 0.067988 Sep 01 05:16:02.398047 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2385/4747] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:16:02 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe/ips => generated 110 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:02.405809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.406712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.417920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.418789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.419634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.421821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.422460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.423061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.520368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-861be161-4f6e-40bb-b76e-1dad80adde8a tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe/ips/tempest-ServerAddressesTestJSON-1156304656-network" status: 200 len: 95 microversion: 2.1 time: 0.120203 Sep 01 05:16:02.530496 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2386/4748] 10.222.0.26 () {58 vars in 1401 bytes} [Thu Sep 1 05:16:02 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe/ips/tempest-ServerAddressesTestJSON-1156304656-network => generated 95 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:16:02.538716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.543682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.559944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.560563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.567150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.568776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.569471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.570158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.613090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:16:02.659903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:02.684478 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97ac8b2a-200b-4d41-b7c5-d6c4052c4962 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1687 microversion: 2.1 time: 0.470003 Sep 01 05:16:02.686728 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2363/4749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:02 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1687 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:02.785479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d61c52a-8937-4c3b-ad22-896c1f757402 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 204 len: 0 microversion: 2.1 time: 0.253159 Sep 01 05:16:02.789282 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2387/4750] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:16:02 2022] DELETE /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:02.795723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:02.796346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:02.810756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.811708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.813010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.813771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.821173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.821646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.846403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:02.913202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-157bc0b2-7cec-495e-a851-4ac3f5879d33 req-ba1a420d-ea93-4db1-b98d-5f05dc5bb71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-unplugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:02.956543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-157bc0b2-7cec-495e-a851-4ac3f5879d33 req-ba1a420d-ea93-4db1-b98d-5f05dc5bb71d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:02.957019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-157bc0b2-7cec-495e-a851-4ac3f5879d33 req-ba1a420d-ea93-4db1-b98d-5f05dc5bb71d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:02.957462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-157bc0b2-7cec-495e-a851-4ac3f5879d33 req-ba1a420d-ea93-4db1-b98d-5f05dc5bb71d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:02.984964 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-157bc0b2-7cec-495e-a851-4ac3f5879d33 req-ba1a420d-ea93-4db1-b98d-5f05dc5bb71d service nova] Creating event network-vif-unplugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:16:02.993457 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-157bc0b2-7cec-495e-a851-4ac3f5879d33 req-ba1a420d-ea93-4db1-b98d-5f05dc5bb71d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088949 Sep 01 05:16:02.995255 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2388/4751] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:03.119380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:03.128705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97f62422-9b5c-46aa-b44d-a9f6268e1ba2 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1512 microversion: 2.1 time: 0.338106 Sep 01 05:16:03.133559 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2364/4752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:02 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:03.279370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:03.280364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:03.288390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.289213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.290193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.292439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.295571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.296744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.527240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:03.542937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:03.552090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:03.553975 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7fc69591-5ecb-4f88-9989-ca084591304f tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.279541 Sep 01 05:16:03.554531 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2389/4753] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:03 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:03.711218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:03.712543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:03.719620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.720452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.721384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:03.722497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:03.723222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:03.723846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:04.152523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:04.153873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:04.173789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:04.174537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:04.175146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:04.176026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:04.176654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:04.177264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:04.209547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:04.221700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e410695b-0ba4-40ae-aa8e-30786bb9a802 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1687 microversion: 2.1 time: 0.516710 Sep 01 05:16:04.231857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2365/4754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:03 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1687 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:04.586077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:04.586983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:04.599232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:04.602454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:04.603761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:04.609710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:04.610144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:04.610604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:05.138153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:05.158302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:05.160183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:05.177392 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-397a877d-8b0a-4117-962c-ae2a4f2900ed tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.581287 Sep 01 05:16:05.194937 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2366/4755] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:04 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:05.247708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:05.256994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:05.257685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:05.277377 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ceeb0a5-1b37-4aa0-93e2-78c6e1b2e4a0 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1512 microversion: 2.1 time: 1.128667 Sep 01 05:16:05.278083 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2390/4756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:04 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1512 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:05.296043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:05.296043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:05.296043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:05.296043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:05.296043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:05.296043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.232316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:06.233234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:06.255161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:06.256864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:06.257467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.263995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:06.266978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:06.267655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.363203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:06.376538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ab6bde3-84f7-469b-b574-783c8d4198d5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.124624 Sep 01 05:16:06.379201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2367/4757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:05 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:06.385901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:06.393350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:06.405513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:06.410475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:06.411343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.412896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:06.415480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:06.416210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:06.979778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:06.996050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:06.998085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:06.999349 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32c0f1a1-ef31-4ebd-a78e-4db8e7104f24 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.787184 Sep 01 05:16:07.006133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2391/4758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:06 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:07.019866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:07.020605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:07.046761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:07.052584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.054329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.059386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.062670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.064343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.064976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.089341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:07.183811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:16:07.406874 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ac5fdab-f087-4739-9e1d-346d25cc3fa8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "DELETE /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 204 len: 0 microversion: 2.1 time: 0.394385 Sep 01 05:16:07.407683 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2392/4759] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:16:07 2022] DELETE /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:07.432854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-62e75e46-e72c-4b26-947f-f36aea482a60 req-91621793-5211-4d94-b2a0-d030c18f8d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66563c2c-1ed6-48e1-acc8-c99f29b124e9", "tag": "1e61b969-ca27-42f2-894e-c9d99e47ea9f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:07.469025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62e75e46-e72c-4b26-947f-f36aea482a60 req-91621793-5211-4d94-b2a0-d030c18f8d1d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.469509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62e75e46-e72c-4b26-947f-f36aea482a60 req-91621793-5211-4d94-b2a0-d030c18f8d1d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.469945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62e75e46-e72c-4b26-947f-f36aea482a60 req-91621793-5211-4d94-b2a0-d030c18f8d1d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.518090 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-62e75e46-e72c-4b26-947f-f36aea482a60 req-91621793-5211-4d94-b2a0-d030c18f8d1d service nova] Creating event network-changed:1e61b969-ca27-42f2-894e-c9d99e47ea9f for instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 on n-h2-820368-37 Sep 01 05:16:07.532348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-62e75e46-e72c-4b26-947f-f36aea482a60 req-91621793-5211-4d94-b2a0-d030c18f8d1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109462 Sep 01 05:16:07.538123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2393/4760] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:07.543837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:07.553105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:07.584731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.593085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.593772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.594674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.595405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.595981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.860595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:07.879354 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93bcfad1-bbfb-4411-822a-03d467488443 tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1512 microversion: 2.1 time: 1.498674 Sep 01 05:16:07.889410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2368/4761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:06 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1512 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:07.906308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:07.917574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:07.940435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.941559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.942710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:07.943666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:07.944581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:07.946522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:08.876713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:08.884959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64b0f266-573a-48f2-bfe3-6214e4d7d8c2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.345292 Sep 01 05:16:08.892055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2394/4762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:07 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:08.930907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-272731bf-7a69-4c73-9ce5-c16b0311d272 req-077d7eca-3da6-419b-b83e-9555323c731c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-plugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:08.974293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-272731bf-7a69-4c73-9ce5-c16b0311d272 req-077d7eca-3da6-419b-b83e-9555323c731c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:08.974920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-272731bf-7a69-4c73-9ce5-c16b0311d272 req-077d7eca-3da6-419b-b83e-9555323c731c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:08.977052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-272731bf-7a69-4c73-9ce5-c16b0311d272 req-077d7eca-3da6-419b-b83e-9555323c731c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.025863 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-272731bf-7a69-4c73-9ce5-c16b0311d272 req-077d7eca-3da6-419b-b83e-9555323c731c service nova] Creating event network-vif-plugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:16:09.046161 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-272731bf-7a69-4c73-9ce5-c16b0311d272 req-077d7eca-3da6-419b-b83e-9555323c731c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147040 Sep 01 05:16:09.051076 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2395/4763] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:09.067246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:09.068048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:09.100008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.100510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.100945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.101890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.108708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.109287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.186390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:09.708692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:09.729667 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a7a5e41-c9fa-4fcd-bfeb-09f0c34a0ff7 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1767 microversion: 2.1 time: 1.838244 Sep 01 05:16:09.735212 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2369/4764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:07 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1767 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:09.744681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:09.746923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:09.765952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.766931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.767513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.768544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.769266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.769867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.913210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:09.914165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:09.917416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:09.921287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lazy-loading 'fault' on Instance uuid d64b8498-4bbb-462d-928b-1e5749629afe {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:16:10.224360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:10.246072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:10.257156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:10.260735 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9114d442-55e5-4228-bdaf-a1a074586868 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 1.208267 Sep 01 05:16:10.283297 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2396/4765] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:09 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:10.309320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4b06802d-eecb-48ec-82dc-b8351752599a req-5b799938-60e6-478a-aa68-990660ac5dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64b8498-4bbb-462d-928b-1e5749629afe", "name": "network-vif-deleted", "tag": "050578dc-7c3f-49c4-b5ea-5333502bae10"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:10.344384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b06802d-eecb-48ec-82dc-b8351752599a req-5b799938-60e6-478a-aa68-990660ac5dee service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.345000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b06802d-eecb-48ec-82dc-b8351752599a req-5b799938-60e6-478a-aa68-990660ac5dee service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.345616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b06802d-eecb-48ec-82dc-b8351752599a req-5b799938-60e6-478a-aa68-990660ac5dee service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.391448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4b06802d-eecb-48ec-82dc-b8351752599a req-5b799938-60e6-478a-aa68-990660ac5dee service nova] Creating event network-vif-deleted:050578dc-7c3f-49c4-b5ea-5333502bae10 for instance d64b8498-4bbb-462d-928b-1e5749629afe on n-h2-820368-37 Sep 01 05:16:10.410435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4b06802d-eecb-48ec-82dc-b8351752599a req-5b799938-60e6-478a-aa68-990660ac5dee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125365 Sep 01 05:16:10.415903 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2397/4766] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:10.436476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd3801fcb04046c3a022c45436262e9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97adc27942a848ceb61acc1348260e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:10.437403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:10.438139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:10.453641 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-984f1a7f-9c03-4eed-95d4-6311c678ca3b tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 200 len: 1306 microversion: 2.1 time: 0.716783 Sep 01 05:16:10.454783 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2370/4767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:09 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 1306 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:10.467583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.468490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.472407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.473526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.474203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.474825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.755101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:10.756901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:10.780916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.783391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.785075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:10.787797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:10.789127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:10.795824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.433951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:11.454834 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80bcaea2-a6a8-4c87-a413-3c8cfb7751d4 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1767 microversion: 2.1 time: 0.699356 Sep 01 05:16:11.461246 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2371/4768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:10 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1767 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:11.488470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:11.495158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:11.510530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.513311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.517433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.518622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.519222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.521899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.729540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:11.741230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b95e0e9a-f59c-4a73-9b1c-1f0a8b7257f1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.323831 Sep 01 05:16:11.751096 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2398/4769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:10 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:11.774331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:11.775334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:11.777140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] [instance: d64b8498-4bbb-462d-928b-1e5749629afe] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:11.790390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:11.792093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:11.793470 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9bae6d6b-656a-40f5-8ef5-933217a3b915 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.330265 Sep 01 05:16:11.795459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.799580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.800423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.801382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:11.802051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:11.802684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:11.803251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2372/4770] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:11 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:11.864295 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] HTTP exception thrown: Instance d64b8498-4bbb-462d-928b-1e5749629afe could not be found. Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Request method failure captured: Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe HTTP/1.1 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED_yGzR4mcrahhrMMKvOPUi5WtVttr0JNBBT19GhkEIooehoxpbz1Zpx6jk21R6nMyU5Vau8y7_e6dwFOpN3dhzVRPVRsyhWO_d_9J8yx_Xh4sW6ooyuOg1RGJRaD9VBJMMCTYQL_2gBGBIocyjkHDVIxcDDFSfgfxIylB_f1IiErKk Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 97adc27942a848ceb61acc1348260e62 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerAddressesTestJSON-968211575 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97adc27942a848ceb61acc1348260e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97adc27942a848ceb61acc1348260e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97adc27942a848ceb61acc1348260e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97adc27942a848ceb61acc1348260e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerAddressesTestJSON-968211575 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 97adc27942a848ceb61acc1348260e62 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerAddressesTestJSON-968211575 Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerAddressesTestJSON-968211575-project Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cd3801fcb04046c3a022c45436262e9a Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerAddressesTestJSON-968211575-project Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d64b8498-4bbb-462d-928b-1e5749629afe could not be found. Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd64b8498-4bbb-462d-928b-1e5749629afe'} Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64b8498-4bbb-462d-928b-1e5749629afe could not be found. Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64b8498-4bbb-462d-928b-1e5749629afe could not be found. Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:11.878924 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64b8498-4bbb-462d-928b-1e5749629afe could not be found. Sep 01 05:16:11.883003 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:11.887191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] Returning 404 to user: Instance d64b8498-4bbb-462d-928b-1e5749629afe could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:16:11.888692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be13bbc2-f64a-45a8-8045-7830d907240e tempest-ServerAddressesTestJSON-968211575 tempest-ServerAddressesTestJSON-968211575-project] 10.222.0.26 "GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe" status: 404 len: 111 microversion: 2.1 time: 0.135250 Sep 01 05:16:11.892055 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2399/4771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:11 2022] GET /compute/v2.1/servers/d64b8498-4bbb-462d-928b-1e5749629afe => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:16:12.483242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:12.484209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:12.496836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.500611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.503544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.504902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.508631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.509293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.711177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fd4f095c-96d4-4a23-9d7a-ba8df8579de1 req-bfbfb7dc-d992-4c0a-acb5-60959e29553f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66563c2c-1ed6-48e1-acc8-c99f29b124e9", "name": "network-vif-deleted", "tag": "1e61b969-ca27-42f2-894e-c9d99e47ea9f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:12.744836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd4f095c-96d4-4a23-9d7a-ba8df8579de1 req-bfbfb7dc-d992-4c0a-acb5-60959e29553f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.745525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd4f095c-96d4-4a23-9d7a-ba8df8579de1 req-bfbfb7dc-d992-4c0a-acb5-60959e29553f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.745925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fd4f095c-96d4-4a23-9d7a-ba8df8579de1 req-bfbfb7dc-d992-4c0a-acb5-60959e29553f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.777441 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fd4f095c-96d4-4a23-9d7a-ba8df8579de1 req-bfbfb7dc-d992-4c0a-acb5-60959e29553f service nova] Creating event network-vif-deleted:1e61b969-ca27-42f2-894e-c9d99e47ea9f for instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 on n-h2-820368-37 Sep 01 05:16:12.793716 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fd4f095c-96d4-4a23-9d7a-ba8df8579de1 req-bfbfb7dc-d992-4c0a-acb5-60959e29553f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089775 Sep 01 05:16:12.796782 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2400/4772] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:12.813770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:12.816342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:12.842149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.847789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.849246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.851087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:12.852204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:12.852837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:12.916532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4341d4d25da94a2389be456b80c645f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6734c36a2f9d454b94c60f5d3531188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:12.940254 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15898e80-75a9-4b82-a6c6-58443159b1a8 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 200 len: 1530 microversion: 2.1 time: 0.461610 Sep 01 05:16:12.942288 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2373/4773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:12 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 1530 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:12.983332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:12.987955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:13.007304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.012992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.014082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:13.015295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:13.016259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:13.016906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.175838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:14.194089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:14.218803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:14.225112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f88c2b9d-fdb4-4bb8-b218-e71a47e71f67 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 1.276239 Sep 01 05:16:14.230661 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2374/4774] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:12 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:14.246040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:14.248697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:14.251709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] [instance: 66563c2c-1ed6-48e1-acc8-c99f29b124e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:14.262122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1c75c5e-ced5-4a01-b858-ee31c4d72493 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.461410 Sep 01 05:16:14.263147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2401/4775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:12 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:14.280567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.284884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.287406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.289823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:14.292897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:14.301080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:14.348016 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] HTTP exception thrown: Instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 could not be found. Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Request method failure captured: Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 HTTP/1.1 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED9Z2q1XRV66SoQ7ctzrMSi9fFs6zma0ZxKHQ2-x15bv0pdyRamGLdcfwxQeuSXMAl-iRNOkBb-5wibX4M2nCv6qIZLRFApcTRk-rap0Fv0L4g0f7WBp819JhKUbuUmtizAU-2PXHMi3lykf9dM949agXrOyOKtwzPw8CtK9qqZJ5tY Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 6734c36a2f9d454b94c60f5d3531188f Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1674321278 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6734c36a2f9d454b94c60f5d3531188f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1674321278 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 6734c36a2f9d454b94c60f5d3531188f Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1674321278 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestSecurityGroupsBasicOps-1674321278-project Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 4341d4d25da94a2389be456b80c645f5 Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1674321278-project Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 could not be found. Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '66563c2c-1ed6-48e1-acc8-c99f29b124e9'} Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 could not be found. Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 could not be found. Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:16:14.356046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 could not be found. Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Returning 404 to user: Instance 66563c2c-1ed6-48e1-acc8-c99f29b124e9 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:16:14.359611 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1973b180-efe3-4956-ae88-e2b35d6a405f tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9" status: 404 len: 111 microversion: 2.1 time: 0.124955 Sep 01 05:16:14.360932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2375/4776] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:14 2022] GET /compute/v2.1/servers/66563c2c-1ed6-48e1-acc8-c99f29b124e9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:16:15.260577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:15.266369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:15.289817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.292050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.293807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.296373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.297578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.299144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:15.299777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:15.300193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.349818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.350548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.351556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.352917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:15.358316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:15.362637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:15.625539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:15.635868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:15.637402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:15.638651 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c37218d-996e-4ad5-870b-03110fd8d259 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.387952 Sep 01 05:16:15.648400 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2402/4777] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:15 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:16.118672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:16.136753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4ee1a8e-60f3-4368-9b70-9a83311128a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 0.852191 Sep 01 05:16:16.147101 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2376/4778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:15 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:16.672268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:16.673582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:16.684791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:16.687620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:16.689678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:16.690592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:16.697204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:16.697899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:16.915526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:16.931128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:16.941793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:16.943658 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b39240cc-da92-48c4-9948-ac22ddf80014 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.275918 Sep 01 05:16:16.953000 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2403/4779] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:16 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:17.165962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:17.166571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:17.185985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:17.187530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:17.189509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:17.191785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:17.192455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:17.194385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:17.953285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:17.964223 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9b548fc-7702-4fef-ad53-5a2b2eb66b6c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 0.802080 Sep 01 05:16:17.971392 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2377/4780] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:17 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:17.980258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:17.982180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:18.008339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:18.016322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:18.023403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:18.026643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:18.030709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:18.035432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:18.406734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:18.424492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:18.425988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:18.427271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-020962ee-c094-4434-9591-fabf54971940 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.451260 Sep 01 05:16:18.434735 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2404/4781] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:17 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:18.991327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:18.992011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:19.006678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:19.007213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:19.007660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:19.008395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:19.008862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:19.015696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:19.454939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:19.456442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:19.473940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:19.479313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:19.480556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:19.482671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:19.485037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:19.486091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:20.352318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:20.372293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:20.375263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:20.385373 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e538579-6a1e-434c-95f6-a5709049c87d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.929601 Sep 01 05:16:20.387830 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2405/4782] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:19 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:20.867428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:20.881622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed9b3740-f8f9-408c-88f1-2e153b9a16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.893562 Sep 01 05:16:20.882974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2378/4783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:21.432182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:21.432809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:21.445874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:21.446383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:21.446821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:21.452515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:21.463768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:21.464387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:21.902763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:21.917024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:21.918629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:21.922433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:21.924260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:21.925835 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-213e5243-4ffb-43cb-a115-2a9153fb111d tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.497711 Sep 01 05:16:21.926966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2406/4784] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:21 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:21.946425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:21.947211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:21.947678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:21.954924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:21.955624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:21.956405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:22.710488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:22.726311 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0de6ebf-5419-4c65-808a-134c326a1118 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 0.815275 Sep 01 05:16:22.729843 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2379/4785] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:21 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:22.954047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:22.955416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:22.971703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:22.973512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:22.974153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:22.977058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:22.978250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:22.980759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:23.370300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:23.389990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:23.405371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:23.413304 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a3b0c05-135a-429e-b858-1c43171971d5 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.457920 Sep 01 05:16:23.442258 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2407/4786] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:22 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:23.787190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:23.788578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:23.807249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:23.810123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:23.812348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:23.813254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:23.814929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:23.815625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:23.816252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:24.478356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:24.481719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:24.491211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:24.491211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:24.492160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:24.492160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:24.492456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:24.492905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:25.007751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.029304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.031531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.033060 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c469fab-830f-48ef-bcba-a434769982fe tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1409 microversion: 2.54 time: 0.559109 Sep 01 05:16:25.057569 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2408/4787] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:24 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1409 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:25.783891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:25.806753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-447a2cc7-7fb6-4b19-b225-d36d2c8c51f6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 2.024610 Sep 01 05:16:25.810570 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2380/4788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:23 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:26.071490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:26.072110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:26.100936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.101442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.116651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.117792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.126529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.127258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.835775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:26.836551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:26.850270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.863015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.863431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.864261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:26.864943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:26.865598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:26.939024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:27.237629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:27.292756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:27.308113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:27.329564 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f732ff5e-024a-44ea-b9e2-3d582da9845e tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1427 microversion: 2.54 time: 1.247408 Sep 01 05:16:27.330705 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2409/4789] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:26 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1427 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:28.237225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:28.245477 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76309453-5299-4c33-a404-ab5212ef47e7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.415082 Sep 01 05:16:28.246118 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2381/4790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:26 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:28.365146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:28.380050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:28.459495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:28.467826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:28.481080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:28.485852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:28.488800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:28.492032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:29.206000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.221338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.226070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:29.229216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-432ce60b-8377-4620-bb78-a23b04c15369 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1415 microversion: 2.54 time: 0.872462 Sep 01 05:16:29.231661 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2410/4791] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:28 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1415 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:29.268004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:29.268619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:29.303392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:29.304599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:29.305049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:29.305958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:29.307345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:29.309758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.270386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:30.272529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:30.291554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.297128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.298192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.301989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.302758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.303420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.345258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.360395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-298e3b25-009a-4c33-b1c0-0ae6b423e412 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 1.095068 Sep 01 05:16:30.377071 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2382/4792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:29 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:30.506470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.528049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.532552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:30.538018 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9031c90a-1fde-4b8a-9c2d-2a9d19425496 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1400 microversion: 2.54 time: 0.276099 Sep 01 05:16:30.563260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2411/4793] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:30 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1400 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:30.565113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7743554-3814-4edb-84a7-c3dfa1ad9977 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '.version_select at 0x7fa75b32bc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:30.607897 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7743554-3814-4edb-84a7-c3dfa1ad9977 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1718545138" status: 204 len: 0 microversion: 2.54 time: 0.046883 Sep 01 05:16:30.609246 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2383/4794] 10.222.0.26 () {60 vars in 1319 bytes} [Thu Sep 1 05:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1718545138 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:16:30.630606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:30.631062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:30.648890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.649351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.656917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.663584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:30.668344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:30.674595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:30.780887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:16:31.008738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e468cb51-f23c-42c9-b326-ee1cace3529a tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 204 len: 0 microversion: 2.54 time: 0.369309 Sep 01 05:16:31.035777 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2412/4795] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:16:30 2022] DELETE /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:16:31.046075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:31.048290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:31.064614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.066305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.067029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.071353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.072071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.072636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.330489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.340586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.343359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:31.345054 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca45f5c4-ae91-40ef-a5f8-812a176ae2f9 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1406 microversion: 2.54 time: 0.304839 Sep 01 05:16:31.346258 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2384/4796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:31 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:31.384143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:31.387305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:31.403724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.405744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.406434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.407804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:31.408616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:31.409313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:31.441028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:32.327467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:32.336884 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e162c4f-d8e0-4edc-91e1-fca2780f3334 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 0.957250 Sep 01 05:16:32.358089 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2413/4797] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:31 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:32.370035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:32.371467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:32.386004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:32.386950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:32.387626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:32.388596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:32.391771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:32.392817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:32.553454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:32.577064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:32.591306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:32.595077 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86279c13-f67f-4457-b7e0-ea2bcc1f6daa tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1406 microversion: 2.54 time: 0.226902 Sep 01 05:16:32.598156 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2385/4798] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:32 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:32.952738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3e52037-4a71-4ad8-8e88-e3e041a6df45 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] Calling method '.version_select at 0x7fa75bf1f1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:33.014744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3e52037-4a71-4ad8-8e88-e3e041a6df45 tempest-TestSecurityGroupsBasicOps-1674321278 tempest-TestSecurityGroupsBasicOps-1674321278-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-943614427" status: 202 len: 0 microversion: 2.1 time: 0.064666 Sep 01 05:16:33.015442 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2414/4799] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:16:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-943614427 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:16:33.368574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:33.369351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:33.386878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:33.389421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:33.391716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:33.394633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:33.395368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:33.395945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:33.658242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:33.659158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:33.677083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:33.683996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:33.684798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:33.685768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:33.692468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:33.700661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:34.002171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.019145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.027371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ff2422e5cef4726aba04684ce7ab757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aecd7315c494dcb91ae0fb826200c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.029559 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31744c8f-6280-41e1-ba81-39819aa7e5bc tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 200 len: 1406 microversion: 2.54 time: 0.376093 Sep 01 05:16:34.030903 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2415/4800] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:33 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:16:34.043752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:34.058154 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70d2dc6e-ae1a-46ce-b3fc-c9f569407b25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 0.694886 Sep 01 05:16:34.072404 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2386/4801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:33 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:35.057946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:35.059104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] [instance: fe587072-02e3-4402-baf3-c88234440e36] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:35.073613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.074141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.074798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.082155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.082705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.083180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.084892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:35.085785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:35.096415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.100769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.101312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.102302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:35.104594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:35.105922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:35.158183 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] HTTP exception thrown: Instance fe587072-02e3-4402-baf3-c88234440e36 could not be found. Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Request method failure captured: Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 HTTP/1.1 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEAG7W3u_WOGsHtPiyXAI6wgkI10G3wPI2WvHhUM78hYVQNa8BCacBuvNCtbyuEjyW_J1y3KQWf1yeeEDdNa4e5ScLCo5NNjoHolb5_gZQHVgCjvEhsbvHvacD5DJ4JP-8L5Lm3PTkaMo9NKpsUktTHXS9xsu-_1qnfYHY-LQtBKaWE Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.54 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 7aecd7315c494dcb91ae0fb826200c56 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerShowV254Test-2068714584 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7aecd7315c494dcb91ae0fb826200c56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7aecd7315c494dcb91ae0fb826200c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7aecd7315c494dcb91ae0fb826200c56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7aecd7315c494dcb91ae0fb826200c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerShowV254Test-2068714584 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 7aecd7315c494dcb91ae0fb826200c56 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerShowV254Test-2068714584 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerShowV254Test-2068714584-project Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6ff2422e5cef4726aba04684ce7ab757 Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerShowV254Test-2068714584-project Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance fe587072-02e3-4402-baf3-c88234440e36 could not be found. Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'fe587072-02e3-4402-baf3-c88234440e36'} Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe587072-02e3-4402-baf3-c88234440e36 could not be found. Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe587072-02e3-4402-baf3-c88234440e36 could not be found. Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:16:35.160316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe587072-02e3-4402-baf3-c88234440e36 could not be found. Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] Returning 404 to user: Instance fe587072-02e3-4402-baf3-c88234440e36 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8782c749-4794-4ba6-a586-b3afc6200ad3 tempest-ServerShowV254Test-2068714584 tempest-ServerShowV254Test-2068714584-project] 10.222.0.26 "GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36" status: 404 len: 111 microversion: 2.54 time: 0.107966 Sep 01 05:16:35.167672 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2416/4802] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:16:35 2022] GET /compute/v2.1/servers/fe587072-02e3-4402-baf3-c88234440e36 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:16:35.876580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:35.895170 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfe03137-9065-46fd-a484-17e3da4ec287 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1682 microversion: 2.1 time: 0.814704 Sep 01 05:16:35.899899 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2387/4803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:35 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1682 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:36.922285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:36.923806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:36.939089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:36.950837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:36.951517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:36.952422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:36.953017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:36.953575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:37.722088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:37.735503 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-333e8e61-f36c-435a-8e1f-c0636dcd8ffd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.817151 Sep 01 05:16:37.737366 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2417/4804] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:36 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:38.003542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:38.004531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:38.020040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:38.020562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:38.021005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:38.021749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:38.022214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:38.025466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:38.491560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:38.506328 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27331963-d525-4a5d-8ebc-bd9560da890b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.504339 Sep 01 05:16:38.507398 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2388/4805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:37 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:41.446335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-915d27e8-0267-49ba-8a34-caf5e19b6943 req-f45d06de-0305-40fa-bad8-a9a6c05ed9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-unplugged", "status": "completed", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:41.461476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:41.462295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:41.466296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:41.477840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-915d27e8-0267-49ba-8a34-caf5e19b6943 req-f45d06de-0305-40fa-bad8-a9a6c05ed9bf service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:41.479555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-915d27e8-0267-49ba-8a34-caf5e19b6943 req-f45d06de-0305-40fa-bad8-a9a6c05ed9bf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:41.480531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:41.481038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:41.481422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-915d27e8-0267-49ba-8a34-caf5e19b6943 req-f45d06de-0305-40fa-bad8-a9a6c05ed9bf service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:41.481583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:41.482187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:41.482644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:41.483098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:41.501079 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-915d27e8-0267-49ba-8a34-caf5e19b6943 req-f45d06de-0305-40fa-bad8-a9a6c05ed9bf service nova] Creating event network-vif-unplugged:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:16:41.513904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-915d27e8-0267-49ba-8a34-caf5e19b6943 req-f45d06de-0305-40fa-bad8-a9a6c05ed9bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074760 Sep 01 05:16:41.515882 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2418/4806] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:41.905581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:41.919228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc690bbc-51ae-4119-9875-2b7585dfe819 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.462543 Sep 01 05:16:41.920579 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2389/4807] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:41 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:41.951918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:41.952858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:41.968647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:41.970770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:41.971415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:41.973299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:41.974606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:41.977934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:42.500080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:42.513350 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b693d527-8bf2-440a-a7ef-d131a1438ff9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.568035 Sep 01 05:16:42.516037 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2419/4808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:41 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:42.545840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:42.546562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:42.562637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:42.567524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:42.568079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:42.568899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:42.569882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:42.570372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:43.320162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:43.330621 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d17fef64-a8ab-40ce-bba4-7a1f64d7ca64 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.791259 Sep 01 05:16:43.334539 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2390/4809] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:42 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:43.358332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:43.361100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:43.376875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:43.384759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:43.385375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:43.386272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:43.386945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:43.387517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:43.502377 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02c23f76-e3d0-4746-9c57-ce01f331a271 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.148187 Sep 01 05:16:43.506641 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2420/4810] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:16:43 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:16:43.513029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:43.513662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:43.524778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:43.525288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:43.531779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:43.532743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:43.533244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:43.533708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:43.894157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:43.904095 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8e240af-f953-4938-8155-f2e52c98e07b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1671 microversion: 2.1 time: 0.395834 Sep 01 05:16:43.904719 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2391/4811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:43 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1671 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:44.929554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:44.930856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:44.958566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:44.959103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:44.959550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:44.960271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:44.960733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:44.961157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:45.809707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:45.822179 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26588568-caeb-4c8f-b341-abbee6609782 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1671 microversion: 2.1 time: 0.898488 Sep 01 05:16:45.822795 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2421/4812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:44 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1671 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:46.852677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:46.853963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:46.904441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:46.905362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:46.905967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:46.907459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:46.912899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:46.916654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:48.686441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:48.727756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a3cc591-9ed1-48f7-8538-aaf6501df2e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1676 microversion: 2.1 time: 1.880194 Sep 01 05:16:48.744010 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2392/4813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:46 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1676 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:49.759491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:49.760358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:49.777478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:49.779618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:49.780415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:49.782436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:49.783139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:49.783792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:50.251098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:50.264875 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-239b79c9-70a9-4225-954c-be5b848ecbb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1676 microversion: 2.1 time: 0.514538 Sep 01 05:16:50.280499 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2422/4814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:49 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1676 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:51.292417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:51.293504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:51.306775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.307459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.308018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.312282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:51.312930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:51.313465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:51.669368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:51.684507 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a27c90a4-f2c0-4f0e-b75c-8d19c5322f1b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1676 microversion: 2.1 time: 0.396135 Sep 01 05:16:51.685694 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2393/4815] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:51 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1676 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:52.712460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:52.715401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:52.730625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.731299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.731968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:52.732948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:52.733681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:52.734875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.224824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:53.234498 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-60e0eb19-b704-4bd9-9eaa-e10fc97a47c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.531090 Sep 01 05:16:53.243494 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2423/4816] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:52 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:53.277436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:53.285718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:53.333549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.334199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.334655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.335487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.335941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.336355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.469267 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5f40794-c9ae-40fa-9889-0e99a041eb41 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 200 len: 322 microversion: 2.1 time: 0.200524 Sep 01 05:16:53.470433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2394/4817] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:16:53 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:53.479982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:53.480817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:53.495322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.496016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.496576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:53.497479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:53.497958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:53.498396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.474627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:55.490545 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5651f642-0bb0-4b46-acf0-f13b4f2eb23f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 2.014520 Sep 01 05:16:55.492340 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2424/4818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:53 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:16:55.516775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:55.530330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:55.544472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.547587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.549780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.555892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:55.562294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:55.564440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:55.842833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-470476326", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:55.860836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:55.951062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] validate_networks() for [('2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:16:56.669527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:56.685261 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73ae4802-2809-41dd-875a-7cf5fc5a4449 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 1.172795 Sep 01 05:16:56.687070 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2425/4819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:55 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:56.855905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7293f139-84c2-404b-b9b9-2ac587330ee8 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Action: 'create', calling method: .version_select at 0x7fa75ba0cb80>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-616912039", "policies": ["affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:56.933921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7293f139-84c2-404b-b9b9-2ac587330ee8 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:56.960296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7293f139-84c2-404b-b9b9-2ac587330ee8 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:57.079753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7293f139-84c2-404b-b9b9-2ac587330ee8 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:57.094101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7293f139-84c2-404b-b9b9-2ac587330ee8 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:57.142359 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7293f139-84c2-404b-b9b9-2ac587330ee8 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.451944 Sep 01 05:16:57.148739 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2426/4820] 10.222.0.26 () {60 vars in 1174 bytes} [Thu Sep 1 05:16:56 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:57.156741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:57.157738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:57.186657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.187602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.188304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:57.189945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:57.191749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:57.193787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.573047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:58.596610 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9011761a-b200-4b24-a490-23611c5840ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 1.449964 Sep 01 05:16:58.598955 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2427/4821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:57 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:58.605278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bfe98a3-4056-46c0-8fed-da8bab1e18e1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Action: 'create', calling method: .version_select at 0x7fa75b76c1f0>, body: {"server_group": {"name": "tempest-server-group-131987649", "policies": ["affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:58.635190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3bfe98a3-4056-46c0-8fed-da8bab1e18e1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:58.656718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3bfe98a3-4056-46c0-8fed-da8bab1e18e1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:58.784344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3bfe98a3-4056-46c0-8fed-da8bab1e18e1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:58.794343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3bfe98a3-4056-46c0-8fed-da8bab1e18e1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:58.818704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bfe98a3-4056-46c0-8fed-da8bab1e18e1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.218051 Sep 01 05:16:58.820181 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2428/4822] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Sep 1 05:16:58 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:58.827710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:58.828999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:58.838402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.840004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.841302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:58.842670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:58.843536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:58.844258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.028239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:16:59.029447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:16:59.030094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:16:59.030669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:16:59.031272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:16:59.062149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.068170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.072636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.083135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:16:59.086474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:16:59.087177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:16:59.129834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=74 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:59.172035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Getting quotas for project 355f1c34d8614151af17b7ad3f2c76d5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:59.179921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Getting quotas for user dd0445362d3641cebea6f5cefc8ac7ef and project 355f1c34d8614151af17b7ad3f2c76d5. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:59.224544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:16:59.227082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:16:59.319325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:16:59.330253 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43f81b7b-740d-4ba9-bf32-11722f496ae6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.508503 Sep 01 05:16:59.355619 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2429/4823] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:58 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:59.369150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-18e7bb9d-d99f-4f0a-bdd3-02121160d577 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Action: 'create', calling method: .version_select at 0x7fa7602d0940>, body: {"server_group": {"name": "tempest-server-group-131987649", "policies": ["affinity"]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:59.396716 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8f491fb-3e13-4b3e-ac9e-d33d5151f8cb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.988766 Sep 01 05:16:59.397392 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2395/4824] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:16:59.409316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f965a7e1-26d7-4aff-95ca-7beeb5820d6f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:16:59.425260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f965a7e1-26d7-4aff-95ca-7beeb5820d6f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:16:59.458662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-18e7bb9d-d99f-4f0a-bdd3-02121160d577 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:59.467617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-18e7bb9d-d99f-4f0a-bdd3-02121160d577 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:59.612596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-18e7bb9d-d99f-4f0a-bdd3-02121160d577 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:16:59.635267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-18e7bb9d-d99f-4f0a-bdd3-02121160d577 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:16:59.646914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:59.654234 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-18e7bb9d-d99f-4f0a-bdd3-02121160d577 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.296188 Sep 01 05:16:59.655435 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2430/4825] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Sep 1 05:16:59 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:16:59.661843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-8000552", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "dc7e6109-f10c-46fb-98ac-ddd7a9c9df15"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:16:59.741667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] validate_networks() for [('dc7e6109-f10c-46fb-98ac-ddd7a9c9df15', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:17:00.035462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f965a7e1-26d7-4aff-95ca-7beeb5820d6f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:00.047612 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f965a7e1-26d7-4aff-95ca-7beeb5820d6f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1216 microversion: 2.1 time: 0.642126 Sep 01 05:17:00.073903 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2396/4826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:16:59 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1216 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:00.095678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1025dbad-c24a-4c64-96e6-65ce57951d41 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.160588 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1025dbad-c24a-4c64-96e6-65ce57951d41 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7e082b5f-24ef-4951-b70c-1b30e1e5ef0f" status: 204 len: 0 microversion: 2.1 time: 0.085357 Sep 01 05:17:00.161164 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2397/4827] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:00 2022] DELETE /compute/v2.1/os-server-groups/7e082b5f-24ef-4951-b70c-1b30e1e5ef0f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:00.169457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51fb287f-7a56-45eb-8c67-a652d8155515 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.221762 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51fb287f-7a56-45eb-8c67-a652d8155515 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.056199 Sep 01 05:17:00.228580 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2398/4828] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:00.234413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24915848-5bfb-4fa5-aa22-3775220c840e tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.309764 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24915848-5bfb-4fa5-aa22-3775220c840e tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/777767c8-2223-46f5-ae66-d5d94dae5425" status: 204 len: 0 microversion: 2.1 time: 0.079892 Sep 01 05:17:00.310650 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2399/4829] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:00 2022] DELETE /compute/v2.1/os-server-groups/777767c8-2223-46f5-ae66-d5d94dae5425 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:00.322681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da53282e-3045-4d42-9229-33b2efc39ef9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.352716 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da53282e-3045-4d42-9229-33b2efc39ef9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.036409 Sep 01 05:17:00.356335 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2400/4830] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:00.368862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13eeeb10-1c47-4464-ad07-6bd25be2157d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Action: 'create', calling method: .version_select at 0x7fa7616e1d30>, body: {"server_group": {"name": "tempest-server-group-1910270922", "policies": ["affinity"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:00.417325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13eeeb10-1c47-4464-ad07-6bd25be2157d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:00.439450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13eeeb10-1c47-4464-ad07-6bd25be2157d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:00.593564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13eeeb10-1c47-4464-ad07-6bd25be2157d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:00.604868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13eeeb10-1c47-4464-ad07-6bd25be2157d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:00.663081 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13eeeb10-1c47-4464-ad07-6bd25be2157d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.297910 Sep 01 05:17:00.666361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:17:00.666860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:17:00.667542 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2401/4831] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Sep 1 05:17:00 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:00.669285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:17:00.669719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:17:00.670142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:17:00.680104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4032f903-051b-4781-a6c6-72588473c1ab tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.700568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.701148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.701493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.702221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:00.707750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:00.708201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:00.746879 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4032f903-051b-4781-a6c6-72588473c1ab tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/b4d027bc-3e94-4a2b-9537-c624a4e88035" status: 204 len: 0 microversion: 2.1 time: 0.072410 Sep 01 05:17:00.748014 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2402/4832] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:00 2022] DELETE /compute/v2.1/os-server-groups/b4d027bc-3e94-4a2b-9537-c624a4e88035 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:00.756364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f70ac660-5ed0-46a2-b559-9fdb0b815ced tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:00.779274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:00.783385 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f70ac660-5ed0-46a2-b559-9fdb0b815ced tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030783 Sep 01 05:17:00.790213 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2403/4833] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:00.795623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for user 87f4f3bcd603448d856a7471120a42af and project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:00.802483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-528f406a-5f76-413b-b713-fd691401168c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Action: 'create', calling method: .version_select at 0x7fa75b1fd5e0>, body: {"server_group": {"name": "tempest-server-group-1329857197", "policies": ["anti-affinity"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:00.828581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:17:00.838651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:17:00.853615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-528f406a-5f76-413b-b713-fd691401168c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:00.859902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-528f406a-5f76-413b-b713-fd691401168c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:00.966371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-528f406a-5f76-413b-b713-fd691401168c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:00.978161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-528f406a-5f76-413b-b713-fd691401168c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:00.983077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:00.989508 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-432edafb-8afe-4428-965a-07b439903582 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332697 Sep 01 05:17:00.990178 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2431/4834] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:17:01.003038 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-528f406a-5f76-413b-b713-fd691401168c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.205491 Sep 01 05:17:01.005074 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2404/4835] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Sep 1 05:17:00 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:01.009196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f01c8d3-ceff-425c-be9d-7f929db28cfe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.010520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f01c8d3-ceff-425c-be9d-7f929db28cfe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:01.023648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e954a17a-59da-4024-9834-c1f9798413d6 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.085193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e954a17a-59da-4024-9834-c1f9798413d6 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/2c00e749-546d-48f0-b2da-b7a944e66dd2" status: 204 len: 0 microversion: 2.1 time: 0.065915 Sep 01 05:17:01.086330 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2405/4836] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:01 2022] DELETE /compute/v2.1/os-server-groups/2c00e749-546d-48f0-b2da-b7a944e66dd2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:01.101216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.102132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:01.104102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3f01c8d3-ceff-425c-be9d-7f929db28cfe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.112222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.113620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f01c8d3-ceff-425c-be9d-7f929db28cfe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1212 microversion: 2.1 time: 0.114983 Sep 01 05:17:01.115189 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2432/4837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:00 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:01.115754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.121159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1155bd1-c186-4a2e-b1ee-46d89ed2af43 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:01.121753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.122654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:01.123279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:01.124076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:01.145038 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1155bd1-c186-4a2e-b1ee-46d89ed2af43 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028271 Sep 01 05:17:01.160466 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2433/4838] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:17:01 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:01.231459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1858475122", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "0811ff55-4da4-461e-b9e6-fb0f4907fc74"}]}, "os:scheduler_hints": {"group": "66702092-52f5-432b-b00e-ba694e547e78"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:01.259803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:01.273495 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0e97740-9e0b-4f46-9b52-46b7572dc5dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1268 microversion: 2.1 time: 0.185855 Sep 01 05:17:01.285162 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2406/4839] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:01 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:01.351196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] validate_networks() for [('0811ff55-4da4-461e-b9e6-fb0f4907fc74', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:17:02.145363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:02.150274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:02.158877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.160088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.167142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.169789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.170481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.171227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.623548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:02.632512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4b5ffb7-bad4-4c66-9fc4-c3c97a2f1228 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1208 microversion: 2.1 time: 0.490898 Sep 01 05:17:02.637645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2407/4840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:02 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1208 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:02.648565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:02.649196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:02.666066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.667933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.670519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:02.671549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:02.672202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:02.674775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.012957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:03.033887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c05ea41f-72b6-4f45-aa82-4d693848e634 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1274 microversion: 2.1 time: 0.394986 Sep 01 05:17:03.046063 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2408/4841] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:02 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1274 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:03.427917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:17:03.429036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:17:03.429683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:17:03.430249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:17:03.430826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:17:03.470279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.473506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.474189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.479246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.480045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.480649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.505148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:03.529316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:03.544726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:03.600142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:17:03.609032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:17:03.654807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:03.656048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:03.672180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.673136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.673929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.674816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:03.675483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:03.679669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:03.724299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128862) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 01 05:17:03.780475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:03.787981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:03.968232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:03.994274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Getting quotas for user 9ba01f2d2e284e11801f61bd0ea24fd2 and project 97ccd11ead4043399b517f1e72ea9433. Resources: {'server_group_members'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:04.057309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.069712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f6018a1-18f0-4e88-afb0-58c5ce4353f1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.840726 Sep 01 05:17:04.075281 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2434/4842] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:17:04.091473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.092580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0cdde0ec-5276-45cd-8794-4962ab654a79 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1270 microversion: 2.1 time: 0.440771 Sep 01 05:17:04.095317 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2409/4843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:03 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1270 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:04.095928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.111630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfa95afa-b848-4e5d-8d13-7eb5c90c4b7d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:04.114025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.115016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfa95afa-b848-4e5d-8d13-7eb5c90c4b7d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:04.116033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.116648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.119086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:04.120475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:04.123201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:04.436074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfa95afa-b848-4e5d-8d13-7eb5c90c4b7d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.444521 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfa95afa-b848-4e5d-8d13-7eb5c90c4b7d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1213 microversion: 2.1 time: 0.347323 Sep 01 05:17:04.445114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2410/4844] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1213 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:04.448355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:04.484344 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cb73a8b-f268-4bed-8c3b-b02308fdaefb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1274 microversion: 2.1 time: 0.404520 Sep 01 05:17:04.487043 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2435/4845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:04 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1274 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:05.116746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:05.117362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:05.133816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.135195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.135810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.137871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.140424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.141075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.464793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:05.466074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:05.482646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.483552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.484335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.485797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.486602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.487300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.728373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.742068 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be775bca-b97f-45ba-9bee-1ad53cb15be5 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1265 microversion: 2.1 time: 0.281320 Sep 01 05:17:05.742685 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2436/4846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:05 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:05.755554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:05.756185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:05.769389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.769891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.770334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.771088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:05.776864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:05.777376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:05.920717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:05.943115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b867eaeb-2b18-4a43-a31f-06c49f6a61e4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.828350 Sep 01 05:17:05.944573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2411/4847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:05 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:06.221784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.240012 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c385b6a-0ff0-4238-8cfb-47ec5a7775ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.496130 Sep 01 05:17:06.240624 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2437/4848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:05 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:06.768602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.769219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.776700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.777742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.778409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.779364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.780014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.780627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.859956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:06.873885 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-222336b8-d23a-488d-8fa3-5a8846d8ac33 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1271 microversion: 2.1 time: 0.109294 Sep 01 05:17:06.875453 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2412/4849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:06.969777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:06.970382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:06.980619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.981605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.982560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:06.983586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:06.984553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:06.985222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.262289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.263154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.286573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.287725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.288413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.289421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.292539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.293417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.505203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.523009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8130975-e841-4b2e-ab6e-e02786d7d6d0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.557614 Sep 01 05:17:07.523616 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2438/4850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:06 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:07.529429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1e3beb9c-a737-4fe1-9b3d-1005b13b1e33 req-cb9c2869-e5b0-4b55-9b85-8703eda45d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:07.552758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e3beb9c-a737-4fe1-9b3d-1005b13b1e33 req-cb9c2869-e5b0-4b55-9b85-8703eda45d6e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.553485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e3beb9c-a737-4fe1-9b3d-1005b13b1e33 req-cb9c2869-e5b0-4b55-9b85-8703eda45d6e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.554062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1e3beb9c-a737-4fe1-9b3d-1005b13b1e33 req-cb9c2869-e5b0-4b55-9b85-8703eda45d6e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.587117 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1e3beb9c-a737-4fe1-9b3d-1005b13b1e33 req-cb9c2869-e5b0-4b55-9b85-8703eda45d6e service nova] Creating event network-changed:66718261-856b-44ca-8215-e6047bec2d10 for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 on n-h2-820368-37 Sep 01 05:17:07.604361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1e3beb9c-a737-4fe1-9b3d-1005b13b1e33 req-cb9c2869-e5b0-4b55-9b85-8703eda45d6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079282 Sep 01 05:17:07.606123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2439/4851] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:07.851740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:07.882652 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4ff18b9-0fb4-4fa8-a806-5f0aae19859c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.626189 Sep 01 05:17:07.900191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:07.901480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:07.901622 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2413/4852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:07.914126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.914633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.915130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:07.915828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:07.919581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:07.923042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.123355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.142214 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c87c46f-4b98-4bab-aa94-5ad743fe2468 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1271 microversion: 2.1 time: 0.247775 Sep 01 05:17:08.145476 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2440/4853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:07 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:08.348914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4d2da03b-7654-4300-af39-cdb837cf859b req-3b32a9f6-82f0-4501-aa2d-800245a4948f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24bcb7c-5471-4635-8e8e-803eaeda1525", "tag": "9f8e8093-237a-4562-a28e-14236720d894"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:08.369590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4d2da03b-7654-4300-af39-cdb837cf859b req-3b32a9f6-82f0-4501-aa2d-800245a4948f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.372954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4d2da03b-7654-4300-af39-cdb837cf859b req-3b32a9f6-82f0-4501-aa2d-800245a4948f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.373484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4d2da03b-7654-4300-af39-cdb837cf859b req-3b32a9f6-82f0-4501-aa2d-800245a4948f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.405560 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4d2da03b-7654-4300-af39-cdb837cf859b req-3b32a9f6-82f0-4501-aa2d-800245a4948f service nova] Creating event network-changed:9f8e8093-237a-4562-a28e-14236720d894 for instance c24bcb7c-5471-4635-8e8e-803eaeda1525 on n-h1-820368-37 Sep 01 05:17:08.418989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4d2da03b-7654-4300-af39-cdb837cf859b req-3b32a9f6-82f0-4501-aa2d-800245a4948f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073922 Sep 01 05:17:08.422294 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2414/4854] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:08.546110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:08.547223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.555330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.556066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.556654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.559048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.560147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.560824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.871227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:08.882387 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e322a48-b44f-4d62-a0e0-14998a86e840 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.341915 Sep 01 05:17:08.902776 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2441/4855] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:08 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:08.917654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:08.918457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:08.931737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.933598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.937068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:08.938112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:08.938800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:08.939587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.130534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.165777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:09.166569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.191034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.191706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.192394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.193226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.197033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.198204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.421168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:09.436540 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e8e9d44-b008-4d7e-81ad-1c293a432691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.527513 Sep 01 05:17:09.438427 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2415/4856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:08 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:09.573089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:09.585346 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ae80e77-beeb-49f1-bd87-d5f100b4a5d1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.423503 Sep 01 05:17:09.588562 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2442/4857] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:09 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:09.910436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:09.911732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:09.933023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.935455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.941996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:09.943341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:09.944125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:09.944916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.396770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:10.407587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75bd0902-9393-4d6b-8196-a3981fa3a2ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.506540 Sep 01 05:17:10.416607 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2416/4858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:09 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:10.458936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.460065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.478470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.485120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.487319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.491936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.493415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.495042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.623014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:10.624379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:10.637208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.643945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.644924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:10.645832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:10.646449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:10.647060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.363639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.386472 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68ae1a9d-3773-4e32-90b5-4965967d0b01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.931476 Sep 01 05:17:11.388796 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2443/4859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:10 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:11.399231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.415982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4494d23-ecdd-4474-bb0d-33695e63b5c0 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.794457 Sep 01 05:17:11.418837 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2417/4860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:10 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:11.440569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:11.442641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:11.462985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.463656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.463904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.464864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:11.465689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:11.466284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:11.888130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:11.900791 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc69a399-9c96-4227-bc1f-d2de4915cab1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.466846 Sep 01 05:17:11.901671 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2444/4861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:11 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:12.409243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.410214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.419321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.420021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.420522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.421323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.421900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.423365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.447996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.449233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.458345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.459455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.460129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.461291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.461953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.463220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.829126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.836132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:12.839596 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66d09389-1008-43b9-bdb7-22bb9151153f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.434736 Sep 01 05:17:12.840511 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2418/4862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:12.846218 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81633efb-6e09-428b-898e-101d2fadb827 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.406173 Sep 01 05:17:12.854145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2445/4863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:12.922998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:12.924026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:12.931236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.932059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.932966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:12.933977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:12.934652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:12.935383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.148417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d480a612-cb7a-4ffd-9927-01aaa887f115 req-a4bc60f7-0af1-4535-89e8-4b64b8cacb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56411a7-7026-48f9-a94b-2e890ecfd34a", "tag": "71a140df-8761-4037-b6aa-1f59d1afa6bb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:13.168505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d480a612-cb7a-4ffd-9927-01aaa887f115 req-a4bc60f7-0af1-4535-89e8-4b64b8cacb67 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.169000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d480a612-cb7a-4ffd-9927-01aaa887f115 req-a4bc60f7-0af1-4535-89e8-4b64b8cacb67 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.169441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d480a612-cb7a-4ffd-9927-01aaa887f115 req-a4bc60f7-0af1-4535-89e8-4b64b8cacb67 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.200616 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d480a612-cb7a-4ffd-9927-01aaa887f115 req-a4bc60f7-0af1-4535-89e8-4b64b8cacb67 service nova] Creating event network-changed:71a140df-8761-4037-b6aa-1f59d1afa6bb for instance a56411a7-7026-48f9-a94b-2e890ecfd34a on n-h2-820368-37 Sep 01 05:17:13.216038 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d480a612-cb7a-4ffd-9927-01aaa887f115 req-a4bc60f7-0af1-4535-89e8-4b64b8cacb67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070050 Sep 01 05:17:13.217809 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2446/4864] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:13.498375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:13.513071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd388161-83fd-40ff-9a6e-a5567227639b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.594150 Sep 01 05:17:13.514047 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2419/4865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:12 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:13.862634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.868859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:13.869717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.874487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:13.890708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:13.891125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.891857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.893778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.897047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.899050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.899696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.900375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.900719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.902742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:13.903929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:13.904669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:13.905373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.028335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=46 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.406479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.414212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.424524 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e088212-4c20-44b8-9342-a7fb44901d54 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.566808 Sep 01 05:17:14.425135 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2447/4866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:14.442051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d640558-0dbe-43f1-a7d2-5ecec7e618cb tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.577370 Sep 01 05:17:14.445490 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2420/4867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:13 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:14.535508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:14.536136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:14.549199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.549701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.550139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.556272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:14.556805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:14.557247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:14.913867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:14.931343 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61217d76-ea14-43c0-941a-7ed21c0e5de1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.398143 Sep 01 05:17:14.932364 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2448/4868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:14 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:15.319159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-621c6a94-6339-4e67-b8f4-4872a863e824 req-8f9ff38b-eaf7-4653-94f4-ad17aba47276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "name": "network-vif-plugged", "status": "completed", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:15.324670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=26 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.337377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-621c6a94-6339-4e67-b8f4-4872a863e824 req-8f9ff38b-eaf7-4653-94f4-ad17aba47276 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.337849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-621c6a94-6339-4e67-b8f4-4872a863e824 req-8f9ff38b-eaf7-4653-94f4-ad17aba47276 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.338270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-621c6a94-6339-4e67-b8f4-4872a863e824 req-8f9ff38b-eaf7-4653-94f4-ad17aba47276 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.356276 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-621c6a94-6339-4e67-b8f4-4872a863e824 req-8f9ff38b-eaf7-4653-94f4-ad17aba47276 service nova] Creating event network-vif-plugged:66718261-856b-44ca-8215-e6047bec2d10 for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 on n-h2-820368-37 Sep 01 05:17:15.366077 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-621c6a94-6339-4e67-b8f4-4872a863e824 req-8f9ff38b-eaf7-4653-94f4-ad17aba47276 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050768 Sep 01 05:17:15.368635 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2421/4869] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:15.448156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.449034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.459550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.459996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.465916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.467196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.467830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.468410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.479883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.480691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.506602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.507224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.510117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.513305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.513827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.522611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.872725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:15.884588 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bac3c6b-32db-496b-aee2-ba3f4f607174 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.442847 Sep 01 05:17:15.899963 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2449/4870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:15.931313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:15.945380 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-458ab7c6-12b5-4524-b5df-a040d5049609 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.477646 Sep 01 05:17:15.945981 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2422/4871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:15.962937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:15.964273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:15.980929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.981466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.981866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:15.982791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:15.983267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:15.984016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.441978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:16.458689 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e42ea41-214c-4de9-a0f9-968a7f695c5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.499591 Sep 01 05:17:16.459700 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2450/4872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:15 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:16.912642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:16.916853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:16.929681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.930689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.932325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.935014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.937786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.938419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.974211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:16.974817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:16.991025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:16.993198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.993964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.994911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:16.996304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:16.998110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:16.998771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.300142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.320638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3bf7920-a1fe-470e-b080-2621725d36d1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1316 microversion: 2.1 time: 0.413690 Sep 01 05:17:17.323214 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2423/4873] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:16 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:17.342057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.352140 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d36de5b-4ae6-4b0c-936a-6544244b284d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.385499 Sep 01 05:17:17.353761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2451/4874] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:16 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:17.423983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b0f99dca-aa0e-4ec3-85ae-01f6d59dc342 req-45b0f4a8-dcd3-4e5a-a524-53cf36da864c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24bcb7c-5471-4635-8e8e-803eaeda1525", "name": "network-vif-plugged", "status": "completed", "tag": "9f8e8093-237a-4562-a28e-14236720d894"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:17.442670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b0f99dca-aa0e-4ec3-85ae-01f6d59dc342 req-45b0f4a8-dcd3-4e5a-a524-53cf36da864c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.443608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b0f99dca-aa0e-4ec3-85ae-01f6d59dc342 req-45b0f4a8-dcd3-4e5a-a524-53cf36da864c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.444049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b0f99dca-aa0e-4ec3-85ae-01f6d59dc342 req-45b0f4a8-dcd3-4e5a-a524-53cf36da864c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.461092 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b0f99dca-aa0e-4ec3-85ae-01f6d59dc342 req-45b0f4a8-dcd3-4e5a-a524-53cf36da864c service nova] Creating event network-vif-plugged:9f8e8093-237a-4562-a28e-14236720d894 for instance c24bcb7c-5471-4635-8e8e-803eaeda1525 on n-h1-820368-37 Sep 01 05:17:17.468532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b0f99dca-aa0e-4ec3-85ae-01f6d59dc342 req-45b0f4a8-dcd3-4e5a-a524-53cf36da864c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048239 Sep 01 05:17:17.470916 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2424/4875] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:17.482109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:17.482738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:17.493777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.494248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.496073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.497030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:17.497507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:17.501916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:17.736219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:17.739702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:17.757215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d837bf0-ae24-4941-a14f-72808feaaeb8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.280213 Sep 01 05:17:17.757992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2452/4876] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:17 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:18.349718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:18.352442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:18.360210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.360704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.361505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.362207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.362874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.363538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.379311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:18.380250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:18.384088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:18.397148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.397971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.398481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.400919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.401906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.403083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.699255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.715824 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-febdaeb3-c2e5-4df5-8a61-f39cd7c13483 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.375154 Sep 01 05:17:18.726916 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2425/4877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:18 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:18.767653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:18.780814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:18.782647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:18.806496 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5d950bc-a37a-4878-93d5-51c3ce8cf08b tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.428513 Sep 01 05:17:18.810582 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2453/4878] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:18 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:18.810778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.812910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.813590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.815492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:18.815987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:18.817972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:18.974176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606826794", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:19.101379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:19.114474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] validate_networks() for [('2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:17:19.116061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-922ca0b8-36e0-46bf-9deb-a58a4a2b35d8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1312 microversion: 2.1 time: 0.338877 Sep 01 05:17:19.130616 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2426/4879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:18 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:19.659354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:17:19.660197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:17:19.660832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:17:19.661253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:17:19.661674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:17:19.673162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.673892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.674332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.675313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.675921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.676562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.698290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Getting quotas for project 355f1c34d8614151af17b7ad3f2c76d5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:19.705571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Getting quotas for user dd0445362d3641cebea6f5cefc8ac7ef and project 355f1c34d8614151af17b7ad3f2c76d5. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:19.721883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:17:19.725484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:17:19.783665 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67b16f5e-36cf-4d08-8b76-545741d2d350 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815346 Sep 01 05:17:19.786027 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2454/4880] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:17:19.798879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-096c2e2f-87cf-4a66-a696-f26fa4787115 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:19.799541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-096c2e2f-87cf-4a66-a696-f26fa4787115 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:19.847292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:19.848073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:19.864691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.865187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.865622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.866957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:19.867454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:19.869048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:19.927586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-096c2e2f-87cf-4a66-a696-f26fa4787115 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:19.951948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-096c2e2f-87cf-4a66-a696-f26fa4787115 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1216 microversion: 2.1 time: 0.157513 Sep 01 05:17:19.971119 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2427/4881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:19 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:20.139345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:20.139514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:20.140136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:20.152846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.153452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.153996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:20.155050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.155618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.156273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:20.169661 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a88d7221-6959-43b7-a95b-65787e8343c2 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.327705 Sep 01 05:17:20.171428 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2455/4882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:19 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:20.703462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-cc900dd2-740f-4ffe-9723-8b70814ce1a4 req-8b994ba3-e3cf-4860-8f18-25ee211a546b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56411a7-7026-48f9-a94b-2e890ecfd34a", "name": "network-vif-plugged", "status": "completed", "tag": "71a140df-8761-4037-b6aa-1f59d1afa6bb"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:20.729486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc900dd2-740f-4ffe-9723-8b70814ce1a4 req-8b994ba3-e3cf-4860-8f18-25ee211a546b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.734849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc900dd2-740f-4ffe-9723-8b70814ce1a4 req-8b994ba3-e3cf-4860-8f18-25ee211a546b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.735785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-cc900dd2-740f-4ffe-9723-8b70814ce1a4 req-8b994ba3-e3cf-4860-8f18-25ee211a546b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:20.769599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-cc900dd2-740f-4ffe-9723-8b70814ce1a4 req-8b994ba3-e3cf-4860-8f18-25ee211a546b service nova] Creating event network-vif-plugged:71a140df-8761-4037-b6aa-1f59d1afa6bb for instance a56411a7-7026-48f9-a94b-2e890ecfd34a on n-h2-820368-37 Sep 01 05:17:20.778203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-cc900dd2-740f-4ffe-9723-8b70814ce1a4 req-8b994ba3-e3cf-4860-8f18-25ee211a546b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086741 Sep 01 05:17:20.830237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:20.835383 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2456/4883] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:20.844004 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07d57fc5-c5f4-4374-bd54-765cbf474546 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1500 microversion: 2.1 time: 0.710493 Sep 01 05:17:20.845582 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2428/4884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:20 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1500 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:20.868260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e8b5b32-ae43-4af5-83d2-b7a8ba47be71 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:20.876184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8b5b32-ae43-4af5-83d2-b7a8ba47be71 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.876822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8b5b32-ae43-4af5-83d2-b7a8ba47be71 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.877258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e8b5b32-ae43-4af5-83d2-b7a8ba47be71 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:20.952840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e8b5b32-ae43-4af5-83d2-b7a8ba47be71 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:17:20.978801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:20.980672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:20.990105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.991895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:20.992564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:20.993539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:20.994703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:21.021674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:21.077356 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e8b5b32-ae43-4af5-83d2-b7a8ba47be71 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525/action" status: 202 len: 0 microversion: 2.1 time: 0.208060 Sep 01 05:17:21.087649 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2457/4885] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:17:20 2022] POST /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:17:21.110461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:21.112573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:21.127395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:21.127882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:21.128613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:21.129475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:21.130089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:21.130509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:21.202920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:21.219724 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a63423c7-318d-4035-962b-65370bbf22bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1268 microversion: 2.1 time: 0.247473 Sep 01 05:17:21.220722 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2429/4886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:20 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:21.256376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:21.256752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:21.276762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:21.277749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:21.278444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:21.279743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:21.280954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:21.281561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:21.353534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:21.370121 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25d1d442-9e93-4211-a2bc-80cd0f33a382 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.280411 Sep 01 05:17:21.370947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2458/4887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:21 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:21.552653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:21.563882 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b94d31c-947e-4df7-b20f-2e970a8eee01 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.340873 Sep 01 05:17:21.579279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2430/4888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:21 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:22.241760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:22.243184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:22.256851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.257756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.260241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.263988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.264818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.265500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.356895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:22.365477 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-22014fd5-d28c-41ff-8f68-e991a586a557 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1274 microversion: 2.1 time: 0.128124 Sep 01 05:17:22.366081 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2459/4889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:22 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:22.394388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:22.395665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:22.404029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.404867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.405309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.406190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.406990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.407593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.573960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:22.586319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:22.587129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:22.599572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72320b0c-b355-423e-8bb3-babc9fcd2488 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.210916 Sep 01 05:17:22.601036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2431/4890] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:22 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:22.615115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.615115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.615115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.615115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:22.615115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:22.615115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:22.848010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:22.862720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3895d8d0-f8fb-43b4-9019-945c033ddae1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1313 microversion: 2.1 time: 0.279577 Sep 01 05:17:22.864387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2460/4891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:22 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:23.386976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:23.387454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:23.398750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.399478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.400478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.400749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.401738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.402285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.622575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:23.625222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:23.630466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:23.633827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.634784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.636017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.637314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.638598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.640302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.643993 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0541ed92-ed68-433f-8c56-547faf45a5b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1316 microversion: 2.1 time: 0.260684 Sep 01 05:17:23.645041 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2432/4892] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:23 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:23.839116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5b59a7ea-c136-4505-bc62-df02463ea823 req-8d04d44b-632f-4bda-9514-0ee7c2c53513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30a7154-35d5-4da3-873b-1f7d61133929", "tag": "f8df5c36-3e2c-47a2-bc52-41610623584c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:23.850958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b59a7ea-c136-4505-bc62-df02463ea823 req-8d04d44b-632f-4bda-9514-0ee7c2c53513 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.851771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b59a7ea-c136-4505-bc62-df02463ea823 req-8d04d44b-632f-4bda-9514-0ee7c2c53513 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.852460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b59a7ea-c136-4505-bc62-df02463ea823 req-8d04d44b-632f-4bda-9514-0ee7c2c53513 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.866621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:23.866834 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b59a7ea-c136-4505-bc62-df02463ea823 req-8d04d44b-632f-4bda-9514-0ee7c2c53513 service nova] Creating event network-changed:f8df5c36-3e2c-47a2-bc52-41610623584c for instance a30a7154-35d5-4da3-873b-1f7d61133929 on n-h1-820368-37 Sep 01 05:17:23.872615 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5b59a7ea-c136-4505-bc62-df02463ea823 req-8d04d44b-632f-4bda-9514-0ee7c2c53513 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040693 Sep 01 05:17:23.873393 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2433/4893] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:23.878356 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-275c4655-c162-49f9-9c1d-56ef4c6e7460 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.260433 Sep 01 05:17:23.887923 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2461/4894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:23 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:23.888150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:23.888150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:23.905726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.906232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.906666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:23.907469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:23.908164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:23.908806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.070679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:24.079598 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d54e70a-05e0-4b5b-9141-d78952519888 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1498 microversion: 2.1 time: 0.197858 Sep 01 05:17:24.080105 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2434/4895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:23 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:24.100154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-958ee0a2-4aac-478d-b545-d9af34c9543c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:24.115406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-958ee0a2-4aac-478d-b545-d9af34c9543c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Querying cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) for 1 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 01 05:17:24.116131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958ee0a2-4aac-478d-b545-d9af34c9543c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.116632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958ee0a2-4aac-478d-b545-d9af34c9543c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.117088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958ee0a2-4aac-478d-b545-d9af34c9543c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.134394 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-958ee0a2-4aac-478d-b545-d9af34c9543c tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/66702092-52f5-432b-b00e-ba694e547e78" status: 200 len: 221 microversion: 2.1 time: 0.038295 Sep 01 05:17:24.135359 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2462/4896] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:17:24 2022] GET /compute/v2.1/os-server-groups/66702092-52f5-432b-b00e-ba694e547e78 => generated 221 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:24.146186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:24.146763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:24.153867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.154599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.158274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.159157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.160267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.160709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.191979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:17:24.304991 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d66fbbd6-2937-4b40-a20b-fbc4e8d07116 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 204 len: 0 microversion: 2.1 time: 0.162535 Sep 01 05:17:24.310970 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2435/4897] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:17:24 2022] DELETE /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:24.317977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:24.319179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:24.333826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.337103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.337103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.337103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.337103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.337103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.501030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:24.509684 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e469fcc-5412-498d-9ea2-1ecd2977edef tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1504 microversion: 2.1 time: 0.197662 Sep 01 05:17:24.510298 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2463/4898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:24 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:24.668207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:24.669795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:24.677747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.678239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.678651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.679554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.680005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.680430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.851048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:24.862687 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed82e4c1-1250-4348-946f-81a5fbf42913 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1316 microversion: 2.1 time: 0.199563 Sep 01 05:17:24.863400 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2436/4899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:24 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:24.901681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:24.902841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:24.911332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.912048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.912856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:24.913960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:24.914602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:24.915322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:25.133310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:25.145973 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-477cd68d-2929-4d9c-9426-c4ca10ed31e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.248151 Sep 01 05:17:25.146571 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2464/4900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:24 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:25.533037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:25.534045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:25.541780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:25.542429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:25.542993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:25.544100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:25.544662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:25.545295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:25.751055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:25.759966 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-033afac0-38ad-4cc4-aa53-0c06fa38bd90 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1504 microversion: 2.1 time: 0.230955 Sep 01 05:17:25.760568 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2437/4901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:25 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:25.885492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:25.886652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:25.894258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:25.895109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:25.895913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:25.896826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:25.897467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:25.898093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.130869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:26.150406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9ebc1ea-2298-4133-96f8-8ecca7be5eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1316 microversion: 2.1 time: 0.269422 Sep 01 05:17:26.154671 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2465/4902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:25 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:26.169226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:26.169847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:26.180262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.181109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.181724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.182981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.184355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.185019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.486086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:26.512332 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b09ca80-a96b-4666-a007-01e717ea8042 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.347322 Sep 01 05:17:26.513185 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2438/4903] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:26 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:26.781583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:26.782201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:26.789257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.790027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.790770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.791709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.792362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.792944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.905043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba01f2d2e284e11801f61bd0ea24fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ccd11ead4043399b517f1e72ea9433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:26.916290 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c97887a4-188e-4930-8d3f-bf120148eda1 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 200 len: 1462 microversion: 2.1 time: 0.138242 Sep 01 05:17:26.919308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2466/4904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:26 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 1462 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:26.955906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1872b371-659b-44fd-b206-23f3e7e54059 req-0117a70b-5c36-45c8-9547-4eed93914ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56411a7-7026-48f9-a94b-2e890ecfd34a", "name": "network-vif-deleted", "tag": "71a140df-8761-4037-b6aa-1f59d1afa6bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:26.972885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1872b371-659b-44fd-b206-23f3e7e54059 req-0117a70b-5c36-45c8-9547-4eed93914ec1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:26.973739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1872b371-659b-44fd-b206-23f3e7e54059 req-0117a70b-5c36-45c8-9547-4eed93914ec1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:26.974400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1872b371-659b-44fd-b206-23f3e7e54059 req-0117a70b-5c36-45c8-9547-4eed93914ec1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:26.989213 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1872b371-659b-44fd-b206-23f3e7e54059 req-0117a70b-5c36-45c8-9547-4eed93914ec1 service nova] Creating event network-vif-deleted:71a140df-8761-4037-b6aa-1f59d1afa6bb for instance a56411a7-7026-48f9-a94b-2e890ecfd34a on n-h2-820368-37 Sep 01 05:17:27.011603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1872b371-659b-44fd-b206-23f3e7e54059 req-0117a70b-5c36-45c8-9547-4eed93914ec1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059612 Sep 01 05:17:27.018291 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2439/4905] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:27.176722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:27.177655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:27.196585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:27.197623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:27.199231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.200744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:27.201811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:27.203157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.437889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:27.460193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dca97e51-c1f9-42a5-b1d7-1b73286a0471 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1316 microversion: 2.1 time: 0.288903 Sep 01 05:17:27.460949 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2467/4906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:27 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:27.538638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:27.540030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:27.549104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:27.549767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:27.550355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.551199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:27.551562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:27.551993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.860673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:27.870194 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e891d4a1-acd3-4170-a9a9-aaf262fd226d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.336822 Sep 01 05:17:27.875065 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2440/4907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:27 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:27.944853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:27.945473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:27.952418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:27.952977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:27.954101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.955024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:27.955509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:27.955939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:27.972327 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a HTTP/1.1 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a56411a7-7026-48f9-a94b-2e890ecfd34a'} Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:27.975296 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:27.979816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:27.981033 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31b9af18-18e8-4aec-a4ad-c31ca8939a44 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 404 len: 111 microversion: 2.1 time: 0.040057 Sep 01 05:17:27.981636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2468/4908] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:27 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:27.992283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ddd6e2a0-f61a-475e-8ba0-9f356afe6570 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.010433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_groups [None req-ddd6e2a0-f61a-475e-8ba0-9f356afe6570 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Querying cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) for 1 instances {{(pid=128863) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 01 05:17:28.011274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd6e2a0-f61a-475e-8ba0-9f356afe6570 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.011753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd6e2a0-f61a-475e-8ba0-9f356afe6570 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.012188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd6e2a0-f61a-475e-8ba0-9f356afe6570 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.022869 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ddd6e2a0-f61a-475e-8ba0-9f356afe6570 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034269 Sep 01 05:17:28.023517 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2441/4909] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:17:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:28.036196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82dd5883-f042-49b8-a635-9c88240737ba tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.050642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_groups [None req-82dd5883-f042-49b8-a635-9c88240737ba tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Querying cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) for 1 instances {{(pid=128862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 01 05:17:28.051569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82dd5883-f042-49b8-a635-9c88240737ba tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.052061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82dd5883-f042-49b8-a635-9c88240737ba tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.052523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82dd5883-f042-49b8-a635-9c88240737ba tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.063551 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82dd5883-f042-49b8-a635-9c88240737ba tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/66702092-52f5-432b-b00e-ba694e547e78" status: 200 len: 183 microversion: 2.1 time: 0.031534 Sep 01 05:17:28.064133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2469/4910] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:17:28 2022] GET /compute/v2.1/os-server-groups/66702092-52f5-432b-b00e-ba694e547e78 => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:28.075609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.076098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:28.082239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.082728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.083242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.083938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.084392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.084815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.098634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a HTTP/1.1 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a56411a7-7026-48f9-a94b-2e890ecfd34a'} Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:28.100334 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c59223db-bca8-40d7-9030-e77082c21bc7 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 404 len: 111 microversion: 2.1 time: 0.030391 Sep 01 05:17:28.104735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2442/4911] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:17:28 2022] DELETE /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:28.110826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.111466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] [instance: a56411a7-7026-48f9-a94b-2e890ecfd34a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:28.121069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.121561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.122030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.122753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.123388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.123808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.140638 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a HTTP/1.1 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a56411a7-7026-48f9-a94b-2e890ecfd34a'} Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.142172 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. Sep 01 05:17:28.145709 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.147431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance a56411a7-7026-48f9-a94b-2e890ecfd34a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:28.148185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07cceb4f-3744-4878-a474-b4eefead6968 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a" status: 404 len: 111 microversion: 2.1 time: 0.041431 Sep 01 05:17:28.148769 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2470/4912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:28 2022] GET /compute/v2.1/servers/a56411a7-7026-48f9-a94b-2e890ecfd34a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:28.158514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb859db-8f7f-4a2c-bdda-51d494c7dab9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.165387 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fcb859db-8f7f-4a2c-bdda-51d494c7dab9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance group 2c00e749-546d-48f0-b2da-b7a944e66dd2 could not be found. Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb859db-8f7f-4a2c-bdda-51d494c7dab9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-server-groups/2c00e749-546d-48f0-b2da-b7a944e66dd2 HTTP/1.1 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance group 2c00e749-546d-48f0-b2da-b7a944e66dd2 could not be found. Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '2c00e749-546d-48f0-b2da-b7a944e66dd2'} Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2c00e749-546d-48f0-b2da-b7a944e66dd2 could not be found. Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2c00e749-546d-48f0-b2da-b7a944e66dd2 could not be found. Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.167218 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2c00e749-546d-48f0-b2da-b7a944e66dd2 could not be found. Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb859db-8f7f-4a2c-bdda-51d494c7dab9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance group 2c00e749-546d-48f0-b2da-b7a944e66dd2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcb859db-8f7f-4a2c-bdda-51d494c7dab9 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/2c00e749-546d-48f0-b2da-b7a944e66dd2" status: 404 len: 117 microversion: 2.1 time: 0.015644 Sep 01 05:17:28.170820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2443/4913] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:28 2022] DELETE /compute/v2.1/os-server-groups/2c00e749-546d-48f0-b2da-b7a944e66dd2 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:28.178421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b8bd0ab-222f-4ee7-a71e-80b9a216e448 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.185232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8b8bd0ab-222f-4ee7-a71e-80b9a216e448 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance group b4d027bc-3e94-4a2b-9537-c624a4e88035 could not be found. Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b8bd0ab-222f-4ee7-a71e-80b9a216e448 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-server-groups/b4d027bc-3e94-4a2b-9537-c624a4e88035 HTTP/1.1 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance group b4d027bc-3e94-4a2b-9537-c624a4e88035 could not be found. Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b4d027bc-3e94-4a2b-9537-c624a4e88035'} Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b4d027bc-3e94-4a2b-9537-c624a4e88035 could not be found. Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b4d027bc-3e94-4a2b-9537-c624a4e88035 could not be found. Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.187397 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b4d027bc-3e94-4a2b-9537-c624a4e88035 could not be found. Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b8bd0ab-222f-4ee7-a71e-80b9a216e448 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance group b4d027bc-3e94-4a2b-9537-c624a4e88035 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b8bd0ab-222f-4ee7-a71e-80b9a216e448 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/b4d027bc-3e94-4a2b-9537-c624a4e88035" status: 404 len: 117 microversion: 2.1 time: 0.014774 Sep 01 05:17:28.191183 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2471/4914] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:28 2022] DELETE /compute/v2.1/os-server-groups/b4d027bc-3e94-4a2b-9537-c624a4e88035 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:28.197555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7386a67e-543e-4516-b97c-aef40f8f563d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.203674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:28.209881 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7386a67e-543e-4516-b97c-aef40f8f563d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance group 777767c8-2223-46f5-ae66-d5d94dae5425 could not be found. Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7386a67e-543e-4516-b97c-aef40f8f563d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-server-groups/777767c8-2223-46f5-ae66-d5d94dae5425 HTTP/1.1 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance group 777767c8-2223-46f5-ae66-d5d94dae5425 could not be found. Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '777767c8-2223-46f5-ae66-d5d94dae5425'} Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 777767c8-2223-46f5-ae66-d5d94dae5425 could not be found. Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 777767c8-2223-46f5-ae66-d5d94dae5425 could not be found. Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.211939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 777767c8-2223-46f5-ae66-d5d94dae5425 could not be found. Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7386a67e-543e-4516-b97c-aef40f8f563d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance group 777767c8-2223-46f5-ae66-d5d94dae5425 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7386a67e-543e-4516-b97c-aef40f8f563d tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/777767c8-2223-46f5-ae66-d5d94dae5425" status: 404 len: 117 microversion: 2.1 time: 0.019754 Sep 01 05:17:28.216349 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2444/4915] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:28 2022] DELETE /compute/v2.1/os-server-groups/777767c8-2223-46f5-ae66-d5d94dae5425 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:28.223548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d5dbdd-cb76-4fef-85e6-bf8d570e7941 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.232431 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-01d5dbdd-cb76-4fef-85e6-bf8d570e7941 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] HTTP exception thrown: Instance group 7e082b5f-24ef-4951-b70c-1b30e1e5ef0f could not be found. Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d5dbdd-cb76-4fef-85e6-bf8d570e7941 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Request method failure captured: Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-server-groups/7e082b5f-24ef-4951-b70c-1b30e1e5ef0f HTTP/1.1 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBHzpQz5JXVCyU2xRMEPLJADuUeBJCsII_aQn2kReeIGGt1k-JCU-YBJYehEukqBAs1Sj-7tnCTLgbTghosnfqwsjqHSs2wmu4V09MUVVP9htAXQAnNHqtu4FJNkGXGeHeawtG6_YNgd5fUy6GEnQ8-vsNYGwIl9q-OQQNDqOzGzvs Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/97ccd11ead4043399b517f1e72ea9433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 97ccd11ead4043399b517f1e72ea9433 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerGroupTestJSON-1347280654 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 9ba01f2d2e284e11801f61bd0ea24fd2 Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerGroupTestJSON-1347280654-project Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance group 7e082b5f-24ef-4951-b70c-1b30e1e5ef0f could not be found. Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7e082b5f-24ef-4951-b70c-1b30e1e5ef0f'} Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7e082b5f-24ef-4951-b70c-1b30e1e5ef0f could not be found. Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7e082b5f-24ef-4951-b70c-1b30e1e5ef0f could not be found. Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.234106 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7e082b5f-24ef-4951-b70c-1b30e1e5ef0f could not be found. Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01d5dbdd-cb76-4fef-85e6-bf8d570e7941 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Returning 404 to user: Instance group 7e082b5f-24ef-4951-b70c-1b30e1e5ef0f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01d5dbdd-cb76-4fef-85e6-bf8d570e7941 tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7e082b5f-24ef-4951-b70c-1b30e1e5ef0f" status: 404 len: 117 microversion: 2.1 time: 0.016462 Sep 01 05:17:28.238045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2472/4916] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:28 2022] DELETE /compute/v2.1/os-server-groups/7e082b5f-24ef-4951-b70c-1b30e1e5ef0f => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:28.245466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e213b871-5b5e-447e-9794-6046ccb09cce tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.282288 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e213b871-5b5e-447e-9794-6046ccb09cce tempest-ServerGroupTestJSON-1347280654 tempest-ServerGroupTestJSON-1347280654-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/66702092-52f5-432b-b00e-ba694e547e78" status: 204 len: 0 microversion: 2.1 time: 0.041532 Sep 01 05:17:28.282894 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2445/4917] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:17:28 2022] DELETE /compute/v2.1/os-server-groups/66702092-52f5-432b-b00e-ba694e547e78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:28.483710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.484454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:28.492499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.493085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.493637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.494435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.495402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.496052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.639719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:28.648212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-878d2700-ed46-4844-a282-975d39290472 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1316 microversion: 2.1 time: 0.169944 Sep 01 05:17:28.648892 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2473/4918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:28 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:28.894225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:28.895466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:28.905298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.905909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.906415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:28.907254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:28.907787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:28.908276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:29.151111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:29.159406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e2e6484-2eec-4256-a634-624a0025acee tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.271201 Sep 01 05:17:29.160391 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2446/4919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:28 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:29.221980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0a6e20db-9f0f-4122-9056-e6ff7e6c76b2 req-94781354-3d38-4168-bf2f-5967df289571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30a7154-35d5-4da3-873b-1f7d61133929", "name": "network-vif-plugged", "status": "completed", "tag": "f8df5c36-3e2c-47a2-bc52-41610623584c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:29.247413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a6e20db-9f0f-4122-9056-e6ff7e6c76b2 req-94781354-3d38-4168-bf2f-5967df289571 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:29.248264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a6e20db-9f0f-4122-9056-e6ff7e6c76b2 req-94781354-3d38-4168-bf2f-5967df289571 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:29.248771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a6e20db-9f0f-4122-9056-e6ff7e6c76b2 req-94781354-3d38-4168-bf2f-5967df289571 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:29.267165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.274825 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0a6e20db-9f0f-4122-9056-e6ff7e6c76b2 req-94781354-3d38-4168-bf2f-5967df289571 service nova] Creating event network-vif-plugged:f8df5c36-3e2c-47a2-bc52-41610623584c for instance a30a7154-35d5-4da3-873b-1f7d61133929 on n-h1-820368-37 Sep 01 05:17:29.283199 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0a6e20db-9f0f-4122-9056-e6ff7e6c76b2 req-94781354-3d38-4168-bf2f-5967df289571 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064845 Sep 01 05:17:29.284426 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2474/4920] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:29.670032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:29.670678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:29.681862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:29.682804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:29.691713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:29.692687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:29.693281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:29.693792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:29.701108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.938630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.957148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:29.978333 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09e36820-0dd1-4de2-9852-b54789df1858 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1316 microversion: 2.1 time: 0.311876 Sep 01 05:17:29.983083 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2447/4921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:29 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:30.179753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:30.181007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:30.185680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:30.187175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:30.205586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:30.206516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:30.207634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:30.208944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:30.209616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:30.210343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:30.380163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:30.389340 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d9935a6-37e5-49fe-afdc-0d0b9f0f2e2c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.210604 Sep 01 05:17:30.390222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2475/4922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:30 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:31.004788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:31.006485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:31.016205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.016703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.017139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.017850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.018320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.018750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.284448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:31.300594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-097e243f-7f7e-490e-a46a-d59ee83ff69e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1504 microversion: 2.1 time: 0.298035 Sep 01 05:17:31.324140 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2448/4923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:30 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1504 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:31.332378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:31.333002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:31.343401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.344037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.344594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.345473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.346032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.346709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.377835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:17:31.411363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:31.412469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:31.419343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.420201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.420842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.421805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.422612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.423279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.518627 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db0041d6-658b-4bfb-b5be-185acd6817b6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 204 len: 0 microversion: 2.1 time: 0.190337 Sep 01 05:17:31.519201 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2476/4924] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:17:31 2022] DELETE /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:31.532324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:31.533857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:31.565279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.571269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.572057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.573429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:31.574795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:31.575441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:31.712753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:31.724232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99141880-34ec-432a-99f5-faa2c4739ab2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.318127 Sep 01 05:17:31.729798 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2449/4925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:31 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:31.820145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:31.829337 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-341e228b-56e6-4d1b-b6bc-99e11e2c15cc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1510 microversion: 2.1 time: 0.304622 Sep 01 05:17:31.832668 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2477/4926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:31 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:32.750440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:32.751246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:32.772881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:32.773373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:32.780605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:32.785656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:32.788263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:32.788594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:32.858063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:32.858738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:32.874226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:32.876595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:32.877872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:32.879948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:32.881520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:32.882137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:33.340493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:33.348924 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6dfe852-97a5-4cd4-9432-3792c0e2a53d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.603044 Sep 01 05:17:33.355361 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2450/4927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:32 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:33.368395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:33.381948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd027441-e730-42cb-ad43-d064f6247474 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1510 microversion: 2.1 time: 0.531601 Sep 01 05:17:33.382570 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2478/4928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:32 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:34.372129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:34.372983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:34.390527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.391067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.405277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:34.406378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.407231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.409670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:34.798703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b4cd416f-4ea2-4075-bf4d-601d38404c4b req-39458d50-6676-43fe-b550-cf9cc3a0d428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30a7154-35d5-4da3-873b-1f7d61133929", "name": "network-vif-deleted", "tag": "f8df5c36-3e2c-47a2-bc52-41610623584c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:34.829444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4cd416f-4ea2-4075-bf4d-601d38404c4b req-39458d50-6676-43fe-b550-cf9cc3a0d428 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.835291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4cd416f-4ea2-4075-bf4d-601d38404c4b req-39458d50-6676-43fe-b550-cf9cc3a0d428 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.837354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4cd416f-4ea2-4075-bf4d-601d38404c4b req-39458d50-6676-43fe-b550-cf9cc3a0d428 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:34.886288 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b4cd416f-4ea2-4075-bf4d-601d38404c4b req-39458d50-6676-43fe-b550-cf9cc3a0d428 service nova] Creating event network-vif-deleted:f8df5c36-3e2c-47a2-bc52-41610623584c for instance a30a7154-35d5-4da3-873b-1f7d61133929 on n-h1-820368-37 Sep 01 05:17:34.909345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b4cd416f-4ea2-4075-bf4d-601d38404c4b req-39458d50-6676-43fe-b550-cf9cc3a0d428 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.753074 Sep 01 05:17:34.910305 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2451/4929] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:34.927198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:34.938232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aee3b3dc-ceb9-4af8-a92f-cecb9faf9d0d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.571039 Sep 01 05:17:34.939972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:34.940796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:34.948474 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2479/4930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:34 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:34.971299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.971817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.972459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:34.973047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:34.973516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:34.973962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:35.064526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:35.065018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:35.065445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:35.069367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lazy-loading 'fault' on Instance uuid a30a7154-35d5-4da3-873b-1f7d61133929 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:17:35.166822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:35.184896 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d3e694e-a3d1-4ed3-aae8-05808de6a049 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 200 len: 1306 microversion: 2.1 time: 0.273308 Sep 01 05:17:35.190419 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2452/4931] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:34 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 1306 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:35.969795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:35.970385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:35.978596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:35.979278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:35.980825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:35.981970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:35.982472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:35.983106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.191252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:36.201213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f09f2394-4ff0-4836-b8dd-ee78004c257f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.235160 Sep 01 05:17:36.201824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2480/4932] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:35 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:36.214922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:36.215540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:36.230020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.230978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.231376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.232287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.232744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.233167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.256223 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 HTTP/1.1 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a30a7154-35d5-4da3-873b-1f7d61133929'} Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:36.258085 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:17:36.262737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.265185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:36.266103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-416e592e-1c66-471a-94b7-2c8baa9062ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 404 len: 111 microversion: 2.1 time: 0.055956 Sep 01 05:17:36.266849 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2453/4933] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:36 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:36.276776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:36.278062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:36.285661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.286167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.287341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.288059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.288508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.289087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.501537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:36.514012 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b80f788e-537e-4817-b922-d0352339fcb2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.241166 Sep 01 05:17:36.515932 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2481/4934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:36 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:36.676813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c710d297-0d68-4519-98ae-83c9613c5c97 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c710d297-0d68-4519-98ae-83c9613c5c97 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 163 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": 12345, "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 12345 Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:36.687469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c710d297-0d68-4519-98ae-83c9613c5c97 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:36.693572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c710d297-0d68-4519-98ae-83c9613c5c97 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011952 Sep 01 05:17:36.695639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:36.696163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:36.699591 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2454/4935] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:36 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:36.705515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.706132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.706558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:36.707169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:36.707736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:36.708043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.222172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:37.222758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:37.232131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:37.232647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:37.233066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.233757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:37.234215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:37.234675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.413652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:37.436323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c81b8981-cbb3-4099-a9fb-9a1a5d782920 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.745634 Sep 01 05:17:37.437610 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2482/4936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:36 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:37.464606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:37.465552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:37.490372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:37.494486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:37.495305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.496312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:37.498233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:37.499407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:37.660659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:37.681411 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f36329c-603e-4e90-b958-654acc34590d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.463119 Sep 01 05:17:37.697292 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2455/4937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:37 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:37.811820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:37.832276 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b655b70c-50b8-4d8a-992d-df71e0348307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.373185 Sep 01 05:17:37.834425 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2483/4938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:37 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:38.701848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:38.702465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:38.714087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:38.714586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:38.715171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:38.715908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:38.716368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:38.719027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:39.084558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:39.093525 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e988cbc-80f1-4095-9c36-eb8b2f94c38b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.395592 Sep 01 05:17:39.094117 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2456/4939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:38 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:40.122522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:40.123311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:40.131974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:40.132482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:40.132998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:40.133713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:40.134412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:40.135278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:40.341815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:40.355022 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2bcc188-2672-4e98-877b-6b5c277625ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.237709 Sep 01 05:17:40.356505 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2484/4940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:40 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:40.914292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fe2499-4a05-4798-9d46-ebba5130feda tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298854491", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "85357566-2167-4b47-872f-96d78fc25f75", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:41.044468 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-11fe2499-4a05-4798-9d46-ebba5130feda tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Block Device 85357566-2167-4b47-872f-96d78fc25f75 is not bootable. Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fe2499-4a05-4798-9d46-ebba5130feda tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 357 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298854491", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "85357566-2167-4b47-872f-96d78fc25f75", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: exception: Block Device 85357566-2167-4b47-872f-96d78fc25f75 is not bootable. Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-298854491', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '85357566-2167-4b47-872f-96d78fc25f75'}], 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 85357566-2167-4b47-872f-96d78fc25f75 is not bootable. Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:41.054764 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 85357566-2167-4b47-872f-96d78fc25f75 is not bootable. Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 85357566-2167-4b47-872f-96d78fc25f75 is not bootable. Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:41.059201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fe2499-4a05-4798-9d46-ebba5130feda tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Block Device 85357566-2167-4b47-872f-96d78fc25f75 is not bootable. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:41.063622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11fe2499-4a05-4798-9d46-ebba5130feda tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.153906 Sep 01 05:17:41.064595 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2457/4941] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:41.075117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:41.076202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:41.094765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.095243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.095651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.096367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.096819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.097244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.290873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:41.301072 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c8ecd31-e3d3-4f9e-aa7b-b15617f772a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.231430 Sep 01 05:17:41.301691 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2485/4942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:41 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:41.323528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:41.324568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:41.331435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.331928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.332359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.333074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.333525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.334136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.378100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:41.378634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:41.388550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.389389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.389836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.390723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:41.391227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:41.391660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:41.674714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:41.685262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:41.686150 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7289e39-2545-4ece-80ed-5940626d0eb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.364543 Sep 01 05:17:41.686796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2458/4943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:41 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:41.707991 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-989d33ae-2148-42c0-89bd-070fdceeffa1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.334525 Sep 01 05:17:41.721009 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2486/4944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:41 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:42.733710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:42.735671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:42.746660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:42.747701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:42.748428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:42.749990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:42.750664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:42.751331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:43.054354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:43.063054 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f5d35db-f2ab-47c9-b7ff-7a1dbfd87ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.333965 Sep 01 05:17:43.065816 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2459/4945] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:42 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:44.092102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:44.093509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:44.116865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.117634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.119308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:44.125127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.125977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.127645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:44.355235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:44.366032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8936ef52-0bcf-4aea-86eb-ef459ab12b00 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.282619 Sep 01 05:17:44.383216 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2487/4946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:44 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:44.609435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ca66a04-eed8-4184-9fd5-cb991451fa42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-199610048", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a6ef865c-7f44-4aad-804f-11f5772882db", "destination_type": "local"}, {"source_type": "volume", "uuid": "7dce7fe2-a7a6-4c11-8f14-4f74785df61e", "destination_type": "invalid"}], "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ca66a04-eed8-4184-9fd5-cb991451fa42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 494 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-199610048", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a6ef865c-7f44-4aad-804f-11f5772882db", "destination_type": "local"}, {"source_type": "volume", "uuid": "7dce7fe2-a7a6-4c11-8f14-4f74785df61e", "destination_type": "invalid"}], "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-199610048', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7dce7fe2-a7a6-4c11-8f14-4f74785df61e', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'invalid' Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:44.616699 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 01 05:17:44.620733 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:44.623311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ca66a04-eed8-4184-9fd5-cb991451fa42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:44.624398 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ca66a04-eed8-4184-9fd5-cb991451fa42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.032327 Sep 01 05:17:44.629745 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2460/4947] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:44 2022] POST /compute/v2.1/servers => generated 155 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:44.635045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:44.636044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:44.645209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.647166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.649383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:44.650219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.651646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.652160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:44.898454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:44.910909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c321fdb9-985e-4c9f-90fe-0c219fb2ceac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.279741 Sep 01 05:17:44.911881 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2488/4948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:44 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:44.936321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:44.937058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:44.940937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:44.946388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.947054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.947455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:44.948496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:44.949071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:44.949596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.144702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1874730856", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "6e47d785-8c8b-41c1-821b-cff00da67111"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:45.145645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:45.149882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:45.156652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c78ce6b3-e02e-4a3a-8346-27f2e8a48db4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.224868 Sep 01 05:17:45.157168 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2489/4949] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:44 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:45.229648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] validate_networks() for [('6e47d785-8c8b-41c1-821b-cff00da67111', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:17:45.360033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec7f2a1a-290b-4b86-a53e-84267f1a3b53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866791504", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec7f2a1a-290b-4b86-a53e-84267f1a3b53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 492 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866791504", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1866791504', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.370144 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec7f2a1a-290b-4b86-a53e-84267f1a3b53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec7f2a1a-290b-4b86-a53e-84267f1a3b53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016922 Sep 01 05:17:45.373377 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2490/4950] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:45 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:17:45.382473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:45.383975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:45.399830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.400407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.400765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.403404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.403918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.404360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.796388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:45.805739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a822341-15c0-402b-8174-40ec3fd2ecf1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.428060 Sep 01 05:17:45.820542 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2491/4951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:45 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:45.833083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:45.833818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:45.841024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.841745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.842278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.843139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.843822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.844345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.974689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:17:45.975476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:17:45.976253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:17:45.976895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:17:45.977549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:17:45.991375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.992548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.993243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:45.995548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:45.997569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:45.998616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.041464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Getting quotas for project f740a68ee34c4622bd9153f8c074644a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:46.042190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.053788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-acf3646d-f16c-4a6d-ba40-d31b6e3fac57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1510 microversion: 2.1 time: 0.231575 Sep 01 05:17:46.053940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Getting quotas for user 8212c4b6be364856831784b8086b099c and project f740a68ee34c4622bd9153f8c074644a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:46.054391 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2492/4952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:45 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:46.071532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:46.072767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:46.077704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:17:46.080736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:17:46.082604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.085014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.087834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.089646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.090258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.091247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.134603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a698fb6-d6a7-4ee3-958c-94f0c350bec4 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.387311 Sep 01 05:17:46.135861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2461/4953] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:17:46.146862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c8269e9-eb1c-4c86-82cf-30f3f6c30a8d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:46.147500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c8269e9-eb1c-4c86-82cf-30f3f6c30a8d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:46.268157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c8269e9-eb1c-4c86-82cf-30f3f6c30a8d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.281769 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c8269e9-eb1c-4c86-82cf-30f3f6c30a8d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1216 microversion: 2.1 time: 0.138818 Sep 01 05:17:46.282710 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2462/4954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:46 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:46.375568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.384864 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef4784b9-0b9a-4818-9b7c-8152512f7f44 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.321277 Sep 01 05:17:46.385489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2493/4955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:46 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:46.593733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-686e1534-bc0b-40c1-9863-d86380c8d358 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-686e1534-bc0b-40c1-9863-d86380c8d358 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 416 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.600790 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:17:46.604012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:46.610432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-686e1534-bc0b-40c1-9863-d86380c8d358 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:46.612676 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-686e1534-bc0b-40c1-9863-d86380c8d358 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.022262 Sep 01 05:17:46.616974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2463/4956] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:46 2022] POST /compute/v2.1/servers => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:46.626834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:46.627580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:46.634551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.641575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.642588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.643845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.645843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.646809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.859304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:46.869655 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53047812-3b57-4eba-a049-b3a7404fe056 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.247306 Sep 01 05:17:46.870637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2494/4957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:46 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:46.896291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:46.897349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:46.910308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.911026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.911514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:46.912825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:46.913400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:46.913834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.082986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:47.084073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.108954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.111672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.112882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.113674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.115706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.116784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.118963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.124926 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9d7fbd3-19c7-4236-a95d-a6467f310a31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.234858 Sep 01 05:17:47.125528 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2464/4958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:46 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:47.236553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2b3bd69-db31-4801-829e-346d23cbe919 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-269454218", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": -1, "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:47.259686 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d2b3bd69-db31-4801-829e-346d23cbe919 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Flavor -1 could not be found. Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2b3bd69-db31-4801-829e-346d23cbe919 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 205 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-269454218", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": -1, "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: exception: Flavor -1 could not be found. Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-269454218', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': -1, 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:47.261798 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 01 05:17:47.265421 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:47.270297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2b3bd69-db31-4801-829e-346d23cbe919 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:47.271621 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2b3bd69-db31-4801-829e-346d23cbe919 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.039496 Sep 01 05:17:47.272767 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2465/4959] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:47 2022] POST /compute/v2.1/servers => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 01 05:17:47.285421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:47.289723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.306920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.308850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.309468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.313290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.317319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.319483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.369692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.388240 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de7465be-50c9-432d-9427-a713d75ca2c3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1487 microversion: 2.1 time: 0.312188 Sep 01 05:17:47.389266 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2495/4960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:47 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1487 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:47.396684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:47.397741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.407173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.407975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.408591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.409467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.410415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.411221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.574765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.585770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-235b988b-0ad7-495c-a928-433f5efdf0cf tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1220 microversion: 2.1 time: 0.195216 Sep 01 05:17:47.591253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2496/4961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:47 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:47.596459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:47.598849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.614477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.615020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.615457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.616176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.616634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.617064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.673688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:47.689160 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68a57e95-ee57-49ef-932a-f571a8c83d3c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.407843 Sep 01 05:17:47.696846 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2466/4962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:47 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:47.710544 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-362b8c05-dffd-4a94-b1b9-46cdea847ce8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 200 len: 120 microversion: 2.1 time: 0.117658 Sep 01 05:17:47.713483 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2497/4963] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:17:47 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 120 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:47.713928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:47.714592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.724059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.724885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.725790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.726535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.727037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.727625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.736199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:47.737748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:47.751619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.752670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.753538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:47.754540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:47.755258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:47.756616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.063893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.077907 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d15564f0-f19f-4b12-956c-e54da7059a66 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.367885 Sep 01 05:17:48.079674 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2467/4964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:47 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:48.118671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.130812 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e957077-dd05-495d-9c44-45d0e14c93a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.409642 Sep 01 05:17:48.146206 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2498/4965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:47 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:48.161046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:48.161690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:48.171094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.175006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.175473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.176231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.176675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.177099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.202188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5a4d728-f647-44a4-962f-67411a89f986 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-690907142", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5a4d728-f647-44a4-962f-67411a89f986 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 172 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-690907142", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-690907142', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi -1 Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:48.211739 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:48.216082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5a4d728-f647-44a4-962f-67411a89f986 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:48.235239 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5a4d728-f647-44a4-962f-67411a89f986 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.033631 Sep 01 05:17:48.236552 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2499/4966] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:48 2022] POST /compute/v2.1/servers => generated 145 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:48.254224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:48.255037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:48.272186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.273276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.275040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.276589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.282401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.283086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.610078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.617743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7388aeb1-237d-4eb0-b702-7bad8af16e0c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.461100 Sep 01 05:17:48.631208 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2468/4967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:48 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:48.631208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:48.631509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:48.648106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.648729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.649159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.650040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.655670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.656525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.752341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.762498 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c19baf8d-6a46-45ec-8ffa-4c3afe0a6094 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.519739 Sep 01 05:17:48.763652 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2500/4968] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:48 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:48.800289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:48.803256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:48.823396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.826443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:48.830969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.837928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.843448 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bd59c13-c000-4f5e-aff3-94b56214a128 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1286 microversion: 2.1 time: 0.212301 Sep 01 05:17:48.844199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.851385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.851855 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2469/4969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:48 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1286 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:48.853202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.858455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:48.873284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:48.897722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.898672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.899535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:48.899871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:48.900331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:48.900754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.229669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.254121 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7bc3c1c3-d256-4e46-af09-503f1409d53a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.489261 Sep 01 05:17:49.256072 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2501/4970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:48 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:49.280265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:49.280999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:49.301499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.302003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.302471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.303467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.303928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.304348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.312569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.344168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdaeaf37-6785-48d8-a493-a166a62d97fb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.479192 Sep 01 05:17:49.360117 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2470/4971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:48 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:49.427454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d12096bc-573e-47a8-8ec9-34156249370b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2143767929", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:49.437589 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d12096bc-573e-47a8-8ec9-34156249370b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d12096bc-573e-47a8-8ec9-34156249370b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 216 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2143767929", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2143767929', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:49.441348 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 01 05:17:49.446018 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:49.447594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d12096bc-573e-47a8-8ec9-34156249370b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:49.448822 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d12096bc-573e-47a8-8ec9-34156249370b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.026236 Sep 01 05:17:49.451489 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2471/4972] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:49 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:17:49.463034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:49.466822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:49.487323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.487892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.488448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.489574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.490245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.490879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.521786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:49.798878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.846107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d78d0a85-e307-477a-9be0-6e67b8935ef0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.570071 Sep 01 05:17:49.848972 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2502/4973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:49 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:49.875540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:49.876504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:49.887377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.887868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.888899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.895935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:49.896510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:49.896957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:49.980088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:49.999330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f114492-6407-4fff-b560-368aad701f31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.540049 Sep 01 05:17:50.002003 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2472/4974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:49 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:50.017227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2028265205", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "dc7e6109-f10c-46fb-98ac-ddd7a9c9df15"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:50.119014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] validate_networks() for [('dc7e6109-f10c-46fb-98ac-ddd7a9c9df15', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:17:50.137107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:50.152858 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c3bb137-3e04-4408-98fa-5d335b904b1d tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1274 microversion: 2.1 time: 0.281351 Sep 01 05:17:50.156577 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2503/4975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:49 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:50.178395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:50.181832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:50.200086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:50.200816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:50.201430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:50.202292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:50.207347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:50.208010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:50.628274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:50.644618 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a5eb73c-1684-41b2-af1e-04d14a653d11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.486267 Sep 01 05:17:50.645517 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2504/4976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:50 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:50.876581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-003b085c-d600-429e-b389-3a21a046fd00 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-523243305", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-key-1801637341", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:50.971785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-003b085c-d600-429e-b389-3a21a046fd00 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] validate_networks() for [('2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:17:51.850405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:17:51.851677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:17:51.852550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:17:51.853531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:17:51.854709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:17:51.871582 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-003b085c-d600-429e-b389-3a21a046fd00 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Invalid key_name provided. Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-003b085c-d600-429e-b389-3a21a046fd00 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 246 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-523243305", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-key-1801637341", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid key_name provided. Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-523243305', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'key_name': 'tempest-key-1801637341', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1801637341 not found for user dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:51.874697 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 01 05:17:51.879562 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:51.881395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:51.881395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:51.881395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:51.882557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:51.882557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:51.884827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:51.885842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-003b085c-d600-429e-b389-3a21a046fd00 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid key_name provided. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:51.893317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-003b085c-d600-429e-b389-3a21a046fd00 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.021616 Sep 01 05:17:51.897669 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2505/4977] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:50 2022] POST /compute/v2.1/servers => generated 70 bytes in 1027 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:51.913905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:51.920578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:51.933558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:17:51.934346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:51.936856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:51.937311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:51.942019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:51.942869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:51.943708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:51.944506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for user 87f4f3bcd603448d856a7471120a42af and project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:17:51.989326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:17:51.997521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:17:52.081031 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30c516c1-5bbc-4945-903e-ca3f5c0e5cca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074937 Sep 01 05:17:52.083506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2473/4978] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:17:52.096268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:52.097252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:52.118547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:52.119092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:52.119532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:52.123195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:52.124024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:52.126912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:52.438503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.452854 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-133fab8e-3e0a-49ac-a594-2e7dda51ac0d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.366760 Sep 01 05:17:52.454671 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2474/4979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:52 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:52.469974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caa9eaf3-dfe7-49ed-b875-412f27bc5160 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:52.469974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-caa9eaf3-dfe7-49ed-b875-412f27bc5160 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:52.566196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-caa9eaf3-dfe7-49ed-b875-412f27bc5160 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.581166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-caa9eaf3-dfe7-49ed-b875-412f27bc5160 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1215 microversion: 2.1 time: 0.125074 Sep 01 05:17:52.599410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2475/4980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:52 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:52.613668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:52.614464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:52.620754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.625241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:52.625976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:52.626358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:52.626847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:52.627351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:52.627752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:52.654127 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b78634b-884f-44b5-97f0-8961457ae805 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.755049 Sep 01 05:17:52.655925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2506/4981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:51 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:52.893523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:52.905940 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-235cdd30-ec32-4cd2-876b-87868e29ef11 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.304758 Sep 01 05:17:52.907321 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2476/4982] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:52 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:53.088460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-45919747-d4b9-4fe3-bb60-4f829aa90da5 req-8861284d-8498-4f3d-967d-2bba17535934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbcfa96-b926-4b38-ad99-9e8471f1a3fb", "tag": "376cf961-1a02-4d96-88b0-a87064aee375"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:53.089481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-661438d0-602b-4629-8c3b-837dcd40db4d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1912443015", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:53.106028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45919747-d4b9-4fe3-bb60-4f829aa90da5 req-8861284d-8498-4f3d-967d-2bba17535934 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.107174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45919747-d4b9-4fe3-bb60-4f829aa90da5 req-8861284d-8498-4f3d-967d-2bba17535934 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.108341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45919747-d4b9-4fe3-bb60-4f829aa90da5 req-8861284d-8498-4f3d-967d-2bba17535934 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.137471 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-45919747-d4b9-4fe3-bb60-4f829aa90da5 req-8861284d-8498-4f3d-967d-2bba17535934 service nova] Creating event network-changed:376cf961-1a02-4d96-88b0-a87064aee375 for instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb on n-h1-820368-37 Sep 01 05:17:53.147529 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-45919747-d4b9-4fe3-bb60-4f829aa90da5 req-8861284d-8498-4f3d-967d-2bba17535934 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063060 Sep 01 05:17:53.149034 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2477/4983] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:17:53.260250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.security_group_api [None req-661438d0-602b-4629-8c3b-837dcd40db4d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Neutron security group does_not_exist not found {{(pid=128862) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 01 05:17:53.262546 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-661438d0-602b-4629-8c3b-837dcd40db4d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-661438d0-602b-4629-8c3b-837dcd40db4d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 258 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1912443015", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1912443015', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 01 05:17:53.281950 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 01 05:17:53.285973 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:53.297958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-661438d0-602b-4629-8c3b-837dcd40db4d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:53.297958 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-661438d0-602b-4629-8c3b-837dcd40db4d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.219003 Sep 01 05:17:53.297958 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2507/4984] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:53 2022] POST /compute/v2.1/servers => generated 106 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:53.311356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:53.312427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:53.318795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:53.324550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.326287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.326972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.328035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.329088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.330193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.604825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:53.605715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:53.612429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.613199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.613802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.614945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.615489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.615925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.619283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:53.634859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cda53e6a-305d-4587-a78c-fdd2d02a8fbd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.331076 Sep 01 05:17:53.646924 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2478/4985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:53 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:53.664004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:53.664710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:53.676663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.677156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.677597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.678379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.678840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.679810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.817813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:53.833789 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e83a860-f4b0-449e-bb78-cb358d3253ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1267 microversion: 2.1 time: 0.231046 Sep 01 05:17:53.834217 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2508/4986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:53 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:53.845282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:53.855283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:53.877396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.878583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.879649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.881210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:53.882242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:53.883235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:53.967459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:53.980619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2215eae6-0943-4992-a526-8ad063cd4d41 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.321077 Sep 01 05:17:53.981722 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2479/4987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:53 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:54.034337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3df7a09-5944-4831-aa14-0e9dce5f5bf9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.035264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3df7a09-5944-4831-aa14-0e9dce5f5bf9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 49f482fb-002d-4b5d-be71-14bf0852dcff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:54.049569 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c3df7a09-5944-4831-aa14-0e9dce5f5bf9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 49f482fb-002d-4b5d-be71-14bf0852dcff could not be found. Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3df7a09-5944-4831-aa14-0e9dce5f5bf9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/49f482fb-002d-4b5d-be71-14bf0852dcff HTTP/1.1 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 49f482fb-002d-4b5d-be71-14bf0852dcff could not be found. Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '49f482fb-002d-4b5d-be71-14bf0852dcff'} Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f482fb-002d-4b5d-be71-14bf0852dcff could not be found. Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f482fb-002d-4b5d-be71-14bf0852dcff could not be found. Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.063907 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f482fb-002d-4b5d-be71-14bf0852dcff could not be found. Sep 01 05:17:54.071847 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.074505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3df7a09-5944-4831-aa14-0e9dce5f5bf9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 49f482fb-002d-4b5d-be71-14bf0852dcff could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:54.080247 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3df7a09-5944-4831-aa14-0e9dce5f5bf9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49f482fb-002d-4b5d-be71-14bf0852dcff" status: 404 len: 111 microversion: 2.1 time: 0.051691 Sep 01 05:17:54.082145 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2480/4988] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:17:54 2022] DELETE /compute/v2.1/servers/49f482fb-002d-4b5d-be71-14bf0852dcff => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:54.102062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.102690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:54.116587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.118470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.118925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.119703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.120363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.121058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.307978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:54.339157 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a1f4e50-bfaf-403c-b3b0-cd8be27202c3 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.494844 Sep 01 05:17:54.340644 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2509/4989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:53 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:54.358745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:54.368833 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5abce811-06b8-45d6-9378-6898d3dc11c8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.280536 Sep 01 05:17:54.369780 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2481/4990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:54 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:54.407765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.409117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:54.423587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.427343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.427854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.428610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.429069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.429611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.627170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:54.630431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:54.639456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-360de9ae-e980-4bf9-8967-c8bd828780bc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.238519 Sep 01 05:17:54.640679 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2510/4991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:54 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:54.678197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39928754-32a4-4198-8bce-0cf6257c1772 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.679379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39928754-32a4-4198-8bce-0cf6257c1772 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 05:17:54.680533 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-39928754-32a4-4198-8bce-0cf6257c1772 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39928754-32a4-4198-8bce-0cf6257c1772 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9223372036854775808 could not be found. Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9223372036854775808'} Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:54.683785 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39928754-32a4-4198-8bce-0cf6257c1772 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:54.687525 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39928754-32a4-4198-8bce-0cf6257c1772 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014821 Sep 01 05:17:54.692125 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2482/4992] 10.222.0.26 () {58 vars in 1188 bytes} [Thu Sep 1 05:17:54 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:17:54.701215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.702857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:54.714293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.715443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.716368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.723071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.724398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.725131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.853720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:54.854828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:54.871022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.871791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.872400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:54.877328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:54.878006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:54.878597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.170245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.186022 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac468dd7-6749-4feb-b701-8e8c9277d54f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.489425 Sep 01 05:17:55.199884 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2511/4993] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:54 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:55.209735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:55.211727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:55.218764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.219665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.220567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.221442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.222050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.222685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.403666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.412714 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c40dc57-491e-4ead-b669-262057870f5b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.562909 Sep 01 05:17:55.417558 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2483/4994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:54 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:55.428550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:55.428550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:55.448745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.449409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.449860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.450589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.451090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.451518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.660204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.676018 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b4be6a6-1e6b-49ea-bc3b-6f8f965ae104 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.470127 Sep 01 05:17:55.676620 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2512/4995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:55 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:55.702956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09c28880-d8c6-427a-95d5-c7583a66c2c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:55.703366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09c28880-d8c6-427a-95d5-c7583a66c2c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Failed to fetch instance by id -1 {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 01 05:17:55.704224 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-09c28880-d8c6-427a-95d5-c7583a66c2c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance -1 could not be found. Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09c28880-d8c6-427a-95d5-c7583a66c2c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance -1 could not be found. Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '-1'} Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:55.706955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09c28880-d8c6-427a-95d5-c7583a66c2c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09c28880-d8c6-427a-95d5-c7583a66c2c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009847 Sep 01 05:17:55.711233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2513/4996] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 1 05:17:55 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:17:55.723493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:55.724381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:55.734750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.735493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.736809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.737881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:55.738622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:55.739359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:55.857969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:55.868236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2cf69e1-678f-44ff-a595-4c8a1d47e108 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.448220 Sep 01 05:17:55.871462 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2484/4997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:55 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:56.134774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9c1605fb-b3da-4335-b1ac-3209d4439e61 req-b04ebc81-d706-4f0d-953e-be4b3449d482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfa9f18-536f-48a1-8832-7a2368e9561a", "tag": "f1cb0eb7-ff66-44a0-aac9-1ba69395a471"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:56.151753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.160375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c1605fb-b3da-4335-b1ac-3209d4439e61 req-b04ebc81-d706-4f0d-953e-be4b3449d482 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.160868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c1605fb-b3da-4335-b1ac-3209d4439e61 req-b04ebc81-d706-4f0d-953e-be4b3449d482 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.161615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c1605fb-b3da-4335-b1ac-3209d4439e61 req-b04ebc81-d706-4f0d-953e-be4b3449d482 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.163652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a15d5a36-7a2c-4a2d-9fa8-8e3acda1a581 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.446782 Sep 01 05:17:56.164588 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2514/4998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:55 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:56.185195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:56.185888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.198075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.198852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.199349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.202281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.203646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.204350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.213132 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9c1605fb-b3da-4335-b1ac-3209d4439e61 req-b04ebc81-d706-4f0d-953e-be4b3449d482 service nova] Creating event network-changed:f1cb0eb7-ff66-44a0-aac9-1ba69395a471 for instance fcfa9f18-536f-48a1-8832-7a2368e9561a on n-h2-820368-37 Sep 01 05:17:56.222077 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9c1605fb-b3da-4335-b1ac-3209d4439e61 req-b04ebc81-d706-4f0d-953e-be4b3449d482 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092853 Sep 01 05:17:56.223571 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2485/4999] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:56.413851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.425847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08617d20-6bb8-4a6e-86ad-6ff32bd5c109 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.244272 Sep 01 05:17:56.427286 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2515/5000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:56 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:56.448024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:56.449650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.453414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bfa395e8-2e2b-4ab1-9049-133d2f58e33a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:56.454308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bfa395e8-2e2b-4ab1-9049-133d2f58e33a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 9abdda3b-67ae-4116-b80b-7d10d090b2cd] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.457197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.458021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.458816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.459807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.460590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.461331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.461449 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-bfa395e8-2e2b-4ab1-9049-133d2f58e33a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 9abdda3b-67ae-4116-b80b-7d10d090b2cd could not be found. Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bfa395e8-2e2b-4ab1-9049-133d2f58e33a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/9abdda3b-67ae-4116-b80b-7d10d090b2cd/action HTTP/1.1 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 19 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: {"forceDelete": {}} Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9abdda3b-67ae-4116-b80b-7d10d090b2cd could not be found. Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9abdda3b-67ae-4116-b80b-7d10d090b2cd', 'body': {'forceDelete': {}}} Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9abdda3b-67ae-4116-b80b-7d10d090b2cd could not be found. Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9abdda3b-67ae-4116-b80b-7d10d090b2cd could not be found. Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:56.469577 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:56.475165 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:56.475165 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:56.475165 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9abdda3b-67ae-4116-b80b-7d10d090b2cd could not be found. Sep 01 05:17:56.475165 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:17:56.477359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bfa395e8-2e2b-4ab1-9049-133d2f58e33a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 9abdda3b-67ae-4116-b80b-7d10d090b2cd could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:56.480482 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bfa395e8-2e2b-4ab1-9049-133d2f58e33a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/9abdda3b-67ae-4116-b80b-7d10d090b2cd/action" status: 404 len: 111 microversion: 2.1 time: 0.034996 Sep 01 05:17:56.481696 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2516/5001] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:17:56 2022] POST /compute/v2.1/servers/9abdda3b-67ae-4116-b80b-7d10d090b2cd/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:17:56.492153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:56.494199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.519716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.520583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.522679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.523654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.524340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.525006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.686330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.708379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-948f265a-2a44-4838-8fba-03aefa873e2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.267504 Sep 01 05:17:56.712618 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2486/5002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:56 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:56.797090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:56.807680 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fdc417c-5151-45a2-9ed2-0ca77fee246e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.318861 Sep 01 05:17:56.808861 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2517/5003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:56 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:56.850247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:56.850877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.858857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.859755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.860197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.861118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.861933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.862549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.912688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:56.913281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:56.921041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.921781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.922218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:56.922964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:56.923593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:56.924012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.072040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:57.080211 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6cf75b88-7920-49c6-885f-10822883531d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.252100 Sep 01 05:17:57.080833 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2487/5004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:56 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:57.107813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc645e86-57de-4f61-9093-9eee64bf8d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:57.113976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc645e86-57de-4f61-9093-9eee64bf8d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 9e40e406-203f-4ce1-8594-e014248e93fc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.136694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cc645e86-57de-4f61-9093-9eee64bf8d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 9e40e406-203f-4ce1-8594-e014248e93fc could not be found. Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc645e86-57de-4f61-9093-9eee64bf8d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/9e40e406-203f-4ce1-8594-e014248e93fc/action HTTP/1.1 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 39 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: {"os-getConsoleOutput": {"length": 10}} Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9e40e406-203f-4ce1-8594-e014248e93fc could not be found. Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9e40e406-203f-4ce1-8594-e014248e93fc', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e40e406-203f-4ce1-8594-e014248e93fc could not be found. Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e40e406-203f-4ce1-8594-e014248e93fc could not be found. Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.140753 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e40e406-203f-4ce1-8594-e014248e93fc could not be found. Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc645e86-57de-4f61-9093-9eee64bf8d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 9e40e406-203f-4ce1-8594-e014248e93fc could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:57.144694 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc645e86-57de-4f61-9093-9eee64bf8d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/9e40e406-203f-4ce1-8594-e014248e93fc/action" status: 404 len: 111 microversion: 2.1 time: 0.045383 Sep 01 05:17:57.151218 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2488/5005] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:17:57 2022] POST /compute/v2.1/servers/9e40e406-203f-4ce1-8594-e014248e93fc/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:57.157119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.158101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.167158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.168036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:57.168346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.168973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.169874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.170512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.171366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.177651 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2350b1b5-d5fb-4cee-b7ce-1cf641612572 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.270832 Sep 01 05:17:57.178264 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2518/5006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:56 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:57.350673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:57.359871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43a582da-35f7-4a19-a853-4e9ac0b70661 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.206893 Sep 01 05:17:57.360731 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2489/5007] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:57.382258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.382915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.390043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.390528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.390984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.391688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.392173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.392597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.539974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:57.548807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10d175e6-eb1c-43d3-97cc-7e7972e1ccb4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.170365 Sep 01 05:17:57.549457 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2519/5008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:57.569431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d0307bd-0000-4605-977f-602d6b5e9b2a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.570156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d0307bd-0000-4605-977f-602d6b5e9b2a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.577384 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0d0307bd-0000-4605-977f-602d6b5e9b2a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d could not be found. Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d0307bd-0000-4605-977f-602d6b5e9b2a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/5d603a86-6eff-43e5-9b9e-1f2a7c663a3d HTTP/1.1 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d could not be found. Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '5d603a86-6eff-43e5-9b9e-1f2a7c663a3d'} Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d could not be found. Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d could not be found. Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:57.579408 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:57.583723 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:57.583723 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:57.583723 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:57.583723 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d could not be found. Sep 01 05:17:57.583723 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:57.585202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d0307bd-0000-4605-977f-602d6b5e9b2a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 5d603a86-6eff-43e5-9b9e-1f2a7c663a3d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:57.586109 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d0307bd-0000-4605-977f-602d6b5e9b2a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/5d603a86-6eff-43e5-9b9e-1f2a7c663a3d" status: 404 len: 111 microversion: 2.1 time: 0.020723 Sep 01 05:17:57.586675 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2490/5009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/5d603a86-6eff-43e5-9b9e-1f2a7c663a3d => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:17:57.595601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.596312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.602328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.602814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.603293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.603988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.604620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.605028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.731507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.732199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.740199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.741178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.741829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.742750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.743454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.744073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.751248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:57.759719 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8aeb6e56-2828-4a06-a563-1f87294a9d30 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.168218 Sep 01 05:17:57.774913 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2520/5010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:57.790756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:57.790756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:57.796340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.796927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.797475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:57.798218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:57.798624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:57.799072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.007704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.027134 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b866f139-03e0-4a0d-a62e-1bdb975265c4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.300651 Sep 01 05:17:58.028134 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2491/5011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:58.069836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.080486 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27a11005-afc9-4f95-a2b0-bce463e35d1c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.299553 Sep 01 05:17:58.081202 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2521/5012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:57 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:58.210637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09bdf54d-2a14-43e5-b107-c716b0cd1c46 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1941796475", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:58.212820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:58.214238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:58.223329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.223828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.224262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.225115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.225583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.226007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09bdf54d-2a14-43e5-b107-c716b0cd1c46 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 238 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1941796475", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1941796475', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.247434 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09bdf54d-2a14-43e5-b107-c716b0cd1c46 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09bdf54d-2a14-43e5-b107-c716b0cd1c46 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045410 Sep 01 05:17:58.251580 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2492/5013] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:58.257923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:58.258543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:58.268133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.268540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.269169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.270055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.270576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.271133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.453707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.472986 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f083eac1-f701-4543-abc8-2fa47371ee53 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.264561 Sep 01 05:17:58.476162 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2522/5014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:58 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:58.477383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.487350 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8a73816-85d6-4d45-83d8-de2062203802 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.232677 Sep 01 05:17:58.488369 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2493/5015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:58 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:58.512177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:58.513055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:58.520409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.521143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.521746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.522679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.523626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.524243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.667376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.676606 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4afb7e44-816f-4600-ace0-7c00e6a128c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.169122 Sep 01 05:17:58.677760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2523/5016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:58 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:58.744245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bd2bb51-2d62-4865-b800-d8f0d153d103 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1874603038", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bd2bb51-2d62-4865-b800-d8f0d153d103 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 235 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1874603038", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1874603038', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.750172 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bd2bb51-2d62-4865-b800-d8f0d153d103 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1bd2bb51-2d62-4865-b800-d8f0d153d103 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011832 Sep 01 05:17:58.756932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2494/5017] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:17:58 2022] POST /compute/v2.1/servers => generated 133 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:17:58.763119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:58.763767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:58.770653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.771576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.772010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.772713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.773169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.773583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.938489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:58.949007 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ef74d73-0272-43f5-9995-11ea80dea815 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.191354 Sep 01 05:17:58.950496 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2524/5018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:58 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:58.973171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:58.974520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:58.983479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.984302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.985423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:58.986653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:58.987331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:58.987952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.052578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:59.061115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:59.089359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.094582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.095305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.100607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.102339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.103458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.243433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:59.254575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-157ad8b9-f6ec-4d94-8972-f87dba1f5e12 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.284915 Sep 01 05:17:59.256107 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2495/5019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:58 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:59.282911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b465051f-7b72-40c8-9f95-3d5f12c8e55b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:59.283742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b465051f-7b72-40c8-9f95-3d5f12c8e55b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 86e48584-09d2-44da-9e06-62b4f02404fc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:59.298634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b465051f-7b72-40c8-9f95-3d5f12c8e55b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 86e48584-09d2-44da-9e06-62b4f02404fc could not be found. Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b465051f-7b72-40c8-9f95-3d5f12c8e55b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/86e48584-09d2-44da-9e06-62b4f02404fc/action HTTP/1.1 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 13 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: {"pause": {}} Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 86e48584-09d2-44da-9e06-62b4f02404fc could not be found. Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '86e48584-09d2-44da-9e06-62b4f02404fc', 'body': {'pause': {}}} Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86e48584-09d2-44da-9e06-62b4f02404fc could not be found. Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86e48584-09d2-44da-9e06-62b4f02404fc could not be found. Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:17:59.307386 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86e48584-09d2-44da-9e06-62b4f02404fc could not be found. Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b465051f-7b72-40c8-9f95-3d5f12c8e55b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 86e48584-09d2-44da-9e06-62b4f02404fc could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b465051f-7b72-40c8-9f95-3d5f12c8e55b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/86e48584-09d2-44da-9e06-62b4f02404fc/action" status: 404 len: 111 microversion: 2.1 time: 0.032104 Sep 01 05:17:59.311554 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2496/5020] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:17:59 2022] POST /compute/v2.1/servers/86e48584-09d2-44da-9e06-62b4f02404fc/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:17:59.438636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:59.450075 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fa5f032-cb69-4698-aa29-b137a5120343 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.403046 Sep 01 05:17:59.452725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2525/5021] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:59 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:59.478530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:59.481919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:59.495692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.496186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.496619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.497328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.497780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.505208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.724033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f867ab7f-faf8-433f-a720-66ff90f6371f req-5ee515d0-64c2-40c7-a835-297df5a46590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbcfa96-b926-4b38-ad99-9e8471f1a3fb", "name": "network-vif-plugged", "status": "completed", "tag": "376cf961-1a02-4d96-88b0-a87064aee375"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:17:59.748952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f867ab7f-faf8-433f-a720-66ff90f6371f req-5ee515d0-64c2-40c7-a835-297df5a46590 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.755481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f867ab7f-faf8-433f-a720-66ff90f6371f req-5ee515d0-64c2-40c7-a835-297df5a46590 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.755993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f867ab7f-faf8-433f-a720-66ff90f6371f req-5ee515d0-64c2-40c7-a835-297df5a46590 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.768008 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f867ab7f-faf8-433f-a720-66ff90f6371f req-5ee515d0-64c2-40c7-a835-297df5a46590 service nova] Creating event network-vif-plugged:376cf961-1a02-4d96-88b0-a87064aee375 for instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb on n-h1-820368-37 Sep 01 05:17:59.777422 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f867ab7f-faf8-433f-a720-66ff90f6371f req-5ee515d0-64c2-40c7-a835-297df5a46590 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463187 Sep 01 05:17:59.778325 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2497/5022] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:17:59.793855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:59.794479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:59.810679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.811938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.812409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.813139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.813595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.814016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.935722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:17:59.945959 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1d14a82-7436-4e97-b70d-865d10409d47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.474143 Sep 01 05:17:59.967595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2526/5023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:59 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:59.976772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:17:59.979283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:17:59.987639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.988651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.989189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:17:59.990030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:17:59.990585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:17:59.991305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.173744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.192989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cf1926e-0f29-470d-8825-00fa28a04558 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.413245 Sep 01 05:18:00.207469 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2498/5024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:59 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:00.240067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.248713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0d20abb-d886-4621-b0a2-d723855dc9ed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.279319 Sep 01 05:18:00.249304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2527/5025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:17:59 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:00.269416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:00.269956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:00.276487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.277398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.277850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.278556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.279050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.279483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.308577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:00.385389 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70f1189f-fd0a-4070-b744-2516827c38dd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.108940 Sep 01 05:18:00.385389 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2499/5026] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:00 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:18:00.395379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:00.398064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:00.413719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.414201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.418206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.420157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.420642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.421080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.475813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:00.476514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:00.484958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.485461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.485950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.486659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:00.487169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:00.487590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:00.631865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.642494 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6879768b-a31b-4137-b3cc-1a81d21b3506 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1509 microversion: 2.1 time: 0.255236 Sep 01 05:18:00.644231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2528/5027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:00 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:00.684415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:00.695872 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfdbe45d-b9bb-47c4-8256-49afa97c6306 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.221034 Sep 01 05:18:00.696421 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2500/5028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:00 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:01.220500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:01.221254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:01.229125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.230175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.230790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.231678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.232276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.232841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.263596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.390646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:01.398543 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b07e1f82-75aa-4f59-9d70-7113f05cb2ab tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1316 microversion: 2.1 time: 0.183261 Sep 01 05:18:01.399143 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2529/5029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:01 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:01.667726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:01.669741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:01.678994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.680181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.680803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.681757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.682735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.683885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.722745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:01.724410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:01.735494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.736130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.736680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.737478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:01.738206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:01.739187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:01.904524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.947674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:01.954339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:01.964260 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7673ca1a-a63b-4d91-b9e0-462abb488aa0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.246291 Sep 01 05:18:01.974359 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2530/5030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:01 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:01.974584 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56c42c2c-97e1-4613-b351-5563a3dcf7ca tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1489 microversion: 2.1 time: 0.308932 Sep 01 05:18:01.974584 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2501/5031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:01 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1489 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:01.991745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:01.992286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:01.999383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.000113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.000718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.001591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.002195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.002768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.033119 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'pause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state paused Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 13 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: {"pause": {}} Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: exception: Cannot 'pause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state paused Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'pause': {}}} Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state paused. Cannot pause while the instance is in this state. Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state paused Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:02.034856 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state paused Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'pause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state paused {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af75ea2a-a33d-4b4f-8528-f6477047b3eb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 143 microversion: 2.1 time: 0.049491 Sep 01 05:18:02.039332 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2531/5032] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:01 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 143 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:18:02.046848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:02.047649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.054213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.054853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.055413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.056210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.056782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.057486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.137075 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa215802-0dfd-4e28-9ae7-1bb21ecacebd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.095122 Sep 01 05:18:02.138300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2502/5033] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:02 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:18:02.153423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.158427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.172537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.173005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.174350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.175115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.175575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.176400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.335798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:02.344971 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ae86a58-8a65-4be1-9328-62eec66c3d25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1496 microversion: 2.1 time: 0.202227 Sep 01 05:18:02.346265 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2532/5034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:02 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1496 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:02.421478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.422493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.429955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.430727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.431351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.432254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.433186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.433822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.574681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:02.591449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:02.600518 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43e9aeb5-e79e-4a98-b7fc-5f414928f525 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1503 microversion: 2.1 time: 0.183915 Sep 01 05:18:02.601109 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2503/5035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:02 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:02.627335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.628042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.634645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.635401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.635929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.636743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.637624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.638278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.713200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4333d98e-96bc-463a-9d3c-4fc6e744d0d7 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.090107 Sep 01 05:18:02.714220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2533/5036] 10.222.0.26 () {58 vars in 1296 bytes} [Thu Sep 1 05:18:02 2022] DELETE /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb/os-server-password => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:02.724556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.725156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.732781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.733258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.733690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.734401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.734836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.735294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.765464 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45877ffb-4d0e-4710-b594-b368d314ac50 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.045630 Sep 01 05:18:02.782646 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2504/5037] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Sep 1 05:18:02 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:02.788782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.790469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.797571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.798213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.798714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.799591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.800137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.800792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.833050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:18:02.943713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1163102-8671-4ed7-94b1-36ec91281b89 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 204 len: 0 microversion: 2.1 time: 0.158870 Sep 01 05:18:02.944951 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2534/5038] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:18:02 2022] DELETE /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:02.954108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.955078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.961774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.962984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.963820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.965173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:02.965807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:02.966588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:02.992181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:02.992896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:02.999837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.000888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.001587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.002784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.003659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.004235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.204287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:03.213239 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eddeace6-10d5-4d98-b775-ec47e032dc8b tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1509 microversion: 2.1 time: 0.263554 Sep 01 05:18:03.214195 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2505/5039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:02 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:03.219712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e889202f-3829-4c22-8ff0-ee483338ef48 req-63a5067c-e9b9-4809-a363-34d19d6265fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfa9f18-536f-48a1-8832-7a2368e9561a", "name": "network-vif-plugged", "status": "completed", "tag": "f1cb0eb7-ff66-44a0-aac9-1ba69395a471"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:03.229822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e889202f-3829-4c22-8ff0-ee483338ef48 req-63a5067c-e9b9-4809-a363-34d19d6265fb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.230323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e889202f-3829-4c22-8ff0-ee483338ef48 req-63a5067c-e9b9-4809-a363-34d19d6265fb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.230746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e889202f-3829-4c22-8ff0-ee483338ef48 req-63a5067c-e9b9-4809-a363-34d19d6265fb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.230970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:03.240078 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4a6e9c7-2538-439f-b888-4d74dc5a56e5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.253693 Sep 01 05:18:03.241198 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2535/5040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:02 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:03.242338 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e889202f-3829-4c22-8ff0-ee483338ef48 req-63a5067c-e9b9-4809-a363-34d19d6265fb service nova] Creating event network-vif-plugged:f1cb0eb7-ff66-44a0-aac9-1ba69395a471 for instance fcfa9f18-536f-48a1-8832-7a2368e9561a on n-h2-820368-37 Sep 01 05:18:03.253496 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e889202f-3829-4c22-8ff0-ee483338ef48 req-63a5067c-e9b9-4809-a363-34d19d6265fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038204 Sep 01 05:18:03.254123 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2506/5041] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:03.369918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:03.370658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:03.377041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.377528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.377966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.378916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.382534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.382534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.582461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:03.593106 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0aa0dc72-f9af-4487-b624-bf6e671befc9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.227186 Sep 01 05:18:03.593883 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2536/5042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:03 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:03.631073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:03.631786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:03.639277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.639792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.640224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:03.640922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:03.642005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:03.642005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.137243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.145501 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3943140-e01e-41ad-811e-48ec3f9f25f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.519996 Sep 01 05:18:04.146077 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2507/5043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:03 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:04.166800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:04.169260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:04.176064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.176555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.176991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.177699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.178154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.178708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.193295 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929/action HTTP/1.1 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 28 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: {"reboot": {"type": "SOFT"}} Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a30a7154-35d5-4da3-873b-1f7d61133929', 'body': {'reboot': {'type': 'SOFT'}}} Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:04.195061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b91aef08-dbab-406a-b5b9-b0cf2edba172 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929/action" status: 404 len: 111 microversion: 2.1 time: 0.033834 Sep 01 05:18:04.199534 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2537/5044] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:04 2022] POST /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:18:04.207173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:04.207902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:04.216185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.216638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.217259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.218110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.218748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.219197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.238211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:04.240114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:04.247124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:04.253248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.254227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.254675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.255462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.255921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.257616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.552336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.568756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01acd4ee-492b-408c-931a-c2031dd14744 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.363914 Sep 01 05:18:04.579703 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2508/5045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:04 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:04.588267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:04.589369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:04.596613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.597177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.597678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.598006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.599134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.599750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.601040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.607407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd714f6e-acb1-471b-9bf7-5e9758f20494 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1509 microversion: 2.1 time: 0.377166 Sep 01 05:18:04.618912 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2538/5046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:04 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:04.618912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:04.618912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:04.625862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.626088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.626507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.627253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:04.627755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:04.628180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:04.908594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.934836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-703c621e-0316-4923-9c37-fbc6a212168e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1315 microversion: 2.1 time: 0.349357 Sep 01 05:18:04.938238 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2509/5047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:04 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:04.970615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:04.983854 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75cb8b62-3a31-4dfe-9da3-705328e79e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.372374 Sep 01 05:18:05.000223 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2539/5048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:04 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:05.015730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-905e8583-882b-47ac-8234-6e991babe07d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:05.018705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-905e8583-882b-47ac-8234-6e991babe07d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.049967 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-905e8583-882b-47ac-8234-6e991babe07d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb could not be found. Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-905e8583-882b-47ac-8234-6e991babe07d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/5b36fc76-b960-47bc-a6d3-91ca85ab8fdb/action HTTP/1.1 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 28 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: {"reboot": {"type": "SOFT"}} Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb could not be found. Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '5b36fc76-b960-47bc-a6d3-91ca85ab8fdb', 'body': {'reboot': {'type': 'SOFT'}}} Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb could not be found. Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb could not be found. Sep 01 05:18:05.055012 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb could not be found. Sep 01 05:18:05.060180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.061897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-905e8583-882b-47ac-8234-6e991babe07d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 5b36fc76-b960-47bc-a6d3-91ca85ab8fdb could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:05.063074 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-905e8583-882b-47ac-8234-6e991babe07d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/5b36fc76-b960-47bc-a6d3-91ca85ab8fdb/action" status: 404 len: 111 microversion: 2.1 time: 0.054539 Sep 01 05:18:05.064269 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2510/5049] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:05 2022] POST /compute/v2.1/servers/5b36fc76-b960-47bc-a6d3-91ca85ab8fdb/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:18:05.076504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.077552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.084770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.085709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.086288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.087453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.088070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.089780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.221119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d687f50b-86b8-4232-baef-b6dc174c3acc req-c899841e-82f3-43c1-b8f1-7dc75fce17f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbcfa96-b926-4b38-ad99-9e8471f1a3fb", "name": "network-vif-deleted", "tag": "376cf961-1a02-4d96-88b0-a87064aee375"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:05.260729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d687f50b-86b8-4232-baef-b6dc174c3acc req-c899841e-82f3-43c1-b8f1-7dc75fce17f3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.260729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d687f50b-86b8-4232-baef-b6dc174c3acc req-c899841e-82f3-43c1-b8f1-7dc75fce17f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.261602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d687f50b-86b8-4232-baef-b6dc174c3acc req-c899841e-82f3-43c1-b8f1-7dc75fce17f3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.282724 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d687f50b-86b8-4232-baef-b6dc174c3acc req-c899841e-82f3-43c1-b8f1-7dc75fce17f3 service nova] Creating event network-vif-deleted:376cf961-1a02-4d96-88b0-a87064aee375 for instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb on n-h1-820368-37 Sep 01 05:18:05.290267 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d687f50b-86b8-4232-baef-b6dc174c3acc req-c899841e-82f3-43c1-b8f1-7dc75fce17f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073684 Sep 01 05:18:05.291925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2511/5050] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:05.311470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.328240 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0118a31e-45b3-41e9-9228-0eb611bdfb03 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.259176 Sep 01 05:18:05.329234 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2540/5051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:05.365637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.366661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.377631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.378430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.379086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.379975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.380602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.382102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.556721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.566106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19a8eccc-aa6a-4f46-aeab-7bb5db528d4e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.216631 Sep 01 05:18:05.566661 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2512/5052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:05.588779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:05.592031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.600853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.601552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.601939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.602751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.603398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.604411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.622850 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929/action HTTP/1.1 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 65 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a30a7154-35d5-4da3-873b-1f7d61133929', 'body': {'rebuild': {'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db'}}} Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 01 05:18:05.624632 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64da35b2-4ad0-4b38-86a8-e0e98d5ac3a2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929/action" status: 404 len: 111 microversion: 2.1 time: 0.043385 Sep 01 05:18:05.632128 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2541/5053] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:05 2022] POST /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:18:05.646614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.646614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.651385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.652228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.652692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.653441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.653898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.654384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.655154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.656373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.665233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.666284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.667605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.668571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.669442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.670163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.710404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.711259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.712226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.713150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lazy-loading 'fault' on Instance uuid 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:05.786626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8212c4b6be364856831784b8086b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f740a68ee34c4622bd9153f8c074644a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.807213 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2bf98879-c429-436a-8c08-f4a7a94d6fb0 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 200 len: 1306 microversion: 2.1 time: 0.168989 Sep 01 05:18:05.808327 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2513/5054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 1306 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:05.863149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:05.873673 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b9210bd-b68e-4ef3-afc2-dac66ecaaf19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.230262 Sep 01 05:18:05.874629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2542/5055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:05.897688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.898286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.905833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.906623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.907276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.908131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.908586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.909011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.960804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:05.961528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:05.968115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.968749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.969206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:05.970021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:05.970524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:05.971042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.118617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.130717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c15f75f9-e0b7-436f-b9cc-7edc654d726a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.236738 Sep 01 05:18:06.131728 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2514/5056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:06.153498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b65ce1b3-d62e-4978-bd44-32b1c3ebd51d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:06.157073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b65ce1b3-d62e-4978-bd44-32b1c3ebd51d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: ad641f6c-5445-4f75-bec2-654d6dd14441] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.163489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.164887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b65ce1b3-d62e-4978-bd44-32b1c3ebd51d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance ad641f6c-5445-4f75-bec2-654d6dd14441 could not be found. Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b65ce1b3-d62e-4978-bd44-32b1c3ebd51d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/ad641f6c-5445-4f75-bec2-654d6dd14441/action HTTP/1.1 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 65 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ad641f6c-5445-4f75-bec2-654d6dd14441 could not be found. Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ad641f6c-5445-4f75-bec2-654d6dd14441', 'body': {'rebuild': {'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db'}}} Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad641f6c-5445-4f75-bec2-654d6dd14441 could not be found. Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 01 05:18:06.167380 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad641f6c-5445-4f75-bec2-654d6dd14441 could not be found. Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad641f6c-5445-4f75-bec2-654d6dd14441 could not be found. Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.171957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b65ce1b3-d62e-4978-bd44-32b1c3ebd51d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance ad641f6c-5445-4f75-bec2-654d6dd14441 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:06.173949 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b65ce1b3-d62e-4978-bd44-32b1c3ebd51d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/ad641f6c-5445-4f75-bec2-654d6dd14441/action" status: 404 len: 111 microversion: 2.1 time: 0.025611 Sep 01 05:18:06.174412 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc7bad1f-cebb-47ca-8a58-bb1021516426 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1502 microversion: 2.1 time: 0.217652 Sep 01 05:18:06.175036 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2543/5057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:05 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:06.175326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2515/5058] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:06 2022] POST /compute/v2.1/servers/ad641f6c-5445-4f75-bec2-654d6dd14441/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:18:06.197093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:06.198903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.204149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:06.206038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.206974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.207643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.208965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.209586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.210161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.210451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.227176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.227814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.228435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.229390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.230048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.230446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.306045 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd5b8010-7dc9-48bc-93a4-79d6ab41af51 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.110093 Sep 01 05:18:06.307251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2516/5059] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:06 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:06.408798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.411784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:06.420476 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef0329bb-55bf-494d-8294-0448f82004de tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.231539 Sep 01 05:18:06.421076 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2544/5060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:06 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:06.442670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:06.443388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.451736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.452284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.452711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.453647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.454094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.454513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.601524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.610544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4d2470a-2937-4377-803f-5571659d91f6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.172077 Sep 01 05:18:06.611504 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2517/5061] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:06 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:06.633199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a8823fb-0f95-4757-9410-9158beb7212e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:06.634212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a8823fb-0f95-4757-9410-9158beb7212e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.641646 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0a8823fb-0f95-4757-9410-9158beb7212e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed could not be found. Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a8823fb-0f95-4757-9410-9158beb7212e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed/action HTTP/1.1 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: {"restore": {}} Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed could not be found. Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed', 'body': {'restore': {}}} Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed could not be found. Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed could not be found. Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:06.643328 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:06.647206 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:06.647206 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:06.647206 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed could not be found. Sep 01 05:18:06.647206 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.650115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a8823fb-0f95-4757-9410-9158beb7212e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:06.663987 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a8823fb-0f95-4757-9410-9158beb7212e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed/action" status: 404 len: 111 microversion: 2.1 time: 0.036059 Sep 01 05:18:06.667695 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2545/5062] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:06 2022] POST /compute/v2.1/servers/f9ea2f48-3dcb-48b9-bb8a-aeefd8f99bed/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:18:06.674280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:06.675943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.684906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.686019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.686711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.687491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.688112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.688547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.692452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:06.829284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:06.830222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] [instance: 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.839083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.840018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.840632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.841524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.841977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.842556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.858857 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] HTTP exception thrown: Instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb could not be found. Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Request method failure captured: Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb HTTP/1.1 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEB4xPKRkvUlt34UMzRGBlMlUtxkPgRFpjQcYZFqSn98IziF_35PffQrx-nTVVsir57TBMUMGq3scDxaeffoI_hKX74IwYNDLk6UaB3d0KbtyZxcl-Wp56qXyQLmhKTxiF11qtqWnBEdMKVMdPyogz2LPdZ-eie2gBby34OwdJoNwOw Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f740a68ee34c4622bd9153f8c074644a Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerPasswordTestJSON-1382257519 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f740a68ee34c4622bd9153f8c074644a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f740a68ee34c4622bd9153f8c074644a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f740a68ee34c4622bd9153f8c074644a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f740a68ee34c4622bd9153f8c074644a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerPasswordTestJSON-1382257519 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f740a68ee34c4622bd9153f8c074644a Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1382257519 Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerPasswordTestJSON-1382257519-project Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 8212c4b6be364856831784b8086b099c Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerPasswordTestJSON-1382257519-project Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb could not be found. Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3dbcfa96-b926-4b38-ad99-9e8471f1a3fb'} Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb could not be found. Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb could not be found. Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:06.860847 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb could not be found. Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] Returning 404 to user: Instance 3dbcfa96-b926-4b38-ad99-9e8471f1a3fb could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:06.865401 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ddd5281-7139-43cb-a8fb-8f6cfccfb490 tempest-ServerPasswordTestJSON-1382257519 tempest-ServerPasswordTestJSON-1382257519-project] 10.222.0.26 "GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb" status: 404 len: 111 microversion: 2.1 time: 0.037143 Sep 01 05:18:06.866414 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2546/5063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:06 2022] GET /compute/v2.1/servers/3dbcfa96-b926-4b38-ad99-9e8471f1a3fb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:18:06.878976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:06.892543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecbcc76f-88ed-4fc1-a34d-ad9797f6df98 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.222625 Sep 01 05:18:06.894827 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2518/5064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:06 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:06.914572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:06.915617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:06.923121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.923912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.924528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:06.925600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:06.926233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:06.926849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.166678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:07.197516 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4eb4964-fb92-4ff2-a613-7d79bcd6ccfa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.287190 Sep 01 05:18:07.198338 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2547/5065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:06 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:07.230947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:07.232797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:07.248953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.249776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.253490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.254872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.256018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.259607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.318485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:07.332517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:07.334100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'restore' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 15 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: {"restore": {}} Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'restore' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'restore': {}}} Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state active. Cannot restore while the instance is in this state. Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:07.342465 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'restore' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbc2d5dc-ac50-4465-8530-c5f266d6dbb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 145 microversion: 2.1 time: 0.120050 Sep 01 05:18:07.348945 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2519/5066] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:07 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 145 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:18:07.355173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:07.356272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.361520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.361688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:07.362559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.363521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.364165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.364777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.377569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.377569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.377569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.378121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.378397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.378779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.477748 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-723a0b4b-4235-4279-b5c4-2d68b814002b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.163192 Sep 01 05:18:07.479932 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2548/5067] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:07 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:07.570555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:07.579428 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ec67c10-f1ac-45ee-a9c2-5a9e77616eaa tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.228296 Sep 01 05:18:07.594452 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2520/5068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:07 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:07.603480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:07.604693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:07.612108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.612595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.613032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.613737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.614225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.614647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.781268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:07.790263 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f41916d0-60fb-4707-9177-8f9330f77923 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.191001 Sep 01 05:18:07.791012 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2549/5069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:07 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:07.813135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6974ce6d-f88e-4346-9a95-f505f031a721 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:07.813682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6974ce6d-f88e-4346-9a95-f505f031a721 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 6f115871-7cd4-4428-bf77-c8186aea9671] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:07.828565 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6974ce6d-f88e-4346-9a95-f505f031a721 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 6f115871-7cd4-4428-bf77-c8186aea9671 could not be found. Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6974ce6d-f88e-4346-9a95-f505f031a721 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/6f115871-7cd4-4428-bf77-c8186aea9671/action HTTP/1.1 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 14 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: {"resume": {}} Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 6f115871-7cd4-4428-bf77-c8186aea9671 could not be found. Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '6f115871-7cd4-4428-bf77-c8186aea9671', 'body': {'resume': {}}} Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f115871-7cd4-4428-bf77-c8186aea9671 could not be found. Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f115871-7cd4-4428-bf77-c8186aea9671 could not be found. Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:07.837416 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:07.842039 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:07.842039 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:07.842039 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f115871-7cd4-4428-bf77-c8186aea9671 could not be found. Sep 01 05:18:07.842039 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:07.842039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6974ce6d-f88e-4346-9a95-f505f031a721 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 6f115871-7cd4-4428-bf77-c8186aea9671 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:07.842039 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6974ce6d-f88e-4346-9a95-f505f031a721 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/6f115871-7cd4-4428-bf77-c8186aea9671/action" status: 404 len: 111 microversion: 2.1 time: 0.030834 Sep 01 05:18:07.849343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:07.849975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:07.853570 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2521/5070] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:07 2022] POST /compute/v2.1/servers/6f115871-7cd4-4428-bf77-c8186aea9671/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:18:07.861305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.861807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.862249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:07.867970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:07.868629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:07.869084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.185009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:08.208187 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64568266-1bbe-48d2-830f-bc5766f32bed tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.363133 Sep 01 05:18:08.220222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2550/5071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:07 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:08.239094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:08.240348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:08.254604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.255733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.262625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.263844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.264959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.265688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.489890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:08.492501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:08.500285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:08.506345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.506854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.507321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.508048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.508506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.508890 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3987d6d6-686d-41e1-af1b-3151860d39fe tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.273872 Sep 01 05:18:08.509004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.512342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2522/5072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:08 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:08.535893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:08.536741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:08.563227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.563934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.564382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.565160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.565622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.566042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.596960 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'resume' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 14 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: {"resume": {}} Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'resume' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'resume': {}}} Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state active. Cannot resume while the instance is in this state. Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:08.600158 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:18:08.604185 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:08.605203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5094d775-628a-47e3-8019-658d64823879 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.114567 Sep 01 05:18:08.605203 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2551/5073] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:08 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:08.607979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'resume' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:08.609808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5fe96568-d348-46dd-a0b8-ff88d3f0622a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 144 microversion: 2.1 time: 0.079018 Sep 01 05:18:08.610625 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2523/5074] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:08 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 144 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:18:08.621873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:08.622742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:08.641291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.641979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.642425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.643184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:08.643650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:08.644087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:08.970360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:08.989443 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00c69014-06f2-4ae1-bc0a-9e550607347c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.366013 Sep 01 05:18:08.990165 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2552/5075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:08 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:09.032394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:09.033064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:09.044991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:09.045488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:09.045928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:09.046971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:09.047439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:09.048858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:09.317077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:09.331477 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4a508c4-937b-45b5-94f2-3241c7cd5120 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.304306 Sep 01 05:18:09.333753 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2524/5076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:09 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:09.520536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b20c9175-7174-40a6-ba2b-38e034d1eafb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b20c9175-7174-40a6-ba2b-38e034d1eafb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 160 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b"}]}} Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a6ef865c-7f44-4aad-804f-11f5772882db', 'flavorRef': '452', 'networks': [{'uuid': '2bb4ac52-304d-4ac7-a03a-22fe8d67ee5b'}]}}} Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:18:09.524713 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b20c9175-7174-40a6-ba2b-38e034d1eafb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:09.528882 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b20c9175-7174-40a6-ba2b-38e034d1eafb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010381 Sep 01 05:18:09.535710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:09.536304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:09.538196 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2553/5077] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:18:09 2022] POST /compute/v2.1/servers => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:18:09.547832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:09.548337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:09.548771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:09.557805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:09.558276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:09.558719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:09.615967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:09.618851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:09.645107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:09.645639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:09.649305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:09.650207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:09.650873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:09.651354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:09.783698 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31f4f248-3079-419b-b8c6-b94576421c87 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.173900 Sep 01 05:18:09.787788 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2554/5078] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:09 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:18:09.967806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:09.983142 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a2e197f-e2da-460c-b0c4-c1aa4f658c0a tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.451452 Sep 01 05:18:09.998752 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2525/5079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:09 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:10.010417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:10.011149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:10.030165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.030645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.031109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.031840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.032292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.032698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.426206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:10.443614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d5884535-84f8-447f-bbde-4b1c8205978f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.436926 Sep 01 05:18:10.446340 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2555/5080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:10 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:10.466846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c8ab873-459c-487f-ba92-fe0c2aafbacb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:10.468517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c8ab873-459c-487f-ba92-fe0c2aafbacb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:10.476868 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6c8ab873-459c-487f-ba92-fe0c2aafbacb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84 could not be found. Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c8ab873-459c-487f-ba92-fe0c2aafbacb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84/action HTTP/1.1 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 14 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: {"shelve": {}} Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84 could not be found. Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84', 'body': {'shelve': {}}} Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84 could not be found. Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84 could not be found. Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:10.482979 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:10.486946 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:10.486946 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:10.486946 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84 could not be found. Sep 01 05:18:10.486946 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:18:10.488917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c8ab873-459c-487f-ba92-fe0c2aafbacb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:10.490117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c8ab873-459c-487f-ba92-fe0c2aafbacb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84/action" status: 404 len: 111 microversion: 2.1 time: 0.027592 Sep 01 05:18:10.504616 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2526/5081] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:10 2022] POST /compute/v2.1/servers/3b17ac42-1f64-4a5e-8aff-9a9c74d4bc84/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:18:10.505925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:10.507476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:10.520591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.521572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.522416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.527314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.528229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.533013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.796337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:10.809392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:10.822216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:10.826836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.827782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.828318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.829256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.829890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.830345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.833348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3d12575-090a-4de2-88e5-28037d24cd0b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.337586 Sep 01 05:18:10.834534 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2556/5082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:10 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:10.859266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:10.863640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:10.884236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.886100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.887564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.888753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:10.889515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:10.890108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:10.909656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02fea3bd-848a-4481-8353-58e71cc17e98 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.117744 Sep 01 05:18:10.910681 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2527/5083] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:10 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:11.133801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:11.145976 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f69cc8b1-4aef-422e-94e8-7877d13daab7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.291884 Sep 01 05:18:11.146618 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2557/5084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:10 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:11.170348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:11.171181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:11.180290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:11.180716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:11.181210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:11.182246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:11.182733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:11.183392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:11.214869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lazy-loading 'flavor' on Instance uuid e1c2ca70-7859-4913-a30e-672fb2c7f9f0 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:11.536819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1105ad1-3011-4db3-8b86-4f7322492998 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.372544 Sep 01 05:18:11.538620 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2528/5085] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:11 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:11.547738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:11.549287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:11.563673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:11.564176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:11.565030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:11.568885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:11.571282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:11.571944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:11.893782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:11.904901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc976178-402f-473d-9fc1-de7ebae43111 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.361717 Sep 01 05:18:11.906101 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2558/5086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:11 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:11.928094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:11.930863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:11.942142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:11.943909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:11.944591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:11.945532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:11.946446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:11.947188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:12.014606 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a146c2e5-5063-4912-bdb4-cff26b165569 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.097125 Sep 01 05:18:12.015623 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2529/5087] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:11 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:12.930264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:12.932362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:12.943709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:12.944665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:12.945435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:12.946547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:12.947259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:12.948031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:13.026362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:13.029544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:13.034584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.039662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:13.040422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:13.040838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:13.041921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:13.042545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:13.043006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:13.108165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09a0368a-1e4d-4ac8-bd03-e0131a769ab9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.085835 Sep 01 05:18:13.112858 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2530/5088] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:13 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:18:13.114708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:13.123162 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8905b44a-5ae8-4706-9c03-65818da2f1fd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.197885 Sep 01 05:18:13.123910 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2559/5089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:12 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:14.129596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:14.132897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:14.141335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.141830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.142372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.143839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.144767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.145473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.222973 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d57e51f2-c049-4310-8208-e78493521541 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.106002 Sep 01 05:18:14.224692 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2560/5090] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:14 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:14.240230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:14.241235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:14.251803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.252475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.253551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.255922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.257517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.258961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.260768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-66418272", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:14.338620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:18:14.339088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:18:14.339835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:18:14.340659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:18:14.341956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:18:14.354343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.355279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.355937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.356945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.357624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.358254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.384623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Getting quotas for project c63c7a2bc82c49e8941e5d1f1e486640. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:18:14.395977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Getting quotas for user c37d2ac9a6904cff914e59616c169855 and project c63c7a2bc82c49e8941e5d1f1e486640. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:18:14.412904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:18:14.415423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:18:14.463175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:14.476804 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd92d8a2-7078-4663-b105-498e8dcc30f3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.249171 Sep 01 05:18:14.477096 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2561/5091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:14 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:14.484794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61415db0-1bb9-41a9-9576-53b01d42ebc3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.554083 Sep 01 05:18:14.488681 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2531/5092] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:18:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:18:14.501360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f640a63f-504a-4152-86ea-d06cd9d7d56f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:14.502061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f640a63f-504a-4152-86ea-d06cd9d7d56f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:14.589373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f640a63f-504a-4152-86ea-d06cd9d7d56f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:14.599431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f640a63f-504a-4152-86ea-d06cd9d7d56f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:14.601099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f640a63f-504a-4152-86ea-d06cd9d7d56f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:14.602737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f640a63f-504a-4152-86ea-d06cd9d7d56f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489" status: 200 len: 1276 microversion: 2.47 time: 0.105169 Sep 01 05:18:14.615637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2562/5093] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:14 2022] GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:14.763088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-263390096", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:14.821018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:18:14.821433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:18:14.821899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:18:14.822445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:18:14.823052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:18:14.842702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.843236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.843671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.844393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:14.847406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:14.852297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:14.890616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Getting quotas for project c63c7a2bc82c49e8941e5d1f1e486640. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:18:14.897563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Getting quotas for user c37d2ac9a6904cff914e59616c169855 and project c63c7a2bc82c49e8941e5d1f1e486640. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:18:14.918921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:18:14.921755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:18:14.985809 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b2412b3-4fb4-49a1-8218-6935939453cc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.227782 Sep 01 05:18:14.992222 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2532/5094] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 05:18:14.998875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a75f927e-ede7-4ed4-b84a-c3f66d81b2a5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:15.002475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a75f927e-ede7-4ed4-b84a-c3f66d81b2a5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:15.098199 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a75f927e-ede7-4ed4-b84a-c3f66d81b2a5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "PUT /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 991 microversion: 2.47 time: 0.088582 Sep 01 05:18:15.104201 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2563/5095] 10.222.0.26 () {62 vars in 1297 bytes} [Thu Sep 1 05:18:14 2022] PUT /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:18:15.132422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bedda09-0a9e-4554-8e24-d69ccdcd0a66 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:15.133369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bedda09-0a9e-4554-8e24-d69ccdcd0a66 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:15.220741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bedda09-0a9e-4554-8e24-d69ccdcd0a66 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:15.243074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:15.248331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:15.254732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bedda09-0a9e-4554-8e24-d69ccdcd0a66 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:15.263453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bedda09-0a9e-4554-8e24-d69ccdcd0a66 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:15.264692 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bedda09-0a9e-4554-8e24-d69ccdcd0a66 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1277 microversion: 2.47 time: 0.137212 Sep 01 05:18:15.267207 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2533/5096] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:15 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:15.267622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:15.268008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:15.268648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:15.271131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:15.271131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:15.271329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:15.351018 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc8aa3a3-0881-4857-a1e2-f4020adc1bb6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.119986 Sep 01 05:18:15.355987 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2564/5097] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:15 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:18:15.501144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:15.501875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:15.511981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:15.512699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:15.513537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:15.514492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:15.515176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:15.515778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:15.684025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:15.693950 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ae38ada-3618-4540-96c5-823cc2a39c82 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.196996 Sep 01 05:18:15.694502 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2534/5098] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:15 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:16.294028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:16.295366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:16.305164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:16.305653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:16.306296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.307333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:16.307792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:16.308205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.362976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:16.365846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:16.379816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:16.380695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:16.382420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.383373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:16.384047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:16.384712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.391616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:16.403607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:16.405681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:16.407565 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a8e2c3b-df9b-487c-91c7-c7771250339a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1329 microversion: 2.47 time: 0.117917 Sep 01 05:18:16.408908 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2565/5099] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:16 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1329 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:16.488636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bd06436-b0c7-4ad8-aa7f-a6be2a18bce7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 14 microversion: 2.1 time: 0.128201 Sep 01 05:18:16.491119 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2535/5100] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:16 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:18:16.716769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:16.717417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:16.725329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:16.725918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:16.726439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.727233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:16.727726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:16.728118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:16.902797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:16.913688 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6008ee39-46ba-4661-bcfb-befe62b3f078 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.201931 Sep 01 05:18:16.914491 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2566/5101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:16 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:17.449907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:17.452157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:17.467140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.468079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.468811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.469807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.470499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.471212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.512133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:17.519308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:17.547890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.550530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.552150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.558807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.559635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.561806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.655892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:17.665084 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63cca20e-e0de-40f1-ba86-cf23ca5c98bb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action" status: 200 len: 8207 microversion: 2.1 time: 0.167293 Sep 01 05:18:17.665791 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2567/5102] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:17 2022] POST /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a/action => generated 8207 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:17.669632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:17.671102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:17.672289 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcd3432c-ed58-4f1a-8317-6b39f85c0401 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1337 microversion: 2.47 time: 0.228821 Sep 01 05:18:17.673108 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2536/5103] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:17 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1337 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:17.677393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:17.678114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:17.686641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.687154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.687772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.688480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.688932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.689350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.693036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:17.847776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:17.856704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14268b61-2c60-47f5-bacb-5e6e71c3d5cc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.183484 Sep 01 05:18:17.857709 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2568/5104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:17 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:17.880570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:17.881187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:17.888037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.888543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.889042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.889680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.890114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.890694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.935556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:17.936494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:17.945486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.945978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.946409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:17.947151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:17.947596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:17.948010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.125103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.138066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-766b1dac-508e-434f-924f-165b12b0bd25 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.261159 Sep 01 05:18:18.139359 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2537/5105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:17 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:18.161176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:18.162221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.170564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.170909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.172153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.172743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.173586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.174193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.174760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.179889 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-86787c46-0d05-4f7a-8465-317029b961be tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.248195 Sep 01 05:18:18.182015 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2569/5106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:17 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:18.325767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.334195 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad3ee399-7d17-415d-9408-b494ed992ff7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.178511 Sep 01 05:18:18.334827 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2538/5107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:18.354973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:18.356140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.366365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.368523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.369059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.370323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.370876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.371324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.530226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.540215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01664f74-83e6-4509-8fcf-be94529194d1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.189696 Sep 01 05:18:18.540811 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2570/5108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:18.562190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:18.563335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.572049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.575413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.575875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.576678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.577138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.577599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.580557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:18.640982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Locking {{(pid=128863) lock /opt/stack/nova/nova/compute/api.py:4843}} Sep 01 05:18:18.701729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:18.704084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.725796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.727293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.730823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.732055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.734193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.734675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.761456 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-211b3d06-0b9b-42a8-832e-d4c58b1e07d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.203086 Sep 01 05:18:18.765081 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2539/5109] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:18 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:18:18.776308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:18.779925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:18.792156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.799473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.800534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.803273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:18.805654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:18.807214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:18.912157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.925759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.932458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:18.936190 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-616eeb1f-efc1-4210-b123-04fe76ed4e67 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1335 microversion: 2.47 time: 0.241498 Sep 01 05:18:18.938589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2571/5110] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:18 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:19.116502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:19.126824 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70eb875a-abca-4f65-827f-0307d07576a6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.358275 Sep 01 05:18:19.128389 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2540/5111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:19.148101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:19.157841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.158658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.159404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.191649 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] HTTP exception thrown: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 is locked Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Request method failure captured: Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action HTTP/1.1 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED-CDRGPuHjnBCeWkqAW-90Wykqx7S0ge-o2f5jeKH7b1x22qZa3dxa2FHPw1-3lT-rFtr_T8RzzEVmjFsLKuBDxhCsWNQWeT0CwOVs_NApkHNaf2UMnITeqTz0HQQz6e0wa4ijmBQ5L43rgxCJN6Mun9ntsRtle40ZhMckP8AGCJCU Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73595708b0aa4675b02e05947383d8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-369979107 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 87f4f3bcd603448d856a7471120a42af Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: {"os-stop": {}} Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 is locked Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7d80cb5b-9297-49aa-8d00-5d630b271401', 'body': {'os-stop': {}}} Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 is locked Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 is locked Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 is locked Sep 01 05:18:19.193834 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:19.199745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Returning 409 to user: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 is locked {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:19.201278 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12b17321-cead-4e83-8cd7-4efefb443533 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 409 len: 107 microversion: 2.1 time: 0.057516 Sep 01 05:18:19.202444 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2572/5112] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:19 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 107 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:18:19.207513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:19.208406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:19.213374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:19.215249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:19.218142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.220583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.221047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.221742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.221865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.222234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.222357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.222678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.222800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.223399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.224234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.224748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.292711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Unlocking {{(pid=128862) unlock /opt/stack/nova/nova/compute/api.py:4872}} Sep 01 05:18:19.377005 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe729b54-8f91-47ca-8486-fe4a6b32526c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.169109 Sep 01 05:18:19.378284 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2573/5113] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:19 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:19.388891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-216d5226-e15a-423d-b870-7684533acc57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:19.401189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-216d5226-e15a-423d-b870-7684533acc57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.401689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-216d5226-e15a-423d-b870-7684533acc57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.402128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-216d5226-e15a-423d-b870-7684533acc57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.412161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:19.422309 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5613cb69-3fb7-4c56-9239-f1a6a598cacc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.222083 Sep 01 05:18:19.432008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-216d5226-e15a-423d-b870-7684533acc57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:18:19.436493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2541/5114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:19 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:19.492971 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-216d5226-e15a-423d-b870-7684533acc57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.109790 Sep 01 05:18:19.493924 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2574/5115] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:19 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:19.501864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:19.502492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:19.511803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.513168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.514156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.515122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.516303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.517217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.784084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:19.794516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2f0dc89-8781-460e-a91c-9d30539e71ce tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.296426 Sep 01 05:18:19.795398 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2542/5116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:19 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:19.966129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:19.966764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:19.985551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.986048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.986489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:19.987273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:19.987703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:19.988126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:20.104673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:20.125872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:20.128227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:20.133479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6db8da6-f34a-4a3d-8e71-7b255911a104 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1335 microversion: 2.47 time: 0.174449 Sep 01 05:18:20.151029 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2575/5117] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:19 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:20.445657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:20.446283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:20.453766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:20.454267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:20.454717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:20.455453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:20.456142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:20.456551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:20.619613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:20.630237 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fa09aca-9163-489e-893e-fface0bee1a3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.189079 Sep 01 05:18:20.631036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2543/5118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:20 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:20.816483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:20.817580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:20.825926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:20.826415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:20.826844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:20.827574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:20.828018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:20.828616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:20.984606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:20.995386 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f659106a-df84-46aa-a1ef-dbc1834b9bf8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.182896 Sep 01 05:18:20.996665 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2576/5119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:20 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:21.157872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:21.158485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:21.165483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.165969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.166508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.167578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.168195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.168964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.237853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.247170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.248599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.249978 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a674ff6-0741-4324-a78b-7dcc4d1a0b9b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1356 microversion: 2.47 time: 0.096014 Sep 01 05:18:21.250540 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2544/5120] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:21 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:21.275643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:21.279034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:21.285969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.286705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.287730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.288706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.289308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.289881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.388264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:18:21.388643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:18:21.389122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:18:21.389514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:18:21.389916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:18:21.476074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:21.483773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.484262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.484977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.485553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.486125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.486532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.530083 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-910097e0-2074-49e9-b532-23d372970e1d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "POST /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51/action" status: 202 len: 1078 microversion: 2.47 time: 0.259837 Sep 01 05:18:21.534945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2577/5121] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:18:21 2022] POST /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51/action => generated 1078 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 01 05:18:21.550923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:21.551740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:21.560196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.561421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.561968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.563367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.563927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.564514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.656092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:21.657613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:21.666351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.666916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.667379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.668140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:21.668678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:21.671256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:21.695497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.705911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.707419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.708862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c502034b-f745-436e-8277-e65b4dceda53 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.163291 Sep 01 05:18:21.709582 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2545/5122] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:21 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:21.887034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:21.897835 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3b1133c-8ded-422c-8a73-86193035ea31 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.248764 Sep 01 05:18:21.898785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2578/5123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:21 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:22.017706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:22.019123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:22.025838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:22.026417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:22.026860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:22.027595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:22.028066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:22.028484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:22.183734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:22.192146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-737871ac-bd84-43a6-b026-5dc762568188 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.178257 Sep 01 05:18:22.192737 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2546/5124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:22 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:22.734149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:22.745162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:22.755709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:22.756414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:22.757016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:22.757875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:22.758898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:22.759517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:22.795312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:22.848972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:22.865809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:22.868101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:22.870400 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b53f4ad1-f8aa-4126-af4f-da1cc8e574fb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.139235 Sep 01 05:18:22.871491 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2579/5125] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:22 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:22.922668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:22.923327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:22.935556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:22.936063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:22.936576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:22.937457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:22.937910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:22.939578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.117570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:23.127240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-babdebf2-ccac-4524-b586-38b2d12deb43 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1531 microversion: 2.1 time: 0.208504 Sep 01 05:18:23.128044 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2547/5126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:22 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1531 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:23.215070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:23.215746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:23.222286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.223265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.224109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.225593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.226123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.226624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.389862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:23.399149 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7cf7ab71-d2c6-4225-974c-c02c64c75bc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.189327 Sep 01 05:18:23.399748 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2580/5127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:23 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:23.895789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:23.895789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:23.921748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.922340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.923430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:23.924242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:23.924952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:23.925563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.015723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:24.025399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:24.026962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:24.028069 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5592efbf-269e-4a9a-9e79-c703da22f09d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.138093 Sep 01 05:18:24.028651 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2548/5128] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:23 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:24.149528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:24.151039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:24.158606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:24.159205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:24.159675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.161099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:24.161611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:24.162477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.312319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:24.322158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aad0b7a0-1a66-446c-b118-2504fd455ff5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1531 microversion: 2.1 time: 0.176265 Sep 01 05:18:24.322869 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2581/5129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:24 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1531 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:24.421217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:24.421839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:24.428515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:24.428661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:24.429275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.429970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:24.430600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:24.431054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:24.574111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:24.582927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13642260-53d4-42d4-81d2-7449b2c9ae22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.165812 Sep 01 05:18:24.584003 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2549/5130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:24 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:25.053652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:25.054270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:25.057047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.067719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.068517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.069168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.070051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.070661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.071278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.175882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:25.191682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:25.196827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:25.202213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-461334ce-5611-4d85-8827-f84a17c85fed tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.152335 Sep 01 05:18:25.208630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2582/5131] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:25 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:25.345582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:25.346250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:25.349476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.351928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.357802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.358574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.359397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.360339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.361011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.361656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.585002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:25.596396 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58da2f59-2fc4-4f74-b1e3-a4f2777ef89d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1531 microversion: 2.1 time: 0.256216 Sep 01 05:18:25.597391 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2550/5132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:25 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1531 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:25.610768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:25.611596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:25.614569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.622768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.625514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.626281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.630627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:25.631533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:25.632147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:25.868734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:25.877356 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e4ebb401-cf33-43f7-a609-f2ebc70f6519 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.271058 Sep 01 05:18:25.878142 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2583/5133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:25 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:26.233807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:26.234461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:26.240765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.241509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.242111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:26.243267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.244406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.245195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:26.321537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:26.331320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:26.333317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:26.334489 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-426d9d2d-6dc0-4a13-b126-fcfd59ca3a59 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.104655 Sep 01 05:18:26.335120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2551/5134] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:26 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:26.621089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:26.622486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:26.630352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.631228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.631859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:26.632892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.633363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.633774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:26.819422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:26.829312 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1d5a3ab-3923-4a18-aa5e-6910896690e2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1531 microversion: 2.1 time: 0.211988 Sep 01 05:18:26.842438 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2584/5135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:26 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1531 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:26.898496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:26.899249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:26.907948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.908987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.909430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:26.910594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:26.911160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:26.911709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:27.085380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:27.096874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8f759cb-08c9-46d5-8b66-d46cd2d31454 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.202495 Sep 01 05:18:27.099234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2552/5136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:26 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:27.149167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6380990b-7ced-4282-a0dc-28bf95641988 req-f2f2857e-97f2-4d34-b370-359e48d154b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "name": "network-vif-plugged", "status": "completed", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:27.163076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6380990b-7ced-4282-a0dc-28bf95641988 req-f2f2857e-97f2-4d34-b370-359e48d154b7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:27.164283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6380990b-7ced-4282-a0dc-28bf95641988 req-f2f2857e-97f2-4d34-b370-359e48d154b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:27.164965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6380990b-7ced-4282-a0dc-28bf95641988 req-f2f2857e-97f2-4d34-b370-359e48d154b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:27.189266 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6380990b-7ced-4282-a0dc-28bf95641988 req-f2f2857e-97f2-4d34-b370-359e48d154b7 service nova] Creating event network-vif-plugged:66718261-856b-44ca-8215-e6047bec2d10 for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 on n-h2-820368-37 Sep 01 05:18:27.196856 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6380990b-7ced-4282-a0dc-28bf95641988 req-f2f2857e-97f2-4d34-b370-359e48d154b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054353 Sep 01 05:18:27.199070 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2585/5137] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:18:27.360058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:27.360666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:27.366909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:27.367447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:27.367882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:27.368641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:27.369257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:27.369856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:27.374842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:27.446971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:27.458030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:27.459736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:27.461360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-194c3f44-f562-41cb-985f-51ce0a816a07 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.105603 Sep 01 05:18:27.462100 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2553/5138] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:27 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:27.863863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:27.864696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:27.873067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:27.873596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:27.874084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:27.875086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:27.875622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:27.876104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.058485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.066649 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d2b04e3-77a8-437c-8945-4bb471068878 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1531 microversion: 2.1 time: 0.207369 Sep 01 05:18:28.067299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2586/5139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:27 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1531 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:28.117816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:28.118307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:28.125898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.126627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.127301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.127994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.128647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.129077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.300850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.312419 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-313f0e49-96aa-4eda-b7a9-f50899f1f8fc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.197220 Sep 01 05:18:28.313676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2554/5140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:28 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:28.485288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:28.486229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:28.493057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.493552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.494076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.494878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:28.495393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:28.495817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:28.585226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.596955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.598545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:28.599797 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17ea5812-0e9d-44df-96f2-2d5f019ac14f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.118636 Sep 01 05:18:28.600923 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2587/5141] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:28 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:29.089100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:29.090066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.100658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.101152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.101584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.102299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.102751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.103200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.335067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:29.335632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.354182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.355099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.355701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.356687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.357312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.357908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.678508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.717458 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26c1a98e-dbd3-4c6b-97e5-5ed7b1c8b3a0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.386390 Sep 01 05:18:29.718909 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2588/5142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:29 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:29.726290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.740322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-315bffe5-04b3-4135-97f8-8916d7838664 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.656263 Sep 01 05:18:29.740727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:29.742706 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2555/5143] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:29 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:29.744773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:29.758730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.759266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.764541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.768438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:29.768438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:29.768438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:29.879712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.891178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.893036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:29.894440 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f36747a-3d5e-4e41-86ee-25ff41ae8c74 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.171177 Sep 01 05:18:29.895039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2589/5144] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:29 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:30.749149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:30.751925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:30.765881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:30.766585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:30.781816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.782559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.783322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.788105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.788812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.789314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.803077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.803852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.804455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:30.805348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:30.808413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:30.809123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.159387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.177727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e258d2a-f5f9-4631-b26f-235dd66d414e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.415957 Sep 01 05:18:31.179658 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2590/5145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:30 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:31.190484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:31.192092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:31.208767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.218982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.222305 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb130678-e91e-4713-baad-627377afad8e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1656 microversion: 2.1 time: 0.483603 Sep 01 05:18:31.223088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.223600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.225142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.226190 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2556/5146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:30 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1656 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:31.226994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.227616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.253343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9cbd9100-b304-4601-968a-bcdfaca2532a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:31.264650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbd9100-b304-4601-968a-bcdfaca2532a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.266630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbd9100-b304-4601-968a-bcdfaca2532a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.267386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cbd9100-b304-4601-968a-bcdfaca2532a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.361727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9cbd9100-b304-4601-968a-bcdfaca2532a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:18:31.404930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.422246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.426235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:31.441064 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9426c307-2119-4efc-ac52-aa09c388492e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.255098 Sep 01 05:18:31.441742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2591/5147] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:31 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:31.445108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9cbd9100-b304-4601-968a-bcdfaca2532a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.196401 Sep 01 05:18:31.446459 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2557/5148] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:31 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:31.457990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:31.459165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:31.479519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.483361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.484133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:31.486476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:31.488013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:31.489631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.201503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:32.202192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:32.217052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.217551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.217988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.231975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.232731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.233326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.314121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.333555 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7706dd7a-0029-4124-a337-d331839065ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1665 microversion: 2.1 time: 0.881818 Sep 01 05:18:32.334408 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2592/5149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:31 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1665 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:32.471327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:32.472223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:32.485052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.488224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.488865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.491198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:32.492035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:32.493669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:32.751513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.769331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.770768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.772140 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0cb4afa-d791-4e35-805c-e8874889f0f6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.304947 Sep 01 05:18:32.772738 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2593/5150] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:32 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:32.796685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:32.805160 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca898c1a-875c-4522-a217-585803625166 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.607826 Sep 01 05:18:32.808600 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2558/5151] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:32 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:33.357001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:33.357655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:33.368087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.370551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.372023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.376472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.377141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.378568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.699210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:33.711381 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0fecd9c9-b68e-43bb-94af-03413f8d61ea tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1665 microversion: 2.1 time: 0.358265 Sep 01 05:18:33.714978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2594/5152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:33 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1665 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:33.799886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:33.801333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:33.827604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.829985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.830844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.831381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:33.832034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:33.832872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.835007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.835743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.841902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.842416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.842874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:33.844392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:33.847395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:33.852501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.135578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.150113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.151816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.153232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46e4056a-eba2-47ea-af86-3a8113703560 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.359508 Sep 01 05:18:34.153869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2559/5153] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:33 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:34.318207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:34.328794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ded5ee1-edc2-44ee-8387-cce8b369acce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.502700 Sep 01 05:18:34.329423 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2595/5154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:33 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:34.739318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:34.740672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:34.751519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.753024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.755040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:34.757205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:34.759919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:34.761100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.038370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.047462 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81d83ca7-889e-4375-8cb4-62cff7d8cadc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.314813 Sep 01 05:18:35.063528 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2560/5155] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:34 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:35.075207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.075927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.087441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.088036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.088468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.089185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.089634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.091794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.194064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.213330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.243851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.247858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.252395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.254167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.258735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.259756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.420612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.424658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.436478 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f8162c1-244c-4c73-ab24-89697e1c8b22 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.365467 Sep 01 05:18:35.450496 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2596/5156] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:35.466941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.467861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.487046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.487766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.488255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.488992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.489449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.495525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.530227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.599291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.603508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.609342 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8caa16f9-3e3a-4dde-96ff-447ec0acd001 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.430492 Sep 01 05:18:35.609960 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2561/5157] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:35.632524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:35.633353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.648536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.649259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.649866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.650785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.651486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.652841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.733188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Unlocking {{(pid=128863) unlock /opt/stack/nova/nova/compute/api.py:4872}} Sep 01 05:18:35.800948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:35.813317 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63ee6876-b1ed-4d9c-bdd8-760f67aa7304 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.361422 Sep 01 05:18:35.813976 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2597/5158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:35.818811 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d363950-bc1e-42f4-9457-f8ba80d1bbc1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.198058 Sep 01 05:18:35.826766 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2562/5159] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:35 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:35.831979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:35.832599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:35.855223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.857311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.858266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:35.861444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:35.862362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:35.865165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.105681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.116582 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e224367a-1352-470a-8260-6a3e7f1ba8cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.288551 Sep 01 05:18:36.130924 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2598/5160] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:35 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:36.138384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.139720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.146564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.147426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.148127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.149103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.149832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.150565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.382526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.394327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce144e77-1ede-465c-98c1-303245241bfb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.259861 Sep 01 05:18:36.395922 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2563/5161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:36.418143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.419441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.429439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.430255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.430933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.432183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.434147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.434621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.639456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.640208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.654330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.655041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.655623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.658584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.659383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.665374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.751860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.764045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3407528-addc-4ae7-8a7e-dd7725240a0e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.347664 Sep 01 05:18:36.766597 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2599/5162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:36.795437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:36.796296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.813048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.813839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.814224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.815007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.815456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.815877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.816596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.827488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.829619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:36.832340 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-249f1c87-0d31-4e6d-a3fa-a008b5d9a9bb tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.199893 Sep 01 05:18:36.847393 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2564/5163] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:36.854373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.855408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.859021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.864484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.865616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.866131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.867105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.867916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.868554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.915123 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd5276ac-54c6-434f-848b-56532b1781be tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.124033 Sep 01 05:18:36.916262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2600/5164] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:36 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:36.928492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:36.930280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:36.939893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.940703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.941499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:36.942955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:36.944698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:36.945499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.269703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.276764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.286969 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b6f6e66-9e07-44ef-94c2-a94b602fe591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1674 microversion: 2.1 time: 0.363618 Sep 01 05:18:37.288445 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2601/5165] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1674 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:37.298460 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63a1cf63-5e6e-4033-abd8-b39313cb4348 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.445441 Sep 01 05:18:37.300018 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2565/5166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:36 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:37.863018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:37.864091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:37.872593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:37.873710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:37.874343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.875467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:37.876158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:37.876770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:37.951733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.961253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.963357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:37.964769 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b88f9b43-3ed7-44df-ae65-384d68d66170 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.108487 Sep 01 05:18:37.965894 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2602/5167] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:37 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:38.320740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.322710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.336338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.336834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.337271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.338033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.338784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.339370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.564530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:38.578982 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1262c8eb-0873-46db-96b7-7c4829f3dc42 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.258827 Sep 01 05:18:38.578982 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2603/5168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:38.646922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.647647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:38.663354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.664200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.673539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.674830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:38.681344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:38.682434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:38.748032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.990139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:38.992488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:38.993572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.005195 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cc8505c-5277-4d59-8d31-9a7b7292fecd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1654 microversion: 2.1 time: 0.699221 Sep 01 05:18:39.006410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2566/5169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1654 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:39.015498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.016386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.017034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.017975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.022454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.023256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.042576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:39.043848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.055252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.055761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.056210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.058063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.058695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.061606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.166787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.180676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.183550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.192287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-839ecc23-583f-4142-bc49-d4b44fbc1c61 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.202358 Sep 01 05:18:39.193528 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2604/5170] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:38 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:39.274862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcd95f26-67ea-40ce-b1de-fa009824e2fe tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.246373 Sep 01 05:18:39.276551 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2567/5171] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:39 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:39.291863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:39.293442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.314207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.315184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.316474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.317951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.319394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.320791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.596287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.625196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:39.641023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:39.645480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf6684a1-5e7c-4e11-8a9e-eebfb9913094 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1661 microversion: 2.1 time: 0.361734 Sep 01 05:18:39.651192 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2605/5172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:39 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1661 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:39.668446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.669687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.670288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.671594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:39.672288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:39.672865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:39.858408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:39.867908 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ad9e0d7-6c0c-4f1f-9301-c185895644b0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.257812 Sep 01 05:18:39.881485 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2568/5173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:39 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:40.231698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.234605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:40.247701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.249289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.250676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.252677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.253388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.253955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.342592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.356302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.358840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.361201 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5aa4f6bb-9b31-4d51-940e-bcee6e872691 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.146092 Sep 01 05:18:40.362110 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2606/5174] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:40.673509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.674754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:40.700163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.700667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.701107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.701827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.702283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.702706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.894388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.895291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:40.912936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.913670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.914251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.915213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:40.915730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:40.916143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:40.927367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:40.954805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0572f5b-ed86-4d33-922c-6119de689a02 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.280882 Sep 01 05:18:40.957470 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2569/5175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:40.981621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:40.985636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.008796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.009816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.010470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.011643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.012346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.012975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.266561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.281247 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-932da4ca-61b8-42e4-b49c-81b6862c4f9c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.305218 Sep 01 05:18:41.282332 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2570/5176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:41.295474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.306970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.307853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.320982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.322813 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-650f4126-01bd-4e09-ad35-c5fa4626bab3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.433746 Sep 01 05:18:41.323496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.330961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.330961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.330961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.330961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.331386 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2607/5177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:40 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:41.385493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.386945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.393898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.394668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.395636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.396673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.397373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.398012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.526611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.540500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.544547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.546518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6be4d548-fb76-4344-87af-19e494b7ae65 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.165752 Sep 01 05:18:41.562925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.565086 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2608/5178] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:41.569480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-adbd0ce5-c18f-4b2d-8b3a-bbf1195d2790 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.266774 Sep 01 05:18:41.573299 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2571/5179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:41.609959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.611182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.618395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.619794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.620693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.622393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.623670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.624497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.800428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:41.809721 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-faf5a8f9-566f-413f-ae4d-27d2386736ae tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.219305 Sep 01 05:18:41.823949 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2609/5180] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:41.834047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:41.834662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:41.842640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.843152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.843589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:41.844440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:41.844892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:41.845314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.025930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.039480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d29bea77-fc3b-4410-a764-35c3d7520df7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.209444 Sep 01 05:18:42.043596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2572/5181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:41 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:42.066664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:42.067690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:42.076523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.077295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.077896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.078752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.079376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.079981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.276548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.299118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bb19796-f416-41aa-8cba-cfd1dc2cc26d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.242500 Sep 01 05:18:42.302983 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2610/5182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:42 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:42.352183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:42.353841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:42.377439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.378861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.379523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.381097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.381784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.382567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.574840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.575431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:42.576043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:42.588770 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60d3bf09-7f0b-4e9d-807e-bb0692a18b76 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.241796 Sep 01 05:18:42.602185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.602185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.602185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.602578 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2573/5183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:42 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:42.602661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:42.602661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:42.602661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:42.683268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.710647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.712125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:42.713385 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff949176-f395-43d1-85bf-d2da4fc07912 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.142263 Sep 01 05:18:42.727689 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2611/5184] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:42 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:43.610060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:43.610741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:43.630732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:43.631266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:43.631720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.632459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:43.632926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:43.633541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.746806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:43.748122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:43.767606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:43.768358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:43.768977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.769868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:43.770482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:43.771092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:43.810350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:43.941666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:43.962033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:43.978814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:43.980719 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6e62d5b-b82c-46f5-a8e1-e9c5c6f8df32 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.238765 Sep 01 05:18:43.981614 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2612/5185] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:43 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:44.051744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:44.083671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d8eea60-ec98-49d9-8001-624d84c095d0 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.475057 Sep 01 05:18:44.084951 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2574/5186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:43 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:45.006328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:45.007063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:45.018928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.019430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.019886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.020605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.021036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.021463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.096066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.112402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.113138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:45.113873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.113996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:45.115136 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1408d361-a3e6-4cd0-bf20-ce5615dc5582 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.112774 Sep 01 05:18:45.115701 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2613/5187] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:45 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:45.125445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.125934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.126376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.127111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:45.127566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:45.128002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:45.288254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:45.316312 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3979d127-e4e9-4d74-9acc-e1335d2b1f9e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1526 microversion: 2.1 time: 0.208769 Sep 01 05:18:45.327720 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2575/5188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:45 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:46.147067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:46.148272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:46.161006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.161515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.161960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.162680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.163253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.165415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.255828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.266696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.268178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.269615 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b7464ea-7b37-437d-88c8-d48de6b37bf3 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.127839 Sep 01 05:18:46.282114 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2614/5189] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:46 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:46.340624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:46.341891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:46.349345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.349846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.350285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.351028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:46.351492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:46.351921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:46.517538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:46.526473 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5fd9ed65-ba5e-4e78-bd34-e12bd0bdbf25 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1508 microversion: 2.1 time: 0.190071 Sep 01 05:18:46.527126 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2576/5190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:46 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:47.301855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:47.301855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:47.307329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.307856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.308289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.309068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.309461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.309884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.415388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:47.431861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:47.433875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:47.435167 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-571e681b-2684-4ea7-86be-8a86ee1b3b06 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.143978 Sep 01 05:18:47.436032 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2615/5191] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:47 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:47.551392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:47.552629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:47.560125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.560922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.561572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.562515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:47.563210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:47.563825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:47.740571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:47.749386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d655b35-5dc1-4b34-936e-a1c9adca274e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1508 microversion: 2.1 time: 0.203675 Sep 01 05:18:47.763183 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2577/5192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:47 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:48.461528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:48.462693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:48.470720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.471241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.471677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.472387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.473001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.473427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.578081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:48.600027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:48.601494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:48.602671 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e0bf0c1-89de-468f-9453-a3b4422f18d1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.146614 Sep 01 05:18:48.623300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2616/5193] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:48 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:48.709723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-406087472", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:48.769853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:48.770474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:48.775674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:18:48.777182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.777675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.778109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:48.778818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:48.779576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:48.780169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.110740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.123260 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cb6b34b-7223-4176-84aa-7ec374ac64dc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1451 microversion: 2.1 time: 0.357273 Sep 01 05:18:49.138941 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2617/5194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:48 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1451 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:49.147678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.148587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.156127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.156824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.157554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.158287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.158823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.159376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.180233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:18:49.180651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:18:49.181318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:18:49.181735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:18:49.182149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:18:49.195582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.195981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.196747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.197745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.198406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.199066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.219119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Getting quotas for project 5e336004af76490b9802791d1c5dca8e. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:18:49.225242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Getting quotas for user 35b92ae8501d4c96a30003ec7a3ab2db and project 5e336004af76490b9802791d1c5dca8e. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:18:49.239723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:18:49.242542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:18:49.330357 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57047a5e-d666-4ec0-b699-e65f374256cc tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624706 Sep 01 05:18:49.331368 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2578/5195] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:18:49.336980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e3bde5cf-a874-4576-9a6e-e2d1fcc93db3 req-f8472eee-f0ba-49cb-983a-3f44ab79a495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "name": "network-vif-unplugged", "status": "completed", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:49.350751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3bde5cf-a874-4576-9a6e-e2d1fcc93db3 req-f8472eee-f0ba-49cb-983a-3f44ab79a495 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.351819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3bde5cf-a874-4576-9a6e-e2d1fcc93db3 req-f8472eee-f0ba-49cb-983a-3f44ab79a495 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.352409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3bde5cf-a874-4576-9a6e-e2d1fcc93db3 req-f8472eee-f0ba-49cb-983a-3f44ab79a495 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.368125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_external_events [req-e3bde5cf-a874-4576-9a6e-e2d1fcc93db3 req-f8472eee-f0ba-49cb-983a-3f44ab79a495 service nova] Unable to find a host for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0. Dropping event network-vif-unplugged {{(pid=128863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:18:49.369986 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e3bde5cf-a874-4576-9a6e-e2d1fcc93db3 req-f8472eee-f0ba-49cb-983a-3f44ab79a495 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037051 Sep 01 05:18:49.371238 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2579/5196] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:18:49.376928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eebf8873-3d71-4f8f-b37d-2704fb2b7590 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.378119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eebf8873-3d71-4f8f-b37d-2704fb2b7590 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.386752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.396796 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6224083-a0f5-444c-991e-f8d4e21e8cdd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1451 microversion: 2.1 time: 0.254482 Sep 01 05:18:49.413964 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2618/5197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:49 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1451 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:49.487349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:49.487915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.496567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eebf8873-3d71-4f8f-b37d-2704fb2b7590 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.502157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.503169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.504201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.505354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.506159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.507507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.507770 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eebf8873-3d71-4f8f-b37d-2704fb2b7590 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1214 microversion: 2.1 time: 0.134692 Sep 01 05:18:49.509024 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2580/5198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:49 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:49.537216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lazy-loading 'flavor' on Instance uuid e1c2ca70-7859-4913-a30e-672fb2c7f9f0 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:18:49.552235 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'shelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state shelved_offloaded Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 14 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: {"shelve": {}} Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: exception: Cannot 'shelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state shelved_offloaded Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'shelve': {}}} Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:18:49.554567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state shelved_offloaded Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state shelved_offloaded Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'shelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state shelved_offloaded {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b69fdd58-a3ac-4e79-b4e0-21d6e92f3307 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 155 microversion: 2.1 time: 0.072699 Sep 01 05:18:49.561714 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2619/5199] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:49 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:18:49.566702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:49.568335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.575881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.576376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.576820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.577521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.577976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.578407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.633968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128863) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:18:49.641568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.642455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.652113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.652670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.653330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.654260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.654819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.655348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.730842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.741386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.743201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.744967 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c72fff9-5376-40dc-b7b5-1ced198b67b1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.108364 Sep 01 05:18:49.745951 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2620/5200] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:49 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:49.765183 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f566137-cb2f-4705-8aaa-2f3f1c0c62ec tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.203693 Sep 01 05:18:49.766192 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2581/5201] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:18:49 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:18:49.775332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:49.775972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:49.783387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.784440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.785483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.786684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:49.787589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:49.788408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:49.975730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:49.997592 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-293d81a7-c5fd-44b4-9171-86c36f0c318c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1459 microversion: 2.1 time: 0.226709 Sep 01 05:18:50.003069 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2621/5202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:49 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1459 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:50.537884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:50.539051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:50.547235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.547766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.548207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.549175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.549611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.552643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.625806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.635982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd796a5a-e14b-4f18-a731-ab9e9f21e82b tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1266 microversion: 2.1 time: 0.109090 Sep 01 05:18:50.637589 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2582/5203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:50 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:50.772809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:50.773512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:50.783286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.785797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.786611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.788070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:50.788533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:50.788953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:50.867788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.876981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.878746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:50.880525 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52e5106b-1179-4179-909f-340a48f3ea91 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.114763 Sep 01 05:18:50.881254 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2622/5204] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:50 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:51.020150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.020764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.029080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.029569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.030201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.031093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.031893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.032683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.057392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:51.208174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:51.221427 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb236bed-0bf7-44c8-9eb8-54ee793d2fdb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1459 microversion: 2.1 time: 0.205373 Sep 01 05:18:51.232771 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2583/5205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1459 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:51.658511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.659432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.668618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.669369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.669801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.670714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.671353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.671931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.829235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:51.839035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7170085-85cc-4116-a0a2-ce248a53daaa tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.184693 Sep 01 05:18:51.846801 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2623/5206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:51.904944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:51.905791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:51.913114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.913620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.914055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:51.914759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:51.915558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:51.917074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.024374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:52.036572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:52.038484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:52.039874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba91b153-17e7-454a-bff2-47735c267910 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.139187 Sep 01 05:18:52.040766 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2584/5207] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:51 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:52.247844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:52.248448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:52.263389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.264236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.264852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.265784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.266439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.267096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.416184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:52.424405 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-438e5c9d-ebf4-4b8d-a649-840214fbd818 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.180647 Sep 01 05:18:52.439136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2624/5208] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:52 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:52.860753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:52.861782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:52.870226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.871042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.871821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:52.873626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:52.874167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:52.874801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.055033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.066190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:53.066871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdaa4215-7e81-43cf-afcf-7d35bbd905ff tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.209607 Sep 01 05:18:53.067062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:53.075640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.076524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.077175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.078160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.078866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.079540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.081853 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2585/5209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:52 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:53.200192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.208810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.210310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.211756 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec31ddb6-68c6-41f5-beac-18f4269a1eb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1365 microversion: 2.47 time: 0.150792 Sep 01 05:18:53.212838 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2625/5210] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:53 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:53.447574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:53.448306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:53.460044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.460686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.461640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.462905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.465056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.465662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.486876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-331610b3-c1c1-440d-809a-da7a1e820276 req-06c9daf3-7271-4f34-9b7a-94f0d71df3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:53.506243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-331610b3-c1c1-440d-809a-da7a1e820276 req-06c9daf3-7271-4f34-9b7a-94f0d71df3ad service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:53.507842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-331610b3-c1c1-440d-809a-da7a1e820276 req-06c9daf3-7271-4f34-9b7a-94f0d71df3ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:53.509054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-331610b3-c1c1-440d-809a-da7a1e820276 req-06c9daf3-7271-4f34-9b7a-94f0d71df3ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:53.534156 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-331610b3-c1c1-440d-809a-da7a1e820276 req-06c9daf3-7271-4f34-9b7a-94f0d71df3ad service nova] Creating event network-changed:66718261-856b-44ca-8215-e6047bec2d10 for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 on n-h1-820368-37 Sep 01 05:18:53.544348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-331610b3-c1c1-440d-809a-da7a1e820276 req-06c9daf3-7271-4f34-9b7a-94f0d71df3ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061102 Sep 01 05:18:53.545524 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2626/5211] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:18:53.646758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:53.656688 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c56bdd3-4782-49e7-81b8-738914c91c2b tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.214821 Sep 01 05:18:53.657680 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2586/5212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:53 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:54.089857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.090551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.097049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.097514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.097936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.098630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.099098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.099697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.236323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.237642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.241185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.252512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.253162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.253595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.254298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.254753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.255822 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f480486-e44b-44c3-bd04-2c9bd72b3475 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.170769 Sep 01 05:18:54.256420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2627/5213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:54 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:54.256850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.325467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.334276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.335709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.336905 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5921eb31-a642-4709-8101-a80ec598e03d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1371 microversion: 2.47 time: 0.105474 Sep 01 05:18:54.337555 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2587/5214] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:54 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:54.678121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:54.678731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:54.686674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.687307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.688288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.689083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:54.689614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:54.690110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:54.845952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:54.854750 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a27c996-c11f-4df1-9bd0-54e655e0ebcf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.180367 Sep 01 05:18:54.855286 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2628/5215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:54 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:55.276865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:55.277481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:55.284801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.285645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.286156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.287020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.287521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.288026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.370547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:55.371502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:55.381652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.383059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.383840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.390710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.391546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.392211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.481257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:55.485453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:55.489988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:55.492035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:55.493737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:55.495232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6087f31-7cef-4e94-86ac-7461d06d4aa0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1371 microversion: 2.47 time: 0.131449 Sep 01 05:18:55.496819 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2629/5216] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:55 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:55.510394 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92ac7cce-be5c-499d-9aed-075239a0ba31 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.237800 Sep 01 05:18:55.515051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2588/5217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:55 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:55.588583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7d212a98-89b7-4e43-a456-ba33bbc04ba4 req-e89cfbee-8489-4430-8e53-ab779f49be0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95aa3589-6fd0-424e-b39b-2f6e563da7cc", "tag": "ec88668e-a93c-4337-b574-2fe621708071"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:18:55.598978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d212a98-89b7-4e43-a456-ba33bbc04ba4 req-e89cfbee-8489-4430-8e53-ab779f49be0b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.599391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d212a98-89b7-4e43-a456-ba33bbc04ba4 req-e89cfbee-8489-4430-8e53-ab779f49be0b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.599843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7d212a98-89b7-4e43-a456-ba33bbc04ba4 req-e89cfbee-8489-4430-8e53-ab779f49be0b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.619040 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7d212a98-89b7-4e43-a456-ba33bbc04ba4 req-e89cfbee-8489-4430-8e53-ab779f49be0b service nova] Creating event network-changed:ec88668e-a93c-4337-b574-2fe621708071 for instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc on n-h2-820368-37 Sep 01 05:18:55.625570 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7d212a98-89b7-4e43-a456-ba33bbc04ba4 req-e89cfbee-8489-4430-8e53-ab779f49be0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040630 Sep 01 05:18:55.626474 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2630/5218] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:18:55.877433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:55.878055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:55.890944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.891455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.891959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:55.892685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:55.893282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:55.893591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.149676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.179410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c885289-a96a-4c6e-addc-84b4ae47b0f5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.306171 Sep 01 05:18:56.180016 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2589/5219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:55 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:56.532552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:56.532552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:56.539926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:56.540621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:56.562854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:56.564070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.565309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.568842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.569677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.570164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.570605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.579232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.579741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.584445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.586953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.588174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.588876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.841338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.855784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.861565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.863170 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95ff8ceb-5609-412d-8ed1-d6793ac7e5c6 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1356 microversion: 2.47 time: 0.344931 Sep 01 05:18:56.864599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2631/5220] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:56 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1356 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:56.893755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:56.900323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.902626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Searching by: {'deleted': False, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:18:56.906725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:56.908435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.908915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.909344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.910570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:56.911396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:56.912097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:56.919322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-972b9c20-3da0-4145-a160-96c4345827fe tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.383627 Sep 01 05:18:56.920423 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2590/5221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:56 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:57.040824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:18:57.134392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.144673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.145990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.146610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.165260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.168108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.208954 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c854f44a-ce19-4433-94bb-e8109aafe805 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.321261 Sep 01 05:18:57.209829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.211680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.229791 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2632/5222] 10.222.0.26 () {60 vars in 1187 bytes} [Thu Sep 1 05:18:56 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:57.230019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.230019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.230476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.231840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.234248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.235077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.247042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.247554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.265196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.265688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.267084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.268091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.268584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.269036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.317061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:18:57.484057 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd07942d-050d-46d0-ad5c-62d0f73272bd tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "DELETE /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 204 len: 0 microversion: 2.47 time: 0.240590 Sep 01 05:18:57.484554 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2633/5223] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:18:57 2022] DELETE /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:18:57.497830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.511472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.512180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.512951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d7fe48d-e18e-4ba3-9eef-60790e02b69c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.306308 Sep 01 05:18:57.513661 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2591/5224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:57 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:57.531882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.533647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.535880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.536915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.537453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.537921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.660938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.676382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.678137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:57.684045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7814f3dc-41d0-43b8-a4e5-758de8094eba tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.190122 Sep 01 05:18:57.701356 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2634/5225] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:57 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:18:57.943833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:57.944602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:57.952767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.953268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.953890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:57.954612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:57.955112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:57.955706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:58.112066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:58.121264 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-946d74a5-0acd-4a71-b058-f59e8e36de97 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.181943 Sep 01 05:18:58.122564 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2592/5226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:57 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:58.546052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:58.547289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:58.561566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:58.562064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:58.562501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:58.563218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:58.563887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:58.564478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:58.708612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:58.709630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:58.722627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:58.723531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:58.724875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:58.725900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:58.726713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:58.727270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:58.744821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:58.755343 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f24e154a-5548-48a5-8c59-b852f59e0adf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.212685 Sep 01 05:18:58.760423 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2635/5227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:58 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:58.807981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:58.818162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:58.819748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:58.821226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55c598a4-2ef1-44d5-81dd-2e71bd9e1598 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.116740 Sep 01 05:18:58.837318 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2593/5228] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:58 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:18:59.142484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:59.143402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:59.150031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.150638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.151134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.152262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.152716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.153135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.411455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:18:59.420175 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-adae8bd9-32e8-414f-bc32-505eb3251300 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.281671 Sep 01 05:18:59.423344 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2636/5229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:59 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:59.789453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:59.790049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:59.796290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:59.797116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:59.804720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.805429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.806853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.807931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.814794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.815553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.850456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:18:59.851157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:18:59.864034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.864808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.865387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:18:59.867242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:18:59.868071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:18:59.868740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:00.013638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:00.033877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:00.043176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:00.046085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33bd20c4-c93e-4180-bd92-f4ea007a0b4e tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.203362 Sep 01 05:19:00.052180 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2637/5230] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:18:59 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:00.148682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:00.157574 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e300fe71-d544-4663-8a12-6338e951bec9 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.372319 Sep 01 05:19:00.160768 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2594/5231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:18:59 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:00.445328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:00.445962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:00.461329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:00.461866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:00.462422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:00.463372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:00.463799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:00.464227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:00.642464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:00.651534 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa76bd37-9405-4cb1-9504-09932b6401c3 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.213617 Sep 01 05:19:00.652136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2638/5232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:00 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:01.072564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:01.073573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:01.082276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.083250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.083876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.090499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.091101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.091558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.186494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:01.187153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:01.190869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:01.199744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:01.202604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:01.204154 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ea3679a-3980-4ddd-8078-af0fb960a4c5 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.137776 Sep 01 05:19:01.205220 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2595/5233] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:01 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:01.208461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.208954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.209401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.210111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.210563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.211015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.488787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-97ce7497-ccd7-4672-8844-7d7afeac2a2a req-8782a010-bb59-4dff-9a28-af6917339b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95aa3589-6fd0-424e-b39b-2f6e563da7cc", "name": "network-vif-plugged", "status": "completed", "tag": "ec88668e-a93c-4337-b574-2fe621708071"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:01.505532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-97ce7497-ccd7-4672-8844-7d7afeac2a2a req-8782a010-bb59-4dff-9a28-af6917339b8b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.506029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-97ce7497-ccd7-4672-8844-7d7afeac2a2a req-8782a010-bb59-4dff-9a28-af6917339b8b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.509504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-97ce7497-ccd7-4672-8844-7d7afeac2a2a req-8782a010-bb59-4dff-9a28-af6917339b8b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.537800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:01.542804 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-97ce7497-ccd7-4672-8844-7d7afeac2a2a req-8782a010-bb59-4dff-9a28-af6917339b8b service nova] Creating event network-vif-plugged:ec88668e-a93c-4337-b574-2fe621708071 for instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc on n-h2-820368-37 Sep 01 05:19:01.551457 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d0c0f8a4-12d1-46da-a397-d5fb688b38f2 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.372662 Sep 01 05:19:01.555712 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2639/5234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:01 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:01.559868 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-97ce7497-ccd7-4672-8844-7d7afeac2a2a req-8782a010-bb59-4dff-9a28-af6917339b8b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075042 Sep 01 05:19:01.561544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2596/5235] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:01.674279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:01.674930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:01.689512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.690015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.690451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.691232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:01.691732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:01.692116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:01.989255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:02.005122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06e1951e-822a-4a60-a0f5-70587c6c7e0f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.334740 Sep 01 05:19:02.026714 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2640/5236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:01 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:02.232560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:02.233220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:02.250802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:02.251540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:02.252159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:02.252907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:02.253429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:02.253861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:02.343397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:02.352055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:02.354004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:02.355523 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8fb1aff-a17d-4aa1-89af-a3d78216066d tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.127896 Sep 01 05:19:02.356596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2597/5237] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:02 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:02.579014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:02.581800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:02.591062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:02.594347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:02.595089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:02.595805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:02.596270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:02.596696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:02.784124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:02.795147 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-189419bc-a844-43c2-85c7-dda99fd9d5fc tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.220673 Sep 01 05:19:02.795744 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2641/5238] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:02 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:03.029203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:03.029821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:03.043134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.043379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.043829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.051302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.051878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.052330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.254849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:03.265027 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2301cf8-c706-4fd7-bdd4-ff8c9ef6407e tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1314 microversion: 2.1 time: 0.240026 Sep 01 05:19:03.266565 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2598/5239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:03 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:03.379913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:03.380417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:03.387542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.388036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.388627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.389346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.389970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.390397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.469335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:03.479286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:03.481014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:03.482294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd533795-882f-479f-a8d4-8b3d8fa8a4f1 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.106657 Sep 01 05:19:03.482868 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2642/5240] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:03 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:19:03.816877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:03.817489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:03.825101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.825848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.826448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:03.827371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:03.828031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:03.828792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.054856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:04.063675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-18ebf724-28a1-4c86-9298-2716140ad652 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.250736 Sep 01 05:19:04.064272 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2599/5241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:03 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:04.287333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:04.287974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:04.295099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.295589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.296026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.296712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.297166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.297615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.439548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:04.448229 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53816283-6299-4fe7-8dd1-9d1ca14e7cad tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1463 microversion: 2.1 time: 0.165240 Sep 01 05:19:04.448818 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2643/5242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:04 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:04.500749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:04.501797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:04.511970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:04.512594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:04.527345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.527345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.527345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.527345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.527345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.527345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.529734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.529734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.530193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.530931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.531398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.531831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.562983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:19:04.565946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:04.601219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:04.605911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:04.613559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:04.615355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:04.616790 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a8f0989-141b-4a8c-a26e-817c113e0cbe tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.110680 Sep 01 05:19:04.630916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2644/5243] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:04 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:19:04.684144 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-046b44e2-4fd4-454b-b71d-964069d23a80 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "DELETE /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 204 len: 0 microversion: 2.1 time: 0.184472 Sep 01 05:19:04.685461 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2600/5244] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:19:04 2022] DELETE /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:04.695077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:04.696227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:04.705847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.706640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.707261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.708121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:04.708763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:04.709345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:04.871091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:04.879412 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19abaa85-8af8-4dca-963f-01d699217e9a tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1469 microversion: 2.1 time: 0.189794 Sep 01 05:19:04.880061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2645/5245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:04 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:05.086922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:05.087907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:05.091390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.095736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.096239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.096678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.097385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.097847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.098276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.241020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:05.249660 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c08581b8-8516-4104-b507-57d44696ba24 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.167286 Sep 01 05:19:05.250250 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2601/5246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:05 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:05.645413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:05.646005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:05.653536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.654025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.654461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.655201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.655678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.656105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.731701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:05.740723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:05.742194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:05.743513 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84aca883-b7b0-4e01-af89-455d7feba95a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.102048 Sep 01 05:19:05.744227 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2646/5247] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:05 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:05.901511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:05.902267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:05.909966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.910829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.911324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:05.912068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:05.912592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:05.913025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.059993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:06.068421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e5d06a7-efb7-4797-a7f0-d9d0e513a2de tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1469 microversion: 2.1 time: 0.171817 Sep 01 05:19:06.069022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2602/5248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:05 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:06.271915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:06.272687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:06.279405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.280628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.280628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.281220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.281639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.282055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.437787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:06.447512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69677c96-2615-488e-a8c1-76a19e608c52 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.179327 Sep 01 05:19:06.451274 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2647/5249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:06 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:06.768555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:06.769529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:06.780451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.781378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.782019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.782922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.783535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.784126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.836005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9b9b4a6e-3acc-44a0-8227-ecdb9a47f613 req-685d0e39-afa0-445c-8fec-34d37ed69ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95aa3589-6fd0-424e-b39b-2f6e563da7cc", "name": "network-vif-deleted", "tag": "ec88668e-a93c-4337-b574-2fe621708071"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:06.864363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b9b4a6e-3acc-44a0-8227-ecdb9a47f613 req-685d0e39-afa0-445c-8fec-34d37ed69ed8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:06.865162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b9b4a6e-3acc-44a0-8227-ecdb9a47f613 req-685d0e39-afa0-445c-8fec-34d37ed69ed8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:06.865564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9b9b4a6e-3acc-44a0-8227-ecdb9a47f613 req-685d0e39-afa0-445c-8fec-34d37ed69ed8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:06.878371 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9b9b4a6e-3acc-44a0-8227-ecdb9a47f613 req-685d0e39-afa0-445c-8fec-34d37ed69ed8 service nova] Creating event network-vif-deleted:ec88668e-a93c-4337-b574-2fe621708071 for instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc on n-h2-820368-37 Sep 01 05:19:06.886143 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9b9b4a6e-3acc-44a0-8227-ecdb9a47f613 req-685d0e39-afa0-445c-8fec-34d37ed69ed8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053235 Sep 01 05:19:06.887651 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2648/5250] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:06.895141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:06.904803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:06.906962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:06.908342 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42d2a856-8850-4045-a3d7-57c6b0510fc0 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1362 microversion: 2.47 time: 0.143997 Sep 01 05:19:06.923539 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2603/5251] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:06 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:07.086918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.091897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:07.092605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:07.100786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.101373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.101724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.102434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.103251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.103755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.143168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.156188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.156764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.157286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.157915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lazy-loading 'fault' on Instance uuid 95aa3589-6fd0-424e-b39b-2f6e563da7cc {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:07.220391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b92ae8501d4c96a30003ec7a3ab2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e336004af76490b9802791d1c5dca8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:07.229021 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dd991f8-859d-4e73-8583-269695cbd00f tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 200 len: 1304 microversion: 2.1 time: 0.143079 Sep 01 05:19:07.235453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2649/5252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:07 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:07.476995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:07.480419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:07.553432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.556422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.558781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.563891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.565937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.566385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.864387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:07.876106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbfdd017-8fa0-4cbd-90a5-561a695bc4a6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.410834 Sep 01 05:19:07.877027 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2604/5253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:07 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:07.933946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:07.935258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:07.944296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.945343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.946731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.948697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.949457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.950299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.992312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:07.993035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:07.993426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:07.993952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lazy-loading 'fault' on Instance uuid 218c6e64-5389-42cc-aeab-cdd4fbef3c51 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:08.046862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:08.055267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:08.057010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:08.058407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b49da49-34d8-426a-9d62-30c05837bfb9 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 200 len: 1367 microversion: 2.47 time: 0.128789 Sep 01 05:19:08.067063 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2650/5254] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:07 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 1367 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:08.249513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:08.250121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] [instance: 95aa3589-6fd0-424e-b39b-2f6e563da7cc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:08.256157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:08.256714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:08.257058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:08.257744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:08.258193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:08.258609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:08.272467 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] HTTP exception thrown: Instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc could not be found. Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Request method failure captured: Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc HTTP/1.1 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEC2fkFgUEex8OLshrVycg91nFvgxmzUU3kFZ2sc8-TzFoU3tWoVrBId1omwxen6KoGaWAiwyNahVgcwDRSg7GA7bgxedIFHtLbQp6-asYkuWFjpHSPAj0Npsamw0fFwSMDGO7y98aw4qKlgikxS-UwtOmNGFesoVF0X4h-TP-TDP18 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5e336004af76490b9802791d1c5dca8e Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-1891256773 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e336004af76490b9802791d1c5dca8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e336004af76490b9802791d1c5dca8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e336004af76490b9802791d1c5dca8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e336004af76490b9802791d1c5dca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-1891256773 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5e336004af76490b9802791d1c5dca8e Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-1891256773 Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-1891256773-project Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 35b92ae8501d4c96a30003ec7a3ab2db Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-1891256773-project Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc could not be found. Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '95aa3589-6fd0-424e-b39b-2f6e563da7cc'} Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc could not be found. Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc could not be found. Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:08.274251 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc could not be found. Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] Returning 404 to user: Instance 95aa3589-6fd0-424e-b39b-2f6e563da7cc could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d392e533-1ef3-4928-b21a-3f78c762ae41 tempest-VolumesNegativeTest-1891256773 tempest-VolumesNegativeTest-1891256773-project] 10.222.0.26 "GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc" status: 404 len: 111 microversion: 2.1 time: 0.030252 Sep 01 05:19:08.279100 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2605/5255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:08 2022] GET /compute/v2.1/servers/95aa3589-6fd0-424e-b39b-2f6e563da7cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:08.898527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:08.899170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:08.905670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:08.906522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:08.907162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:08.908141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:08.908832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:08.909255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.082961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:09.083757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:09.084286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 218c6e64-5389-42cc-aeab-cdd4fbef3c51] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:09.092491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b0cd595-8a2f-4425-9407-ebd8a5cc6f8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.198473 Sep 01 05:19:09.093141 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2651/5256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:08 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:09.096727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.097378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.097963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.099028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.099803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.100370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.120431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] HTTP exception thrown: Instance 218c6e64-5389-42cc-aeab-cdd4fbef3c51 could not be found. Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Request method failure captured: Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 HTTP/1.1 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEECVH1jb9efwlpLHEhsdqSLC_353GTi2ONcr821i1BbioLSnk12tMuz9Ym-Ozbr4fw-3B2HWh2xu9g_Z5cAb-C4cfZqsBoTtcDI4Z0Y-Uoebzjj_JrCS2twwczxHzvwJ5ghQJUy2wtxVC3vu6zBPaS4GMtjKn5E67EGx83IP_CFYaTw Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.47 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c63c7a2bc82c49e8941e5d1f1e486640 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerShowV247Test-1907240041 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerShowV247Test-1907240041 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c63c7a2bc82c49e8941e5d1f1e486640 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerShowV247Test-1907240041 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerShowV247Test-1907240041-project Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c37d2ac9a6904cff914e59616c169855 Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerShowV247Test-1907240041-project Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 218c6e64-5389-42cc-aeab-cdd4fbef3c51 could not be found. Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '218c6e64-5389-42cc-aeab-cdd4fbef3c51'} Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 218c6e64-5389-42cc-aeab-cdd4fbef3c51 could not be found. Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 218c6e64-5389-42cc-aeab-cdd4fbef3c51 could not be found. Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:09.121990 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 218c6e64-5389-42cc-aeab-cdd4fbef3c51 could not be found. Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Returning 404 to user: Instance 218c6e64-5389-42cc-aeab-cdd4fbef3c51 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0987d604-da7c-40c6-800c-7605f9152e3a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51" status: 404 len: 111 microversion: 2.47 time: 0.044580 Sep 01 05:19:09.127665 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2606/5257] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:09 2022] GET /compute/v2.1/servers/218c6e64-5389-42cc-aeab-cdd4fbef3c51 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:19:09.132417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:09.132926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:09.141821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.142308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.142745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.143742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.144329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.144760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.173012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:19:09.263754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d26461e3-ae08-48cd-86c6-56e1d3ea622f tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489" status: 204 len: 0 microversion: 2.47 time: 0.134958 Sep 01 05:19:09.265046 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2652/5258] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:19:09 2022] DELETE /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:19:09.276122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:09.277536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:09.304129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.305250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.306051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.306977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.307682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.308263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.445576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:09.455741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5fdfdbe2-22e0-4b82-baf8-1b853196873b req-db3163be-9be2-46ac-8b3c-d9a920bfe659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "name": "network-vif-plugged", "status": "completed", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:09.466798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:09.469585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:09.472628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5fdfdbe2-22e0-4b82-baf8-1b853196873b req-db3163be-9be2-46ac-8b3c-d9a920bfe659 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:09.473035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5fdfdbe2-22e0-4b82-baf8-1b853196873b req-db3163be-9be2-46ac-8b3c-d9a920bfe659 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:09.473464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5fdfdbe2-22e0-4b82-baf8-1b853196873b req-db3163be-9be2-46ac-8b3c-d9a920bfe659 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:09.475123 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5a03778-795e-4e6d-bb75-75bef3d6a512 tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489" status: 200 len: 1361 microversion: 2.47 time: 0.205057 Sep 01 05:19:09.476991 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2607/5259] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:09 2022] GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:09.489146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5fdfdbe2-22e0-4b82-baf8-1b853196873b req-db3163be-9be2-46ac-8b3c-d9a920bfe659 service nova] Creating event network-vif-plugged:66718261-856b-44ca-8215-e6047bec2d10 for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 on n-h1-820368-37 Sep 01 05:19:09.498032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5fdfdbe2-22e0-4b82-baf8-1b853196873b req-db3163be-9be2-46ac-8b3c-d9a920bfe659 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045677 Sep 01 05:19:09.500085 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2653/5260] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:19:10.115571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:10.116450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:10.124812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:10.125302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:10.125917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:10.126681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:10.127168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:10.127592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:10.289428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:10.298962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-943510f4-ee2c-4e8a-815a-881725513c3f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.187078 Sep 01 05:19:10.299702 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2608/5261] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:10 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:10.503685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:10.504548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:10.512673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:10.513158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:10.513580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:10.514363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:10.514902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:10.515354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:10.586347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:10.596026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:10.597451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:10.598607 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cfd2d21-b7ca-4b7e-acf7-5f576fe36f1b tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489" status: 200 len: 1361 microversion: 2.47 time: 0.099855 Sep 01 05:19:10.599195 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2654/5262] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:10 2022] GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 => generated 1361 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:11.321042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:11.322636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:11.329842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.330540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.331148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.331862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.332322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.332750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.499541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:11.508380 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3e984d6-0d78-4da8-a9d8-ee300ccd98c6 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1517 microversion: 2.1 time: 0.191285 Sep 01 05:19:11.515071 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2609/5263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:11 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:11.623259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:11.623879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:11.637213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.637714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.638153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.638857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.641139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.641592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.682665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:11.683465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:11.683911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:11.684362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lazy-loading 'fault' on Instance uuid 1b4386cc-6f93-46f9-84cf-46bc580ed489 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:11.756234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:11.767081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:11.769529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c37d2ac9a6904cff914e59616c169855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63c7a2bc82c49e8941e5d1f1e486640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:11.770754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00df0ca1-284d-4b11-b6ae-58cc34022b4a tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489" status: 200 len: 1366 microversion: 2.47 time: 0.151973 Sep 01 05:19:11.771381 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2655/5264] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:11 2022] GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:19:12.532600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:12.533902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:12.545556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.546543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.547372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.548443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.549418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.549963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.716148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:12.729165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a32d0ef5-7325-4243-b35c-918fc98812bf tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.202028 Sep 01 05:19:12.730093 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2610/5265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:12 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:12.750098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:12.750713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:12.757797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.758278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.758714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.759479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.759936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.760355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.796194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:12.797152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] [instance: 1b4386cc-6f93-46f9-84cf-46bc580ed489] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:12.804268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.805109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.805822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.807168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.807936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.808601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.833418 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] HTTP exception thrown: Instance 1b4386cc-6f93-46f9-84cf-46bc580ed489 could not be found. Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Request method failure captured: Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 HTTP/1.1 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEECVH1jb9efwlpLHEhsdqSLC_353GTi2ONcr821i1BbioLSnk12tMuz9Ym-Ozbr4fw-3B2HWh2xu9g_Z5cAb-C4cfZqsBoTtcDI4Z0Y-Uoebzjj_JrCS2twwczxHzvwJ5ghQJUy2wtxVC3vu6zBPaS4GMtjKn5E67EGx83IP_CFYaTw Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.47 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: c63c7a2bc82c49e8941e5d1f1e486640 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerShowV247Test-1907240041 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c63c7a2bc82c49e8941e5d1f1e486640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerShowV247Test-1907240041 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: c63c7a2bc82c49e8941e5d1f1e486640 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerShowV247Test-1907240041 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerShowV247Test-1907240041-project Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c37d2ac9a6904cff914e59616c169855 Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerShowV247Test-1907240041-project Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 1b4386cc-6f93-46f9-84cf-46bc580ed489 could not be found. Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '1b4386cc-6f93-46f9-84cf-46bc580ed489'} Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4386cc-6f93-46f9-84cf-46bc580ed489 could not be found. Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4386cc-6f93-46f9-84cf-46bc580ed489 could not be found. Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:12.835814 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4386cc-6f93-46f9-84cf-46bc580ed489 could not be found. Sep 01 05:19:12.839914 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:12.842579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] Returning 404 to user: Instance 1b4386cc-6f93-46f9-84cf-46bc580ed489 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:12.844340 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7bf350ec-a92f-427f-a6ef-30854dcb2edc tempest-ServerShowV247Test-1907240041 tempest-ServerShowV247Test-1907240041-project] 10.222.0.26 "GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489" status: 404 len: 111 microversion: 2.47 time: 0.051894 Sep 01 05:19:12.845820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2611/5266] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:19:12 2022] GET /compute/v2.1/servers/1b4386cc-6f93-46f9-84cf-46bc580ed489 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:19:12.908646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:12.918452 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96db464c-bf80-40ac-b700-d490fce57c47 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.172229 Sep 01 05:19:12.919554 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2656/5267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:12 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:12.950320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:12.951440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:12.958569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.959107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.959547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:12.960444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:12.960905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:12.961359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.121883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:13.132165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe67c4be-93e6-4d86-903c-0451b0b4ae02 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.187876 Sep 01 05:19:13.133076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2612/5268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:12 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:13.153686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-796c80ac-d01a-42d1-985e-b2041faea8ad tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:13.159729 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-796c80ac-d01a-42d1-985e-b2041faea8ad tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 40616aad-16db-4f79-91d8-3f9b46f2bad5 has no mapping to a cell. Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-796c80ac-d01a-42d1-985e-b2041faea8ad tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/40616aad-16db-4f79-91d8-3f9b46f2bad5/action HTTP/1.1 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: {"os-stop": {}} Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 40616aad-16db-4f79-91d8-3f9b46f2bad5 has no mapping to a cell. Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '40616aad-16db-4f79-91d8-3f9b46f2bad5', 'body': {'os-stop': {}}} Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 40616aad-16db-4f79-91d8-3f9b46f2bad5 has no mapping to a cell. Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:13.167959 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40616aad-16db-4f79-91d8-3f9b46f2bad5 has no mapping to a cell. Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40616aad-16db-4f79-91d8-3f9b46f2bad5 has no mapping to a cell. Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-796c80ac-d01a-42d1-985e-b2041faea8ad tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 40616aad-16db-4f79-91d8-3f9b46f2bad5 has no mapping to a cell. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-796c80ac-d01a-42d1-985e-b2041faea8ad tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/40616aad-16db-4f79-91d8-3f9b46f2bad5/action" status: 404 len: 117 microversion: 2.1 time: 0.022019 Sep 01 05:19:13.176918 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2657/5269] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:13 2022] POST /compute/v2.1/servers/40616aad-16db-4f79-91d8-3f9b46f2bad5/action => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:13.184309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:13.185079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:13.197486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.198505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.199066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.201432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.202759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.203666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.394448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:13.406116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5f427c6-717c-4ab8-8965-796912f297e1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.226876 Sep 01 05:19:13.407911 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2613/5270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:13 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:13.431629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:13.432304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:13.439529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.440000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.440447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.441178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.441667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.442065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.629331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:13.638870 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27b75ef0-664f-471a-bcc4-2e98922117b8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.213629 Sep 01 05:19:13.640396 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2658/5271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:13 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:13.660963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcdab8c4-0eb4-494d-93d2-4f8fb0d6f880 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:13.662095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcdab8c4-0eb4-494d-93d2-4f8fb0d6f880 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 9b997114-5126-4744-ae43-7a4bb52b9b45] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:13.668872 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fcdab8c4-0eb4-494d-93d2-4f8fb0d6f880 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 9b997114-5126-4744-ae43-7a4bb52b9b45 could not be found. Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcdab8c4-0eb4-494d-93d2-4f8fb0d6f880 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/9b997114-5126-4744-ae43-7a4bb52b9b45/action HTTP/1.1 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 15 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: {"suspend": {}} Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9b997114-5126-4744-ae43-7a4bb52b9b45 could not be found. Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9b997114-5126-4744-ae43-7a4bb52b9b45', 'body': {'suspend': {}}} Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b997114-5126-4744-ae43-7a4bb52b9b45 could not be found. Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b997114-5126-4744-ae43-7a4bb52b9b45 could not be found. Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:13.670629 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:13.675216 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:13.675216 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:13.675216 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b997114-5126-4744-ae43-7a4bb52b9b45 could not be found. Sep 01 05:19:13.675216 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:13.676635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcdab8c4-0eb4-494d-93d2-4f8fb0d6f880 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 9b997114-5126-4744-ae43-7a4bb52b9b45 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:13.677655 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcdab8c4-0eb4-494d-93d2-4f8fb0d6f880 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/9b997114-5126-4744-ae43-7a4bb52b9b45/action" status: 404 len: 111 microversion: 2.1 time: 0.021248 Sep 01 05:19:13.678662 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2614/5272] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:13 2022] POST /compute/v2.1/servers/9b997114-5126-4744-ae43-7a4bb52b9b45/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:19:13.687114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:13.687995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:13.695274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.695760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.696186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.697063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.697550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.697908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.873582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:13.882753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7406fdcd-ea62-42c6-a60a-ae854bb21320 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.199617 Sep 01 05:19:13.885048 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2659/5273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:13 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:13.907810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:13.909031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:13.919454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.920226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.920849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:13.923025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:13.923673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:13.924315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.139775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:14.156016 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2e728ab-c2fe-4192-b2bd-f35dc4194a39 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.255337 Sep 01 05:19:14.175840 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2615/5274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:13 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:14.184295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:14.185166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:14.192137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:14.192815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:14.194690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.195994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:14.197210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:14.198537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.226612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lazy-loading 'flavor' on Instance uuid e1c2ca70-7859-4913-a30e-672fb2c7f9f0 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:14.250979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:14.332909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87ba6c47-5d5f-431e-9ba4-8422cb470e6e tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.155090 Sep 01 05:19:14.334923 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2660/5275] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:14 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:19:14.344218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:14.344852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:14.351674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:14.352213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:14.352989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.353568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:14.354020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:14.354625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:14.546182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:14.556602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8b5ff61-fc02-4ec8-bcda-d2fe5728d874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1512 microversion: 2.1 time: 0.217454 Sep 01 05:19:14.557412 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2616/5276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:14 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:15.580990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:15.581716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:15.592984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.594056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.595206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.596595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.597316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.598110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.828944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:15.833915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:15.854025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.854525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.855024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.855729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.856827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.859853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.893950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:15.905713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a68db863-75d9-4012-bb6d-814b54b2bfb3 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1495 microversion: 2.1 time: 0.331352 Sep 01 05:19:15.906421 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2661/5277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:15 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1495 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:15.929279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:15.930101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:15.941630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.942652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.943561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.944822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:15.945573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:15.947762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:15.982178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lazy-loading 'flavor' on Instance uuid e1c2ca70-7859-4913-a30e-672fb2c7f9f0 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:15.996079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:15.998672 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'suspend' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state suspended Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: {"suspend": {}} Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: exception: Cannot 'suspend' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state suspended Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'suspend': {}}} Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 01 05:19:16.002019 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state suspended Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state suspended Sep 01 05:19:16.006699 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:16.010398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'suspend' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state suspended {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:16.011496 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e36375f8-715c-47b7-9635-8cc13bc36a01 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 148 microversion: 2.1 time: 0.087297 Sep 01 05:19:16.016118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2662/5278] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:15 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 148 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:19:16.020078 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c9dd84d-3e7f-4660-8dc0-aa1594c48ee9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.196788 Sep 01 05:19:16.022932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2617/5279] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:15 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:19:16.026381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:16.030197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:16.040587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:16.042589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:16.045643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.048663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.049221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.051865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.052623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.053786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.062748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.065396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.065861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.067645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.070682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.071707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.159078 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a1aa35c-6a4c-4dbc-b422-7d29040603ac tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.141311 Sep 01 05:19:16.159824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2663/5280] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:16 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:19:16.170912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:16.172035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:16.180223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.181776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.182446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.184414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:16.185203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:16.185866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:16.545806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:16.557363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c541b76-33d2-4e0f-9cc1-21124c33c72c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1671 microversion: 2.1 time: 0.531810 Sep 01 05:19:16.557977 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2618/5281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:16 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:16.668292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:16.680845 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a183c291-7bf6-4252-9d6a-0ab97a07a612 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1501 microversion: 2.1 time: 0.515440 Sep 01 05:19:16.681454 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2664/5282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:16 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:17.578200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:17.578821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:17.588916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:17.589717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:17.590155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:17.590917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:17.591448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:17.591848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:17.702152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:17.712850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:17.733116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:17.736264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:17.737906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:17.741100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:17.742238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:17.744103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:17.960680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:17.974393 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-944add7f-e56f-4b7c-b0d2-d5b8a9322d7f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1671 microversion: 2.1 time: 0.399943 Sep 01 05:19:17.987990 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2619/5283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:17 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1671 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:18.124933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:18.136028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f60a2875-8a1a-496a-ace0-ad228126bc7f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1501 microversion: 2.1 time: 0.437873 Sep 01 05:19:18.137896 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2665/5284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:17 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1501 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:19.001913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:19.002629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:19.015158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.015158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.015602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.016488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.017132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.017701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.156977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:19.157651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:19.168391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.179416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.179969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.180795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.181267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.181731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.393812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:19.412321 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63970597-1611-4ad0-a6ee-6dc58ce0cdf5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.417523 Sep 01 05:19:19.412924 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2620/5285] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:19.485125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:19.498490 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1814124-4162-42a8-ac13-42e61699de19 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.344968 Sep 01 05:19:19.500330 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2666/5286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:19 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:19.525740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:19.530601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:19.561020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.563983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.565572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.569128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.569943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.575344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.843717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:19.855915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9caf1bf9-df23-4b71-9191-606fb3dd076c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.334293 Sep 01 05:19:19.859381 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2621/5287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:19 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:19.882783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-128c19d2-a3c7-425d-b08b-5af7e559b735 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:19.883711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-128c19d2-a3c7-425d-b08b-5af7e559b735 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 305901c8-55c8-4315-a9c4-a2f74bb6240e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:19.897904 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-128c19d2-a3c7-425d-b08b-5af7e559b735 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 305901c8-55c8-4315-a9c4-a2f74bb6240e could not be found. Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-128c19d2-a3c7-425d-b08b-5af7e559b735 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/305901c8-55c8-4315-a9c4-a2f74bb6240e/action HTTP/1.1 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 15 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: {"unpause": {}} Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 305901c8-55c8-4315-a9c4-a2f74bb6240e could not be found. Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '305901c8-55c8-4315-a9c4-a2f74bb6240e', 'body': {'unpause': {}}} Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305901c8-55c8-4315-a9c4-a2f74bb6240e could not be found. Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305901c8-55c8-4315-a9c4-a2f74bb6240e could not be found. Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:19.902190 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:19.906698 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:19.906698 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:19.906698 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305901c8-55c8-4315-a9c4-a2f74bb6240e could not be found. Sep 01 05:19:19.906698 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:19.906698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-128c19d2-a3c7-425d-b08b-5af7e559b735 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 305901c8-55c8-4315-a9c4-a2f74bb6240e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:19.911328 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-128c19d2-a3c7-425d-b08b-5af7e559b735 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/305901c8-55c8-4315-a9c4-a2f74bb6240e/action" status: 404 len: 111 microversion: 2.1 time: 0.033416 Sep 01 05:19:19.918537 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2667/5288] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:19 2022] POST /compute/v2.1/servers/305901c8-55c8-4315-a9c4-a2f74bb6240e/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:19.923836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:19.924564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:19.936455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.937886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.939772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:19.940724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:19.942700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:19.948308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.244457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:20.267098 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43eac10b-81a9-4e32-a9d8-430200832a8f tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.343054 Sep 01 05:19:20.268683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2622/5289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:19 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:20.291950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:20.292727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:20.308625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.309129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.309567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.310284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.310742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.323513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.765287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:20.800396 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b4f6844-6e33-4efa-8773-7bb11eba8776 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.512781 Sep 01 05:19:20.807694 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2668/5290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:20 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:20.833596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:20.835329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:20.860000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.862309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.863595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.864342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.864814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.865241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.905913 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'unpause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 15 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: {"unpause": {}} Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'unpause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'unpause': {}}} Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state active. Cannot unpause while the instance is in this state. Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:20.907837 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'unpause' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83fe1c01-485c-407a-a407-46ac22d62ad7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 145 microversion: 2.1 time: 0.084725 Sep 01 05:19:20.912046 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2623/5291] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:20 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 145 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:19:20.922954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:20.924969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:20.937749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.939907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.940935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:20.942025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:20.942641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:20.944936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:21.273699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:21.290055 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9ad4561-9ba3-4892-8ad0-51396b7b554d tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.371740 Sep 01 05:19:21.302922 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2669/5292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:20 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:21.320694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:21.322579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:21.336636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:21.339093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:21.345182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:21.346156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:21.346659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:21.347393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:21.632817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:21.650311 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3699ebf-86ef-41e7-b70a-773199f95185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.336651 Sep 01 05:19:21.651088 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2624/5293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:21 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:21.671569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2587e62-ab40-404c-bb3d-2d5690bec598 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:21.672172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2587e62-ab40-404c-bb3d-2d5690bec598 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: 403b30ca-2569-412d-b52f-240df6df9a27] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:21.679355 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b2587e62-ab40-404c-bb3d-2d5690bec598 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance 403b30ca-2569-412d-b52f-240df6df9a27 could not be found. Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2587e62-ab40-404c-bb3d-2d5690bec598 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/403b30ca-2569-412d-b52f-240df6df9a27/action HTTP/1.1 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 18 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: {"unshelve": null} Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 403b30ca-2569-412d-b52f-240df6df9a27 could not be found. Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '403b30ca-2569-412d-b52f-240df6df9a27', 'body': {'unshelve': None}} Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403b30ca-2569-412d-b52f-240df6df9a27 could not be found. Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403b30ca-2569-412d-b52f-240df6df9a27 could not be found. Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:21.681404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403b30ca-2569-412d-b52f-240df6df9a27 could not be found. Sep 01 05:19:21.686284 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:21.688255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2587e62-ab40-404c-bb3d-2d5690bec598 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance 403b30ca-2569-412d-b52f-240df6df9a27 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:21.689384 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2587e62-ab40-404c-bb3d-2d5690bec598 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/403b30ca-2569-412d-b52f-240df6df9a27/action" status: 404 len: 111 microversion: 2.1 time: 0.021914 Sep 01 05:19:21.698737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:21.699720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:21.700184 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2670/5294] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:21 2022] POST /compute/v2.1/servers/403b30ca-2569-412d-b52f-240df6df9a27/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:21.707842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:21.708657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:21.709323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:21.710252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:21.710954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:21.711592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:22.086166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:22.096485 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0543ba0e-da68-46a0-99b2-4d500eb6b8d4 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.401808 Sep 01 05:19:22.106173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2625/5295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:21 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:22.119907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:22.120518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:22.130226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:22.133855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:22.134078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:22.134801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:22.137928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:22.138615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:22.139697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.285875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:23.298522 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f8042f4-d373-477c-a6db-9f1deec72185 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 1.183183 Sep 01 05:19:23.299918 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2671/5296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:22 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:23.324706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:23.325542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:23.337021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:23.339498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:23.341098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.342018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:23.343863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:23.348902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.394229 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Cannot 'unshelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action HTTP/1.1 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 18 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: {"unshelve": null} Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: exception: Cannot 'unshelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'unshelve': None}} Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 in vm_state active. Cannot unshelve while the instance is in this state. Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:19:23.396110 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active Sep 01 05:19:23.401803 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:23.404083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 409 to user: Cannot 'unshelve' instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:23.405212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-016ceeea-ccc1-4077-a544-57f800ea4f6c tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action" status: 409 len: 146 microversion: 2.1 time: 0.086324 Sep 01 05:19:23.407567 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2626/5297] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:19:23 2022] POST /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0/action => generated 146 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 05:19:23.417186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:23.418275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:23.438804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:23.439330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:23.447971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.449426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:23.449916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:23.450352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:23.939969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:23.966512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d54a49a-c2bd-4779-b346-02996e5b7afb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.553897 Sep 01 05:19:23.969399 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2672/5298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:23 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:23.996302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:23.997756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:24.015901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.018471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.019844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.021191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.025361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.026407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.435548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:24.467152 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19767d79-1c08-4653-b8c5-a8894f8fca53 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.480955 Sep 01 05:19:24.468024 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2627/5299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:23 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:24.492901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-549ca4cf-7502-4718-b6ca-e758f1ada874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198869029_updated"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:24.497534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-549ca4cf-7502-4718-b6ca-e758f1ada874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: d0590918-8f15-4543-a64b-713f14a1883b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:24.504841 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-549ca4cf-7502-4718-b6ca-e758f1ada874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance d0590918-8f15-4543-a64b-713f14a1883b could not be found. Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-549ca4cf-7502-4718-b6ca-e758f1ada874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/servers/d0590918-8f15-4543-a64b-713f14a1883b HTTP/1.1 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 80 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198869029_updated"}} Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d0590918-8f15-4543-a64b-713f14a1883b could not be found. Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd0590918-8f15-4543-a64b-713f14a1883b', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-198869029_updated'}}} Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0590918-8f15-4543-a64b-713f14a1883b could not be found. Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 01 05:19:24.507428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0590918-8f15-4543-a64b-713f14a1883b could not be found. Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0590918-8f15-4543-a64b-713f14a1883b could not be found. Sep 01 05:19:24.515382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:24.519782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-549ca4cf-7502-4718-b6ca-e758f1ada874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance d0590918-8f15-4543-a64b-713f14a1883b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:24.520940 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-549ca4cf-7502-4718-b6ca-e758f1ada874 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "PUT /compute/v2.1/servers/d0590918-8f15-4543-a64b-713f14a1883b" status: 404 len: 111 microversion: 2.1 time: 0.032443 Sep 01 05:19:24.535258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:24.536615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:24.539307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2673/5300] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:19:24 2022] PUT /compute/v2.1/servers/d0590918-8f15-4543-a64b-713f14a1883b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:24.545487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.546339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.547041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.548011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.548694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.549318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.807390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:24.820201 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25cffbbe-b218-42bb-877c-0c07115d0691 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.291585 Sep 01 05:19:24.821077 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2628/5301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:24 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:24.847226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:24.848404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:24.858618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.859274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.860003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:24.860953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:24.861659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:24.862305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.101554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:25.116466 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1eaaa959-9b91-4885-9096-62949aca4efd tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.274152 Sep 01 05:19:25.117474 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2674/5302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:24 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:25.139546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31d834a7-e081-4fdd-b027-9f33dd8c45c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31d834a7-e081-4fdd-b027-9f33dd8c45c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: request: PUT /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 HTTP/1.1 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 280 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.144665 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 01 05:19:25.147922 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.152395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31d834a7-e081-4fdd-b027-9f33dd8c45c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:25.154217 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31d834a7-e081-4fdd-b027-9f33dd8c45c7 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "PUT /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 400 len: 619 microversion: 2.1 time: 0.019812 Sep 01 05:19:25.158398 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2629/5303] 10.222.0.26 () {60 vars in 1257 bytes} [Thu Sep 1 05:19:25 2022] PUT /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:19:25.166272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:25.169106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:25.185927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.186578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.187061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.187776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.188225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.188645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.396073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:25.408285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7fc4c75-08b3-44b0-b951-4f11c047bde1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.248700 Sep 01 05:19:25.409624 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2675/5304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:25 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:25.433736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:25.434746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:25.443334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.444892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.445566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.447982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.448694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.449346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.675637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:25.688367 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce1981ec-5755-4012-9504-3521454b5996 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.261001 Sep 01 05:19:25.706288 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2630/5305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:25 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:25.712253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba06f4a8-ec01-4841-a403-6b76de159576 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba06f4a8-ec01-4841-a403-6b76de159576 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 HTTP/1.1 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 24 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": ""}} Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0', 'body': {'server': {'name': ''}}} Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:19:25.721544 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 01 05:19:25.726966 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:25.729231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba06f4a8-ec01-4841-a403-6b76de159576 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:25.730298 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba06f4a8-ec01-4841-a403-6b76de159576 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "PUT /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 400 len: 108 microversion: 2.1 time: 0.023084 Sep 01 05:19:25.745789 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2676/5306] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:19:25 2022] PUT /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 05:19:25.756845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:25.756845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:25.774760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.776023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.776480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:25.782279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:25.782836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:25.787689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:26.095985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:26.112948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8aad6e0a-b4f4-4ac7-a38c-f6023223bcfb tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1504 microversion: 2.1 time: 0.364047 Sep 01 05:19:26.122979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2631/5307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:25 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:35.179124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:35.290210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:35.291355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:35.302077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=59 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:35.313898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.314811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.323070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.324177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.324825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.325448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.402041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:35.403603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 HTTP/1.1 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a30a7154-35d5-4da3-873b-1f7d61133929'} Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:35.406741 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.412056 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.414519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:35.417051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f6152ed-5333-477a-b1b1-e176a3a238a8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 404 len: 111 microversion: 2.1 time: 0.136843 Sep 01 05:19:35.422658 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2632/5308] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:19:35 2022] DELETE /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:35.432945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:35.433940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: a30a7154-35d5-4da3-873b-1f7d61133929] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:35.452099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1725789370", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "7e1b5293-6ff0-4ab9-ba47-ead3410d5c0e"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:35.454531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.455160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.455697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.456664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.457306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.457771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.485202 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 HTTP/1.1 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a30a7154-35d5-4da3-873b-1f7d61133929'} Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:35.492960 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. Sep 01 05:19:35.496935 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:35.500659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance a30a7154-35d5-4da3-873b-1f7d61133929 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:35.501812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5448bf78-5eb7-4f55-a219-546cf24f58b5 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929" status: 404 len: 111 microversion: 2.1 time: 0.077444 Sep 01 05:19:35.502940 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2633/5309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:35 2022] GET /compute/v2.1/servers/a30a7154-35d5-4da3-873b-1f7d61133929 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:35.513439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:35.516623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:35.534571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.535846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.536505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.539188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.541123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.543112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.563858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] validate_networks() for [('7e1b5293-6ff0-4ab9-ba47-ead3410d5c0e', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:19:35.627053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:19:35.818985 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7c96701-0b05-4c33-a994-0c0988481dd8 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 204 len: 0 microversion: 2.1 time: 0.311285 Sep 01 05:19:35.819665 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2634/5310] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:19:35 2022] DELETE /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:35.842013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:35.843311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:35.851248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.852485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.853238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:35.854499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:35.855259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:35.856345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:36.286862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:36.289638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:36.297537 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-527f62c0-c7d7-48e5-909d-c97663c467ce tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 0.472886 Sep 01 05:19:36.298160 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2635/5311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:35 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:37.067031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:19:37.067598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:19:37.067927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:19:37.068344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:19:37.068753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:19:37.090706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.091271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.091715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.094903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.096921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.097370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.151965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Getting quotas for project 8e2625f2d0b34d18b4f341ff465d1ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:19:37.171106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Getting quotas for user d8fad98b182441d488a4b303f1207e8c and project 8e2625f2d0b34d18b4f341ff465d1ffe. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:19:37.208973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:19:37.212338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:19:37.321295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:37.322411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:37.339231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.345184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.345758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.346543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:37.347058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:37.347497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:37.354206 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31473d58-b8aa-4983-acf6-28e77c86aa56 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235579 Sep 01 05:19:37.363181 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2677/5312] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:19:37.379053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29ce8345-0105-4b00-9fdc-233278c86ba2 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:37.385204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29ce8345-0105-4b00-9fdc-233278c86ba2 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:37.546380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29ce8345-0105-4b00-9fdc-233278c86ba2 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:37.558748 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29ce8345-0105-4b00-9fdc-233278c86ba2 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1228 microversion: 2.1 time: 0.187697 Sep 01 05:19:37.566348 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2678/5313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:37 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1228 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:38.585618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:38.587390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:38.620122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:38.643054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.643563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.644011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.644779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.645225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.645656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.653603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-297b7caf-6333-4dfb-b421-5eb4e53fc684 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1510 microversion: 2.1 time: 1.336704 Sep 01 05:19:38.654241 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2636/5314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:37 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1510 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:38.717237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4e7abb74-5112-4280-9726-25c9cde064a7 req-d4398eb6-c0d3-4f72-b096-1fff432291f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c2ca70-7859-4913-a30e-672fb2c7f9f0", "name": "network-vif-deleted", "tag": "66718261-856b-44ca-8215-e6047bec2d10"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:38.755330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e7abb74-5112-4280-9726-25c9cde064a7 req-d4398eb6-c0d3-4f72-b096-1fff432291f9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:38.755956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e7abb74-5112-4280-9726-25c9cde064a7 req-d4398eb6-c0d3-4f72-b096-1fff432291f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:38.761835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e7abb74-5112-4280-9726-25c9cde064a7 req-d4398eb6-c0d3-4f72-b096-1fff432291f9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:38.805802 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4e7abb74-5112-4280-9726-25c9cde064a7 req-d4398eb6-c0d3-4f72-b096-1fff432291f9 service nova] Creating event network-vif-deleted:66718261-856b-44ca-8215-e6047bec2d10 for instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 on n-h1-820368-37 Sep 01 05:19:38.822022 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4e7abb74-5112-4280-9726-25c9cde064a7 req-d4398eb6-c0d3-4f72-b096-1fff432291f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109063 Sep 01 05:19:38.823515 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2637/5315] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:19:38.986062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:38.998482 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-939aeba4-dd10-4fdd-88d2-cae66742b5ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1232 microversion: 2.1 time: 0.417003 Sep 01 05:19:39.002716 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2679/5316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:38 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1232 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:39.678651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:39.680094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:39.692328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.693755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.694380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.695349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.697033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.697805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.764114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:39.764959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:39.765414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:39.766640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lazy-loading 'fault' on Instance uuid e1c2ca70-7859-4913-a30e-672fb2c7f9f0 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:19:39.940278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0445362d3641cebea6f5cefc8ac7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355f1c34d8614151af17b7ad3f2c76d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:39.955201 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c460f922-b031-498f-bbd1-123427ae2720 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 200 len: 1306 microversion: 2.1 time: 0.281391 Sep 01 05:19:39.955837 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2638/5317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:39 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 1306 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:40.025823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:40.027320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:40.039019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:40.045136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:40.045813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:40.048637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:40.049410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:40.050217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:40.186633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:40.195949 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba5e6394-a7fc-403c-9c1a-7dd9acc4e06f tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1286 microversion: 2.1 time: 0.174000 Sep 01 05:19:40.209978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2680/5318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:40 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:40.991447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:40.994273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] [instance: e1c2ca70-7859-4913-a30e-672fb2c7f9f0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:41.046731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.047293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.052504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.053517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.059041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.059537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.108661 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] HTTP exception thrown: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 could not be found. Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Request method failure captured: Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 HTTP/1.1 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEBGx3g0ztdY0d7YUzOP9s4gwy4ZbhnUCrAl942zxgRHzQiHD1ELzorCg73DJnPw49jhNLPj0Femz6L3Bl8Tqyc3A7oTuVDLLqXpDATQDfv8r2Bjvq6xhUCvagOVexG32oaKVK1xHCDKllx-SMOWYxjEOiZvV2PqW9SyZHq2RniAwIY Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/355f1c34d8614151af17b7ad3f2c76d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 355f1c34d8614151af17b7ad3f2c76d5 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1581384489 Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: dd0445362d3641cebea6f5cefc8ac7ef Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1581384489-project Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 could not be found. Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e1c2ca70-7859-4913-a30e-672fb2c7f9f0'} Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 could not be found. Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 could not be found. Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:41.115589 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 could not be found. Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] Returning 404 to user: Instance e1c2ca70-7859-4913-a30e-672fb2c7f9f0 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:41.120804 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-996a7ba7-4fd4-49c9-b170-65c40cdadfb1 tempest-ServersNegativeTestJSON-1581384489 tempest-ServersNegativeTestJSON-1581384489-project] 10.222.0.26 "GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0" status: 404 len: 111 microversion: 2.1 time: 0.142491 Sep 01 05:19:41.130014 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2639/5319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:40 2022] GET /compute/v2.1/servers/e1c2ca70-7859-4913-a30e-672fb2c7f9f0 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:41.218664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:41.219542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:41.239939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.241907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.242392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.242780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:41.251464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:41.252203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:41.726569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:41.744555 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6690fbb-9013-43e7-896f-97fe11b029ec tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.530883 Sep 01 05:19:41.752947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2681/5320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:41 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:41.899031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a06885c6-fde8-4e4a-bde9-dd4c2610454a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2076342925", "availability_zone": "foo_zone"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:41.906077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-a06885c6-fde8-4e4a-bde9-dd4c2610454a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Generated uuid 3a106624-374f-4e31-89cf-4f8c9ed0329b for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 01 05:19:41.975534 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a06885c6-fde8-4e4a-bde9-dd4c2610454a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.220632 Sep 01 05:19:41.977378 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2640/5321] 10.222.0.26 () {60 vars in 1164 bytes} [Thu Sep 1 05:19:41 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:41.989046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e6f9af4c-1b06-410f-895c-a2eac9385895 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:42.020882 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e6f9af4c-1b06-410f-895c-a2eac9385895 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] [71619eec-194b-4380-8e03-02d6f96a168e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:19:42.783028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:42.784789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:42.814792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.815363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.815823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:42.817149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:42.817149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:42.817586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.029616 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-e6f9af4c-1b06-410f-895c-a2eac9385895 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] [71619eec-194b-4380-8e03-02d6f96a168e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57074. Sep 01 05:19:43.071053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e6f9af4c-1b06-410f-895c-a2eac9385895 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 1.085588 Sep 01 05:19:43.083135 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2682/5322] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 05:19:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:19:43.101650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:43.119069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:43.128209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3007aad-996d-42b1-b9e3-36199d4ce6dd tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.358306 Sep 01 05:19:43.130526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.131855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.134012 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2641/5323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:42 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:43.134836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.135898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.138620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.139353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.207140 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61c969df-0cc5-4b80-ab20-b10a896b4ecc tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.121280 Sep 01 05:19:43.208575 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2683/5324] 10.222.0.26 () {58 vars in 1176 bytes} [Thu Sep 1 05:19:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:43.220902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5da23498-51e3-4ca2-accc-f923d4e47d68 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:43.230757 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5da23498-51e3-4ca2-accc-f923d4e47d68 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014634 Sep 01 05:19:43.231766 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2642/5325] 10.222.0.26 () {58 vars in 1143 bytes} [Thu Sep 1 05:19:43 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:43.243928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10ce2e25-aa39-44ce-b350-b56af3a443a8 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-820368-37"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:43.260952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10ce2e25-aa39-44ce-b350-b56af3a443a8 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.261439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10ce2e25-aa39-44ce-b350-b56af3a443a8 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.261937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10ce2e25-aa39-44ce-b350-b56af3a443a8 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.466246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-df31e33f-a29a-44e3-84e2-778751be1dca req-d4df31aa-9926-46af-8925-c70177745a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ecdff6-730c-406c-834d-744a565f3604", "tag": "eab3d81b-6be9-4c7f-8588-a04e1c046e64"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:43.497912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df31e33f-a29a-44e3-84e2-778751be1dca req-d4df31aa-9926-46af-8925-c70177745a5b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:43.503249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df31e33f-a29a-44e3-84e2-778751be1dca req-d4df31aa-9926-46af-8925-c70177745a5b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:43.504383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df31e33f-a29a-44e3-84e2-778751be1dca req-d4df31aa-9926-46af-8925-c70177745a5b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:43.541538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df31e33f-a29a-44e3-84e2-778751be1dca req-d4df31aa-9926-46af-8925-c70177745a5b service nova] Creating event network-changed:eab3d81b-6be9-4c7f-8588-a04e1c046e64 for instance 90ecdff6-730c-406c-834d-744a565f3604 on n-h2-820368-37 Sep 01 05:19:43.557667 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-df31e33f-a29a-44e3-84e2-778751be1dca req-d4df31aa-9926-46af-8925-c70177745a5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091668 Sep 01 05:19:43.563878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2643/5326] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.010639 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10ce2e25-aa39-44ce-b350-b56af3a443a8 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.765946 Sep 01 05:19:44.012482 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2684/5327] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 05:19:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.022726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d1f6d96-0092-4100-8c85-5a6d5d9e7a95 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.049746 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d1f6d96-0092-4100-8c85-5a6d5d9e7a95 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.031089 Sep 01 05:19:44.058774 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2644/5328] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:19:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.069399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-034c7036-81bd-4293-9766-cb7669f78276 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-492367397", "availability_zone": "foo_zone"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:44.161775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.164970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:44.190699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.194411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.195968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.198078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.198956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.200787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.397600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-034c7036-81bd-4293-9766-cb7669f78276 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.332627 Sep 01 05:19:44.398805 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2685/5329] 10.222.0.26 () {60 vars in 1173 bytes} [Thu Sep 1 05:19:44 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.439947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8e4e776-0bd6-4f27-a5d8-63ff1ba8e301 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:44.490183 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8e4e776-0bd6-4f27-a5d8-63ff1ba8e301 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.074014 Sep 01 05:19:44.492349 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2686/5330] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 05:19:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.497182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:44.514929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88af3bfd-0781-45bb-b6a0-bae29c702c7a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.521057 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c94e8f4-46e8-43d2-bcb2-8b86fdd5737d tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.370310 Sep 01 05:19:44.531162 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2645/5331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:44 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:44.531371 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88af3bfd-0781-45bb-b6a0-bae29c702c7a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.025943 Sep 01 05:19:44.531371 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2687/5332] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Sep 1 05:19:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.542761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf609f6f-ba80-4ba3-a32b-e3f59709a259 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-820368-37"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:44.554671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf609f6f-ba80-4ba3-a32b-e3f59709a259 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:44.556594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf609f6f-ba80-4ba3-a32b-e3f59709a259 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:44.557116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf609f6f-ba80-4ba3-a32b-e3f59709a259 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:44.854164 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf609f6f-ba80-4ba3-a32b-e3f59709a259 tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.316287 Sep 01 05:19:44.875011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e617f2b9-9768-4340-8967-af5e63e4e47a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:44.882704 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2646/5333] 10.222.0.26 () {60 vars in 1194 bytes} [Thu Sep 1 05:19:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:44.910298 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e617f2b9-9768-4340-8967-af5e63e4e47a tempest-TestAggregatesBasicOps-231967700 tempest-TestAggregatesBasicOps-231967700-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.045191 Sep 01 05:19:44.911837 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2688/5334] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 1 05:19:44 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 01 05:19:45.546184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:45.547145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:45.563542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.564148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.564704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:45.565562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:45.566133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:45.566662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:46.088338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:46.097547 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6730b6d-4715-4f50-acc7-a03b83c73c3e tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.556625 Sep 01 05:19:46.098166 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2647/5335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:45 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:47.119065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:47.120511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:47.153460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:47.154253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:47.154922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.155855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:47.156496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:47.157198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:47.551160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:47.955729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:47.972629 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b901e73e-5147-409c-8a38-5fa020b54457 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.854331 Sep 01 05:19:47.980971 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2689/5336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:47 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:48.998142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:48.998142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:49.018400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.018917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.021639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.022404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:49.026750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:49.027987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:49.606750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:49.632933 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1bab181-d17a-4a2c-82dd-041d5b263399 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.638461 Sep 01 05:19:49.647656 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2648/5337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:48 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:50.665001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:50.668003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:50.684840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.690683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.691453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:50.696010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:50.697595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:50.698266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:51.092064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:51.115511 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f882ed7-fd74-4795-973d-f6ef96924dc3 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.453276 Sep 01 05:19:51.117242 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2690/5338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:50 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:52.149749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:52.150507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:52.177886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.184069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.184853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.189044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.190580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.191620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.331452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:52.333441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:52.352370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.353831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.356784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.358984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.363128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.363979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.684739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:52.700769 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b116f318-9279-4434-ba2e-0a7cbcf3e199 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.566482 Sep 01 05:19:52.703551 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2649/5339] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:52 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:52.718944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-916849e3-62ff-405e-9b87-c9c76341bd3f req-f8513973-2323-4f29-b351-a4301aaacd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ecdff6-730c-406c-834d-744a565f3604", "name": "network-vif-plugged", "status": "completed", "tag": "eab3d81b-6be9-4c7f-8588-a04e1c046e64"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:52.737175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-916849e3-62ff-405e-9b87-c9c76341bd3f req-f8513973-2323-4f29-b351-a4301aaacd01 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.737811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-916849e3-62ff-405e-9b87-c9c76341bd3f req-f8513973-2323-4f29-b351-a4301aaacd01 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.741532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-916849e3-62ff-405e-9b87-c9c76341bd3f req-f8513973-2323-4f29-b351-a4301aaacd01 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.751796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-916849e3-62ff-405e-9b87-c9c76341bd3f req-f8513973-2323-4f29-b351-a4301aaacd01 service nova] Creating event network-vif-plugged:eab3d81b-6be9-4c7f-8588-a04e1c046e64 for instance 90ecdff6-730c-406c-834d-744a565f3604 on n-h2-820368-37 Sep 01 05:19:52.762235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-916849e3-62ff-405e-9b87-c9c76341bd3f req-f8513973-2323-4f29-b351-a4301aaacd01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056463 Sep 01 05:19:52.763751 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2650/5340] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:19:52.798938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:52.820742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6f25cef-74fd-40b1-bc3e-a8cc34a2ad2a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.504173 Sep 01 05:19:52.823306 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2691/5341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:52 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:52.865879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:52.866802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:52.887505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.891345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.892062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:52.893049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:52.896895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:52.898925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.296209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:53.310224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9e77fb5-c74b-4af0-9cd9-66131841aaad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.466040 Sep 01 05:19:53.324295 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2651/5342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:52 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:53.329984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:53.334449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:53.335085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:53.347421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.347910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.348664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.349410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.349849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.356597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.732352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:53.735037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:53.744936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.745424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.745884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.746555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.747452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.747452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.846384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:53.855226 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c0b84ff-f2cb-4189-b2bc-d9cdbc365d48 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.526188 Sep 01 05:19:53.866010 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2692/5343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:53 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:53.889193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:53.890066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:53.911853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.912351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.913065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:53.917834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:53.923085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:53.923897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:54.068660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:54.087628 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce45fae1-965e-4874-87d9-70cf268ef23a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1328 microversion: 2.1 time: 0.362598 Sep 01 05:19:54.092010 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2652/5344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:53 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1328 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:54.128563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:54.138446 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1dc7221b-28ae-4d37-afe3-73e2074998a4 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.255834 Sep 01 05:19:54.139565 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2693/5345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:53 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:54.296011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1426915992", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "dc7e6109-f10c-46fb-98ac-ddd7a9c9df15"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:54.377592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] validate_networks() for [('dc7e6109-f10c-46fb-98ac-ddd7a9c9df15', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:19:55.097287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:19:55.097641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:19:55.098123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:19:55.098535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:19:55.098973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:19:55.114125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:55.115355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:55.117451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.118412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.119706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.120679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.122523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.123579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.126813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.128799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.130093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.134462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.136459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.137228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.178645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:19:55.191124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for user 87f4f3bcd603448d856a7471120a42af and project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:19:55.235615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:19:55.238086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:19:55.388262 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19b825e1-d97e-44c0-982a-ab68db707284 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096101 Sep 01 05:19:55.403449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2653/5346] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:19:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:19:55.412408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-262173ac-7b26-46ec-82e2-64e09148000c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:55.413281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-262173ac-7b26-46ec-82e2-64e09148000c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:55.660301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-262173ac-7b26-46ec-82e2-64e09148000c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:55.668322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:55.673755 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-262173ac-7b26-46ec-82e2-64e09148000c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1215 microversion: 2.1 time: 0.266511 Sep 01 05:19:55.676625 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2654/5347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:55 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:55.700372 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d178eba-f4d5-498b-b6f8-ff45a43f010a tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1529 microversion: 2.1 time: 0.589981 Sep 01 05:19:55.713309 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2694/5348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:55 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1529 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:55.725598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:55.728699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:55.741689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.743942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.744527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:55.752001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:55.767335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:55.768284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:56.709213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:56.709878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:56.735879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:56.736373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:56.736804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:56.746699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:56.751396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:56.751947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.027617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:57.037880 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2403a8a-b170-474a-94df-448d29904a8f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1211 microversion: 2.1 time: 0.333026 Sep 01 05:19:57.038473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2695/5349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:56 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1211 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:57.239942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:57.264800 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9ae0f71-fdba-4d59-94e4-c7e42779bfa1 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1529 microversion: 2.1 time: 1.541276 Sep 01 05:19:57.297774 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2655/5350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:55 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1529 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:57.785015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:57.785877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:57.800864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.801355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.804680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.809195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.811282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.811973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.851620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] HTTP exception thrown: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Request method failure captured: Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 HTTP/1.1 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEDmMp5g6kc9QLo1GIqSOxZsTNANTWMScVI0GJnaDyliLW_6ufK8CCahuRRTTjRag_rDuBAQRKDHlpwlopZXi4-FjPMMC8G10ly5FAQX5g396m5N-YPi7WF32ZQh2LvzWrhvxWfucsJwJE4pMUHqiQwFno9vxCcUYSKur7EI3O-ax9g Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 37da59b53b6a4dba90ca8675e67b3819 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-68751354 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-68751354 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 37da59b53b6a4dba90ca8675e67b3819 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-68751354 Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestMultiTenantJSON-68751354-project Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 994efbba2632474a89b9ad50134f855c Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-68751354-project Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '90ecdff6-730c-406c-834d-744a565f3604'} Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:57.863005 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:57.868814 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:57.872916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Returning 404 to user: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:57.874086 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04ea456b-c448-4561-a264-9f2165025859 tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 404 len: 111 microversion: 2.1 time: 0.553131 Sep 01 05:19:57.876483 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2696/5351] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:19:57 2022] DELETE /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 111 bytes in 556 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:57.886429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:57.887371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:57.909266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.910173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.911300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:57.919668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:57.927299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:57.927934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.062402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:58.063335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:58.073405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.074207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.075840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.076756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.078369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.093188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.320870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:58.332516 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee8198a1-673d-4b02-a71b-86752cb19623 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1273 microversion: 2.1 time: 0.273791 Sep 01 05:19:58.339429 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2697/5352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:58 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:19:58.383881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:58.395058 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-818f0554-280d-44e4-a04e-3279be81eb12 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1529 microversion: 2.1 time: 0.509342 Sep 01 05:19:58.395895 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2656/5353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:57 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1529 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:58.432699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Action: 'update', calling method: >, body: {"server": {"name": "90ecdff6-730c-406c-834d-744a565f3604_new"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:19:58.443790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:58.458781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.459512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.460153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.461082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.461911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.462865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.504352 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] HTTP exception thrown: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Request method failure captured: Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: request: PUT /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 HTTP/1.1 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 64 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEDmMp5g6kc9QLo1GIqSOxZsTNANTWMScVI0GJnaDyliLW_6ufK8CCahuRRTTjRag_rDuBAQRKDHlpwlopZXi4-FjPMMC8G10ly5FAQX5g396m5N-YPi7WF32ZQh2LvzWrhvxWfucsJwJE4pMUHqiQwFno9vxCcUYSKur7EI3O-ax9g Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 37da59b53b6a4dba90ca8675e67b3819 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-68751354 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37da59b53b6a4dba90ca8675e67b3819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-68751354 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 37da59b53b6a4dba90ca8675e67b3819 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-68751354 Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestMultiTenantJSON-68751354-project Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 994efbba2632474a89b9ad50134f855c Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-68751354-project Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: {"server": {"name": "90ecdff6-730c-406c-834d-744a565f3604_new"}} Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '90ecdff6-730c-406c-834d-744a565f3604', 'body': {'server': {'name': '90ecdff6-730c-406c-834d-744a565f3604_new'}}} Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 01 05:19:58.508061 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:19:58.514526 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:19:58.528190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] Returning 404 to user: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:19:58.529393 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e29b89de-9e68-4a2f-8543-c482ad48055d tempest-ServersNegativeTestMultiTenantJSON-68751354 tempest-ServersNegativeTestMultiTenantJSON-68751354-project] 10.222.0.26 "PUT /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 404 len: 111 microversion: 2.1 time: 0.113502 Sep 01 05:19:58.534431 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2698/5354] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:19:58 2022] PUT /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:19:58.541926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:58.542429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:58.562092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.563080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.563713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.565943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.569574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.570294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.661391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:19:58.890510 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c14ead4-f4d9-449a-b5d4-e02923a5c8ee tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 204 len: 0 microversion: 2.1 time: 0.351008 Sep 01 05:19:58.900955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:58.901739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:58.905114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2657/5355] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:19:58 2022] DELETE /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:58.912789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.915699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.916405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:58.919848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:58.921296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:58.922329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:59.249083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:59.261507 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68a31c6f-430f-4820-9c4a-f3249cf5ce55 tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1535 microversion: 2.1 time: 0.365140 Sep 01 05:19:59.268379 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2699/5356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:58 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1535 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:59.358729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:19:59.359813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:19:59.385707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:59.387621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:59.388525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:59.390534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:19:59.391438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:19:59.392946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:19:59.405992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:59.541238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:19:59.553020 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57d5c012-e111-4656-af2f-954f0572dd07 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1273 microversion: 2.1 time: 0.202269 Sep 01 05:19:59.553637 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2658/5357] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:19:59 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:00.289107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:00.290637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:00.305179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.306393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.306822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.307582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.308036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.308460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.574734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:00.575797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:00.588889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.589394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.589836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:00.599065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:00.604288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:00.605000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.261526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:01.280353 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e025606-b286-4cd2-a3ce-1dc2f0fd0dce tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1535 microversion: 2.1 time: 0.996128 Sep 01 05:20:01.300245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2700/5358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:00 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1535 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:01.444942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:01.465969 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6a653b9-27d9-42a2-90ca-fd44bd8130b1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.895948 Sep 01 05:20:01.470915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2659/5359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:00 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:01.520059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4b21a79b-4018-4891-b096-def8c63f9152 req-3378b751-e337-4a83-8b05-56f033f35126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ecdff6-730c-406c-834d-744a565f3604", "name": "network-vif-deleted", "tag": "eab3d81b-6be9-4c7f-8588-a04e1c046e64"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:01.542149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b21a79b-4018-4891-b096-def8c63f9152 req-3378b751-e337-4a83-8b05-56f033f35126 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:01.553263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b21a79b-4018-4891-b096-def8c63f9152 req-3378b751-e337-4a83-8b05-56f033f35126 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:01.555019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4b21a79b-4018-4891-b096-def8c63f9152 req-3378b751-e337-4a83-8b05-56f033f35126 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.570104 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4b21a79b-4018-4891-b096-def8c63f9152 req-3378b751-e337-4a83-8b05-56f033f35126 service nova] Creating event network-vif-deleted:eab3d81b-6be9-4c7f-8588-a04e1c046e64 for instance 90ecdff6-730c-406c-834d-744a565f3604 on n-h2-820368-37 Sep 01 05:20:01.579018 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4b21a79b-4018-4891-b096-def8c63f9152 req-3378b751-e337-4a83-8b05-56f033f35126 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063771 Sep 01 05:20:01.582407 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2701/5360] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:01.842054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ef8d5278-fce7-4a80-aad0-b022330b27bb req-ce9b6a18-bd6f-49bc-945e-b7175f94e4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4a71ec-b6b8-461e-808f-00fe2d3de422", "tag": "778a1c44-d43c-4907-8c9f-493ae86439ae"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:01.876400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:01.882044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef8d5278-fce7-4a80-aad0-b022330b27bb req-ce9b6a18-bd6f-49bc-945e-b7175f94e4b9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:01.882736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef8d5278-fce7-4a80-aad0-b022330b27bb req-ce9b6a18-bd6f-49bc-945e-b7175f94e4b9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:01.884731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef8d5278-fce7-4a80-aad0-b022330b27bb req-ce9b6a18-bd6f-49bc-945e-b7175f94e4b9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:01.920218 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ef8d5278-fce7-4a80-aad0-b022330b27bb req-ce9b6a18-bd6f-49bc-945e-b7175f94e4b9 service nova] Creating event network-changed:778a1c44-d43c-4907-8c9f-493ae86439ae for instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 on n-h1-820368-37 Sep 01 05:20:01.927179 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ef8d5278-fce7-4a80-aad0-b022330b27bb req-ce9b6a18-bd6f-49bc-945e-b7175f94e4b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092088 Sep 01 05:20:01.928523 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2660/5361] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:02.308633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:02.309457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:02.318103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.318856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.319951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.321545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.322780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.323476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.411589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.412083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.412524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.412990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lazy-loading 'fault' on Instance uuid 90ecdff6-730c-406c-834d-744a565f3604 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:20:02.490424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8fad98b182441d488a4b303f1207e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2625f2d0b34d18b4f341ff465d1ffe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:02.495036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:02.495274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:02.495885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:02.503368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bde2a6d-df45-4798-be1e-094c611debbe tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 200 len: 1318 microversion: 2.1 time: 0.201176 Sep 01 05:20:02.507810 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2702/5362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:02 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:02.511170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.511672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.517648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.518435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:02.519171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:02.519930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:02.941308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:02.950910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-443b70b4-972c-4cc8-89b2-10f32cb84497 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.464438 Sep 01 05:20:02.951530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2661/5363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:02 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:03.530693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:03.531287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] [instance: 90ecdff6-730c-406c-834d-744a565f3604] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:03.536165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:03.548873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:03.549380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:03.549820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:03.550541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:03.551015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:03.557113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:03.603543 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] HTTP exception thrown: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Request method failure captured: Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 HTTP/1.1 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEDahzkqCKRXnSmh3YrTtG7kP9nLmkg-yuZqfLTNI3naucVuHGkwzwJ0RLIz1yOfm_huTeusVO_YB4ur_6KdQX8kLM5DSamvQtpKmlht3q8IZpcEfW5lrPSQxslOHTDwbURpZ_lb7khC8P5aQj5xPsQ7xRU89Vhrc5IJeItxbVJwzHI Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 8e2625f2d0b34d18b4f341ff465d1ffe Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-354961320 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e2625f2d0b34d18b4f341ff465d1ffe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e2625f2d0b34d18b4f341ff465d1ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e2625f2d0b34d18b4f341ff465d1ffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e2625f2d0b34d18b4f341ff465d1ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-354961320 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 8e2625f2d0b34d18b4f341ff465d1ffe Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-354961320 Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestMultiTenantJSON-354961320-project Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d8fad98b182441d488a4b303f1207e8c Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-354961320-project Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '90ecdff6-730c-406c-834d-744a565f3604'} Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:20:03.605537 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. Sep 01 05:20:03.610074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:20:03.611459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] Returning 404 to user: Instance 90ecdff6-730c-406c-834d-744a565f3604 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:20:03.612329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fbdf94a-55a9-492d-87a3-5986555893fc tempest-ServersNegativeTestMultiTenantJSON-354961320 tempest-ServersNegativeTestMultiTenantJSON-354961320-project] 10.222.0.26 "GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604" status: 404 len: 111 microversion: 2.1 time: 0.085939 Sep 01 05:20:03.612898 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2703/5364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:03 2022] GET /compute/v2.1/servers/90ecdff6-730c-406c-834d-744a565f3604 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:20:03.974134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:03.976349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:03.999161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:04.005645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:04.006367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:04.010041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:04.010610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:04.014075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:04.339022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:04.350227 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b67347b6-d0fb-4a33-81ef-f09cc6a5e89b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.381527 Sep 01 05:20:04.351345 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2662/5365] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:03 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:04.611896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19926ef1-5246-4da7-8a56-f0ce20c75500 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: .version_select at 0x7fa75a7715e0>, body: {"keypair": {"name": "tempest-keypair-820299156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX54CnJgsfgj/XFue9Fmlgl173/rgiXj+z8/Jx1cXr1cmLRIp8OQIHvJKkb/UbjA3vAVtF+jsk5DagRqSqyTtPg/M9Y9bXTapGTiG5veIKLDL9RMJy5Z7EmPcI14cEa5g=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:04.641990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-19926ef1-5246-4da7-8a56-f0ce20c75500 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for project effcb18d84544e18b42c5c4df340e298. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:04.650012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-19926ef1-5246-4da7-8a56-f0ce20c75500 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for user 8dd890dfc9e743388863785f3ce4b266 and project effcb18d84544e18b42c5c4df340e298. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:04.685847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19926ef1-5246-4da7-8a56-f0ce20c75500 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.461844 Sep 01 05:20:04.687279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2704/5366] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:20:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:20:05.368471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:05.375133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:05.376066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:05.394516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:05.395206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:05.395908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:05.396908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:05.398745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:05.401247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:05.667507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:05.881744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:05.897068 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ff4edb8-590b-4c6c-995b-f93559c97ddc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.529186 Sep 01 05:20:05.899474 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2663/5367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:05 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:06.931419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:06.934386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:06.942454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:06.943391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:06.944027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:06.945309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:06.946995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:06.947759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:07.151551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-438002667", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22bee5f0-b7bc-4321-940b-b22ffa3ba17b"}], "security_groups": [{"name": "tempest-securitygroup--2062728686"}], "key_name": "tempest-keypair-820299156", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:07.178710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:07.191212 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04ce94d4-58d4-4c88-8af0-c3554caaf892 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.274577 Sep 01 05:20:07.191847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2705/5368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:06 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:07.298960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] validate_networks() for [('22bee5f0-b7bc-4321-940b-b22ffa3ba17b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:20:08.038562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:20:08.039025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:20:08.039548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:20:08.039964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:20:08.040488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:20:08.052592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.053093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.053539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.054605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.055341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.056076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.097131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for project effcb18d84544e18b42c5c4df340e298. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:08.115692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for user 8dd890dfc9e743388863785f3ce4b266 and project effcb18d84544e18b42c5c4df340e298. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:08.155355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:20:08.158034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:20:08.213883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:08.215173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:08.229989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.247470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.248300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.249258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.251549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.255634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.266628 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b133db7e-bbbc-41fb-8b40-911d3646c866 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.121626 Sep 01 05:20:08.271623 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2664/5369] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:20:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:20:08.313679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98245abe-da4f-4826-be62-6e67c10ce158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:08.314443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98245abe-da4f-4826-be62-6e67c10ce158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:08.458123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98245abe-da4f-4826-be62-6e67c10ce158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:08.468677 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98245abe-da4f-4826-be62-6e67c10ce158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1236 microversion: 2.1 time: 0.178409 Sep 01 05:20:08.473722 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2665/5370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:08 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1236 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:08.599696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-406a09d2-0fdc-4fe4-904f-62c8195d27b5 req-a8238036-8cca-48f5-8d41-b29be56aca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4a71ec-b6b8-461e-808f-00fe2d3de422", "name": "network-vif-plugged", "status": "completed", "tag": "778a1c44-d43c-4907-8c9f-493ae86439ae"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:08.646988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-406a09d2-0fdc-4fe4-904f-62c8195d27b5 req-a8238036-8cca-48f5-8d41-b29be56aca6a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:08.647821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-406a09d2-0fdc-4fe4-904f-62c8195d27b5 req-a8238036-8cca-48f5-8d41-b29be56aca6a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:08.648619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-406a09d2-0fdc-4fe4-904f-62c8195d27b5 req-a8238036-8cca-48f5-8d41-b29be56aca6a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:08.681276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:08.719228 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55f9e5db-a8e4-4b56-99fc-59d3a89b7922 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.509027 Sep 01 05:20:08.720244 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2706/5371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:08 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:08.737348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-406a09d2-0fdc-4fe4-904f-62c8195d27b5 req-a8238036-8cca-48f5-8d41-b29be56aca6a service nova] Creating event network-vif-plugged:778a1c44-d43c-4907-8c9f-493ae86439ae for instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 on n-h1-820368-37 Sep 01 05:20:08.761297 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-406a09d2-0fdc-4fe4-904f-62c8195d27b5 req-a8238036-8cca-48f5-8d41-b29be56aca6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165517 Sep 01 05:20:08.779566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2666/5372] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:20:09.489849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:09.490465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:09.506189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.508253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.511260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.514469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.515339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.516106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.658776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:09.671388 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccd9b525-f5a3-48fe-b085-904eba055809 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1288 microversion: 2.1 time: 0.185067 Sep 01 05:20:09.674944 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2707/5373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:09 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:09.743280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:09.744116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:09.760799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.761961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.763181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:09.765534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:09.766385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:09.769815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.098758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:10.115115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-445aeb03-6edb-4b42-91a6-b1efee831d15 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1315 microversion: 2.1 time: 0.377192 Sep 01 05:20:10.116515 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2667/5374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:09 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:10.696128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:10.699679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:10.709109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:10.709625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:10.710036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.712426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:10.713053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:10.718302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:10.887185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:10.898731 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5ea8164-88f0-47d0-b144-e570aae9b242 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1294 microversion: 2.1 time: 0.206466 Sep 01 05:20:10.919005 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2708/5375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:10 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1294 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:11.138230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:11.139069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:11.158783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.159401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.159954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.161186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.161739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.162297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.935347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:11.936091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:11.980292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.981225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.981888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:11.986702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:11.987483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:11.991879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:12.224777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:12.256784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68100eb6-71db-441d-8ba6-481c12ee2732 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1503 microversion: 2.1 time: 1.117869 Sep 01 05:20:12.260138 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2668/5376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:11 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1503 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:12.299755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:12.300533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:12.311516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:12.312285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:12.315188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:12.318042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:12.318753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:12.319960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:12.719153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:12.730152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d194d5a-1ae7-4eaa-948d-263718669403 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.801662 Sep 01 05:20:12.743513 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2709/5377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:11 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:12.821067 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Removing security group f483754e-7f2f-41e8-a75a-44cc6214fcd9 from port 778a1c44-d43c-4907-8c9f-493ae86439ae Sep 01 05:20:13.635755 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d11f93d-0cc9-4904-8827-31f8295e2fec tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422/action" status: 202 len: 0 microversion: 2.1 time: 1.348956 Sep 01 05:20:13.637524 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2669/5378] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:20:12 2022] POST /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422/action => generated 0 bytes in 1353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:20:13.653484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-893ce2a0-fb5a-414e-ad6a-0df4e8d3c4a7 req-cebbe6d6-1cb0-47a9-af98-9e7a87742a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4a71ec-b6b8-461e-808f-00fe2d3de422", "tag": "778a1c44-d43c-4907-8c9f-493ae86439ae"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:13.654609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:13.655813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:13.689321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.692390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.695667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.703978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.705738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.708626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.716476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-893ce2a0-fb5a-414e-ad6a-0df4e8d3c4a7 req-cebbe6d6-1cb0-47a9-af98-9e7a87742a7a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.716971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-893ce2a0-fb5a-414e-ad6a-0df4e8d3c4a7 req-cebbe6d6-1cb0-47a9-af98-9e7a87742a7a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.717388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-893ce2a0-fb5a-414e-ad6a-0df4e8d3c4a7 req-cebbe6d6-1cb0-47a9-af98-9e7a87742a7a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.776931 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-893ce2a0-fb5a-414e-ad6a-0df4e8d3c4a7 req-cebbe6d6-1cb0-47a9-af98-9e7a87742a7a service nova] Creating event network-changed:778a1c44-d43c-4907-8c9f-493ae86439ae for instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 on n-h1-820368-37 Sep 01 05:20:13.791688 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-893ce2a0-fb5a-414e-ad6a-0df4e8d3c4a7 req-cebbe6d6-1cb0-47a9-af98-9e7a87742a7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142521 Sep 01 05:20:13.792800 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2670/5379] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:13.810675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:13.826757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:13.839267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.844060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.844799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:13.847872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:13.849018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:13.852894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:14.659092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:14.726247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:14.773578 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24082489-1910-4412-846a-1ad19339889f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1461 microversion: 2.1 time: 1.130361 Sep 01 05:20:14.778075 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2710/5380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:13 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1461 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:14.800785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:14.802387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:14.812964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:14.813462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:14.816243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:14.819140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:14.819977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:14.825593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.160169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:15.195528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f27e51ac-d125-4db9-bedc-414b0f05d1dd tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 1.397761 Sep 01 05:20:15.202979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2671/5381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:13 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:15.338412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:15.349782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14f7a3e6-12b9-4c41-9eda-01128d5bb86d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.553001 Sep 01 05:20:15.392173 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2711/5382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:14 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:15.408712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:15.413008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:15.448042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.448749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.449393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.452548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.460188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.460819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.846823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bdfb1339-936a-4cda-b158-75c6b344249b req-bcf483d9-61da-4bae-ae2b-0b3b25ec68ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a706f82-fb41-4b07-aab0-8308a90e077d", "tag": "49cf8aac-855f-4013-af31-fb86ce23a37d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:15.875219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bdfb1339-936a-4cda-b158-75c6b344249b req-bcf483d9-61da-4bae-ae2b-0b3b25ec68ae service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:15.875706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bdfb1339-936a-4cda-b158-75c6b344249b req-bcf483d9-61da-4bae-ae2b-0b3b25ec68ae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:15.876145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bdfb1339-936a-4cda-b158-75c6b344249b req-bcf483d9-61da-4bae-ae2b-0b3b25ec68ae service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:15.898933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bdfb1339-936a-4cda-b158-75c6b344249b req-bcf483d9-61da-4bae-ae2b-0b3b25ec68ae service nova] Creating event network-changed:49cf8aac-855f-4013-af31-fb86ce23a37d for instance 9a706f82-fb41-4b07-aab0-8308a90e077d on n-h2-820368-37 Sep 01 05:20:15.911091 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bdfb1339-936a-4cda-b158-75c6b344249b req-bcf483d9-61da-4bae-ae2b-0b3b25ec68ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075601 Sep 01 05:20:15.912008 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2712/5383] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:16.006937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:16.055953 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2a0d2d1-db11-4d45-907b-2c63fa50cbad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.653070 Sep 01 05:20:16.065070 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2672/5384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:15 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:16.088540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:16.088813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:16.111477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.116689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.120992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.122464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.127892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.128919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.222678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:16.223499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:16.230547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.244242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.244706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.245656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.246938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.247570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.608765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:16.617952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea654d13-2483-412a-9c29-a51b26823e88 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.534827 Sep 01 05:20:16.637876 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2713/5385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:16 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:16.644154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:16.644988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:16.654858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.656186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.660268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.663504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:16.664633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:16.666327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:16.803220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:16.831476 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3216825-07a5-465a-b38c-56c312d2fd74 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.611849 Sep 01 05:20:16.833633 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2673/5386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:16 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:17.072023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:17.087620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb791465-cedd-47ea-83f9-d0b6029d3f6a tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.447831 Sep 01 05:20:17.089374 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2714/5387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:16 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:17.269669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1230202482", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "dc7e6109-f10c-46fb-98ac-ddd7a9c9df15"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:17.380279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] validate_networks() for [('dc7e6109-f10c-46fb-98ac-ddd7a9c9df15', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:20:17.856591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:17.857320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:17.873112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:17.873651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:17.874269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:17.875023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:17.875543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:17.876191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:18.065375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:18.287710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:18.292621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:20:18.293104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:20:18.293501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:20:18.293911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:20:18.294321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:20:18.306032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f937609-71f7-4427-adec-0a5ad240a7fb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.453491 Sep 01 05:20:18.323642 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2715/5388] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:17 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:18.325427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:18.325928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:18.326364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:18.327125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:18.339879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:18.340716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:18.372812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:18.385330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Getting quotas for user 87f4f3bcd603448d856a7471120a42af and project 73595708b0aa4675b02e05947383d8d9. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:18.425136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:20:18.427665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:20:18.529379 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e86f5fd-8191-4f32-8efb-37e09ee02bab tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264753 Sep 01 05:20:18.530293 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2674/5389] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:20:18.544551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d7a34f9-77ee-4536-b361-304b2ab8d51c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:18.546332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d7a34f9-77ee-4536-b361-304b2ab8d51c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:19.015372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68ffb4c1-5833-4f40-a83d-b3ffcf8d8fb6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'create', calling method: .version_select at 0x7fa75be68430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1425510476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoXq9C2ktbZRbiZbEauRbIt/pFffQ5tYWzB16wG3ycaoHV3gb5CEJ1IdRJoJiN7mtNNTQrzZkwVnGyfoXn1blgWs6EeJxr0OPfN4d9KBA55fuVc2R9bvIr4f9LpBKNPCg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:19.051082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-68ffb4c1-5833-4f40-a83d-b3ffcf8d8fb6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:19.058187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-68ffb4c1-5833-4f40-a83d-b3ffcf8d8fb6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for user 50a11eb4b2684c369eaff25fe84e837c and project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:19.124809 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68ffb4c1-5833-4f40-a83d-b3ffcf8d8fb6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.114938 Sep 01 05:20:19.125698 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2675/5390] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:20:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:19.311226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d7a34f9-77ee-4536-b361-304b2ab8d51c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:19.320135 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d7a34f9-77ee-4536-b361-304b2ab8d51c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1215 microversion: 2.1 time: 0.782241 Sep 01 05:20:19.327614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:19.329029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:19.334742 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2716/5391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:18 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1215 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:19.340363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:19.348491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:19.349299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:19.350210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:19.350993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:19.351332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:19.890022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:19.907532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5e6549e-1f6c-415c-9f6b-23fca6fb3065 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.583923 Sep 01 05:20:19.918427 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2676/5392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:19 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:20.356600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:20.359129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:20.373108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.381094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.381933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.385258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.386053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.387057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.532713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:20.559909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4052dd7-251f-49b5-8a10-813b8a5db240 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1267 microversion: 2.1 time: 0.209237 Sep 01 05:20:20.568171 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2717/5393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:20 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:20.940490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:20.941313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:20.961796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.966073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.966819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:20.967671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:20.968345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:20.968791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.398480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:21.416972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69cead47-31f4-494b-a4c0-c32bcbada907 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.481134 Sep 01 05:20:21.418840 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2677/5394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:20 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:21.589738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:21.590361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:21.595335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-492331599", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "9d4e3963-d895-4f91-833b-c6a70f440861"}], "key_name": "tempest-TestNetworkBasicOps-1425510476", "security_groups": [{"name": "tempest-secgroup-smoke-857671675"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:21.604204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:21.604694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:21.609591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.610726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:21.612218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:21.612840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:21.756943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:21.768022 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f51c5df7-f3b4-4242-82e7-02be74a17c30 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1273 microversion: 2.1 time: 0.183168 Sep 01 05:20:21.771833 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2718/5395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:21 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:22.008286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] validate_networks() for [('9d4e3963-d895-4f91-833b-c6a70f440861', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:20:22.444704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:22.445377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:22.471711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.478634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.478964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.479752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.480245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.480657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.928522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:22.937406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4e95ece-d73d-4850-a876-be3a4379f091 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.496919 Sep 01 05:20:22.937999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2719/5396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:22 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:22.954527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:22.957649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:22.978174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.984868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.987944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:22.989042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:22.992381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:22.993119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.378834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:23.391637 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61c47c7c-c156-428d-ba00-5d9d69ad0c84 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.445081 Sep 01 05:20:23.392840 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2720/5397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:22 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:23.598375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1bf2dc6e-931d-4bc2-82b9-a3c3d3076819 req-89ca458e-c85c-4187-8bb4-116b215e35fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2800d91a-d2a9-48ce-a70b-7bb29291e60f", "tag": "49b8786b-4038-4ca1-abde-569bbfff7ee4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:23.628815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1bf2dc6e-931d-4bc2-82b9-a3c3d3076819 req-89ca458e-c85c-4187-8bb4-116b215e35fd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.630188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1bf2dc6e-931d-4bc2-82b9-a3c3d3076819 req-89ca458e-c85c-4187-8bb4-116b215e35fd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.630867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1bf2dc6e-931d-4bc2-82b9-a3c3d3076819 req-89ca458e-c85c-4187-8bb4-116b215e35fd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.679174 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1bf2dc6e-931d-4bc2-82b9-a3c3d3076819 req-89ca458e-c85c-4187-8bb4-116b215e35fd service nova] Creating event network-changed:49b8786b-4038-4ca1-abde-569bbfff7ee4 for instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f on n-h2-820368-37 Sep 01 05:20:23.693884 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1bf2dc6e-931d-4bc2-82b9-a3c3d3076819 req-89ca458e-c85c-4187-8bb4-116b215e35fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099549 Sep 01 05:20:23.695194 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2721/5398] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:20:23.885502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:20:23.887049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:20:23.887694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:20:23.888264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:20:23.888837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:20:23.908668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.909218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.909747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.910542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.916194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:23.916685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:23.959924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:23.961232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:23.964573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:23.970396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for user 50a11eb4b2684c369eaff25fe84e837c and project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:23.991398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:23.991901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.010698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:20:24.013295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:20:24.025867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.027979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.028648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.029242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.168064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfe36a89-86de-47cb-a764-1d6289e44e31 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.578365 Sep 01 05:20:24.169184 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2678/5399] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:20:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:20:24.182547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e2f8648-0603-48b3-8341-321f59d5fb6c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:24.183699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e2f8648-0603-48b3-8341-321f59d5fb6c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:24.337630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e2f8648-0603-48b3-8341-321f59d5fb6c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:24.368726 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e2f8648-0603-48b3-8341-321f59d5fb6c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1248 microversion: 2.1 time: 0.190226 Sep 01 05:20:24.370790 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2679/5400] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:24 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1248 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:24.413203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:24.416479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:24.423519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:24.442189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.442782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.443295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.444611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:24.445081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:24.445589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:24.496202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:24.511148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-686e838c-9680-4f0c-b4aa-e2a4d5596bb0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.552662 Sep 01 05:20:24.514086 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2722/5401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:23 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:24.773029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:24.783059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-080eb1f2-a7f4-4528-a667-dd0ad4b6d043 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.373669 Sep 01 05:20:24.784601 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2680/5402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:24 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:25.392216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:25.392587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:25.401139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.401626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.402054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.402745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.403244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.403613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.425437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:25.487750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:25.502368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d249833-af00-4308-bb57-ad3125c7258c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1300 microversion: 2.1 time: 0.113890 Sep 01 05:20:25.504230 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2723/5403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:25 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:25.537804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:25.539007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:25.548148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.548764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.549085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.549805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.550699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.551519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.794837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:25.805444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:25.806082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:25.819030 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7be32a6d-3d1d-4891-8253-db69bb8e8ed2 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.285257 Sep 01 05:20:25.819650 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2681/5404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:25 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:25.826276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.826783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.827320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:25.829982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:25.830472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:25.830933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.115634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:26.126373 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71c4140f-cc5f-4960-b9ae-9d0641ce0905 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.325553 Sep 01 05:20:26.141497 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2724/5405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:25 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:26.349080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f65c5992-362c-4f62-befd-462f894e4dcc req-b9152f3e-f5a0-4531-8cc5-c56b4b87047f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a706f82-fb41-4b07-aab0-8308a90e077d", "name": "network-vif-plugged", "status": "completed", "tag": "49cf8aac-855f-4013-af31-fb86ce23a37d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:26.363645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f65c5992-362c-4f62-befd-462f894e4dcc req-b9152f3e-f5a0-4531-8cc5-c56b4b87047f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.370838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f65c5992-362c-4f62-befd-462f894e4dcc req-b9152f3e-f5a0-4531-8cc5-c56b4b87047f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.371562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f65c5992-362c-4f62-befd-462f894e4dcc req-b9152f3e-f5a0-4531-8cc5-c56b4b87047f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.389891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:26.392408 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f65c5992-362c-4f62-befd-462f894e4dcc req-b9152f3e-f5a0-4531-8cc5-c56b4b87047f service nova] Creating event network-vif-plugged:49cf8aac-855f-4013-af31-fb86ce23a37d for instance 9a706f82-fb41-4b07-aab0-8308a90e077d on n-h2-820368-37 Sep 01 05:20:26.412535 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f65c5992-362c-4f62-befd-462f894e4dcc req-b9152f3e-f5a0-4531-8cc5-c56b4b87047f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062648 Sep 01 05:20:26.412535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2682/5406] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:26.528975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:26.529575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:26.541199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.541706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.542147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.543454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.543947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.544596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.846793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:26.847540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:26.862348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.868663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.871261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:26.872321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:26.874134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:26.875886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.466412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:27.475092 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-feb82f7f-65da-4078-938c-cb1756e5cbf2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1306 microversion: 2.1 time: 0.951056 Sep 01 05:20:27.483091 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2725/5407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:26 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1306 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:27.483091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:27.483091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:27.488453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:27.488564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:27.488940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.489821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:27.490593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:27.491042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:27.611424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:27.620760 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-634af0a4-0ce8-4ff8-9b1b-fd03ebb37a8d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.779285 Sep 01 05:20:27.634649 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2683/5408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:26 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:27.691793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:27.705289 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8542c48e-74d0-4814-af3a-ab03b1078290 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.228045 Sep 01 05:20:27.706609 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2726/5409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:27 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:28.499551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:28.500376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:28.511917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.512399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.513771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.514854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.517429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.518063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.684448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c66997b5-cbec-48ba-9ab0-96c394d008bd tempest-ComputeTenantNetworksTest-2011946116 tempest-ComputeTenantNetworksTest-2011946116-project] Calling method '.version_select at 0x7fa75b311700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:28.781380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:28.791714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bdb2baf-bf9c-4a38-be1e-f7d7ee8be442 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1373 microversion: 2.1 time: 0.297768 Sep 01 05:20:28.804179 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2727/5410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:28 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1373 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:28.816177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:28.817123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:28.824084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.824969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.825320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.826431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.827099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.827523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.872910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c66997b5-cbec-48ba-9ab0-96c394d008bd tempest-ComputeTenantNetworksTest-2011946116 tempest-ComputeTenantNetworksTest-2011946116-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.404724 Sep 01 05:20:28.873513 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2684/5411] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 05:20:28 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:28.883365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:28.884596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:28.892108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.892917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.893577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:28.894480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:28.895135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:28.895873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.181943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:29.202872 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b65f518e-688c-44ec-bec9-b43264191724 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1362 microversion: 2.1 time: 0.396587 Sep 01 05:20:29.203863 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2728/5412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:28 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:29.229024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b6e2492-5a0b-453a-b5ed-2961d69583a8 tempest-ComputeTenantNetworksTest-2011946116 tempest-ComputeTenantNetworksTest-2011946116-project] Calling method '.version_select at 0x7fa75a77e280>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:29.289563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:29.300938 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae35f0cb-f7c4-46e3-ab23-0a2a549f3514 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.425873 Sep 01 05:20:29.304705 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2685/5413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:28 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:29.317939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:29.332526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-41498ae0-b15c-45ce-ad91-9dd419b40dcf req-7e67afa0-14c5-490a-9ba4-c7e605394742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06768c8f-8853-4c51-95d3-80643bd4c11f", "tag": "95bf9467-82aa-47ef-bfba-b82a17addc81"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:29.360631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41498ae0-b15c-45ce-ad91-9dd419b40dcf req-7e67afa0-14c5-490a-9ba4-c7e605394742 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.361436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41498ae0-b15c-45ce-ad91-9dd419b40dcf req-7e67afa0-14c5-490a-9ba4-c7e605394742 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.362051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41498ae0-b15c-45ce-ad91-9dd419b40dcf req-7e67afa0-14c5-490a-9ba4-c7e605394742 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.390615 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-41498ae0-b15c-45ce-ad91-9dd419b40dcf req-7e67afa0-14c5-490a-9ba4-c7e605394742 service nova] Creating event network-changed:95bf9467-82aa-47ef-bfba-b82a17addc81 for instance 06768c8f-8853-4c51-95d3-80643bd4c11f on n-h1-820368-37 Sep 01 05:20:29.396810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-41498ae0-b15c-45ce-ad91-9dd419b40dcf req-7e67afa0-14c5-490a-9ba4-c7e605394742 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075013 Sep 01 05:20:29.397772 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2686/5414] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:29.416417 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b6e2492-5a0b-453a-b5ed-2961d69583a8 tempest-ComputeTenantNetworksTest-2011946116 tempest-ComputeTenantNetworksTest-2011946116-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks/374e148c-607c-4b9b-a4b5-90b9d4c96f39" status: 200 len: 140 microversion: 2.1 time: 0.199423 Sep 01 05:20:29.417018 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2729/5415] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 05:20:29 2022] GET /compute/v2.1/os-tenant-networks/374e148c-607c-4b9b-a4b5-90b9d4c96f39 => generated 140 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:29.823292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:29.824066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:29.835553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.836989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.837452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:29.838178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:29.838645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:29.841240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.087720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:30.104348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a0f3a09-3805-43a9-b3c2-788b6d53430f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1373 microversion: 2.1 time: 0.287678 Sep 01 05:20:30.106671 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2687/5416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:29 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1373 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:30.231595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:30.232978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:30.267373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.269277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.271118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.273991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.274710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.275709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.326477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:30.327602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:30.345720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.346244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.346691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.347546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.354239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.354704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.552503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:30.564775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31b0a44c-0c85-45ae-959c-8af2f5154e59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1547 microversion: 2.1 time: 0.338777 Sep 01 05:20:30.566939 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2730/5417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:30 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1547 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:30.575172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7aa5824c-a92c-45e5-b234-6ec00329aedd req-05215c8a-4c2f-47e0-879c-0e1b1a661567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2800d91a-d2a9-48ce-a70b-7bb29291e60f", "name": "network-vif-plugged", "status": "completed", "tag": "49b8786b-4038-4ca1-abde-569bbfff7ee4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:30.591045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7aa5824c-a92c-45e5-b234-6ec00329aedd req-05215c8a-4c2f-47e0-879c-0e1b1a661567 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.591720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7aa5824c-a92c-45e5-b234-6ec00329aedd req-05215c8a-4c2f-47e0-879c-0e1b1a661567 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.592250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7aa5824c-a92c-45e5-b234-6ec00329aedd req-05215c8a-4c2f-47e0-879c-0e1b1a661567 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.609529 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7aa5824c-a92c-45e5-b234-6ec00329aedd req-05215c8a-4c2f-47e0-879c-0e1b1a661567 service nova] Creating event network-vif-plugged:49b8786b-4038-4ca1-abde-569bbfff7ee4 for instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f on n-h2-820368-37 Sep 01 05:20:30.616815 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7aa5824c-a92c-45e5-b234-6ec00329aedd req-05215c8a-4c2f-47e0-879c-0e1b1a661567 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047408 Sep 01 05:20:30.618736 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2731/5418] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:30.624692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:30.625581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:30.634820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:30.635413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.636151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.636801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.637711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:30.638365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:30.639201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:30.643604 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12fdc9d0-cd96-437c-b89e-3d2cc81e346f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.320989 Sep 01 05:20:30.644537 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2688/5419] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:30 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:30.758780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac51f6d5-4877-4413-88e7-9cb60a62c9bb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137967 Sep 01 05:20:30.770162 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2732/5420] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:20:30 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:31.129549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:31.130954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:31.143403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.144167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.144761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.145671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.146290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.146873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.369960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:31.378758 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-205087fa-fa7e-43f7-bd12-573a9fe9581e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1373 microversion: 2.1 time: 0.256465 Sep 01 05:20:31.391201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2689/5421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:31 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:31.669650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:31.671373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:31.686615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.688839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.689701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:31.691358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:31.692335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:31.693044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:32.057846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:32.073265 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b35df21e-7740-4377-b879-3352d2b25c3e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1315 microversion: 2.1 time: 0.408793 Sep 01 05:20:32.089850 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2733/5422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:31 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:32.402224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:32.404109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:32.415290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:32.416102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:32.416700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:32.417664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:32.418409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:32.419111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:32.818417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:32.844745 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80f9a0b8-a47d-4cdf-a56b-088835103f62 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1373 microversion: 2.1 time: 0.447323 Sep 01 05:20:32.847945 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2690/5423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:32 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1373 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:33.097932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:33.098545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:33.115400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.116009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.116465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.117330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.117974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.118429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.537994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:33.550032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b9fbd43-1690-4831-879b-81f453386d05 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1502 microversion: 2.1 time: 0.455967 Sep 01 05:20:33.550743 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2734/5424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:33 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1502 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:33.575430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:33.576110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:33.588162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.588767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.589314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.590127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.591357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.591897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.745130 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c80eb31d-8c97-4654-8eb7-7bbfafcc991f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f/action" status: 202 len: 0 microversion: 2.1 time: 0.173767 Sep 01 05:20:33.746151 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2735/5425] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:20:33 2022] POST /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:20:33.756115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:33.757297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:33.757937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-951af592-eb26-47e7-9a75-6fdb5a87ca44 req-c71335b8-658b-4d4f-87c0-4b961874dbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a706f82-fb41-4b07-aab0-8308a90e077d", "tag": "49cf8aac-855f-4013-af31-fb86ce23a37d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:33.763672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:33.771307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-951af592-eb26-47e7-9a75-6fdb5a87ca44 req-c71335b8-658b-4d4f-87c0-4b961874dbb5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.772276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-951af592-eb26-47e7-9a75-6fdb5a87ca44 req-c71335b8-658b-4d4f-87c0-4b961874dbb5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.772875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-951af592-eb26-47e7-9a75-6fdb5a87ca44 req-c71335b8-658b-4d4f-87c0-4b961874dbb5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.779274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.780197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.780853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.781838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.782503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.783231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.789052 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-951af592-eb26-47e7-9a75-6fdb5a87ca44 req-c71335b8-658b-4d4f-87c0-4b961874dbb5 service nova] Creating event network-changed:49cf8aac-855f-4013-af31-fb86ce23a37d for instance 9a706f82-fb41-4b07-aab0-8308a90e077d on n-h2-820368-37 Sep 01 05:20:33.795730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-951af592-eb26-47e7-9a75-6fdb5a87ca44 req-c71335b8-658b-4d4f-87c0-4b961874dbb5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286432 Sep 01 05:20:33.797035 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2691/5426] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:20:33.871566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:33.872273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:33.878829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.879460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.880113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.881204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:33.881967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:33.883034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:33.931008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:34.143299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:34.154782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa70646f-a71d-419b-b7d6-e91d013718ca tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1507 microversion: 2.1 time: 0.402915 Sep 01 05:20:34.156519 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2736/5427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:33 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:34.185399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:34.197747 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-920ca5be-c5c1-4357-930d-e8e1a2392038 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1373 microversion: 2.1 time: 0.330897 Sep 01 05:20:34.199158 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2692/5428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:33 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1373 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:34.417740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-30c5ae6f-d481-46eb-84d3-cd147c91a3eb req-26a852f6-a410-4b24-b322-d36866c35d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06768c8f-8853-4c51-95d3-80643bd4c11f", "name": "network-vif-plugged", "status": "completed", "tag": "95bf9467-82aa-47ef-bfba-b82a17addc81"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:34.446992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-30c5ae6f-d481-46eb-84d3-cd147c91a3eb req-26a852f6-a410-4b24-b322-d36866c35d86 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:34.447480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-30c5ae6f-d481-46eb-84d3-cd147c91a3eb req-26a852f6-a410-4b24-b322-d36866c35d86 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:34.494051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-30c5ae6f-d481-46eb-84d3-cd147c91a3eb req-26a852f6-a410-4b24-b322-d36866c35d86 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:34.519788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-30c5ae6f-d481-46eb-84d3-cd147c91a3eb req-26a852f6-a410-4b24-b322-d36866c35d86 service nova] Creating event network-vif-plugged:95bf9467-82aa-47ef-bfba-b82a17addc81 for instance 06768c8f-8853-4c51-95d3-80643bd4c11f on n-h1-820368-37 Sep 01 05:20:34.543504 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-30c5ae6f-d481-46eb-84d3-cd147c91a3eb req-26a852f6-a410-4b24-b322-d36866c35d86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125367 Sep 01 05:20:34.546020 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2737/5429] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:35.182521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:35.184426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:35.201590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=26 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:35.205312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.206231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.206989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.208048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.208764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.209429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.223961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:35.225641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:35.240595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.241122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.241576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.245126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.245641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.246089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.648655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:35.662268 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-06425125-4096-48eb-bb9b-925e08069db2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1373 microversion: 2.1 time: 0.442192 Sep 01 05:20:35.668437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:35.669016 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2738/5430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:35 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1373 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:35.697788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51da515a-964b-4dad-99f4-efa5bd3265ff tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1487 microversion: 2.1 time: 0.524168 Sep 01 05:20:35.698769 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2693/5431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:35 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1487 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:35.724996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:35.725623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:35.749087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.750346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.751929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.754335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:35.759006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:35.760975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:35.818635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lazy-loading 'flavor' on Instance uuid 2800d91a-d2a9-48ce-a70b-7bb29291e60f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:20:35.978093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:36.228160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be2c78c3-0a9b-40d5-9b40-c7df519a27cb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f/action" status: 202 len: 0 microversion: 2.1 time: 0.508107 Sep 01 05:20:36.230830 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2739/5432] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:20:35 2022] POST /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:20:36.244251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:36.244901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:36.273445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.273813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.280244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.282210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.285437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.287565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.689405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:36.693052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:36.695085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:36.700171 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb7bc0ad-7f74-4c9c-ba7e-84ae9eb96632 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1493 microversion: 2.1 time: 0.463842 Sep 01 05:20:36.700784 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2694/5433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:36 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1493 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:20:36.708406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.709309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.709964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.711012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:36.711752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:36.712399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:36.991965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:37.022712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e00226a9-c8d2-46c4-964a-16f71784b70e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1544 microversion: 2.1 time: 0.336804 Sep 01 05:20:37.024189 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2740/5434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:36 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1544 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:37.051851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:37.052890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:37.061509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.062345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.063183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:37.065600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.066486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.068709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:37.340837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:37.351309 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-388bd549-888a-4a98-8307-d5488637f653 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1544 microversion: 2.1 time: 0.308712 Sep 01 05:20:37.368725 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2695/5435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:37 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1544 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:37.721278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:37.721997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:37.740310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.740971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.741926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:37.745556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:37.748919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:37.749543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:38.140064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:38.151290 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-57c97d8b-0273-40b7-bedc-3a362ae25934 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1493 microversion: 2.1 time: 0.434357 Sep 01 05:20:38.163035 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2741/5436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:37 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1493 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:39.178403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:39.179064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:39.187008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:39.187383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:39.187819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:39.188532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:39.188987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:39.189414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:39.470213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:39.488661 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec8fb215-0e50-4842-b6e9-adc713486fd1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1514 microversion: 2.1 time: 0.314757 Sep 01 05:20:39.489270 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2696/5437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:39 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:40.263708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-586db722-58bc-41f3-882b-1c4d87280cf0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'create', calling method: .version_select at 0x7fa75a8f6040>, body: {"keypair": {"name": "tempest-keypair-67700291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOf+pxGRiQNay69u2rhXAGitbYH826rtohrzq4NkbMooCvIeXUKV4twFlKF+79c+RVCRIHuU8oRCmSdHoEiwplUh7dLh7AF3wb28h4fBAR33p3k+Sz7pbZFZBbJl2FZAEg=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:40.285121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-586db722-58bc-41f3-882b-1c4d87280cf0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for project 07d01164358d4590b20329062498a698. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:40.294613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-586db722-58bc-41f3-882b-1c4d87280cf0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for user ac2c5b97f8ca4163b94de75a6095987e and project 07d01164358d4590b20329062498a698. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:40.329391 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-586db722-58bc-41f3-882b-1c4d87280cf0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.339140 Sep 01 05:20:40.338935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2742/5438] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 05:20:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 349 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:40.511130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:40.512753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:40.526185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4af0f820-afcc-4bfc-a9e7-d869e2f89ed7 req-8b42acd2-ca56-49f4-bbba-3d9c9411db02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06768c8f-8853-4c51-95d3-80643bd4c11f", "tag": "95bf9467-82aa-47ef-bfba-b82a17addc81"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:40.538267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.539147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.539780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.541453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.543472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.544217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.550203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4af0f820-afcc-4bfc-a9e7-d869e2f89ed7 req-8b42acd2-ca56-49f4-bbba-3d9c9411db02 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:40.550754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4af0f820-afcc-4bfc-a9e7-d869e2f89ed7 req-8b42acd2-ca56-49f4-bbba-3d9c9411db02 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:40.551302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4af0f820-afcc-4bfc-a9e7-d869e2f89ed7 req-8b42acd2-ca56-49f4-bbba-3d9c9411db02 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:40.567215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4af0f820-afcc-4bfc-a9e7-d869e2f89ed7 req-8b42acd2-ca56-49f4-bbba-3d9c9411db02 service nova] Creating event network-changed:95bf9467-82aa-47ef-bfba-b82a17addc81 for instance 06768c8f-8853-4c51-95d3-80643bd4c11f on n-h1-820368-37 Sep 01 05:20:40.576386 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4af0f820-afcc-4bfc-a9e7-d869e2f89ed7 req-8b42acd2-ca56-49f4-bbba-3d9c9411db02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054646 Sep 01 05:20:40.577792 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2743/5439] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:40.836382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:40.846822 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34b18a68-9555-4be1-ad9d-d51d7f3ffe8b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1514 microversion: 2.1 time: 0.340231 Sep 01 05:20:40.851205 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2697/5440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:40 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:41.874240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:41.875626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:41.882267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:41.883153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:41.883882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:41.884840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:41.885516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:41.886155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:42.073658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:42.084873 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9eba40ea-99ad-4c86-a140-480c858b7391 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1514 microversion: 2.1 time: 0.215830 Sep 01 05:20:42.085509 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2744/5441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:41 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:42.595837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5c7f53f5-1c2c-47c6-8246-f698582a4fc2 req-700f990a-9623-4410-86ff-ede2b593d313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2800d91a-d2a9-48ce-a70b-7bb29291e60f", "name": "network-vif-plugged", "status": "completed", "tag": "49b8786b-4038-4ca1-abde-569bbfff7ee4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:42.626691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5c7f53f5-1c2c-47c6-8246-f698582a4fc2 req-700f990a-9623-4410-86ff-ede2b593d313 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:42.627623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5c7f53f5-1c2c-47c6-8246-f698582a4fc2 req-700f990a-9623-4410-86ff-ede2b593d313 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:42.629289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5c7f53f5-1c2c-47c6-8246-f698582a4fc2 req-700f990a-9623-4410-86ff-ede2b593d313 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:42.665954 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5c7f53f5-1c2c-47c6-8246-f698582a4fc2 req-700f990a-9623-4410-86ff-ede2b593d313 service nova] Creating event network-vif-plugged:49b8786b-4038-4ca1-abde-569bbfff7ee4 for instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f on n-h2-820368-37 Sep 01 05:20:42.687326 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5c7f53f5-1c2c-47c6-8246-f698582a4fc2 req-700f990a-9623-4410-86ff-ede2b593d313 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095541 Sep 01 05:20:42.688884 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2698/5442] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:42.815597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-293887867", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8373e591-04c4-4086-863c-fd314077a1b0"}], "security_groups": [{"name": "tempest-securitygroup--433937194"}], "key_name": "tempest-keypair-67700291", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:42.951516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] validate_networks() for [('8373e591-04c4-4086-863c-fd314077a1b0', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:20:43.111918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:43.112906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:43.124238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.125034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.127940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.128874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.129956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.130626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.408203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:43.427425 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4110205a-15c4-4704-9a7f-630a81d2e342 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.323080 Sep 01 05:20:43.448412 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2699/5443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:43 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:43.659032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:20:43.663130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:20:43.663475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:20:43.665276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:20:43.665707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:20:43.696864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.697357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.697783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.698497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:43.699015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:43.700102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:43.725098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for project 07d01164358d4590b20329062498a698. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:20:43.732041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for user ac2c5b97f8ca4163b94de75a6095987e and project 07d01164358d4590b20329062498a698. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:20:43.747846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:20:43.750523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:20:43.850099 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4e9fbba-bc16-4dbb-8212-936650eff279 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.038930 Sep 01 05:20:43.852987 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2745/5444] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:20:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:20:43.873368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f9f945a-b615-43b0-ad68-fbcd17f3bc97 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:43.875321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f9f945a-b615-43b0-ad68-fbcd17f3bc97 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:44.071556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f9f945a-b615-43b0-ad68-fbcd17f3bc97 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:44.079865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f9f945a-b615-43b0-ad68-fbcd17f3bc97 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:44.081353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f9f945a-b615-43b0-ad68-fbcd17f3bc97 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:44.097232 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f9f945a-b615-43b0-ad68-fbcd17f3bc97 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1279 microversion: 2.20 time: 0.237605 Sep 01 05:20:44.104818 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2700/5445] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:43 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:44.455527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:44.457890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:44.468553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:44.469361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:44.469963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:44.470851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:44.471482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:44.472050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:44.701643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:44.717595 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eaec465c-96e3-4c76-928a-d119409c23a3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.271531 Sep 01 05:20:44.718770 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2746/5446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:44 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:45.127959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:45.128580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:45.138864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.139610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.140265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.141168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.141777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.142467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.243846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:45.281465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:45.284818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:45.287865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a6dafe2-b0ad-4dec-877c-5cf97d9196ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1331 microversion: 2.20 time: 0.162670 Sep 01 05:20:45.289337 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2701/5447] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:45 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1331 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:45.739797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:45.740517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:45.756037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.757069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.757742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:45.758636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:45.759890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:45.760486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.047315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:46.061163 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0d5636a-b04e-405d-be36-3f459f781bb7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.325246 Sep 01 05:20:46.061789 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2747/5448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:45 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:46.315944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:46.319226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:46.332637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:46.333106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:46.333738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.334466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:46.334940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:46.335587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:46.472043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:46.512461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:46.521862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:46.540488 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0427f429-a983-4e31-87b4-12206b14f8af tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1337 microversion: 2.20 time: 0.227281 Sep 01 05:20:46.551434 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2702/5449] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:46 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1337 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:47.086628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:47.087191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:47.103999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.104507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.104944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.105678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.106134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.106567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.356244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:47.378859 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-78aa6d54-67c3-4dac-a13a-68b49be1bf13 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.286815 Sep 01 05:20:47.401645 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2748/5450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:47 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:47.578450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:47.579757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:47.593919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.594421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.597412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.607295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.607892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.608346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.682511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:47.995977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:48.034809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:48.040783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:48.041994 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ae49e45-2fe7-4be9-9d35-4b38a6a7fe64 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.469293 Sep 01 05:20:48.050252 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2703/5451] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:47 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:20:48.409838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:48.411592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:48.422827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.423766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.425252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.426315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.427023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.427720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.598114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:48.609514 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9018166-4669-4f36-a1c3-23a88cdbc0d7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.203883 Sep 01 05:20:48.611402 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2749/5452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:48 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:48.712991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4d1e0ac7-df02-4abd-83c0-ed985005eed3 req-066e172b-ee35-4c48-b30d-2b7a1630645e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:48.776720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4d1e0ac7-df02-4abd-83c0-ed985005eed3 req-066e172b-ee35-4c48-b30d-2b7a1630645e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:48.782765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4d1e0ac7-df02-4abd-83c0-ed985005eed3 req-066e172b-ee35-4c48-b30d-2b7a1630645e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:48.784697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4d1e0ac7-df02-4abd-83c0-ed985005eed3 req-066e172b-ee35-4c48-b30d-2b7a1630645e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:48.812127 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4d1e0ac7-df02-4abd-83c0-ed985005eed3 req-066e172b-ee35-4c48-b30d-2b7a1630645e service nova] Creating event network-changed:f6d0850c-616e-40f8-82d3-8b77f3e22a74 for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 on n-h1-820368-37 Sep 01 05:20:48.822961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4d1e0ac7-df02-4abd-83c0-ed985005eed3 req-066e172b-ee35-4c48-b30d-2b7a1630645e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118067 Sep 01 05:20:48.825104 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2704/5453] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:49.067079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:49.071236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:49.078238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.079296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.079988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.080938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.081658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.082308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.260079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:49.272756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:49.275700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:49.277336 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-819af22e-081b-40b5-b1f9-cf8146da93dc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.214229 Sep 01 05:20:49.278343 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2750/5454] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:49 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:49.632812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:49.633517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:49.651439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.651938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.652376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.653093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:49.653550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:49.653974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:49.869089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:49.879090 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28077077-0e40-4e0a-b5a2-f967be908d8c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.250454 Sep 01 05:20:49.884769 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2705/5455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:49 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:50.305493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:50.306037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:50.316056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.316836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.318026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.319777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.327242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.329242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.548641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:50.559024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:50.563456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:50.565348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2492d20-db7a-4226-85aa-1bb3ba9854c7 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.264148 Sep 01 05:20:50.573163 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2751/5456] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:50 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:50.911975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:50.914751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:50.926158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.926745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.927385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:50.928279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:50.928942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:50.929625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:51.124257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:51.134745 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc8f3b32-c82a-404c-b94d-56b89231f0ef tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.230528 Sep 01 05:20:51.135963 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2706/5457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:50 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:51.596716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:51.597822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:51.607481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:51.608433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:51.609031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:51.610096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:51.610699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:51.611475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:51.774384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:51.783797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:51.786281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:51.787839 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-871dad08-fb0c-4b2a-b613-254cc0c2dc72 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.197140 Sep 01 05:20:51.805253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2752/5458] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:51 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:52.169197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:52.169949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:52.190356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:52.190877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:52.191358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.192251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:52.192714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:52.193328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.395318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:52.406273 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39497f08-a0f1-4f0b-8f20-21da3855b7c8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.246061 Sep 01 05:20:52.409957 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2707/5459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:52 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:52.818525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:52.819710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:52.827549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:52.828854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:52.829521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.830391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:52.831039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:52.831617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:52.996658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:53.011133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:53.012748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:53.014130 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61b945e7-ca0a-4f8e-9a60-f1e9feb5b7ba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.202730 Sep 01 05:20:53.015471 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2753/5460] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:52 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:53.436294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:53.437675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:53.450543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:53.451093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:53.451955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:53.453002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:53.453643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:53.454241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:53.679237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:53.693856 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20719901-65d7-4ba4-9bc6-b85429cdacb1 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.262145 Sep 01 05:20:53.695074 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2708/5461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:53 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:54.038074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:54.039066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:54.041311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:54.043572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:54.065260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-56cae027-a6fb-4dcb-9aca-91fdf4f6babc req-2648ead7-8838-401e-a05f-16317e734634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "name": "network-vif-plugged", "status": "completed", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:54.073666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.074488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.075165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.076117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.076239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56cae027-a6fb-4dcb-9aca-91fdf4f6babc req-2648ead7-8838-401e-a05f-16317e734634 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.076764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56cae027-a6fb-4dcb-9aca-91fdf4f6babc req-2648ead7-8838-401e-a05f-16317e734634 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.077485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56cae027-a6fb-4dcb-9aca-91fdf4f6babc req-2648ead7-8838-401e-a05f-16317e734634 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.078193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.083571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.090101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:54.093230 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-56cae027-a6fb-4dcb-9aca-91fdf4f6babc req-2648ead7-8838-401e-a05f-16317e734634 service nova] Creating event network-vif-plugged:f6d0850c-616e-40f8-82d3-8b77f3e22a74 for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 on n-h1-820368-37 Sep 01 05:20:54.100107 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-56cae027-a6fb-4dcb-9aca-91fdf4f6babc req-2648ead7-8838-401e-a05f-16317e734634 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038494 Sep 01 05:20:54.101594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2709/5462] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:54.278200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:54.288088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:54.289920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:54.291387 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47a2a603-77f7-412e-b694-8dc32fa9436e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.258272 Sep 01 05:20:54.306731 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2754/5463] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:54 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:54.722433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:54.723097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:54.730276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=59 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:54.793267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.794107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.794756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.795865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:54.796449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:54.797389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:54.987006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:55.003921 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9872080a-5156-4235-8bf2-6b12b0d29abf tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.287340 Sep 01 05:20:55.004524 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2710/5464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:54 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:55.313854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:55.314974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:55.323444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:55.324354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:55.325172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:55.325959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:55.326608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:55.327276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:55.496970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:55.509524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:55.511428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:55.513435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ceff8ab5-ed4b-46cf-8608-74a2f02c18ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1404 microversion: 2.20 time: 0.203606 Sep 01 05:20:55.514329 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2755/5465] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:55 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:20:56.032722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:56.033330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:56.041545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.042046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.042494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.043301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.043820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.044268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.204123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:56.218758 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f913b1a-29f4-49e8-87b0-3d476b238cb0 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1509 microversion: 2.1 time: 0.189521 Sep 01 05:20:56.219527 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2711/5466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:56 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:56.537723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:56.538854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:56.546394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.547047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.547642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:56.548448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:56.549223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:56.549752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.060740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:57.069440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:57.071342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:57.072594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8906e8b6-b316-42ba-8eaf-9fdbc319f3cd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1595 microversion: 2.20 time: 0.539412 Sep 01 05:20:57.073184 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2756/5467] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:20:56 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1595 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:20:57.095427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:57.096049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:57.104578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.104985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.105446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.106152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.106605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.107060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.186501 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7243ee81-6c0f-4ffd-8c96-aaeb7583627a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095125 Sep 01 05:20:57.187148 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2712/5468] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 05:20:57 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:57.240580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:57.241594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:57.248094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.248584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.249016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.249716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:57.250167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:57.250591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:57.395512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:57.404855 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f41d8853-0b23-4aba-8782-5bd7c1cae057 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1506 microversion: 2.1 time: 0.168460 Sep 01 05:20:57.405586 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2757/5469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:57 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:58.227173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-65e45d83-4be2-4adf-937b-3a2c3a2db14a req-1c597335-c0fc-4d42-9650-ac928a3dc2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:20:58.248168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65e45d83-4be2-4adf-937b-3a2c3a2db14a req-1c597335-c0fc-4d42-9650-ac928a3dc2ef service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.248657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65e45d83-4be2-4adf-937b-3a2c3a2db14a req-1c597335-c0fc-4d42-9650-ac928a3dc2ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.249093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65e45d83-4be2-4adf-937b-3a2c3a2db14a req-1c597335-c0fc-4d42-9650-ac928a3dc2ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.261484 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-65e45d83-4be2-4adf-937b-3a2c3a2db14a req-1c597335-c0fc-4d42-9650-ac928a3dc2ef service nova] Creating event network-changed:f6d0850c-616e-40f8-82d3-8b77f3e22a74 for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 on n-h1-820368-37 Sep 01 05:20:58.267378 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-65e45d83-4be2-4adf-937b-3a2c3a2db14a req-1c597335-c0fc-4d42-9650-ac928a3dc2ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045542 Sep 01 05:20:58.268396 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2713/5470] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:20:58.427060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:58.429342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:58.436729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.437508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.438112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.439038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:58.439645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:58.440258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:58.585599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:58.590608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:58.598829 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e98d38f-b169-435f-a893-6c268ce88dad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1506 microversion: 2.1 time: 0.175603 Sep 01 05:20:58.599992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2758/5471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:58 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:59.622176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:59.622987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:59.630010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.630637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.631222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.631984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.632587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.633003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.777797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:59.786603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62d631d1-97ea-4867-875f-fb46e7ef72a5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 200 len: 1449 microversion: 2.1 time: 0.169344 Sep 01 05:20:59.787431 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2714/5472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:59 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:59.807268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:59.807918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:20:59.815326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.815818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.816273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.816965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:59.817453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:59.817874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:59.960049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:20:59.969425 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6de9eb59-ac2f-4dba-9f01-cce1850e6816 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.166137 Sep 01 05:20:59.970092 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2759/5473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:59 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:20:59.996759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:59.997615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.004973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.005676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.006106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.006834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.007350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.007775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.148139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:00.156673 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab173c6-1b4a-4be5-91d1-0073286258d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.163697 Sep 01 05:21:00.157251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2715/5474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:20:59 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:00.180932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:00.181561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.188701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.189231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.189808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.190533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.191081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.191504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.372691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:00.382233 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-faf79b64-1230-4155-8b7f-7feb7432668f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.205868 Sep 01 05:21:00.384350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2760/5475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:00 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:00.405794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:00.406920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.422660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.425487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.426629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1c53b312-e9e2-4935-8b3a-a85e677276bc req-bf33cbf6-0a97-4b02-a21b-6f22009d6da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2800d91a-d2a9-48ce-a70b-7bb29291e60f", "name": "network-vif-unplugged", "status": "completed", "tag": "49b8786b-4038-4ca1-abde-569bbfff7ee4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:00.427359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.428239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.430031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.435027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.452097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c53b312-e9e2-4935-8b3a-a85e677276bc req-bf33cbf6-0a97-4b02-a21b-6f22009d6da2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.452957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c53b312-e9e2-4935-8b3a-a85e677276bc req-bf33cbf6-0a97-4b02-a21b-6f22009d6da2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.460581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c53b312-e9e2-4935-8b3a-a85e677276bc req-bf33cbf6-0a97-4b02-a21b-6f22009d6da2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.475211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-1c53b312-e9e2-4935-8b3a-a85e677276bc req-bf33cbf6-0a97-4b02-a21b-6f22009d6da2 service nova] Unable to find a host for instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f. Dropping event network-vif-unplugged {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:21:00.486836 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1c53b312-e9e2-4935-8b3a-a85e677276bc req-bf33cbf6-0a97-4b02-a21b-6f22009d6da2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.074973 Sep 01 05:21:00.488107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2761/5476] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:21:00.609940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:00.618251 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b41bfac-b24f-454c-b51f-90013d7a63dd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.217437 Sep 01 05:21:00.618915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2716/5477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:00 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:00.640197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-551c06b9-75ab-423f-a760-aa0b0d1ff712 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:00.646541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551c06b9-75ab-423f-a760-aa0b0d1ff712 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.647075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551c06b9-75ab-423f-a760-aa0b0d1ff712 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.647515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-551c06b9-75ab-423f-a760-aa0b0d1ff712 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.672529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-551c06b9-75ab-423f-a760-aa0b0d1ff712 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:21:00.717700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-551c06b9-75ab-423f-a760-aa0b0d1ff712 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.081048 Sep 01 05:21:00.718275 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2762/5478] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:21:00 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:21:00.726947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:00.728373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:00.737518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.738339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.738730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.739768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:00.740575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:00.741171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:00.917120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:00.926145 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a390b3d3-2ec1-4618-b749-34153b52596b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.203218 Sep 01 05:21:00.927031 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2717/5479] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:00 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:01.178540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:01.181519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:01.188083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.188669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.189196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.189985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.190819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.191346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.251014 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a00f3f0-22b6-4a31-9328-23c9efe14c28 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f/action" status: 200 len: 24562 microversion: 2.1 time: 0.081864 Sep 01 05:21:01.259002 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2763/5480] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:21:01 2022] POST /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f/action => generated 24562 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:01.950484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:01.951304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:01.958071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.958679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.959203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:01.959938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:01.960491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:01.960911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:02.101390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:02.110310 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94de4cfe-17ba-4c34-83cd-1d66d9162d10 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.164000 Sep 01 05:21:02.111158 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2718/5481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:01 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:02.490296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2882f255-deab-4361-82e4-9b6248e94edb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: .version_select at 0x7fa75a887430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1817326578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl4gzbFPF3Attecj1ELU4OoWHc0Sy41sNEveI9xi0S7Vi0HMUlFWOjvIvwH5L3bDXVpDksaPgdVjgtVbv2+pl5ndkXauGW4L9Exz/MxKyuP5E8/NtFRYv7ZagXzSRomAw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:02.507819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2882f255-deab-4361-82e4-9b6248e94edb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:21:02.513403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-2882f255-deab-4361-82e4-9b6248e94edb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:21:02.539655 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2882f255-deab-4361-82e4-9b6248e94edb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.238553 Sep 01 05:21:02.540276 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2764/5482] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:21:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:03.133253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:03.133852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:03.141560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.142064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.142506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.143233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:03.143679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:03.144108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:03.295184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:03.303540 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1018ff02-49d0-43e9-b323-083909cbfd3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.174636 Sep 01 05:21:03.304347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2719/5483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:03 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:04.328381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:04.329335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:04.332216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:04.338695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.339212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.339686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.340483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:04.341014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:04.341482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:04.599471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:04.608019 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ba0fd79-ebba-4efc-a694-53140c39fc56 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.283700 Sep 01 05:21:04.608727 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2765/5484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:04 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:05.632007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:05.632634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:05.642094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.642583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.643038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.643740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:05.644197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:05.644617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:05.877439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:05.888239 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cefe8eb-2078-492e-9b51-8bbb4c092d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.260447 Sep 01 05:21:05.896308 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2720/5485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:05 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:06.909691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:06.910281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:06.918839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.919477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.920190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:06.920977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:06.921494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:06.922037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:07.199003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:07.212471 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8684cf81-7422-4f52-a9c0-392ba20c39f3 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.307268 Sep 01 05:21:07.213745 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2766/5486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:06 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:08.234095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:08.234715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:08.244068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.244576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.245026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.245743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:08.246201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:08.246807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:08.451705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:08.464885 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9b2395c-9829-4b59-bfb5-25d235a92dfc tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.234771 Sep 01 05:21:08.466034 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2721/5487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:08 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:09.062537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-345620865", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "efde1e6d-b8e5-49f5-9b50-7a369e3a7cae"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1817326578", "security_groups": [{"name": "tempest-secgroup-smoke-71694181"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:09.205430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] validate_networks() for [('efde1e6d-b8e5-49f5-9b50-7a369e3a7cae', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:21:09.485747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:09.486404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:09.494467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.495216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.495835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.496703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.497401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.497917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.517842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:09.738000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:21:09.738547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:21:09.739332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:21:09.739937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:21:09.740354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:21:09.742819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:09.751898 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23cc22f3-fa10-4de4-ba87-32a11cf05eeb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.270025 Sep 01 05:21:09.753712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.754695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.755344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.756313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:09.757290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:09.757946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:09.767124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2722/5488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:09 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:09.780905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:21:09.786655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:21:09.799997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:21:09.802352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:21:09.854936 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ea9bd83-13ae-490f-9fc9-f14ae1274122 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.796435 Sep 01 05:21:09.855988 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2767/5489] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:21:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:21:09.866550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a8f8216-8ba3-4da1-a7f9-1e34c29d7d58 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:09.867499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a8f8216-8ba3-4da1-a7f9-1e34c29d7d58 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:09.946389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a8f8216-8ba3-4da1-a7f9-1e34c29d7d58 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:09.954378 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a8f8216-8ba3-4da1-a7f9-1e34c29d7d58 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1266 microversion: 2.1 time: 0.091780 Sep 01 05:21:09.971066 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2723/5490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:09 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:10.774392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:10.775065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:10.785865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.786711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.787175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.787877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.788505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.789027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.928440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:10.937610 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55ac1fd7-cce7-45f4-82da-2adda5c9eb3c tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.167708 Sep 01 05:21:10.938281 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2768/5491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:10 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:10.975952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:10.976707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:10.990932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.991528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.992054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:10.992757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:10.993243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:10.994038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:11.071922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:11.081635 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1aafaae-8f0a-4efb-ad47-870784367850 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1318 microversion: 2.1 time: 0.109533 Sep 01 05:21:11.084234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2724/5492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:10 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:11.959710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:11.960456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:11.969267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:11.969898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:11.970479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:11.972248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:11.972710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:11.973131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.105937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:12.106488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:12.113664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.114574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.115219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.116127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.116788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.117573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:12.139016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:12.148335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc1be5f1-2fc1-479d-bf07-e3a2f5397f06 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.192834 Sep 01 05:21:12.148925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2769/5493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:11 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:12.344042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:12.352480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-865e1e24-fc9d-457a-a7f0-df52f03651aa tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.251338 Sep 01 05:21:12.353091 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2725/5494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:12 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:12.973071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0ae2034f-9041-4829-a9d9-bacd83b1646d req-1e62e9b1-8780-4dae-9d43-b55771aa269d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:12.985949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0ae2034f-9041-4829-a9d9-bacd83b1646d req-1e62e9b1-8780-4dae-9d43-b55771aa269d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:12.986339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0ae2034f-9041-4829-a9d9-bacd83b1646d req-1e62e9b1-8780-4dae-9d43-b55771aa269d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:12.986779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0ae2034f-9041-4829-a9d9-bacd83b1646d req-1e62e9b1-8780-4dae-9d43-b55771aa269d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.003653 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0ae2034f-9041-4829-a9d9-bacd83b1646d req-1e62e9b1-8780-4dae-9d43-b55771aa269d service nova] Creating event network-changed:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h2-820368-37 Sep 01 05:21:13.010210 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0ae2034f-9041-4829-a9d9-bacd83b1646d req-1e62e9b1-8780-4dae-9d43-b55771aa269d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042482 Sep 01 05:21:13.011083 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2770/5495] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:13.170272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:13.170940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:13.178016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.178563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.178970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.179671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.180621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.181163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.325545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:13.333866 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b75fc234-25ba-4084-bbc3-ea3913e8a8cd tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.167625 Sep 01 05:21:13.334460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2726/5496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:13 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:13.374554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:13.375428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:13.382320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.382808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.383480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.383984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:13.384624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:13.385053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:13.532947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:13.543306 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b253861a-a1ed-421c-97c9-02d8ec53da40 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.172950 Sep 01 05:21:13.544234 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2771/5497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:13 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:14.355768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:14.356369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:14.363738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.364224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.364654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.365345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.365795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.366219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.516085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:14.524818 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46c5f058-1c57-4778-a389-f204db497471 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.173192 Sep 01 05:21:14.525401 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2727/5498] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:14 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:14.566679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:14.567257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:14.576119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.576612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.577042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.577736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:14.578186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:14.578607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:14.728129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:14.737070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77726327-a31e-48c4-af17-2edff9727757 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.176584 Sep 01 05:21:14.737670 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2772/5499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:14 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:15.546672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:15.547453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:15.554496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.554916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.555420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.556128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.556774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.557498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.703297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:15.711946 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fff08751-f5e2-4d2a-a6ba-8d6eb95f7286 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1679 microversion: 2.1 time: 0.169728 Sep 01 05:21:15.712692 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2728/5500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:15 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:15.758019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:15.758655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:15.768059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.768486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.768954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:15.769675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:15.770298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:15.770660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.031125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:16.041956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dbff7451-a5e0-436d-97cf-2a9e0798cfdf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.287603 Sep 01 05:21:16.055741 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2773/5501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:15 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:16.409569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da5407b9-db8e-4a4d-b4fb-c3ddd056883b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'create', calling method: .version_select at 0x7fa75bcc2700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1441869164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkL2RkN6aCZM80WKUgIS7NJkjWBLAYwvciRuTSxN8gE62loZNOIIVisc45inssl8oC061CGkum8Osmxk14r+yKYQEF9HlK4SrnInbR0ZOPkRncfHuJXzXhs8/oKEK9V9g=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:16.426126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-da5407b9-db8e-4a4d-b4fb-c3ddd056883b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:21:16.431427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-da5407b9-db8e-4a4d-b4fb-c3ddd056883b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for user 50a11eb4b2684c369eaff25fe84e837c and project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:21:16.457405 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da5407b9-db8e-4a4d-b4fb-c3ddd056883b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.051823 Sep 01 05:21:16.463802 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2729/5502] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:21:16 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:16.733755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:16.734692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:16.741152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.741648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.742311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.743204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.743673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.744163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:16.910671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:16.920955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-526391bc-14a5-4fe6-8518-e595143d16a8 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1656 microversion: 2.1 time: 0.191466 Sep 01 05:21:16.921697 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2774/5503] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:16 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1656 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:16.948841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c733e107-ed06-4973-8e63-38679183d31f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:16.957362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c733e107-ed06-4973-8e63-38679183d31f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:16.957847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c733e107-ed06-4973-8e63-38679183d31f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:16.958287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c733e107-ed06-4973-8e63-38679183d31f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.006443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c733e107-ed06-4973-8e63-38679183d31f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:21:17.065799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:17.066518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:17.073724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.075045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.075322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c733e107-ed06-4973-8e63-38679183d31f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.131096 Sep 01 05:21:17.075678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.076495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.077620 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2730/5504] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:21:16 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:21:17.081354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.082570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.102826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:17.103641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:17.129434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.129954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.130397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.131240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:17.131751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:17.132393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:17.424496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:17.432170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:17.440000 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c13f693-d13c-4371-84c1-ecc77aeaf63d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.379040 Sep 01 05:21:17.443017 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a6d32da-7a0b-49ca-a59f-c088ec996164 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1665 microversion: 2.1 time: 0.350080 Sep 01 05:21:17.453624 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2775/5505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:17 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:17.456380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2731/5506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:17 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1665 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:17.951383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-308863128", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "b619ee86-93e6-48b3-bee4-6307c77557eb"}], "key_name": "tempest-TestNetworkBasicOps-1441869164", "security_groups": [{"name": "tempest-secgroup-smoke-944163757"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:18.073688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] validate_networks() for [('b619ee86-93e6-48b3-bee4-6307c77557eb', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:21:18.470856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.471508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.478633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.479147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.479820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.480532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.480997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.481426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.506107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:21:18.507688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:21:18.508617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:21:18.509220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:21:18.510641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:21:18.524646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.525667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.526459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.527615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.528186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.528668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.555170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:21:18.561849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for user 50a11eb4b2684c369eaff25fe84e837c and project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:21:18.580200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:21:18.582932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:21:18.663883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:18.665500 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba29d0ae-8c86-4c54-803a-d34c4de360b1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718507 Sep 01 05:21:18.667233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2776/5507] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:21:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:21:18.673962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.674599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.681112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6fbe82e-9f66-4b00-8214-f639a6f9bfb4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.223051 Sep 01 05:21:18.686271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.687048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.687687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.689392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.690204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.691756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.696067 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2732/5508] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:18.714636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-283742a6-cbaf-4ab0-acdb-2fd75cd9decd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.715278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-283742a6-cbaf-4ab0-acdb-2fd75cd9decd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.795242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-283742a6-cbaf-4ab0-acdb-2fd75cd9decd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:18.802295 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-283742a6-cbaf-4ab0-acdb-2fd75cd9decd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1248 microversion: 2.1 time: 0.105061 Sep 01 05:21:18.803087 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2733/5509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1248 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:18.870560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:18.879623 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a385ecb-ed56-46e8-96bb-9aa775a0c47d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.211066 Sep 01 05:21:18.880307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2777/5510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:18.901768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:18.903148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:18.909473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.910011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.910459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:18.911530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:18.912124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:18.913005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.410312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:19.419168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5a8dd40-f7cb-4743-9a36-bc82051e8f4f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.521718 Sep 01 05:21:19.419772 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2734/5511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:18 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:19.442059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.442741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.451644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.452473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.452910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.453613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.454512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.454961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.476458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:19.595918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:19.604341 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fac66331-adee-4bfa-b56a-9ab2475c88c6 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.166349 Sep 01 05:21:19.604926 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2778/5512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:19.624641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.625826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.632902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.633614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.634064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.634825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.636174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.636627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.705972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.706982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.713944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.714830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.715296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.716022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.717120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.717573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.804125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:19.812655 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a54ff1e7-35d2-48f2-b2b7-19fbb85c3272 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.192006 Sep 01 05:21:19.813433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2735/5513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:19.822512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.823162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.829453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.829955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.830433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.831171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.831634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.832069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.871597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:19.880160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-093efaf3-7f41-4f45-8a35-476327921ca6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.178165 Sep 01 05:21:19.880764 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2779/5514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:19.898439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:19.899064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:19.899224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:19.905572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.906334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.907086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.907834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:19.908176 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61037eea-900a-4769-9b46-c00e1973f6f2 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1300 microversion: 2.1 time: 0.089963 Sep 01 05:21:19.908303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:19.908747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:19.909073 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2736/5515] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:20.061635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:20.073576 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-daa2e5bd-2263-4e71-810e-3793f06cef6b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.178827 Sep 01 05:21:20.074392 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2780/5516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:19 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:20.094410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:20.095404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.101995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.102532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.102969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.103970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.104475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.105074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.132178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lazy-loading 'flavor' on Instance uuid 7d80cb5b-9297-49aa-8d00-5d630b271401 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:21:20.211393 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da2fa0ab-4d00-4637-a529-3d5ce80a66d2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.120932 Sep 01 05:21:20.212353 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2737/5517] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:21:20 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:21:20.220811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:20.221689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.228420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.229005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.229787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.230749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.231397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.231976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.382263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:20.391070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e107da3b-72f8-4534-a8e0-a22e4c4ee7fb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1677 microversion: 2.1 time: 0.174435 Sep 01 05:21:20.393911 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2781/5518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:20 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:20.453660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d1246a0c-1ec0-4b80-9cdc-da11c19c417c req-b0a6be1a-868a-45e4-b9d7-a12325f872be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "name": "network-vif-plugged", "status": "completed", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:20.465534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1246a0c-1ec0-4b80-9cdc-da11c19c417c req-b0a6be1a-868a-45e4-b9d7-a12325f872be service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.466186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1246a0c-1ec0-4b80-9cdc-da11c19c417c req-b0a6be1a-868a-45e4-b9d7-a12325f872be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.466605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d1246a0c-1ec0-4b80-9cdc-da11c19c417c req-b0a6be1a-868a-45e4-b9d7-a12325f872be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.482316 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d1246a0c-1ec0-4b80-9cdc-da11c19c417c req-b0a6be1a-868a-45e4-b9d7-a12325f872be service nova] Creating event network-vif-plugged:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h2-820368-37 Sep 01 05:21:20.487538 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d1246a0c-1ec0-4b80-9cdc-da11c19c417c req-b0a6be1a-868a-45e4-b9d7-a12325f872be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038174 Sep 01 05:21:20.488153 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2738/5519] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:20.902484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:20.903198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.911813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.912312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.912751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.913472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.913926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.914350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.930213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:20.931174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:20.940195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.941041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.941503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:20.942237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:20.942753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:20.943220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.126562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:21.134879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f37de13e-d655-4a24-968c-d9ebb2d37de0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1390 microversion: 2.1 time: 0.236908 Sep 01 05:21:21.135847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2782/5520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:20 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:21.157234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:21.165904 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8a2bb44-518d-4027-bde0-49780f4d1d0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.239856 Sep 01 05:21:21.166714 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2739/5521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:20 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:21.414410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:21.415413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:21.421680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.422188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.422621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.423352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.423790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.424214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.562468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:21.574669 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0895772b-e29a-48ee-b14e-f51d8131380d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1660 microversion: 2.1 time: 0.164687 Sep 01 05:21:21.575321 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2783/5522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:21 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1660 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:21.597992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:21.599777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:21.609933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.610526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.611069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.611859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.612391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.612824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.615848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:21.687636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf4a58eb-7512-4add-86a3-1a1696b46591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action" status: 202 len: 0 microversion: 2.1 time: 0.095489 Sep 01 05:21:21.691568 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2740/5523] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:21:21 2022] POST /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:21:21.696821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:21.697882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:21.705238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.705870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.706343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.707098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.707869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.708467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.773308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5059bc99-2e6c-4f40-a168-dd6edc165331 req-6fb39178-2c30-4928-a18b-9c8e2b0c86e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91effc9-657c-44af-b047-79e9f1fc70df", "tag": "d531dad1-672b-47ec-a6cc-98696db5dcbe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:21.789356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5059bc99-2e6c-4f40-a168-dd6edc165331 req-6fb39178-2c30-4928-a18b-9c8e2b0c86e6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:21.790257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5059bc99-2e6c-4f40-a168-dd6edc165331 req-6fb39178-2c30-4928-a18b-9c8e2b0c86e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:21.791700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5059bc99-2e6c-4f40-a168-dd6edc165331 req-6fb39178-2c30-4928-a18b-9c8e2b0c86e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:21.805537 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5059bc99-2e6c-4f40-a168-dd6edc165331 req-6fb39178-2c30-4928-a18b-9c8e2b0c86e6 service nova] Creating event network-changed:d531dad1-672b-47ec-a6cc-98696db5dcbe for instance b91effc9-657c-44af-b047-79e9f1fc70df on n-h2-820368-37 Sep 01 05:21:21.810731 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5059bc99-2e6c-4f40-a168-dd6edc165331 req-6fb39178-2c30-4928-a18b-9c8e2b0c86e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043755 Sep 01 05:21:21.811999 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2741/5524] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:21.875268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:21.884714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bddfd9ff-1c8b-473d-9f5d-a8cff189fd7b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1666 microversion: 2.1 time: 0.191552 Sep 01 05:21:21.885926 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2784/5525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:21 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1666 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:22.158740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:22.159523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:22.167544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.168050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.168698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.169379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.169848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.170226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.189046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:22.190530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:22.199204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.200662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.201350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.202353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.203182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.203835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.377351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:22.385812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c90076c-4630-4ca0-a701-06864e87056b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1561 microversion: 2.1 time: 0.232704 Sep 01 05:21:22.386469 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2742/5526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:22.407050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:22.415193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:22.415574 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a50ebcbc-bdf7-43ab-bafb-98e73194ea1e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.231834 Sep 01 05:21:22.415796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:22.417516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2785/5527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:22.422132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.422618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.423175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.423901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.424441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.424981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.564240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:22.572813 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e800ad81-c67e-4d12-bbcc-91ff6dd40774 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1561 microversion: 2.1 time: 0.169045 Sep 01 05:21:22.573380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2743/5528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:22.906659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:22.907550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:22.914388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.914966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.915356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:22.916445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:22.916965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:22.917339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.064703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:23.073435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d41c2d5-a57e-4a08-bc2a-a4d18ab0829b tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1666 microversion: 2.1 time: 0.170761 Sep 01 05:21:23.074147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2786/5529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:22 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:23.437676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:23.438269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:23.445805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.446305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.446745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.447574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:23.448050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:23.448485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:23.600445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:23.609418 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb2ec776-4130-4303-9655-f7c7a6c5cab1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.175593 Sep 01 05:21:23.609923 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2744/5530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:23 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:24.095721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.096394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.104535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.105039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.105471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.106202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.106663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.107122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.240349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:24.249514 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f227812e-d2dd-4a30-ade7-930fc7d0a0f5 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.157784 Sep 01 05:21:24.250185 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2787/5531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:24.270063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.270672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.278246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.278738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.279200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.279865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.280336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.280753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.425359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:24.433655 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbb9f84d-dbbb-4bff-8f71-200edfbf7edb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1669 microversion: 2.1 time: 0.167453 Sep 01 05:21:24.434467 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2745/5532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:24.455792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.456199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.462474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.463030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.463463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.464153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.464607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.465009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.491243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:21:24.498197 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Working on deleting snapshot a2b6b214-dbb0-43a9-95b0-d2dbfa90e1a1 from shelved instance... Sep 01 05:21:24.602676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.603389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.611063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.611639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.612142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.613041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.613494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.614086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.765661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:24.780537 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4993a6f5-954a-46ac-8095-d3def22095f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1561 microversion: 2.1 time: 0.182199 Sep 01 05:21:24.796454 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2746/5533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:24.802371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-592f299d-adb9-4d6a-bfc9-9b5b0f6a10b1 req-692104b1-10b9-4235-821c-835778e62c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:24.814662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:24.816798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-592f299d-adb9-4d6a-bfc9-9b5b0f6a10b1 req-692104b1-10b9-4235-821c-835778e62c98 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.817330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-592f299d-adb9-4d6a-bfc9-9b5b0f6a10b1 req-692104b1-10b9-4235-821c-835778e62c98 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.817818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-592f299d-adb9-4d6a-bfc9-9b5b0f6a10b1 req-692104b1-10b9-4235-821c-835778e62c98 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.832485 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-592f299d-adb9-4d6a-bfc9-9b5b0f6a10b1 req-692104b1-10b9-4235-821c-835778e62c98 service nova] Creating event network-changed:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h2-820368-37 Sep 01 05:21:24.838363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-592f299d-adb9-4d6a-bfc9-9b5b0f6a10b1 req-692104b1-10b9-4235-821c-835778e62c98 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040229 Sep 01 05:21:24.839736 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2747/5534] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:24.846204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:24.847806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:24.858420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.859127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.860396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:24.861121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:24.861584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:24.862557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.066030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:25.075135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39941ab3-158e-4a66-a6ff-ee9137222fe6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.233680 Sep 01 05:21:25.075748 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2748/5535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:24 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:25.263601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Doing local delete in cell d0d5f4e8-de5e-4681-b062-ea6b446cdfe7(cell1) {{(pid=128862) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 01 05:21:25.265041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:25.265716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:25.266943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:25.267616 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 01 05:21:25.273456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] deallocate_for_instance() {{(pid=128862) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Sep 01 05:21:26.068327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Updating instance_info_cache with network_info: [] {{(pid=128862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Sep 01 05:21:26.073205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-096a6f45-d996-4c5f-8293-aae80b05d06c req-021f89df-4891-42f7-82f1-d4ca7d2fb311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2800d91a-d2a9-48ce-a70b-7bb29291e60f", "name": "network-vif-deleted", "tag": "49b8786b-4038-4ca1-abde-569bbfff7ee4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:26.090354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-096a6f45-d996-4c5f-8293-aae80b05d06c req-021f89df-4891-42f7-82f1-d4ca7d2fb311 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.091755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-096a6f45-d996-4c5f-8293-aae80b05d06c req-021f89df-4891-42f7-82f1-d4ca7d2fb311 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.092410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-096a6f45-d996-4c5f-8293-aae80b05d06c req-021f89df-4891-42f7-82f1-d4ca7d2fb311 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.109076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_external_events [req-096a6f45-d996-4c5f-8293-aae80b05d06c req-021f89df-4891-42f7-82f1-d4ca7d2fb311 service nova] Unable to find a host for instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f. Dropping event network-vif-deleted {{(pid=128863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:21:26.110401 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-096a6f45-d996-4c5f-8293-aae80b05d06c req-021f89df-4891-42f7-82f1-d4ca7d2fb311 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.043525 Sep 01 05:21:26.111940 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2749/5536] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:21:26.128012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.130142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.141853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.143221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.143678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.144399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.145038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.145472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.278554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:26.289755 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5d20b41c-30fb-4b62-b50e-b115eff74170 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 204 len: 0 microversion: 2.1 time: 1.837936 Sep 01 05:21:26.290387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2788/5537] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:21:24 2022] DELETE /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 0 bytes in 1839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:21:26.299324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.299930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 2800d91a-d2a9-48ce-a70b-7bb29291e60f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.307640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.308125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.308552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.309247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.309693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.310107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.310750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:26.319161 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88e0b097-26dc-4ad4-a653-57d5122b46c4 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.205733 Sep 01 05:21:26.319754 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2750/5538] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:26 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:26.325808 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] HTTP exception thrown: Instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f could not be found. Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Request method failure captured: Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f HTTP/1.1 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED-CDRGPuHjnBCeWkqAW-90Wykqx7S0ge-o2f5jeKH7b1x22qZa3dxa2FHPw1-3lT-rFtr_T8RzzEVmjFsLKuBDxhCsWNQWeT0CwOVs_NApkHNaf2UMnITeqTz0HQQz6e0wa4ijmBQ5L43rgxCJN6Mun9ntsRtle40ZhMckP8AGCJCU Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73595708b0aa4675b02e05947383d8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 87f4f3bcd603448d856a7471120a42af Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f could not be found. Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2800d91a-d2a9-48ce-a70b-7bb29291e60f'} Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f could not be found. Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f could not be found. Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:26.327686 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f could not be found. Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Returning 404 to user: Instance 2800d91a-d2a9-48ce-a70b-7bb29291e60f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ac2f1be-2bd5-4d31-8f12-774f704b4c04 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f" status: 404 len: 111 microversion: 2.1 time: 0.034166 Sep 01 05:21:26.332169 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2789/5539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:26 2022] GET /compute/v2.1/servers/2800d91a-d2a9-48ce-a70b-7bb29291e60f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:21:26.337573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.338067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.344382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.344804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.345231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.345910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.346360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.346777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.373067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:21:26.465308 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-542ea262-5869-4279-a930-8dc447487088 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 204 len: 0 microversion: 2.1 time: 0.131278 Sep 01 05:21:26.465928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2751/5540] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:21:26 2022] DELETE /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:21:26.474623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:26.475263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:26.481790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.482276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.482701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.483418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:26.483869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:26.484272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:26.575918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:26.584041 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cbce85f-a045-4893-badf-293d9f29fa1e tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1467 microversion: 2.1 time: 0.113646 Sep 01 05:21:26.584631 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2790/5541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:26 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1467 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:27.341781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:27.342358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:27.350080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.350586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.351038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.351782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.352248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.352679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.558778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:27.567296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e87c436-7337-4239-8359-838e024a7fb5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.229878 Sep 01 05:21:27.567893 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2752/5542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:27 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:27.605221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:27.605795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:27.613319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.613811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.614244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.614957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:27.615443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:27.615862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:27.767320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:27.776089 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b7eba8fc-54e6-4c57-bd9d-737979a18f5f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1467 microversion: 2.1 time: 0.175279 Sep 01 05:21:27.776686 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2791/5543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:27 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1467 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:28.288485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-13dce040-7476-49c8-881c-7b0142fa4c99 req-04c74e33-22b8-423e-9b58-961e348d5986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4a71ec-b6b8-461e-808f-00fe2d3de422", "name": "network-vif-deleted", "tag": "778a1c44-d43c-4907-8c9f-493ae86439ae"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:28.299258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-13dce040-7476-49c8-881c-7b0142fa4c99 req-04c74e33-22b8-423e-9b58-961e348d5986 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.299736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-13dce040-7476-49c8-881c-7b0142fa4c99 req-04c74e33-22b8-423e-9b58-961e348d5986 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.300194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-13dce040-7476-49c8-881c-7b0142fa4c99 req-04c74e33-22b8-423e-9b58-961e348d5986 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.316536 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-13dce040-7476-49c8-881c-7b0142fa4c99 req-04c74e33-22b8-423e-9b58-961e348d5986 service nova] Creating event network-vif-deleted:778a1c44-d43c-4907-8c9f-493ae86439ae for instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 on n-h1-820368-37 Sep 01 05:21:28.323001 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-13dce040-7476-49c8-881c-7b0142fa4c99 req-04c74e33-22b8-423e-9b58-961e348d5986 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038754 Sep 01 05:21:28.324368 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2753/5544] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:28.589523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:28.590228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:28.592217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:28.592892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:28.599209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.599703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.600185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.600877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.601332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.601741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.725579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-433c7872-d5b3-4f09-bee2-26730d6bf418 req-9d0b50f6-4fca-4485-9550-403af1556623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91effc9-657c-44af-b047-79e9f1fc70df", "name": "network-vif-plugged", "status": "completed", "tag": "d531dad1-672b-47ec-a6cc-98696db5dcbe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:28.739676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-433c7872-d5b3-4f09-bee2-26730d6bf418 req-9d0b50f6-4fca-4485-9550-403af1556623 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.740597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-433c7872-d5b3-4f09-bee2-26730d6bf418 req-9d0b50f6-4fca-4485-9550-403af1556623 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.741042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-433c7872-d5b3-4f09-bee2-26730d6bf418 req-9d0b50f6-4fca-4485-9550-403af1556623 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.742958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:28.752545 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a664e22e-13c4-48d0-8d0d-3ca4560d6408 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.167371 Sep 01 05:21:28.753564 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-433c7872-d5b3-4f09-bee2-26730d6bf418 req-9d0b50f6-4fca-4485-9550-403af1556623 service nova] Creating event network-vif-plugged:d531dad1-672b-47ec-a6cc-98696db5dcbe for instance b91effc9-657c-44af-b047-79e9f1fc70df on n-h2-820368-37 Sep 01 05:21:28.759076 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-433c7872-d5b3-4f09-bee2-26730d6bf418 req-9d0b50f6-4fca-4485-9550-403af1556623 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039357 Sep 01 05:21:28.759857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2754/5545] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:28.766054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2792/5546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:28 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:28.798346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:28.798782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:28.801154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:28.807934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.808425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.808865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.809570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.810034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.810457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.848361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:28.848851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:28.849285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:28.849735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lazy-loading 'fault' on Instance uuid fe4a71ec-b6b8-461e-808f-00fe2d3de422 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:21:28.903851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:28.912479 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aafcd322-c8d3-4a06-8c54-60b8b94df5ad tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 200 len: 1305 microversion: 2.1 time: 0.118592 Sep 01 05:21:28.913405 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2755/5547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:28 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:29.774104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:29.774716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:29.782440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.782870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.783340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.784056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.784513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.784940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.922638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:29.931728 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79c26727-8ec2-4568-9f55-1efdb6e3030c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.161548 Sep 01 05:21:29.932320 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2793/5548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:29 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:29.934084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:29.934706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fe4a71ec-b6b8-461e-808f-00fe2d3de422] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:29.942718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.943245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.943678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.944397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.944854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.945437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.960957 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] HTTP exception thrown: Instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 could not be found. Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Request method failure captured: Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 HTTP/1.1 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED-CDRGPuHjnBCeWkqAW-90Wykqx7S0ge-o2f5jeKH7b1x22qZa3dxa2FHPw1-3lT-rFtr_T8RzzEVmjFsLKuBDxhCsWNQWeT0CwOVs_NApkHNaf2UMnITeqTz0HQQz6e0wa4ijmBQ5L43rgxCJN6Mun9ntsRtle40ZhMckP8AGCJCU Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73595708b0aa4675b02e05947383d8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 87f4f3bcd603448d856a7471120a42af Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 could not be found. Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'fe4a71ec-b6b8-461e-808f-00fe2d3de422'} Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 could not be found. Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 could not be found. Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:29.963309 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 could not be found. Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Returning 404 to user: Instance fe4a71ec-b6b8-461e-808f-00fe2d3de422 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67d9604f-abe0-4766-ad50-5d452264867d tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422" status: 404 len: 111 microversion: 2.1 time: 0.035100 Sep 01 05:21:29.969196 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2756/5549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:29 2022] GET /compute/v2.1/servers/fe4a71ec-b6b8-461e-808f-00fe2d3de422 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:21:29.976839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:29.977348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:29.984451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.984957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.985396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:29.986114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:29.986573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:29.987026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.014773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:21:30.084521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:30.106515 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e15658a3-959d-41fa-a778-466c395a2c55 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 204 len: 0 microversion: 2.1 time: 0.133826 Sep 01 05:21:30.107186 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2794/5550] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:21:29 2022] DELETE /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:21:30.115866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:30.116482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:30.123057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.123566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.124004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.124712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.125172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.125610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.260095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:30.262711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:30.270631 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cf88c9c-6417-445a-a2cc-1643baf9ac72 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1508 microversion: 2.1 time: 0.158740 Sep 01 05:21:30.271369 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2757/5551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:30 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:30.954668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:30.956177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:30.963474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.964162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.964663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:30.965459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:30.966024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:30.966378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.115014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:31.123888 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09b177b6-b882-4ba0-b2e5-aba621778361 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1373 microversion: 2.1 time: 0.173882 Sep 01 05:21:31.124465 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2795/5552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:30 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:31.292603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:31.293237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:31.301709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:31.302207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:31.302645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.303399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:31.303895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:31.304333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:31.453387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:31.462312 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cefa848c-954e-4f45-888a-491458206c69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1508 microversion: 2.1 time: 0.173867 Sep 01 05:21:31.463051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2758/5553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:31 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:32.145584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:32.146243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:32.153526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.153988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.154442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.155170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.155619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.156028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.368463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:32.377448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0321fb9a-5ec1-4a76-92b2-5fdfc2551953 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1546 microversion: 2.1 time: 0.235802 Sep 01 05:21:32.378044 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2796/5554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:32 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:32.399793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:32.401757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:32.409528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.410033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.410470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.411895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.412523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.413110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.490167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:32.491072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:32.498530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.499338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.500036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.501602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.502792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.503923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.601109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:32.617781 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2462604-38a9-481b-8c78-d78a23c622c9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 200 len: 1466 microversion: 2.1 time: 0.131399 Sep 01 05:21:32.618452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2797/5555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:32 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 1466 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:32.635212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a639899a-3880-4692-9452-d82c8b4cd5d2 req-f8f6c445-a5c3-4121-9b86-4ada04c6f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfa9f18-536f-48a1-8832-7a2368e9561a", "name": "network-vif-deleted", "tag": "f1cb0eb7-ff66-44a0-aac9-1ba69395a471"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:32.645104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:32.645568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a639899a-3880-4692-9452-d82c8b4cd5d2 req-f8f6c445-a5c3-4121-9b86-4ada04c6f67c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:32.646255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a639899a-3880-4692-9452-d82c8b4cd5d2 req-f8f6c445-a5c3-4121-9b86-4ada04c6f67c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:32.646686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a639899a-3880-4692-9452-d82c8b4cd5d2 req-f8f6c445-a5c3-4121-9b86-4ada04c6f67c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:32.654214 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea299d77-c394-409f-9024-afed974fdaeb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1546 microversion: 2.1 time: 0.259532 Sep 01 05:21:32.655066 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2759/5556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:32 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:32.659572 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a639899a-3880-4692-9452-d82c8b4cd5d2 req-f8f6c445-a5c3-4121-9b86-4ada04c6f67c service nova] Creating event network-vif-deleted:f1cb0eb7-ff66-44a0-aac9-1ba69395a471 for instance fcfa9f18-536f-48a1-8832-7a2368e9561a on n-h2-820368-37 Sep 01 05:21:32.664861 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a639899a-3880-4692-9452-d82c8b4cd5d2 req-f8f6c445-a5c3-4121-9b86-4ada04c6f67c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044791 Sep 01 05:21:32.665476 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2798/5557] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:33.641830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:33.642488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: fcfa9f18-536f-48a1-8832-7a2368e9561a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:33.650303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.651366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.651810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.652519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.652977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.653409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.671768 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] HTTP exception thrown: Instance fcfa9f18-536f-48a1-8832-7a2368e9561a could not be found. Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Request method failure captured: Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a HTTP/1.1 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED-CDRGPuHjnBCeWkqAW-90Wykqx7S0ge-o2f5jeKH7b1x22qZa3dxa2FHPw1-3lT-rFtr_T8RzzEVmjFsLKuBDxhCsWNQWeT0CwOVs_NApkHNaf2UMnITeqTz0HQQz6e0wa4ijmBQ5L43rgxCJN6Mun9ntsRtle40ZhMckP8AGCJCU Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73595708b0aa4675b02e05947383d8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 87f4f3bcd603448d856a7471120a42af Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance fcfa9f18-536f-48a1-8832-7a2368e9561a could not be found. Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'fcfa9f18-536f-48a1-8832-7a2368e9561a'} Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfa9f18-536f-48a1-8832-7a2368e9561a could not be found. Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfa9f18-536f-48a1-8832-7a2368e9561a could not be found. Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:33.673319 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfa9f18-536f-48a1-8832-7a2368e9561a could not be found. Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Returning 404 to user: Instance fcfa9f18-536f-48a1-8832-7a2368e9561a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-defd2383-36de-4403-b326-2dfb1033ec2f tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a" status: 404 len: 111 microversion: 2.1 time: 0.038856 Sep 01 05:21:33.677827 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2760/5558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:33 2022] GET /compute/v2.1/servers/fcfa9f18-536f-48a1-8832-7a2368e9561a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:21:33.686157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:33.686729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:33.693736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.694259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.694697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.695451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.695906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.696334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.725849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:21:33.813876 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d44d76e9-d22b-48eb-b433-33d27b8fa8f9 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 204 len: 0 microversion: 2.1 time: 0.132758 Sep 01 05:21:33.814599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2799/5559] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:21:33 2022] DELETE /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:21:33.824062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:33.824674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:33.831128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.832674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.832674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.832998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:33.833191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:33.833831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:33.971488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:33.980641 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c79f6618-13aa-477b-8ad3-49776a9fabcb tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1493 microversion: 2.1 time: 0.161298 Sep 01 05:21:33.981227 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2761/5560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:33 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:34.191415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:34.191882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:34.198724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.199228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.199664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.200389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:34.200823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:34.201247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:34.226540 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-427a3748-11d9-4b02-8b72-aaf0c30525ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/ips" status: 200 len: 150 microversion: 2.20 time: 0.039763 Sep 01 05:21:34.227152 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2800/5561] 10.222.0.26 () {60 vars in 1289 bytes} [Thu Sep 1 05:21:34 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:35.008851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:35.010612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:35.029153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.029961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.030579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.031537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.032151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.032730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.257087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:35.287608 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3117ade-2716-4467-9d6c-3b862f40f591 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1493 microversion: 2.1 time: 0.284501 Sep 01 05:21:35.308990 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2762/5562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:35 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1493 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:35.920509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-10e16d33-7ae0-4ea6-a2b7-30108682c89f req-2d0169f0-ba05-4cf4-9868-76cea60f2112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24bcb7c-5471-4635-8e8e-803eaeda1525", "name": "network-vif-deleted", "tag": "9f8e8093-237a-4562-a28e-14236720d894"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:35.935787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-10e16d33-7ae0-4ea6-a2b7-30108682c89f req-2d0169f0-ba05-4cf4-9868-76cea60f2112 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:35.936544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-10e16d33-7ae0-4ea6-a2b7-30108682c89f req-2d0169f0-ba05-4cf4-9868-76cea60f2112 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:35.937203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-10e16d33-7ae0-4ea6-a2b7-30108682c89f req-2d0169f0-ba05-4cf4-9868-76cea60f2112 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:35.968775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-10e16d33-7ae0-4ea6-a2b7-30108682c89f req-2d0169f0-ba05-4cf4-9868-76cea60f2112 service nova] Creating event network-vif-deleted:9f8e8093-237a-4562-a28e-14236720d894 for instance c24bcb7c-5471-4635-8e8e-803eaeda1525 on n-h1-820368-37 Sep 01 05:21:35.975037 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-10e16d33-7ae0-4ea6-a2b7-30108682c89f req-2d0169f0-ba05-4cf4-9868-76cea60f2112 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058090 Sep 01 05:21:35.981212 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2801/5563] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:36.323358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:36.324125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:36.333595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.334246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.334921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.335915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.336513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.337933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.377417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:36.377916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:36.378351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:36.378806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lazy-loading 'fault' on Instance uuid c24bcb7c-5471-4635-8e8e-803eaeda1525 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:21:36.445389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:36.456454 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b42c1fe7-0311-470c-8ed9-6e2fd5c0d935 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 200 len: 1302 microversion: 2.1 time: 0.138322 Sep 01 05:21:36.457397 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2763/5564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:36 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:37.231010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:37.231960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.239396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.239889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.240485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.241410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.241994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.242524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.275973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lazy-loading 'flavor' on Instance uuid 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:21:37.352516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:37.479720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.480429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: c24bcb7c-5471-4635-8e8e-803eaeda1525] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.488938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.489543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.490245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.491073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.491751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.492253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.505473 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5dd1a33-24a4-42b3-b061-c716147b5b2e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/action" status: 202 len: 0 microversion: 2.20 time: 0.281148 Sep 01 05:21:37.506172 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2802/5565] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:21:37 2022] POST /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:21:37.516690 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] HTTP exception thrown: Instance c24bcb7c-5471-4635-8e8e-803eaeda1525 could not be found. Sep 01 05:21:37.522084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.522900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Request method failure captured: Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 HTTP/1.1 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjED-CDRGPuHjnBCeWkqAW-90Wykqx7S0ge-o2f5jeKH7b1x22qZa3dxa2FHPw1-3lT-rFtr_T8RzzEVmjFsLKuBDxhCsWNQWeT0CwOVs_NApkHNaf2UMnITeqTz0HQQz6e0wa4ijmBQ5L43rgxCJN6Mun9ntsRtle40ZhMckP8AGCJCU Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73595708b0aa4675b02e05947383d8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 87f4f3bcd603448d856a7471120a42af Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance c24bcb7c-5471-4635-8e8e-803eaeda1525 could not be found. Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'c24bcb7c-5471-4635-8e8e-803eaeda1525'} Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c24bcb7c-5471-4635-8e8e-803eaeda1525 could not be found. Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24bcb7c-5471-4635-8e8e-803eaeda1525 could not be found. Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:37.523750 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24bcb7c-5471-4635-8e8e-803eaeda1525 could not be found. Sep 01 05:21:37.529011 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:21:37.530620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Returning 404 to user: Instance c24bcb7c-5471-4635-8e8e-803eaeda1525 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:21:37.531202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.531902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.532139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.532976 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eca9e484-d4bc-4288-8115-83fabe163d20 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525" status: 404 len: 111 microversion: 2.1 time: 0.057480 Sep 01 05:21:37.533093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.533459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.533884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.534742 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2764/5566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:37 2022] GET /compute/v2.1/servers/c24bcb7c-5471-4635-8e8e-803eaeda1525 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:21:37.546630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.547952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.559301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.559963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.560512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.561336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.562088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.562619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.593350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:21:37.722076 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a07670b4-14aa-4921-acff-685ad391eda2 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 204 len: 0 microversion: 2.1 time: 0.180306 Sep 01 05:21:37.723793 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2765/5567] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:21:37 2022] DELETE /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:21:37.738959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:37.740272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:37.740414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:37.751651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.752626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.753621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.754828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:37.755267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:37.755986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:37.756925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:37.758274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:37.761146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a0ef550-eb35-4ab7-99d0-ad136149a7d4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.244639 Sep 01 05:21:37.762121 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2803/5568] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:37 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:37.945711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:37.953915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-996e7de5-6c69-4524-b823-cbcf11d21c57 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1675 microversion: 2.1 time: 0.224139 Sep 01 05:21:37.954506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2766/5569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:37 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:38.799462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:38.800855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:38.807431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.807920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.808373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.809313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.809782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.810187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.974784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:38.983363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:38.984225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:38.986137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:38.988725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:38.990645 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0be7710-1bd5-41c0-8873-7ddfea46b81e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.195444 Sep 01 05:21:38.991681 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2804/5570] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:38 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:38.991929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.992430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.992866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:38.993598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:38.994145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:38.994577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:39.176768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:39.185416 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87ced250-b618-4d8e-8aad-3474f08744c7 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1675 microversion: 2.1 time: 0.205904 Sep 01 05:21:39.186010 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2767/5571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:38 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:21:40.035585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:40.035585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:40.044721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.045468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.046280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.047205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.047807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.048388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.208418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:40.209018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:40.217293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.218110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.218702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.219716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.220383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.220804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.229317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:40.240225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:40.241797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:40.243282 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dc00bec5-2e10-4c14-8347-ee056729aae5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.213067 Sep 01 05:21:40.244482 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2805/5572] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:40 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:40.295701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f4f3bcd603448d856a7471120a42af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73595708b0aa4675b02e05947383d8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:40.305607 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c362b3a-0f78-4d98-9f46-a093535b5d69 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 200 len: 1607 microversion: 2.1 time: 0.102039 Sep 01 05:21:40.306235 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2768/5573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:40 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 1607 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:21:40.412682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6eed33ce-b2e3-4a5f-b284-530384a1f72d req-2cefca56-82d8-4319-977e-f47cd0130fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d80cb5b-9297-49aa-8d00-5d630b271401", "name": "network-vif-deleted", "tag": "d57fb005-96ea-43a1-abe6-74bb19e418fd"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:40.425022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6eed33ce-b2e3-4a5f-b284-530384a1f72d req-2cefca56-82d8-4319-977e-f47cd0130fe6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:40.425829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6eed33ce-b2e3-4a5f-b284-530384a1f72d req-2cefca56-82d8-4319-977e-f47cd0130fe6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:40.426378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6eed33ce-b2e3-4a5f-b284-530384a1f72d req-2cefca56-82d8-4319-977e-f47cd0130fe6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:40.441100 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6eed33ce-b2e3-4a5f-b284-530384a1f72d req-2cefca56-82d8-4319-977e-f47cd0130fe6 service nova] Creating event network-vif-deleted:d57fb005-96ea-43a1-abe6-74bb19e418fd for instance 7d80cb5b-9297-49aa-8d00-5d630b271401 on n-h1-820368-37 Sep 01 05:21:40.448382 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6eed33ce-b2e3-4a5f-b284-530384a1f72d req-2cefca56-82d8-4319-977e-f47cd0130fe6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040555 Sep 01 05:21:40.449339 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2806/5574] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:41.269977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:41.270605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:41.278572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.279122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.279605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.280306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.280792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.281219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.329984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:41.330708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] [instance: 7d80cb5b-9297-49aa-8d00-5d630b271401] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:41.337990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.338482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.338928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.339671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:41.340329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:41.341090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:41.356647 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] HTTP exception thrown: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 could not be found. Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Request method failure captured: Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 HTTP/1.1 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjED-CDRGPuHjnBCeWkqAW-90Wykqx7S0ge-o2f5jeKH7b1x22qZa3dxa2FHPw1-3lT-rFtr_T8RzzEVmjFsLKuBDxhCsWNQWeT0CwOVs_NApkHNaf2UMnITeqTz0HQQz6e0wa4ijmBQ5L43rgxCJN6Mun9ntsRtle40ZhMckP8AGCJCU Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_73595708b0aa4675b02e05947383d8d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/73595708b0aa4675b02e05947383d8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 73595708b0aa4675b02e05947383d8d9 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-369979107 Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 87f4f3bcd603448d856a7471120a42af Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-369979107-project Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 could not be found. Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7d80cb5b-9297-49aa-8d00-5d630b271401'} Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 could not be found. Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 could not be found. Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:41.358379 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 could not be found. Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Returning 404 to user: Instance 7d80cb5b-9297-49aa-8d00-5d630b271401 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2672b37e-35d8-4cd5-82fa-1be14f411600 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401" status: 404 len: 111 microversion: 2.1 time: 0.035658 Sep 01 05:21:41.365865 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2807/5575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:21:41 2022] GET /compute/v2.1/servers/7d80cb5b-9297-49aa-8d00-5d630b271401 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:21:41.369132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47b31ebd-202c-450f-8c39-98dbec338b78 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] Calling method '.version_select at 0x7fa75b119d30>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:41.393494 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47b31ebd-202c-450f-8c39-98dbec338b78 tempest-ServerActionsTestJSON-369979107 tempest-ServerActionsTestJSON-369979107-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313200635" status: 202 len: 0 microversion: 2.1 time: 0.028445 Sep 01 05:21:41.394334 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2808/5576] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313200635 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:21:41.471000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:41.481038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:41.482554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:41.484098 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b45db261-0475-4b7a-8331-15c8e3db254a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.218337 Sep 01 05:21:41.485075 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2769/5577] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:41 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:42.508639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:42.509329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:42.520352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.520852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.521327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.522033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:42.522460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:42.523033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:42.772953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:42.782317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:42.783804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:42.785015 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e514eed2-1a1a-4c70-aa99-3c398ccd781c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.281416 Sep 01 05:21:42.785579 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2809/5578] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:42 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:43.809530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:43.811767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:43.820302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.821842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.822465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:43.823351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:43.823904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:43.824408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:44.049800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:44.058578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:44.060180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:44.061684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4879c257-8ba0-46d4-a34d-a28e4c51addd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.256418 Sep 01 05:21:44.068563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2770/5579] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:43 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:45.091309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:45.091947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:45.106289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.107321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.108009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.109593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:45.110242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:45.110868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:45.324301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:45.335282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:45.337027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:45.338753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9560b30e-eb84-4442-ba73-e53e5052b90a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.251709 Sep 01 05:21:45.342373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2810/5580] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:45 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:21:46.364996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:46.365819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:46.373598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.374068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.374558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.375394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:46.375889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:46.376260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:46.704612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:46.718571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:46.720046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:46.721407 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71659302-c2a8-4b7e-b4bf-72a8ce5da530 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.360463 Sep 01 05:21:46.722000 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2771/5581] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:46 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:46.903202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2596aea9-4cbf-49f6-b482-9f9de3384400 tempest-ExtensionsTest-674680550 tempest-ExtensionsTest-674680550-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:46.904775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2596aea9-4cbf-49f6-b482-9f9de3384400 tempest-ExtensionsTest-674680550 tempest-ExtensionsTest-674680550-project] 10.222.0.26 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.141039 Sep 01 05:21:46.905319 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2811/5582] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 1 05:21:46 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:46.914969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3766427-3708-4f99-8eb3-26e70310f9d3 tempest-ExtensionsTest-674680550 tempest-ExtensionsTest-674680550-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:46.917113 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3766427-3708-4f99-8eb3-26e70310f9d3 tempest-ExtensionsTest-674680550 tempest-ExtensionsTest-674680550-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006473 Sep 01 05:21:46.917667 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2772/5583] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Sep 1 05:21:46 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:47.390801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:47.391418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:47.401957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.402907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.403763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.405006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.405819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.406562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.457425 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1297178f-6a01-49cc-b260-14fe856db834 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/ips" status: 200 len: 144 microversion: 2.1 time: 0.070255 Sep 01 05:21:47.465337 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2812/5584] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:21:47 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/ips => generated 144 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:47.758131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:47.759817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:47.766687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.767132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.767570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.768297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:47.768753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:47.769176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:47.944992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:47.955352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:47.956901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:47.958275 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-568b4174-e3b4-40df-a44e-b776a55b2dc2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.209576 Sep 01 05:21:47.958932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2773/5585] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:47 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:48.624169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07536037-a7be-4c51-b2a4-691fbfeaa751 tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] Calling method '.version_select at 0x7fa75aea0430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.682491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07536037-a7be-4c51-b2a4-691fbfeaa751 tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.209290 Sep 01 05:21:48.683139 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2813/5586] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9/defaults => generated 371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:48.694769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b61b7746-07e2-45f2-be89-a6fdf27b68ba tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] Calling method '.version_select at 0x7fa75bfc0ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.779973 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b61b7746-07e2-45f2-be89-a6fdf27b68ba tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9" status: 200 len: 371 microversion: 2.1 time: 0.088962 Sep 01 05:21:48.780609 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2774/5587] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9 => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:48.794562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a006ae03-58a7-49f5-96d5-2cf6a94eceba tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] Calling method '.version_select at 0x7fa75af6c430>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.854304 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a006ae03-58a7-49f5-96d5-2cf6a94eceba tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.063803 Sep 01 05:21:48.855306 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2814/5588] 10.222.0.26 () {58 vars in 1269 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9/defaults => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:48.868521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a2e71f1-a50c-4884-bf9d-864561472a84 tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] Calling method '.version_select at 0x7fa760580f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.940259 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a2e71f1-a50c-4884-bf9d-864561472a84 tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9" status: 200 len: 371 microversion: 2.1 time: 0.075702 Sep 01 05:21:48.941618 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2775/5589] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:48.953357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a675f53e-3052-4721-8597-7796c96569db tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] Calling method '.version_select at 0x7fa75aec6dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.985319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:48.985875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:48.995236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.995717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.999510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:48.999510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:48.999510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:48.999510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.053949 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a675f53e-3052-4721-8597-7796c96569db tempest-QuotasTestJSON-1066747349 tempest-QuotasTestJSON-1066747349-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9?user_id=f9a3b4c4eed243fca81a0cd4c61c284d" status: 200 len: 371 microversion: 2.1 time: 0.104409 Sep 01 05:21:49.054450 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2815/5590] 10.222.0.26 () {58 vars in 1323 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/os-quota-sets/63f4c65d907c4c72a02719c8845790b9?user_id=f9a3b4c4eed243fca81a0cd4c61c284d => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:21:49.169313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:49.171793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:49.179861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:49.182138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:49.183474 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a949156-9ace-4fc2-9022-4087c5ddca84 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1740 microversion: 2.20 time: 0.202297 Sep 01 05:21:49.184142 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2776/5591] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:48 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:49.605406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb09f035-778b-468b-880f-9706751ba6c2"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:49.607817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:49.614619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.615150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.615580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.616289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:49.616737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:49.617158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:49.921510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efc7018a-a066-4d88-a3a9-2ea11484c3a5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320170 Sep 01 05:21:49.922650 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2816/5592] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:21:49 2022] POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:50.305751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:50.308242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:50.335316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.338330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.342117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.345281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:50.346149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:50.346750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:50.578157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:50.589779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:50.592378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:50.594161 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7aedcd61-63e7-4f3b-bf73-f74945627056 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.299280 Sep 01 05:21:50.595871 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2777/5593] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:50 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:50.925682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e17f31e-ff40-46bc-8f84-748fea87982b tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Action: 'create', calling method: .version_select at 0x7fa75a8e43a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1740181947", "metadata": {"Type": "work"}}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:51.623705 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e17f31e-ff40-46bc-8f84-748fea87982b tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.850090 Sep 01 05:21:51.627107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2817/5594] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 1 05:21:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:21:51.629471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:51.633837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:51.652125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-17573ef4-6294-48b9-95dc-a4b6120bcc24 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75a8e4af0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:51.679012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:51.680236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:51.683012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.686358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:51.687921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:51.689166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:51.773784 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-17573ef4-6294-48b9-95dc-a4b6120bcc24 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 353 microversion: 2.1 time: 0.130841 Sep 01 05:21:51.775939 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2818/5595] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:51 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:51.976645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:51.988547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:51.990548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:51.992323 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-876602aa-aa9e-4898-bc4c-0595e66cd5d8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.376047 Sep 01 05:21:51.993766 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2778/5596] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:51 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:52.358458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-52041ef4-c93c-4009-b065-7335f5752eef req-e53e72c3-4232-4b1d-9e5a-bb8f8000d88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "name": "network-vif-plugged", "status": "completed", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:21:52.370944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-52041ef4-c93c-4009-b065-7335f5752eef req-e53e72c3-4232-4b1d-9e5a-bb8f8000d88a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:52.371966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-52041ef4-c93c-4009-b065-7335f5752eef req-e53e72c3-4232-4b1d-9e5a-bb8f8000d88a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:52.372890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-52041ef4-c93c-4009-b065-7335f5752eef req-e53e72c3-4232-4b1d-9e5a-bb8f8000d88a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:52.393326 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-52041ef4-c93c-4009-b065-7335f5752eef req-e53e72c3-4232-4b1d-9e5a-bb8f8000d88a service nova] Creating event network-vif-plugged:f6d0850c-616e-40f8-82d3-8b77f3e22a74 for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 on n-h1-820368-37 Sep 01 05:21:52.400983 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-52041ef4-c93c-4009-b065-7335f5752eef req-e53e72c3-4232-4b1d-9e5a-bb8f8000d88a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046661 Sep 01 05:21:52.402714 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2819/5597] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:52.788881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-569b0ba7-4ebc-405d-a69f-1af9bd272e39 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75bf26790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:52.887499 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-569b0ba7-4ebc-405d-a69f-1af9bd272e39 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 353 microversion: 2.1 time: 0.101776 Sep 01 05:21:52.888404 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2779/5598] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:52 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:53.022497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:53.023392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:53.035838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.037139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.037823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.038789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:53.039501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:53.040167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:53.206469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:53.218067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:53.220171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:53.221806 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-152eeb96-5607-4f9e-90f7-378b5caf9621 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.204254 Sep 01 05:21:53.222622 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2820/5599] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:53 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:53.903178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-853f1a84-c88b-447f-a949-fcda809b8c28 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75b2e00d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:53.965157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-853f1a84-c88b-447f-a949-fcda809b8c28 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 354 microversion: 2.1 time: 0.067180 Sep 01 05:21:53.965837 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2780/5600] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:53 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:53.980525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30818689-69d2-4be7-ad40-19c232858bc9 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75aefe700>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.045976 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30818689-69d2-4be7-ad40-19c232858bc9 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 354 microversion: 2.1 time: 0.070483 Sep 01 05:21:54.061498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c184daf1-2ee7-4cc3-9a41-666e78058764 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75b4305e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.061973 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2821/5601] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:53 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:54.146113 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c184daf1-2ee7-4cc3-9a41-666e78058764 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 202 len: 0 microversion: 2.1 time: 0.088913 Sep 01 05:21:54.147110 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2781/5602] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:21:54 2022] DELETE /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:21:54.155975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37619efb-929f-43c9-b93f-43c17262b292 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75bc99160>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.248517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:54.249690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:54.261790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.271265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.272170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.273209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:54.277106 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37619efb-929f-43c9-b93f-43c17262b292 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 353 microversion: 2.1 time: 0.125039 Sep 01 05:21:54.278083 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2822/5603] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:54 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:54.279053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:54.280482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:54.494382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:54.503398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:54.505020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:54.506236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10ff9196-2366-4c70-b24a-d71967fc44ca tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.262622 Sep 01 05:21:54.507132 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2782/5604] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:54 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:55.300051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-780a7d76-8e46-4352-855d-f3cd96bbb62f tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75bc99b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:55.400542 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-780a7d76-8e46-4352-855d-f3cd96bbb62f tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 353 microversion: 2.1 time: 0.104466 Sep 01 05:21:55.401135 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2823/5605] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:55 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:55.529969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:55.531249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:55.538234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:55.539821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:55.540404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:55.541222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.542063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:55.542723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:55.543346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:55.766467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:55.777772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:55.779904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:55.781691 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe972ac3-fa19-442e-963d-40cf99cb11fb tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.256112 Sep 01 05:21:55.783193 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2783/5606] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:55 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:56.421158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32f671d4-112d-4aa3-a598-29633d9aed3d tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75aefe3a0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:56.499150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32f671d4-112d-4aa3-a598-29633d9aed3d tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 200 len: 353 microversion: 2.1 time: 0.088053 Sep 01 05:21:56.500022 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2824/5607] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:56 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:21:56.807602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:56.808948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:56.816606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.817346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.817942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:56.818807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:56.819432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:56.820006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:57.113108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:57.127675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:57.129378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:57.140743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1dad3c64-cba7-40c7-982a-a6b8efac0f52 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.337391 Sep 01 05:21:57.151598 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2784/5608] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:56 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:21:57.518065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b1ef01c-cdc0-4dc7-8408-9783bbc524a4 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Calling method '.version_select at 0x7fa75b0a6820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:57.565241 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-0b1ef01c-cdc0-4dc7-8408-9783bbc524a4 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] HTTP exception thrown: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b1ef01c-cdc0-4dc7-8408-9783bbc524a4 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Request method failure captured: Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 HTTP/1.1 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEFu5bCnJyXmxE-yUs_4FQxOt9-Oo5Za8s6dRulNT3cjfJzfb30JCJNxmaANf1ZzYtnp5ATxdRNNkxVlSngLF8s7BPYQtRv8rDCTcyR1DA46hHdMXSd_VNGE1wWO8E_ndfBiOXT6L9N-gljKO3e8jojkXz-CK8c6M7R6KlN91BBh300 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 721d94e982db48a0b112abf3ceb87e68 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesGetTestJSON-1814975820 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721d94e982db48a0b112abf3ceb87e68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/721d94e982db48a0b112abf3ceb87e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_721d94e982db48a0b112abf3ceb87e68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721d94e982db48a0b112abf3ceb87e68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesGetTestJSON-1814975820 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 721d94e982db48a0b112abf3ceb87e68 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesGetTestJSON-1814975820 Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesGetTestJSON-1814975820-project Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cbe16a576a444f9fa4b9e61e45a1964f Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesGetTestJSON-1814975820-project Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: exception: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'c9509bb5-4ef6-43d1-8233-b4c619a14722'} Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. (HTTP 404) (Request-ID: req-74e12993-0b0f-4cc6-95e7-94a4cbf50a20) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:21:57.567681 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0b1ef01c-cdc0-4dc7-8408-9783bbc524a4 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] Returning 404 to user: Volume c9509bb5-4ef6-43d1-8233-b4c619a14722 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0b1ef01c-cdc0-4dc7-8408-9783bbc524a4 tempest-VolumesGetTestJSON-1814975820 tempest-VolumesGetTestJSON-1814975820-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722" status: 404 len: 109 microversion: 2.1 time: 0.059660 Sep 01 05:21:57.575930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2825/5609] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:21:57 2022] GET /compute/v2.1/os-volumes/c9509bb5-4ef6-43d1-8233-b4c619a14722 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:21:58.173876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:58.175818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:58.184492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.185805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.187835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.190381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:58.191066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:58.191733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:58.422824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:58.431847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:58.433743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:58.435418 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61ddb06e-c0c5-4a3e-85ff-e769a7aa8039 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.268943 Sep 01 05:21:58.436398 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2785/5610] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:58 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:21:59.476152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:59.499512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:21:59.505374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:21:59.528732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.530511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.531189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.532105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:21:59.532998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:21:59.533589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:21:59.696092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:59.705777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:59.707958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:21:59.709500 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f2a1a1d-74aa-4192-9b2e-329c684bcbe6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.249758 Sep 01 05:21:59.710629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2826/5611] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:21:59 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:00.733872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:00.735162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:00.741130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:00.744800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.745397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.746163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.748331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:00.749036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:00.750398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:00.956790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:00.966615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:00.972941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:00.975286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d425a70d-075b-4d7e-b30d-ceeb3cbb5f61 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.245540 Sep 01 05:22:00.975882 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2786/5612] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:00 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:01.998646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:01.999275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:02.002061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:02.007505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.008018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.008449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.009391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.009965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.010366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.159275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:02.173959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:02.176805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:02.178055 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ffdbdc7-e0d1-47ff-8d29-f28e3a4bc645 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1735 microversion: 2.20 time: 0.183635 Sep 01 05:22:02.179436 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2827/5613] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:01 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:02.188840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:02.192282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:02.199896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.200382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.200821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.201627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.202133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.202563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.274252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d05cceda-0cf4-41c6-872d-4f1b0cd61953 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action" status: 200 len: 24574 microversion: 2.1 time: 0.089598 Sep 01 05:22:02.275022 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2787/5614] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:22:02 2022] POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action => generated 24574 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:02.560757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d871ebd1-1466-4f53-b696-3b03094e5971 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:02.569343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d871ebd1-1466-4f53-b696-3b03094e5971 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.569858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d871ebd1-1466-4f53-b696-3b03094e5971 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.570315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d871ebd1-1466-4f53-b696-3b03094e5971 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.602012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d871ebd1-1466-4f53-b696-3b03094e5971 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:22:02.654141 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d871ebd1-1466-4f53-b696-3b03094e5971 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action" status: 202 len: 0 microversion: 2.1 time: 0.097909 Sep 01 05:22:02.654777 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2828/5615] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:22:02 2022] POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:22:02.664721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:02.666497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:02.673860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.674455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.675051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.676231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:02.676801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:02.677327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:02.876397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:02.902543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-557d62e5-5b4b-4ffb-ba3b-7b87d5aa6525 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.242310 Sep 01 05:22:02.907573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2788/5616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:02 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:03.211687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:03.213527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:03.222536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.223540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.224143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.224877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.225346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.226374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.371399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:03.380220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:03.381665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:03.382857 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e68a1bf2-5685-41f2-9a4c-0f25b9490db2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1717 microversion: 2.20 time: 0.178517 Sep 01 05:22:03.383465 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2829/5617] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:03 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:03.925030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:03.926296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:03.936546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.937287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.937724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:03.938636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:03.940101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:03.940538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.090442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:04.099752 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17a3360e-18bd-416c-8d03-82180a3f4e62 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.178485 Sep 01 05:22:04.101014 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2789/5618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:03 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:04.406481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:04.407113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:04.414349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.414831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.415375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.416102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:04.416540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:04.416959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:04.558669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:04.567224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:04.568679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:04.570058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-385d5a39-5099-40d1-8e9c-b27265258746 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1717 microversion: 2.20 time: 0.167673 Sep 01 05:22:04.570621 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2830/5619] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:04 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:05.122410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:05.123085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:05.130321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.130733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.131206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.131903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.132356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.132777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.286093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:05.296873 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0762808-9053-4dcc-b8a1-e9ed338fcc5d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.179040 Sep 01 05:22:05.297796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2790/5620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:05 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:05.593859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:05.594456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:05.601799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.602280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.602834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.603573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.604107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.604488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.608935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:05.752289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:05.760903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:05.762365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:05.763596 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d00d5cd3-ba9d-4425-a1cf-433104af59bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1660 microversion: 2.20 time: 0.173805 Sep 01 05:22:05.764174 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2831/5621] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:05 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1660 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:05.787379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a4bb415-1405-42d4-914b-caa8f7ae4a87"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:05.790266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:05.797610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.798165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.798875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:05.799841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:05.800418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:05.800935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.115162 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c3f7fa6-906b-419c-97e5-cde6a6641140 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332919 Sep 01 05:22:06.115786 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2791/5622] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Sep 1 05:22:05 2022] POST /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:06.255052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:06.256257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:06.263455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.264091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.264642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.265392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.266172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.266689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.318054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:06.319305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:06.334778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.335894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:22:06.338456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.338938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.340296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.340939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.341553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.441125 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6276477e-8300-41b9-a023-3d76df159828 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/action" status: 202 len: 0 microversion: 2.20 time: 0.189921 Sep 01 05:22:06.441887 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2832/5623] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:22:06 2022] POST /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:22:06.447531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-98362328-7dc8-4939-889b-b4eae13cf0f4 req-2b182d55-63fc-420c-9d26-dd0a675d63a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:06.459247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98362328-7dc8-4939-889b-b4eae13cf0f4 req-2b182d55-63fc-420c-9d26-dd0a675d63a9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.459932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98362328-7dc8-4939-889b-b4eae13cf0f4 req-2b182d55-63fc-420c-9d26-dd0a675d63a9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.460677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98362328-7dc8-4939-889b-b4eae13cf0f4 req-2b182d55-63fc-420c-9d26-dd0a675d63a9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.478041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-98362328-7dc8-4939-889b-b4eae13cf0f4 req-2b182d55-63fc-420c-9d26-dd0a675d63a9 service nova] Unable to find a host for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6. Dropping event network-vif-unplugged {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:22:06.488417 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-98362328-7dc8-4939-889b-b4eae13cf0f4 req-2b182d55-63fc-420c-9d26-dd0a675d63a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036097 Sep 01 05:22:06.489819 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2833/5624] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:22:06.495625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:06.496364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:06.503634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.504301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.504784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.505443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:06.505898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:06.506317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:06.516440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:06.530292 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9641009-c990-4293-9f2d-9d5bb154666f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.215904 Sep 01 05:22:06.531779 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2792/5625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:06 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:06.697484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:06.707255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:06.709033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:06.710257 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a0b28c2-6794-4b00-b754-a04b456d48fd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1746 microversion: 2.20 time: 0.219895 Sep 01 05:22:06.711373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2834/5626] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:06 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:07.552684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:07.553433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:07.561090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.561590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.562421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.563977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.564721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.565117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.735207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:07.736458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:07.739520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:07.743072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.744584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.745199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.746092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:07.746721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:07.747334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:07.749026 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad47d677-46bc-4770-9e0f-8eeb99d727f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.200464 Sep 01 05:22:07.751173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2793/5627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:07.897096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:07.908507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:07.910220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:07.912041 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a8eceb99-fc32-4424-a820-221635d5844f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1746 microversion: 2.20 time: 0.181817 Sep 01 05:22:07.912617 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2835/5628] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:08.772885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:08.774308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:08.787168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.787670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.788111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.788831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.789303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.789731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.795744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:08.938374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:08.939809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:08.950393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.951224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.951659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:08.952377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:08.952834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:08.958962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:09.023340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:09.037832 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b1814f3-c0f1-4ff4-9d98-e95822bf937c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.269340 Sep 01 05:22:09.040633 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2794/5629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:08 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:09.261727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:09.277621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:09.279435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:09.280923 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13293e15-40b0-43c4-b6ea-9a0740ab34e2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1748 microversion: 2.20 time: 0.347170 Sep 01 05:22:09.291905 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2836/5630] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:08 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1748 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:10.062135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:10.062945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:10.072182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.075395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.077756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.078867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.081079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.081820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.308800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:10.311390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:10.312132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:10.322433 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be4214df-aae5-4c42-9013-b2bcb2e5b7d4 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.264342 Sep 01 05:22:10.325031 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2795/5631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:10 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:10.328708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.329604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.330609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.339392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.340022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.340592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.561754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:10.572485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:10.574315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:10.576053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11f9ba77-a2b3-4dcb-8f60-7dcaa3d62d21 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1748 microversion: 2.20 time: 0.272246 Sep 01 05:22:10.576700 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2837/5632] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:10 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1748 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:10.870604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:10.870806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:10.877959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.878609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.879090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.879946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:10.880463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:10.880883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:10.908534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:22:11.054064 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66cdcf5d-f962-4b38-856b-690c0bc38da1 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 204 len: 0 microversion: 2.1 time: 0.188006 Sep 01 05:22:11.055127 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2796/5633] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:22:10 2022] DELETE /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:22:11.064595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.065614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:11.073231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.074219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.074935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.075910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.076606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.077318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.239314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:11.248840 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd24110a-c168-4fbe-b31a-b281c73c6743 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1552 microversion: 2.1 time: 0.188570 Sep 01 05:22:11.249640 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2838/5634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:11.344431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.345152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:11.352548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.353044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.353484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.354193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.354665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.355117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.549280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:11.561407 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-daf6f4a1-7b54-493e-bb89-e8c98a9c00ef tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.220433 Sep 01 05:22:11.561761 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2797/5635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:11.601487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:11.602223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:11.610240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.610735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.611364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.612213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:11.612673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:11.613195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:11.819335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:11.830308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:11.831977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:11.833202 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1b6c226-ef53-41d1-ab0c-f2998808a10c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1748 microversion: 2.20 time: 0.236039 Sep 01 05:22:11.839823 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2839/5636] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:11 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1748 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:12.270335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:12.271516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:12.280485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.281318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.282481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.284337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.284804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.285242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.486396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:12.496460 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31bc9e3b-7635-470b-9766-afcbe517f7b7 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1552 microversion: 2.1 time: 0.230243 Sep 01 05:22:12.500190 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2798/5637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:12 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1552 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:12.592875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:12.594035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:12.606377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.607075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.609598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.609598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.610425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.611285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.859832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:12.861670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:12.871791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.872719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.873354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.874238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:12.875309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:12.876284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:12.993240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:13.039385 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9d39cfd-dd71-45ed-a04d-405cc9814028 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.458372 Sep 01 05:22:13.054962 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2840/5638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:12 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:13.163703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:13.178564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:13.184512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:13.186922 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7a0f468-7aae-4630-80a3-1c9555b8cbba tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1748 microversion: 2.20 time: 0.332619 Sep 01 05:22:13.188168 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2799/5639] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:12 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1748 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:13.525262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:13.526993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:13.538637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.539519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.540340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.541551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.542805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.543627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.548592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9b184599-f8c8-405e-8c5e-45e02c7001c1 req-8d16ec15-91db-4286-876e-1afff886463e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91effc9-657c-44af-b047-79e9f1fc70df", "name": "network-vif-deleted", "tag": "d531dad1-672b-47ec-a6cc-98696db5dcbe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:13.583919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b184599-f8c8-405e-8c5e-45e02c7001c1 req-8d16ec15-91db-4286-876e-1afff886463e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:13.584700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b184599-f8c8-405e-8c5e-45e02c7001c1 req-8d16ec15-91db-4286-876e-1afff886463e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:13.602475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b184599-f8c8-405e-8c5e-45e02c7001c1 req-8d16ec15-91db-4286-876e-1afff886463e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:13.634406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9b184599-f8c8-405e-8c5e-45e02c7001c1 req-8d16ec15-91db-4286-876e-1afff886463e service nova] Creating event network-vif-deleted:d531dad1-672b-47ec-a6cc-98696db5dcbe for instance b91effc9-657c-44af-b047-79e9f1fc70df on n-h2-820368-37 Sep 01 05:22:13.641664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9b184599-f8c8-405e-8c5e-45e02c7001c1 req-8d16ec15-91db-4286-876e-1afff886463e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100246 Sep 01 05:22:13.642762 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2800/5640] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:13.672935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:13.686682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d2182cf-1a36-44bf-9178-932bf752cdfc tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 200 len: 1485 microversion: 2.1 time: 0.169858 Sep 01 05:22:13.688233 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2841/5641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:13 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 1485 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:14.078780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:14.079887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:14.088190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.089144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.089598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.090340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.091044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.091905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.221477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:14.222628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:14.230907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.231689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.232415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.233727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.234395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.234996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.364760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:14.383655 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1bbcab85-21d3-4915-bf15-63b4978e26f1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.307879 Sep 01 05:22:14.385287 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2801/5642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:14 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:14.460834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:14.477669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:14.481177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:14.484034 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e33c2c73-ac99-42e7-9752-6519fe36c8b4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.266830 Sep 01 05:22:14.485671 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2842/5643] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:14 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:14.709646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:14.710926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: b91effc9-657c-44af-b047-79e9f1fc70df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:14.720107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.720868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.721694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.722610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:14.723968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:14.724576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:14.741132 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] HTTP exception thrown: Instance b91effc9-657c-44af-b047-79e9f1fc70df could not be found. Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Request method failure captured: Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df HTTP/1.1 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEEDk78amUL5VwpnUB8cm1bhi3DPKGYBDJpZrd_W60X8fHPqUjWhfBqPvNGGwSh-l5nXbI-ymzZ_WPwQkDivGv0QEZVi3saUrz76VTe9KgaqtS3fA-5FfAD0ZtQezkBx-n8Msq8WDMYZ_Gnc-XZQqmO08N-GcwllUAD8-t7lCcYbvtM Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 82a8447c65d94100bd959f7eeba4aa15 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 82a8447c65d94100bd959f7eeba4aa15 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestNetworkBasicOps-1779558484-project Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 50a11eb4b2684c369eaff25fe84e837c Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkBasicOps-1779558484-project Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance b91effc9-657c-44af-b047-79e9f1fc70df could not be found. Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'b91effc9-657c-44af-b047-79e9f1fc70df'} Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91effc9-657c-44af-b047-79e9f1fc70df could not be found. Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91effc9-657c-44af-b047-79e9f1fc70df could not be found. Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:22:14.742737 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91effc9-657c-44af-b047-79e9f1fc70df could not be found. Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Returning 404 to user: Instance b91effc9-657c-44af-b047-79e9f1fc70df could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4165c884-d319-4ffa-bb2f-3c9b2bcfe625 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df" status: 404 len: 111 microversion: 2.1 time: 0.039942 Sep 01 05:22:14.751867 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2802/5644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:14 2022] GET /compute/v2.1/servers/b91effc9-657c-44af-b047-79e9f1fc70df => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:22:14.986484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2405b41-92a3-4ecf-b015-01b2124904a0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '.version_select at 0x7fa75a8e4550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:15.039694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2405b41-92a3-4ecf-b015-01b2124904a0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1441869164" status: 202 len: 0 microversion: 2.1 time: 0.059193 Sep 01 05:22:15.044753 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2843/5645] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 05:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1441869164 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:22:15.408674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:15.409751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:15.420330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.421703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.422477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.423833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.424586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.425868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.510841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:15.511488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:15.525528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.525842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.526118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.526844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:15.527327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:15.527743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:15.937715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:15.941163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:15.955454 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29109dab-76fb-4662-92b0-596effef9f00 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.552516 Sep 01 05:22:15.966928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2803/5646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:15 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:15.974243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:15.982293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:15.987947 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-061fd88e-d6f4-4a1c-a94c-65b55297ce25 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.480642 Sep 01 05:22:16.005384 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2844/5647] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:15 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:17.003060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:17.012169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:17.040551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:17.051103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:17.060563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.061197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.069522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.074423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.076667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.077959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.085906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.088480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.089856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.094706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:17.099789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:17.100416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:17.773602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:17.806812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:17.815240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:17.816958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:17.822726 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c777004e-5cda-465a-ad0f-3a505a84780d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.789651 Sep 01 05:22:17.834554 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-464c5aa5-ae8a-44b0-a136-1af536eed733 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1721 microversion: 2.1 time: 0.841047 Sep 01 05:22:17.835781 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2804/5648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:16 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1721 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:17.858575 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2845/5649] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:17 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:18.873380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:18.878597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:18.879843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:18.881424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:18.911105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.914026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.915983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.917633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.920808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.922864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.923645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.925006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.925475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:18.927213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:18.928196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:18.931794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.470093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:19.485127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:19.487162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:19.488811 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb572e07-c666-4b56-b40a-212e24feff82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.624909 Sep 01 05:22:19.509405 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2805/5650] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:18 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:19.633792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:19.650014 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cec2175-e512-4d54-8bef-c01a01b5e158 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1698 microversion: 2.1 time: 0.779891 Sep 01 05:22:19.650633 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2846/5651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:18 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1698 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:19.692622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49d13599-3b04-427e-b291-ed669863f4a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:19.721992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49d13599-3b04-427e-b291-ed669863f4a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.728003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49d13599-3b04-427e-b291-ed669863f4a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.731547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49d13599-3b04-427e-b291-ed669863f4a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.746153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:19.746993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:19.759742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.760252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.761558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.762756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.763685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.764417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.813287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49d13599-3b04-427e-b291-ed669863f4a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:22:19.841002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:22:19.927310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:19.935256 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49d13599-3b04-427e-b291-ed669863f4a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action" status: 202 len: 0 microversion: 2.1 time: 0.245398 Sep 01 05:22:19.938165 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2806/5652] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:22:19 2022] POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:22:19.946791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7eda724b-a934-4b70-87d2-5a88a5612825 req-da2beba9-2631-4b0e-bc00-e57b42bdf7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06768c8f-8853-4c51-95d3-80643bd4c11f", "tag": "95bf9467-82aa-47ef-bfba-b82a17addc81"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:19.961908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7eda724b-a934-4b70-87d2-5a88a5612825 req-da2beba9-2631-4b0e-bc00-e57b42bdf7ef service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:19.963344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7eda724b-a934-4b70-87d2-5a88a5612825 req-da2beba9-2631-4b0e-bc00-e57b42bdf7ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:19.964229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7eda724b-a934-4b70-87d2-5a88a5612825 req-da2beba9-2631-4b0e-bc00-e57b42bdf7ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:19.995366 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7eda724b-a934-4b70-87d2-5a88a5612825 req-da2beba9-2631-4b0e-bc00-e57b42bdf7ef service nova] Creating event network-changed:95bf9467-82aa-47ef-bfba-b82a17addc81 for instance 06768c8f-8853-4c51-95d3-80643bd4c11f on n-h1-820368-37 Sep 01 05:22:20.004431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7eda724b-a934-4b70-87d2-5a88a5612825 req-da2beba9-2631-4b0e-bc00-e57b42bdf7ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063191 Sep 01 05:22:20.005847 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2807/5653] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:20.019095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:20.021193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:20.062824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.073152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.073964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.075400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.076377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.077053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.162105 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd3ba78b-8503-4a27-bdb8-3da993c22ded tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 204 len: 0 microversion: 2.1 time: 0.421241 Sep 01 05:22:20.162667 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2847/5654] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:22:19 2022] DELETE /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:22:20.175789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:20.175789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:20.187487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.188007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.189065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:20.189264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:20.190474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:20.190474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.022048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:21.035425 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b6f4b9e-6e42-451d-8b3d-b8a6b35e071a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1707 microversion: 2.1 time: 1.027599 Sep 01 05:22:21.036048 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2808/5655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:20 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1707 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:21.042059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:21.042686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:21.051010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.051756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.052384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.053271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:21.054044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:21.054648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:21.127244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:21.145847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4919f333-37d3-407c-ba6a-1491af00b150 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1669 microversion: 2.1 time: 0.977099 Sep 01 05:22:21.160609 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2848/5656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:20 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1669 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:21.393123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:21.404076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:21.406145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:21.408070 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0b3c067-5ccc-45b1-b9e9-13bc54fab80f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.370370 Sep 01 05:22:21.408987 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2809/5657] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:21 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:22.103234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:22.108345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:22.130570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.134205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.135471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.139460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.141212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.142484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.178652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:22.182978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:22.230321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.232865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.236665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.241043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:22.244651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:22.247673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:22.275366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:23.100535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:23.112874 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6e141b7-ad65-4ce6-9a2f-8110b0e875c0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1707 microversion: 2.1 time: 1.037755 Sep 01 05:22:23.122569 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2849/5658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:22 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1707 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:23.132171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:23.135194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:23.153044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.153866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.154649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.156475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:23.163981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:23.165266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:23.364173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:23.411056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55f7279b-a47b-4f59-9da1-89e3ec77c266 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1669 microversion: 2.1 time: 1.241786 Sep 01 05:22:23.431854 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2810/5659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:22 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1669 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:23.858159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:23.895907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:23.920140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:23.938429 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75aba507-1ccd-4d51-a1f9-0db6eb61a54d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.811013 Sep 01 05:22:23.950763 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2850/5660] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:23 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:24.146172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:24.147953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:24.174313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.174768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.175243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.176111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.176597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.177123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.478460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:24.488230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:24.550832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.555096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.559340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.562117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:24.564099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:24.565829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:24.805909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:24.828245 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4818b440-8fe7-43e1-bf54-80c3d1593b8a tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1711 microversion: 2.1 time: 0.692320 Sep 01 05:22:24.829078 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2811/5661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:24 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1711 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:24.982039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:24.982707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:25.004273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.004782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.005225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.005965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.006437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.006871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.205418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:25.268375 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9ceeacd5-12bc-4308-ab3f-af71d9d4a2f8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1669 microversion: 2.1 time: 0.808762 Sep 01 05:22:25.269363 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2851/5662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:24 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1669 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:25.296343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7e3dcf18-7a5c-4e50-9bb8-b0629512a116 req-7ca50e5b-251f-4b3b-b522-5aaf69327037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06768c8f-8853-4c51-95d3-80643bd4c11f", "name": "network-vif-deleted", "tag": "95bf9467-82aa-47ef-bfba-b82a17addc81"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:25.353112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7e3dcf18-7a5c-4e50-9bb8-b0629512a116 req-7ca50e5b-251f-4b3b-b522-5aaf69327037 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:25.353948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7e3dcf18-7a5c-4e50-9bb8-b0629512a116 req-7ca50e5b-251f-4b3b-b522-5aaf69327037 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:25.354736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7e3dcf18-7a5c-4e50-9bb8-b0629512a116 req-7ca50e5b-251f-4b3b-b522-5aaf69327037 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:25.408321 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7e3dcf18-7a5c-4e50-9bb8-b0629512a116 req-7ca50e5b-251f-4b3b-b522-5aaf69327037 service nova] Creating event network-vif-deleted:95bf9467-82aa-47ef-bfba-b82a17addc81 for instance 06768c8f-8853-4c51-95d3-80643bd4c11f on n-h1-820368-37 Sep 01 05:22:25.421320 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7e3dcf18-7a5c-4e50-9bb8-b0629512a116 req-7ca50e5b-251f-4b3b-b522-5aaf69327037 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147225 Sep 01 05:22:25.423031 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2852/5663] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:25.487761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:25.502649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:25.505297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:25.507969 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a14c2921-b68f-4902-8115-64ca48670f02 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.535189 Sep 01 05:22:25.523633 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2812/5664] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:24 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:26.335055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.341563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:26.357877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.369672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.375559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.378348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.379291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.380035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.428631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.429107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.429917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.430724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lazy-loading 'fault' on Instance uuid 06768c8f-8853-4c51-95d3-80643bd4c11f {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:22:26.540452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.541489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:26.566829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:26.575894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.580156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.586922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.589431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:26.593984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:26.596656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:26.613358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:26.626343 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42fa7d6d-3e10-4a9c-94c6-52a8e1077009 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 200 len: 1338 microversion: 2.1 time: 0.329983 Sep 01 05:22:26.643132 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2853/5665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 1338 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:26.896037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:26.912011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:26.914368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:26.916482 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d9f5ba3-c16a-4bf0-8533-93f30732d2a8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.382592 Sep 01 05:22:26.917449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2813/5666] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:27.653448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:27.654251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: 06768c8f-8853-4c51-95d3-80643bd4c11f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:27.666177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.667151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.668017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.669408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.670336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.671200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.701545 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] HTTP exception thrown: Instance 06768c8f-8853-4c51-95d3-80643bd4c11f could not be found. Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Request method failure captured: Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f HTTP/1.1 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEDk78amUL5VwpnUB8cm1bhi3DPKGYBDJpZrd_W60X8fHPqUjWhfBqPvNGGwSh-l5nXbI-ymzZ_WPwQkDivGv0QEZVi3saUrz76VTe9KgaqtS3fA-5FfAD0ZtQezkBx-n8Msq8WDMYZ_Gnc-XZQqmO08N-GcwllUAD8-t7lCcYbvtM Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 82a8447c65d94100bd959f7eeba4aa15 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 82a8447c65d94100bd959f7eeba4aa15 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkBasicOps-1779558484-project Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 50a11eb4b2684c369eaff25fe84e837c Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkBasicOps-1779558484-project Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 06768c8f-8853-4c51-95d3-80643bd4c11f could not be found. Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '06768c8f-8853-4c51-95d3-80643bd4c11f'} Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06768c8f-8853-4c51-95d3-80643bd4c11f could not be found. Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06768c8f-8853-4c51-95d3-80643bd4c11f could not be found. Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:22:27.704524 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06768c8f-8853-4c51-95d3-80643bd4c11f could not be found. Sep 01 05:22:27.714482 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:22:27.719847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Returning 404 to user: Instance 06768c8f-8853-4c51-95d3-80643bd4c11f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:22:27.719847 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91374cba-a21f-42a5-b2c7-c711e6ac924b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f" status: 404 len: 111 microversion: 2.1 time: 0.069297 Sep 01 05:22:27.719847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2854/5667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:27 2022] GET /compute/v2.1/servers/06768c8f-8853-4c51-95d3-80643bd4c11f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:22:27.950229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:27.951566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:27.962756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b67e2516-7480-4c72-bd69-e1feba292cbe tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '.version_select at 0x7fa75bed2310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:27.965730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.966585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.967490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:27.969097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:27.970437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:27.971352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:28.032461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b67e2516-7480-4c72-bd69-e1feba292cbe tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1425510476" status: 202 len: 0 microversion: 2.1 time: 0.089677 Sep 01 05:22:28.034414 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2855/5668] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 05:22:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1425510476 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:22:28.192002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:28.206490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:28.210059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:28.213380 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c93741dd-73ea-47e8-ba05-5a57f2954824 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.270091 Sep 01 05:22:28.214754 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2814/5669] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:27 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:29.243461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:29.244765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:29.262823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.264215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.266108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.268842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:29.268842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:29.269405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:29.513960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:29.526332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:29.528857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:29.530431 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff05ae0c-f011-45b0-9f12-f9d308e6ec95 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.296240 Sep 01 05:22:29.544541 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2856/5670] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:29 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:30.559805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:30.561245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:30.572813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:30.573838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:30.574579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.575598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:30.576183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:30.576627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:30.940806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:30.954590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:30.958281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:30.960480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16a3acce-e78b-407f-b94d-cbc8e5bfeef5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.404914 Sep 01 05:22:30.963305 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2815/5671] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:30 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:32.017499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:32.025097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:32.047889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:32.078691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.079992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.082412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.084712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:32.085871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:32.086992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:32.493744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:32.510785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:32.515094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:32.518148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a36df392-33f9-42a0-af5a-364da7f96f6c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.508509 Sep 01 05:22:32.520341 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2857/5672] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:32 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:33.561426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:33.562642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:33.578215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.579463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.580286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.581625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:33.582495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:33.583676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:33.947469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:33.963132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:33.965666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:33.968035 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a19ae097-0ffb-4c37-b5a2-475c348bd069 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.414392 Sep 01 05:22:33.968891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2816/5673] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:33 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:35.015023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:35.017309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:35.043695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.045735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.047105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.048916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:35.050225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:35.051474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:35.834855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:35.847134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:35.847857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:35.849257 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f1a409f-85af-4e85-87cc-671cfaea4721 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.848733 Sep 01 05:22:35.850155 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2858/5674] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:34 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:36.892855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:36.908521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:36.926512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:36.928699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:36.929791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:36.931572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:36.932899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:36.933898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:37.388463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:37.404716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:37.407862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:37.409667 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b45871fa-7572-430f-ad95-e91e89ec3318 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.524279 Sep 01 05:22:37.410175 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2817/5675] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:36 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:38.453682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:38.455018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:38.465408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.466458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.467206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.468187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:38.470117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:38.470777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:38.694307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:38.709369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:38.711723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:38.713607 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12243be4-339f-4af4-89d3-30163f2b78ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.267365 Sep 01 05:22:38.714913 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2859/5676] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:38 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:39.030978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-02f87bfa-16e4-4a79-b06b-68bbfabcd69c req-f062166f-a4d1-4a1e-b701-5b346919b931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "name": "network-vif-plugged", "status": "completed", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:39.068504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02f87bfa-16e4-4a79-b06b-68bbfabcd69c req-f062166f-a4d1-4a1e-b701-5b346919b931 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.069375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02f87bfa-16e4-4a79-b06b-68bbfabcd69c req-f062166f-a4d1-4a1e-b701-5b346919b931 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.078299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02f87bfa-16e4-4a79-b06b-68bbfabcd69c req-f062166f-a4d1-4a1e-b701-5b346919b931 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.114665 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-02f87bfa-16e4-4a79-b06b-68bbfabcd69c req-f062166f-a4d1-4a1e-b701-5b346919b931 service nova] Creating event network-vif-plugged:f6d0850c-616e-40f8-82d3-8b77f3e22a74 for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 on n-h1-820368-37 Sep 01 05:22:39.128541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-02f87bfa-16e4-4a79-b06b-68bbfabcd69c req-f062166f-a4d1-4a1e-b701-5b346919b931 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142329 Sep 01 05:22:39.130176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2818/5677] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:39.760134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:39.779479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:39.817335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.826535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.834963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:39.836499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:39.847938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:39.849299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:40.603849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:40.625028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:40.636843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:40.640193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-958c26d0-51b5-408d-8e1c-d5ab722ea505 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.889316 Sep 01 05:22:40.656045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2860/5678] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:39 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:41.248298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:41.249575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:41.278028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.278760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.279576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.280869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.281681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.282401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.686015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:41.687121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:41.740531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.745468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.746624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:41.748078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:41.761047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:41.765858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.216343 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fb4b01a-86bc-45b2-833d-4e0bd6160686 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1833 microversion: 2.1 time: 0.979209 Sep 01 05:22:42.222394 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2819/5679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:41 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1833 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:42.253598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:42.258261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:42.280907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.282991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.284372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.288292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:42.290296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:42.291928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:42.603548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:42.624731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:42.631526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:42.635248 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ec0fcdf9-7a5e-4245-adad-0b49bd6051ad tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1804 microversion: 2.20 time: 0.957372 Sep 01 05:22:42.654300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2861/5680] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:41 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1804 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:42.883816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:42.898157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eae63de-3cd9-43e4-8e3d-6d62c4d9e677 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1680 microversion: 2.1 time: 0.656457 Sep 01 05:22:42.921746 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2820/5681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:42 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1680 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:43.144636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:43.149956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:43.162416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.163665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.164722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.166206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.167252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.168168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.277460 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e497896f-fab7-4f02-9c1d-65bff31d5b96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action" status: 200 len: 32645 microversion: 2.1 time: 0.140225 Sep 01 05:22:43.280320 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2862/5682] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:22:43 2022] POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action => generated 32645 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:43.333050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e82d00fa-de7f-4dbf-a7a4-0c9be1881cc8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'create', calling method: .version_select at 0x7fa75b168790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-504514576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JFivdLATuNLL/FGrs5AgYS3whvU31z1Y4ZZVAUnkIgBfeuh/PnHzYDasl0qqJAY4TQZDb+3i2cpAkeWOTutB8JGmqXzIJQXCKjtuX+usJccoXKNX6ywzAzrzixrCObQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:43.379251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e82d00fa-de7f-4dbf-a7a4-0c9be1881cc8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:22:43.391476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e82d00fa-de7f-4dbf-a7a4-0c9be1881cc8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for user 50a11eb4b2684c369eaff25fe84e837c and project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:22:43.435702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:43.437458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:43.461974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.469149 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e82d00fa-de7f-4dbf-a7a4-0c9be1881cc8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.145005 Sep 01 05:22:43.470236 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2821/5683] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:22:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:43.472178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.474949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.480755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.481849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.482698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.576970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f0a6c5077b246c2aa26d8dc6649aa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dbca68536c472e8a8cfca5bc29347c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:43.578170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] flavor_id is None. Assuming migration. {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4194}} Sep 01 05:22:43.579096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:22:43.671972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:43.673813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:43.721624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.722522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.723352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:43.724671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:43.725503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:43.726283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.109252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55b142cf-eb85-43a6-86cb-a43660c05bf3 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action" status: 202 len: 0 microversion: 2.1 time: 0.683521 Sep 01 05:22:44.110164 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2863/5684] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:22:43 2022] POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:22:44.124081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:44.124721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:44.153798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.154757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.154757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.155495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:44.155978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:44.157304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:44.204881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:45.113242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:45.118972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:45.158994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:45.173607 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b3e5477b-2b2d-4537-846a-ca990fcd3000 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1689 microversion: 2.1 time: 1.055456 Sep 01 05:22:45.186176 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2864/5685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:44 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1689 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:45.199763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:45.202414 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57f3f0f9-f842-4855-96d4-fa9fdac4e25a tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1791 microversion: 2.20 time: 1.542720 Sep 01 05:22:45.207295 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2822/5686] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:22:43 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1791 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:22:46.213347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:46.215280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:46.252132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:46.264909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:46.278693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:46.279761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:46.282485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:46.284697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:47.130774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1339533606", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "05d77385-9be9-4c4e-acff-e72205b70332"}], "key_name": "tempest-TestNetworkBasicOps-504514576", "security_groups": [{"name": "tempest-secgroup-smoke-309104292"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:47.134083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:47.151546 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b31309c-262e-42ef-a2d8-89cea94ca6b0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1689 microversion: 2.1 time: 0.944797 Sep 01 05:22:47.169336 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2865/5687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:46 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1689 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:47.431728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] validate_networks() for [('05d77385-9be9-4c4e-acff-e72205b70332', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:22:48.185811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:48.195834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:48.228553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:48.229819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:48.230988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:48.235819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:48.238818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:48.246025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.528788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:49.544338 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db74d011-53b8-4fb1-9562-3757242793bf tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1689 microversion: 2.1 time: 1.365963 Sep 01 05:22:49.545282 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2866/5688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:48 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1689 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:49.611603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:22:49.612320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:22:49.614132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:22:49.615558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:22:49.616594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:22:49.636891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:49.638308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:49.639456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.641255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:49.642502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:49.644088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:49.692048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:22:49.701991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Getting quotas for user 50a11eb4b2684c369eaff25fe84e837c and project 82a8447c65d94100bd959f7eeba4aa15. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:22:49.734172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:22:49.739267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:22:49.844734 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-669d993c-9b44-4f86-b3d2-ff7eedc0b462 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.723460 Sep 01 05:22:49.845848 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2823/5689] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:22:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:22:49.878918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-20e33683-d6ba-4f96-afbd-634db82ecd5b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:49.883936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-20e33683-d6ba-4f96-afbd-634db82ecd5b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:50.000552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-20e33683-d6ba-4f96-afbd-634db82ecd5b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:50.020173 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-20e33683-d6ba-4f96-afbd-634db82ecd5b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1248 microversion: 2.1 time: 0.154370 Sep 01 05:22:50.035945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2867/5690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:49 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1248 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:50.588732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:50.590207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:50.606794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.608124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.609005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.611065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:50.612007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:50.613493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:50.965695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:50.979890 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fb4f3d2-eb93-4ab6-9a04-e01c509955ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.402850 Sep 01 05:22:50.981782 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2824/5691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:50 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:51.051717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:51.053978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:51.068484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.069672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.071457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.073107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:51.074176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:51.075468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:51.202503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:51.219986 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-358cf1b4-73fa-4cc2-b98e-137561dbbb4b tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1300 microversion: 2.1 time: 0.172961 Sep 01 05:22:51.219986 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2868/5692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:51 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:52.010155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:52.011420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:52.026006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.027554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.028730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.030411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.031739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.032892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.253472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:52.256350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:52.267876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.269720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.270558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.271818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:52.272639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:52.273286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:52.398726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:52.401666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:52.412717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=80 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:52.414066 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad9c6228-2576-4d76-9fbe-547813f8557f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1306 microversion: 2.1 time: 0.172137 Sep 01 05:22:52.415033 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2869/5693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:52 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1306 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:52.419759 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3df0d89-06f3-4f82-97e4-20a38187f388 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.417651 Sep 01 05:22:52.421749 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2825/5694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:51 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:53.443232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:53.444280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:53.444927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:53.445120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:53.465647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.467493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.468846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.470037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.471375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.472228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.472825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.473499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.475858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.476977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:53.481207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:53.482540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:53.920925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:53.940294 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd29591a-6810-4907-80e9-0b281fed7e03 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.501038 Sep 01 05:22:53.942952 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2826/5695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:53 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:53.977419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:54.000619 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-30022d09-100f-4f2d-a4da-ab230f3fffd0 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.565756 Sep 01 05:22:54.001893 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2870/5696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:53 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:54.446840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e2a02c0a-d7ea-443a-b6d1-d206c251f0cf req-b4f7f13a-01a1-4cb9-9625-b3a77f45db8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53bf5c5-c730-4b3e-ae86-80f0263ba84b", "tag": "f372549e-0562-4049-a68f-93a5426e7215"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:54.473163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e2a02c0a-d7ea-443a-b6d1-d206c251f0cf req-b4f7f13a-01a1-4cb9-9625-b3a77f45db8d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:54.474557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e2a02c0a-d7ea-443a-b6d1-d206c251f0cf req-b4f7f13a-01a1-4cb9-9625-b3a77f45db8d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:54.477667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e2a02c0a-d7ea-443a-b6d1-d206c251f0cf req-b4f7f13a-01a1-4cb9-9625-b3a77f45db8d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:54.504819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e2a02c0a-d7ea-443a-b6d1-d206c251f0cf req-b4f7f13a-01a1-4cb9-9625-b3a77f45db8d service nova] Creating event network-changed:f372549e-0562-4049-a68f-93a5426e7215 for instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b on n-h2-820368-37 Sep 01 05:22:54.516298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e2a02c0a-d7ea-443a-b6d1-d206c251f0cf req-b4f7f13a-01a1-4cb9-9625-b3a77f45db8d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.433328 Sep 01 05:22:54.517851 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2827/5697] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:22:54.991649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:54.992510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:55.002413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.004845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.005370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.006143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.006607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.007088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.046309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:55.047898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:55.062648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.063608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.064355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.065605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:55.066433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:55.067115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:55.237385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:55.253776 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5efb602-4795-4a7f-b8be-88af66b11cc6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.267240 Sep 01 05:22:55.255694 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2871/5698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:54 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:55.304379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:55.315497 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af0be0f7-e772-4c98-acf0-391e24090a0f tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.274238 Sep 01 05:22:55.316345 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2828/5699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:55 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:56.288833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:56.289927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:56.299549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.300268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.300880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.301721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.302194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.302791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.356568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:56.359814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:56.371555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.372390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.373143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.374806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:56.375627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:56.376317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:56.614072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:56.626650 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4561c4f5-1cd9-4d8f-a5ef-ad96d2dcfda1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.345113 Sep 01 05:22:56.627650 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2872/5700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:56 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:56.671997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:56.683081 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26c1edc8-63b1-4987-9525-98b8a473942e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.333131 Sep 01 05:22:56.684095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2829/5701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:56 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:57.653288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:57.654198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:57.663285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.663981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.664731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.665601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.666292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.666824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.712976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:57.715460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:57.730183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:57.734357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.735449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.737360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.738788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:57.739734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:57.740851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:57.976305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:57.985800 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba9bf66b-b36d-48e4-9fb9-7459c3c8f9b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.337320 Sep 01 05:22:58.000420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2873/5702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:57 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:58.046337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:58.056359 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34f4618a-96fd-43e8-86a0-3e76c8d6288e tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.353187 Sep 01 05:22:58.057028 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2830/5703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:57 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:59.036155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:59.037625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:59.049620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.050274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.050935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.052027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.052622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.053197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.095303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:59.097220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:22:59.109053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.109820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.111018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.112800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:22:59.114078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:22:59.115037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:22:59.363988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:59.383887 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46eadb93-254a-4043-b92f-9a9155f38b2a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.354754 Sep 01 05:22:59.406829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2874/5704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:59 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:59.460445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:22:59.476819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bdcbbf9-e142-4a8d-ba59-9480b94a10cb tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.388027 Sep 01 05:22:59.478382 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2831/5705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:22:59 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:00.419775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.420482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:00.422558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.430387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.431341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.431901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.432998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.433529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.434082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.518813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.520944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:00.532469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.534613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.540970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.541611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.542646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.544227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:00.545532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:00.546320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:00.713970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:00.728939 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d87fbd46-d4db-47bb-bd19-7ceafb627332 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.314373 Sep 01 05:23:00.729859 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2875/5706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:00.776842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:00.791193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb27f051-8916-433f-b210-18d081a529dd tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.280558 Sep 01 05:23:00.792521 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2832/5707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:01.765100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:01.766353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:01.776152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.776660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.777102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.777842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.778305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.778736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.909712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3bd9ebd5-993e-42c5-b7d3-cd6d141178ed req-528e15fd-3665-498c-abbc-0e4a00d96478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53bf5c5-c730-4b3e-ae86-80f0263ba84b", "name": "network-vif-plugged", "status": "completed", "tag": "f372549e-0562-4049-a68f-93a5426e7215"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:01.927841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3bd9ebd5-993e-42c5-b7d3-cd6d141178ed req-528e15fd-3665-498c-abbc-0e4a00d96478 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.929155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3bd9ebd5-993e-42c5-b7d3-cd6d141178ed req-528e15fd-3665-498c-abbc-0e4a00d96478 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.930249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3bd9ebd5-993e-42c5-b7d3-cd6d141178ed req-528e15fd-3665-498c-abbc-0e4a00d96478 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.953382 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3bd9ebd5-993e-42c5-b7d3-cd6d141178ed req-528e15fd-3665-498c-abbc-0e4a00d96478 service nova] Creating event network-vif-plugged:f372549e-0562-4049-a68f-93a5426e7215 for instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b on n-h2-820368-37 Sep 01 05:23:01.963625 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3bd9ebd5-993e-42c5-b7d3-cd6d141178ed req-528e15fd-3665-498c-abbc-0e4a00d96478 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328697 Sep 01 05:23:01.965088 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2876/5708] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:01.977259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:01.979103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:01.990070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.990595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.991169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:01.992005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:01.992671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:01.993119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:02.033299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:02.056513 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8d90e24-354c-445d-b361-63d8267674f9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.298114 Sep 01 05:23:02.057470 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2833/5709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:01 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:02.250038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:02.260827 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-663db19a-e8e8-4978-9d38-9031945ad644 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.293209 Sep 01 05:23:02.261655 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2877/5710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:01 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:03.093252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:03.094006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:03.104057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.104594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.105344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.106422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.107047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.107494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.289839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:03.291109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:03.302673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=46 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:03.306623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.308077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.308392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.309714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:03.310562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:03.311343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:03.339169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:03.353737 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d7fdaf1-a969-4d31-a009-9229e5621cb1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.264725 Sep 01 05:23:03.354673 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2834/5711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:03.536038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:03.548712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b35ca8a1-619d-4571-9517-fec947cb1f1c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1373 microversion: 2.1 time: 0.267826 Sep 01 05:23:03.549636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2878/5712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:04.391684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.392894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:04.408835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.409988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.410786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.412479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.413348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.414533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.575342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.577879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:04.589025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.589811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.590490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.591475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:04.592297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:04.593029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:04.794053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:04.803485 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c1f4244-31fa-4994-9c36-d4cc83657e45 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.417090 Sep 01 05:23:04.804266 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2835/5713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:04.989711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:05.010374 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-336fd492-c57a-4283-9045-014b83a6d062 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1544 microversion: 2.1 time: 0.439978 Sep 01 05:23:05.011634 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2879/5714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1544 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:05.033754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.034753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:05.046113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.047509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.048834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.050208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.051583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.052071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.221526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:05.231197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99be91a8-f40a-4e48-a3aa-b946ccf86f7c tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1544 microversion: 2.1 time: 0.201796 Sep 01 05:23:05.231831 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2836/5715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1544 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:05.828556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.829451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:05.839123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.839663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.840187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:05.841146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:05.841782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:05.842294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:06.343915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:06.355695 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ecabf94-6c2d-49ab-b6da-2115c2d368fd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.531521 Sep 01 05:23:06.356416 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2880/5716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:07.396347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:07.397480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:07.409095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:07.410384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:07.412800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:07.414768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:07.415793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:07.416632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:07.725443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:07.739360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-746ce5cc-4b44-4435-8f2a-ebe7219b2e7d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.350826 Sep 01 05:23:07.740344 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2837/5717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:07 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:08.584774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f88a0c29-8b88-432c-8185-2b78e0b9f2d3 req-f455ea31-c417-499a-8069-6ebb940adbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53bf5c5-c730-4b3e-ae86-80f0263ba84b", "tag": "f372549e-0562-4049-a68f-93a5426e7215"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:08.605795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f88a0c29-8b88-432c-8185-2b78e0b9f2d3 req-f455ea31-c417-499a-8069-6ebb940adbbd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:08.606631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f88a0c29-8b88-432c-8185-2b78e0b9f2d3 req-f455ea31-c417-499a-8069-6ebb940adbbd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:08.607440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f88a0c29-8b88-432c-8185-2b78e0b9f2d3 req-f455ea31-c417-499a-8069-6ebb940adbbd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:08.632188 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f88a0c29-8b88-432c-8185-2b78e0b9f2d3 req-f455ea31-c417-499a-8069-6ebb940adbbd service nova] Creating event network-changed:f372549e-0562-4049-a68f-93a5426e7215 for instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b on n-h2-820368-37 Sep 01 05:23:08.647571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f88a0c29-8b88-432c-8185-2b78e0b9f2d3 req-f455ea31-c417-499a-8069-6ebb940adbbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069859 Sep 01 05:23:08.649900 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2881/5718] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:08.764416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:08.765343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:08.776028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:08.776528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:08.776965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:08.777709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:08.785455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:08.786078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:09.071350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:09.082811 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5300ed5b-4b56-4b35-98a3-1ec8f1a87129 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.322566 Sep 01 05:23:09.083988 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2838/5719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:08 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:10.112434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:10.113605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:10.127047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.127905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.128685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.129957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:10.130974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:10.131750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:10.350777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:10.368520 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b028d9d-e918-4053-90eb-a50afe461976 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.264333 Sep 01 05:23:10.371267 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2882/5720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:10 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:11.002719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.003416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.011807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.012319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.012779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.013496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.013961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.014393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.051005 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74233b44-6d49-4650-831c-cb16ec59ed13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments/3a4bb415-1405-42d4-914b-caa8f7ae4a87" status: 200 len: 194 microversion: 2.20 time: 0.052335 Sep 01 05:23:11.051675 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2839/5721] 10.222.0.26 () {60 vars in 1454 bytes} [Thu Sep 1 05:23:10 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments/3a4bb415-1405-42d4-914b-caa8f7ae4a87 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:11.134813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.135673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.148010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.149762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.150579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.151918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.152733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.153542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.162481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:11.297274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lazy-loading 'services' on Instance uuid 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:23:11.388734 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d047913-31b5-4a81-bfdf-d5f15447c16e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments/3a4bb415-1405-42d4-914b-caa8f7ae4a87" status: 202 len: 0 microversion: 2.20 time: 0.257090 Sep 01 05:23:11.389724 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2883/5722] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Sep 1 05:23:11 2022] DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments/3a4bb415-1405-42d4-914b-caa8f7ae4a87 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:23:11.395527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.396501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.404783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.406388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.407367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.408021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.408691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.409764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.410448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.413147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:11.425089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.426597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.427285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.428494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.430733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.431790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:11.492608 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4217e07c-56de-4992-b1a8-1c3b844fd471 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094295 Sep 01 05:23:11.493995 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2884/5723] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:11.646027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:11.664489 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-008d0c92-2df7-469d-86cd-03c9ed5f3d0c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1694 microversion: 2.1 time: 0.274234 Sep 01 05:23:11.665472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2840/5724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1694 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:11.985123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Calling method '.version_select at 0x7fa75ae4eaf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.987001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:11.987678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:11.987997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.004621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.005236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.005655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.019167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.019609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.020096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.028875 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd18a841-3017-42fe-bb25-93b8d3d5a9ee tempest-PortsAdminExtendedAttrsTestJSON-531102362 tempest-PortsAdminExtendedAttrsTestJSON-531102362-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.230375 Sep 01 05:23:12.029489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2885/5725] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:12.507464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:12.509903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:12.517511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.518298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.518944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.519835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.520471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.521141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.558066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1335a7fe-04d7-4542-9127-8d7228707cc0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054323 Sep 01 05:23:12.559356 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2841/5726] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:12 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:12.694561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:12.700615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:12.714182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.715035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.716748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:12.718059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:12.719135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:12.720010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.029422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:13.042659 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-505a9a12-c061-473f-a485-bd83c31cb7c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1693 microversion: 2.1 time: 0.356190 Sep 01 05:23:13.045056 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2886/5727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:12 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1693 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:13.402741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "name": "network-vif-unplugged", "status": "completed", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:13.441788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.442650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.443351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.465022 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] Creating event network-vif-unplugged:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h1-820368-37 Sep 01 05:23:13.474218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:23:13.489684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-40ee9fc6-d516-4d7e-8a15-056fb063e874 req-3caaa411-3b26-4b0b-9d30-3d21a6d1b81f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102335 Sep 01 05:23:13.490942 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2842/5728] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:13.576375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:13.580937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:13.593228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.594186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.595175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.596555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:13.597677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:13.598558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:13.663811 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e039f4c-09d9-429b-b935-eabef404aca5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095076 Sep 01 05:23:13.666117 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2887/5729] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:13 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:14.071417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:14.073554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:14.088183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.089308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.090236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.091564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.092657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.093421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.123036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:14.439086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:14.458151 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fff7cf94-52ed-4373-82d6-d1d3b53988eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1693 microversion: 2.1 time: 0.393896 Sep 01 05:23:14.459428 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2843/5730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:14 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1693 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:14.681609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:14.685259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:14.700005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.703345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.704049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.707100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:14.709945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:14.710593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:14.783467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7e6a5d8-3ebf-4cc0-bc6a-75b56fc2d1c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105675 Sep 01 05:23:14.786344 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2888/5731] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:14 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:15.489080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:15.490489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:15.509456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.515254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.516176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.517164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.517817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.518442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.568283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:15.610529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.611259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.612248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.628919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] Creating event network-changed:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h1-820368-37 Sep 01 05:23:15.637818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:23:15.668289 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bbb115c7-b118-495f-b758-082d7b581544 req-54daf4d4-59b6-4254-8a1b-83fde0555de0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108835 Sep 01 05:23:15.669487 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2889/5732] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:15.799937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:15.803693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:15.813145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.813668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.814365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.815182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:15.815821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:15.816254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:15.855313 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb800c7e-ce73-45cb-b2bd-986b3892a6d1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060260 Sep 01 05:23:15.856627 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2890/5733] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:15 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:16.098075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:16.114098 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2ee9d33-63e4-40ca-9bd1-883e0fc5306f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1693 microversion: 2.1 time: 0.629559 Sep 01 05:23:16.115771 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2844/5734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:15 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1693 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:16.872670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:16.876871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:16.886909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.887705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.888318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.889218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:16.889880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:16.890642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:16.980928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-792b5c31-5358-4149-bdfe-d6c908b86168 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114597 Sep 01 05:23:16.989759 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2891/5735] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:16 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:17.146341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:17.150110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:17.176344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.177643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.178606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.180275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:17.181478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:17.182184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:17.539777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:17.562387 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35785931-4292-4e8b-aa23-b7798e120979 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1691 microversion: 2.1 time: 0.425727 Sep 01 05:23:17.582051 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2845/5736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:17 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1691 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:18.006703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:18.009755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.020700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.021200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.021645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.022492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.023094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.023480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.060291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7331f662-e0dc-4a3c-aa62-a6f23ad3e553 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066496 Sep 01 05:23:18.060973 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2892/5737] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:23:17 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:18.139066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:18.139862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.147387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.148127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.148508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.149490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.150043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.150538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.180938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:23:18.284124 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-324ce15f-3620-4c86-9373-d5ed44dba700 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 204 len: 0 microversion: 2.20 time: 0.149628 Sep 01 05:23:18.285876 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2846/5738] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:23:18 2022] DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:23:18.298793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:18.299687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.311525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.312555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.313414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.314844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.315795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.316797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.539825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:18.557200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:18.558936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:18.560298 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9bb273c8-209f-4efb-be7e-558fb057c4c6 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.268279 Sep 01 05:23:18.561240 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2893/5739] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:18 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:18.593103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:18.593827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.600928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.601400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.602094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.603261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.603714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.604406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.836798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:18.847052 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1b768d8-5859-4f2e-86ca-8aab95453e5c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1688 microversion: 2.1 time: 0.258955 Sep 01 05:23:18.847836 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2847/5740] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:18 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:18.888317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:18.889264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:18.900681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.901525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.902301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:18.903639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:18.905186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:18.905996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.044410 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce5f29e5-8025-42f6-aa3c-6d73ad9ae473 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action" status: 204 len: 0 microversion: 2.1 time: 0.163716 Sep 01 05:23:19.052102 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2894/5741] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:23:18 2022] POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:23:19.066681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:19.071490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:19.092304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.096598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.097474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.098230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.098834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.099488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.542229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:19.553660 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b8dc5b0-1f52-418d-811d-f587f77dea41 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1688 microversion: 2.1 time: 0.494254 Sep 01 05:23:19.554298 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2848/5742] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:19 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1688 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:19.588015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:19.588620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:19.596825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.597320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.597755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:19.598469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:19.598941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:19.599367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.189413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:20.207847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:20.211291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:20.213755 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5349e3f5-d342-4746-9c84-a296dd4216c8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.631256 Sep 01 05:23:20.230312 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2895/5743] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:19 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:20.315100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:20.315974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:20.329159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.330333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.331092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.332454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.333599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.334576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.486920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lazy-loading 'services' on Instance uuid 9a706f82-fb41-4b07-aab0-8308a90e077d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:23:20.588578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:20.589405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:20.607472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.610541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bab3d965-cceb-4cff-a832-55a6c2465683 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-volume_attachments/cb09f035-778b-468b-880f-9706751ba6c2" status: 202 len: 0 microversion: 2.1 time: 0.302993 Sep 01 05:23:20.613722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.614259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.615341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.616249 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2849/5744] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:23:20 2022] DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-volume_attachments/cb09f035-778b-468b-880f-9706751ba6c2 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:23:20.617724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.621250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:20.969410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "name": "network-vif-plugged", "status": "completed", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:20.983480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:20.984384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:20.985173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.005541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] Creating event network-vif-plugged:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h1-820368-37 Sep 01 05:23:21.022384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:23:21.059736 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9c866c4d-0df7-432b-8491-4c8462dc1b31 req-91d657b0-66c3-4989-a175-91e1b9239565 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094932 Sep 01 05:23:21.062867 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2850/5745] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:21.256436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:21.257514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:21.268642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.269769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.270341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.271933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:21.272716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:21.273680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:21.364557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:21.379297 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c9e23c0c-9826-408f-a5aa-70fa49225363 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1688 microversion: 2.1 time: 0.803189 Sep 01 05:23:21.380437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2896/5746] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:20 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1688 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:21.621080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:21.631394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:21.633440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:21.635037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb584598-96eb-4af3-874f-72aa776978f3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1719 microversion: 2.20 time: 0.387269 Sep 01 05:23:21.636234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2851/5747] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:21 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1719 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:22.399187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e4ff1a1d-2875-4d3a-a75b-878177124c97 req-07a75de2-2b5e-461a-9320-cb815cea3b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd5f7a6-41a4-4b47-93bb-2332bd719bc6", "name": "network-vif-deleted", "tag": "f6d0850c-616e-40f8-82d3-8b77f3e22a74"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:22.426801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:22.427140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e4ff1a1d-2875-4d3a-a75b-878177124c97 req-07a75de2-2b5e-461a-9320-cb815cea3b5b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.428327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e4ff1a1d-2875-4d3a-a75b-878177124c97 req-07a75de2-2b5e-461a-9320-cb815cea3b5b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.429532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e4ff1a1d-2875-4d3a-a75b-878177124c97 req-07a75de2-2b5e-461a-9320-cb815cea3b5b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.429795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:22.460025 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e4ff1a1d-2875-4d3a-a75b-878177124c97 req-07a75de2-2b5e-461a-9320-cb815cea3b5b service nova] Creating event network-vif-deleted:f6d0850c-616e-40f8-82d3-8b77f3e22a74 for instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 on n-h1-820368-37 Sep 01 05:23:22.463994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.476469 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e4ff1a1d-2875-4d3a-a75b-878177124c97 req-07a75de2-2b5e-461a-9320-cb815cea3b5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091538 Sep 01 05:23:22.478640 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2897/5748] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:22.480871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.481337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.488902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.496501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.497875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.680347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:22.691455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:22.719446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.720878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.724086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.725171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.728251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.728988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.805883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:22.808241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:22.810022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:22.812921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lazy-loading 'fault' on Instance uuid 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:23:22.908962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:22.912301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:22.916765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:22.921244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08b76be9-4c5a-4b25-91e9-eca936dd1ef9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1688 microversion: 2.1 time: 0.521623 Sep 01 05:23:22.925449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2852/5749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:22 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1688 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:22.959585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:22.971253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:22.975603 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2312213f-2663-4837-9a02-fb4779c005b3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 200 len: 1369 microversion: 2.20 time: 0.302697 Sep 01 05:23:22.978210 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2898/5750] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:22 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 1369 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:23.978298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:23.981153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:24.020258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.020258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.020258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.020780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.021039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.021713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.026847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:24.028423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:24.049787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.050868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.051886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.054750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:24.055810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:24.056679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:24.126159 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] HTTP exception thrown: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Request method failure captured: Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 HTTP/1.1 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEnLZ4n_POHs79uXi0CWYb9RIiYM-_AWq0tCu6zN09_c4oQowiIJZuyEE34HNTET_v-tpE3mjnqxE-aYo1FZD2p5uL_vZun_J-nslAKp2qNO3m1oQW142ulpoB0WyVxMecmeUa-aOKHFZC5WaiiXMQM4fSLKXbZHMepEFdf15VYZxc Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 07d01164358d4590b20329062498a698 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07d01164358d4590b20329062498a698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07d01164358d4590b20329062498a698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 07d01164358d4590b20329062498a698 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ac2c5b97f8ca4163b94de75a6095987e Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '6dd5f7a6-41a4-4b47-93bb-2332bd719bc6'} Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:24.135382 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Returning 404 to user: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:24.144738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-05f2e23f-1e06-44a2-8392-839a41e2c15c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 404 len: 111 microversion: 2.20 time: 0.126027 Sep 01 05:23:24.154329 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2899/5751] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:24 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:23:24.172399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0022a326-fb0a-40fd-b7d2-9eb1858d598c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '.version_select at 0x7fa75b730940>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:24.231830 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0022a326-fb0a-40fd-b7d2-9eb1858d598c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67700291" status: 204 len: 0 microversion: 2.20 time: 0.067511 Sep 01 05:23:24.234098 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2900/5752] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:23:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67700291 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 05:23:24.257594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:24.267871 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-647bef3a-940d-4ee3-bc45-43f3cc250343 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1680 microversion: 2.1 time: 0.309893 Sep 01 05:23:24.269176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2853/5753] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:23 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:25.413110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59891ea1-25c3-41db-8d97-beb41eea7775 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'create', calling method: .version_select at 0x7fa75b7bda60>, body: {"keypair": {"name": "tempest-keypair-1240623847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOvdrfYksagJ1QxTOwaWMd8B+hjzzuJGxsFLYeMDhjVX3+wWjlRB2C13O+1zmOFjMz++Ea7Ysi6jAmZKfiYFHDW51NnIWV/QvvnzLMW75wKzoI0g/GT8zvyQ7+oid/y2Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:25.446859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-59891ea1-25c3-41db-8d97-beb41eea7775 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for project 07d01164358d4590b20329062498a698. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:23:25.459280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-59891ea1-25c3-41db-8d97-beb41eea7775 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for user ac2c5b97f8ca4163b94de75a6095987e and project 07d01164358d4590b20329062498a698. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:23:25.514426 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59891ea1-25c3-41db-8d97-beb41eea7775 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.109024 Sep 01 05:23:25.515980 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2901/5754] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 1 05:23:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:23:27.468577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07fa8b50-fbec-4375-a951-00807c46f0df tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:27.488081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07fa8b50-fbec-4375-a951-00807c46f0df tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.489733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07fa8b50-fbec-4375-a951-00807c46f0df tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.490806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07fa8b50-fbec-4375-a951-00807c46f0df tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.541787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07fa8b50-fbec-4375-a951-00807c46f0df tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:23:27.626276 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07fa8b50-fbec-4375-a951-00807c46f0df tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action" status: 202 len: 0 microversion: 2.1 time: 0.164532 Sep 01 05:23:27.634330 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2854/5755] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:23:27 2022] POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:23:27.652212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:27.659322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:27.669983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.670657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.671411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.672391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:27.673135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:27.673801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:27.904014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-361140874", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8373e591-04c4-4086-863c-fd314077a1b0"}], "security_groups": [{"name": "tempest-securitygroup--802800383"}], "key_name": "tempest-keypair-1240623847", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:27.917038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:27.949611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:27.963006 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-651ef527-272a-4307-9eb5-16c7cf715cd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.325473 Sep 01 05:23:27.964107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2902/5756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:27 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:28.063889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] validate_networks() for [('8373e591-04c4-4086-863c-fd314077a1b0', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:23:28.601459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:23:28.602550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:23:28.603227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:23:28.603858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:23:28.604334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:23:28.614830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:28.615492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:28.616197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:28.617463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:28.618200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:28.618865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:28.641045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for project 07d01164358d4590b20329062498a698. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:23:28.647209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Getting quotas for user ac2c5b97f8ca4163b94de75a6095987e and project 07d01164358d4590b20329062498a698. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:23:28.664046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:23:28.667940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:23:28.765602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-739b8f53-147e-4eb6-bb12-a95c3c50426e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.867192 Sep 01 05:23:28.766757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2855/5757] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 1 05:23:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 05:23:28.784888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e19927a-c634-492c-be3a-4487c6629904 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:28.790726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e19927a-c634-492c-be3a-4487c6629904 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:28.864168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e19927a-c634-492c-be3a-4487c6629904 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:28.873308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e19927a-c634-492c-be3a-4487c6629904 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:28.874812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e19927a-c634-492c-be3a-4487c6629904 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:28.876720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e19927a-c634-492c-be3a-4487c6629904 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1281 microversion: 2.20 time: 0.100773 Sep 01 05:23:28.877529 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2903/5758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:28 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:28.992148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:28.993043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:29.013968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.014542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.016460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.023609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.025157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.026235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.253976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:29.267367 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09372568-0903-41d7-93f7-46c1479a5e17 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.284559 Sep 01 05:23:29.267979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2856/5759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:28 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:29.913940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:29.915172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:29.926487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.927020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.927465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:29.928174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:29.928645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:29.929075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.022845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:30.041569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:30.045183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:30.048638 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c9051a1-2901-4f64-8a78-cdafaffc2a9d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1333 microversion: 2.20 time: 0.138758 Sep 01 05:23:30.055059 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2904/5760] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:29 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:30.311571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:30.312278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:30.321111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.322081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.322911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.323984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:30.325088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:30.325791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:30.617728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:30.622481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:30.635846 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40845ff7-1e3d-4ba4-8467-77f7d7174d1f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.334609 Sep 01 05:23:30.650862 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2857/5761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:30 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:31.095630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:31.097596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:31.110601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.111878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.113219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.114432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.115202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.116134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.408491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:31.424062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:31.425548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:31.426776 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-776645bf-6e80-4fa3-96ff-cd23b8123ffd tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1406 microversion: 2.20 time: 0.339227 Sep 01 05:23:31.440412 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2905/5762] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:31 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:31.661589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:31.662778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:31.672611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.673269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.673908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:31.675068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:31.675707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:31.676569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.017027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:32.032908 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-699c2cb0-2ffe-4231-8238-abbcc17a6664 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.377494 Sep 01 05:23:32.041541 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2858/5763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:31 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:32.343573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bbf698fb-bd51-482a-bba6-50278bd4ecca req-d3378bf6-c367-4d2d-8916-53ef90626320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:32.368214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbf698fb-bd51-482a-bba6-50278bd4ecca req-d3378bf6-c367-4d2d-8916-53ef90626320 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.369377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbf698fb-bd51-482a-bba6-50278bd4ecca req-d3378bf6-c367-4d2d-8916-53ef90626320 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.369972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bbf698fb-bd51-482a-bba6-50278bd4ecca req-d3378bf6-c367-4d2d-8916-53ef90626320 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.398390 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bbf698fb-bd51-482a-bba6-50278bd4ecca req-d3378bf6-c367-4d2d-8916-53ef90626320 service nova] Creating event network-changed:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:23:32.405293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bbf698fb-bd51-482a-bba6-50278bd4ecca req-d3378bf6-c367-4d2d-8916-53ef90626320 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069994 Sep 01 05:23:32.407292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2906/5764] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:32.453984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:32.454647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:32.465391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.465893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.466391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.467650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:32.468419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:32.469163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:32.770226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:32.780022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:32.782349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:32.784184 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fde356d-933b-412e-885f-8ad41927e137 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1406 microversion: 2.20 time: 0.334440 Sep 01 05:23:32.811099 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2859/5765] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:32 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:33.065599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:33.066368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:33.073707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.074210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.074662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.075438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.075901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.076339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.328034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:33.346700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6690c1b0-4830-4e30-afb4-4162debd0cfe tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.286595 Sep 01 05:23:33.349222 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2907/5766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:33 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:33.809437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:33.810029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:33.819292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.820066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.821220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:33.822459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:33.823057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:33.828767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.264247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:34.274529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:34.276070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:34.277242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8674dc5-33cd-49f9-ab67-a93430365b66 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1406 microversion: 2.20 time: 0.472612 Sep 01 05:23:34.277828 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2860/5767] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:33 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:34.376090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:34.376721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:34.380883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:34.385596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.386084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.386530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.387295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:34.387781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:34.388188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:34.718044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:34.728939 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92906d43-845c-4162-bf3b-f230b1fe9bea tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.358552 Sep 01 05:23:34.733152 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2908/5768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:34 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:35.303971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:35.304712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:35.316342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.317526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.318677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.320673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.322128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.323287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.497222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:35.508996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:35.511806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:35.513696 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a147d95-d653-49c1-8c70-104f738d0ff3 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1406 microversion: 2.20 time: 0.215292 Sep 01 05:23:35.528712 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2861/5769] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:35 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:35.768543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:35.770770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:35.788368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.797885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.799145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.800409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:35.801445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:35.802434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:35.997425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:36.007292 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da1a5435-951f-424b-bc62-547943b7dabf tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.255997 Sep 01 05:23:36.008339 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2909/5770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:35 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:36.548492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:36.549118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:36.557641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.558146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.558586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.559998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.560488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.560895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.711544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:36.723059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:36.725908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:36.728506 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4b61d7b-3596-4dba-8382-740914b2d331 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1406 microversion: 2.20 time: 0.183424 Sep 01 05:23:36.746820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2862/5771] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:36 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:36.892816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-14937308-66c2-4558-98db-6f4c3dc70fd9 req-b3162b5b-be5e-4a0c-807e-b32cc7663486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "name": "network-vif-plugged", "status": "completed", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:36.907042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-14937308-66c2-4558-98db-6f4c3dc70fd9 req-b3162b5b-be5e-4a0c-807e-b32cc7663486 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:36.907374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-14937308-66c2-4558-98db-6f4c3dc70fd9 req-b3162b5b-be5e-4a0c-807e-b32cc7663486 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:36.908976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-14937308-66c2-4558-98db-6f4c3dc70fd9 req-b3162b5b-be5e-4a0c-807e-b32cc7663486 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:36.923855 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-14937308-66c2-4558-98db-6f4c3dc70fd9 req-b3162b5b-be5e-4a0c-807e-b32cc7663486 service nova] Creating event network-vif-plugged:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:23:36.930473 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-14937308-66c2-4558-98db-6f4c3dc70fd9 req-b3162b5b-be5e-4a0c-807e-b32cc7663486 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041625 Sep 01 05:23:36.932032 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2910/5772] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:37.045450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:37.046188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:37.061946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.065415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.066025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.066986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.071209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.071738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.267044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:37.278412 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26a8e18a-1bd1-4da3-8246-d34a8a09f39c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.238344 Sep 01 05:23:37.279347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2863/5773] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:37 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:37.754904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:37.755616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:37.763048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.763533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.763983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.764706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:37.765170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:37.765613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:37.953337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:37.965254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:37.966643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:37.967850 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b0c2321c-0c4b-4917-9511-93dae635e586 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1406 microversion: 2.20 time: 0.217505 Sep 01 05:23:37.968450 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2911/5774] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:37 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:38.308167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:38.308838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:38.316217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.316709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.317147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.317947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:38.318390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:38.318814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:38.630357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:38.655026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:38.753075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:38.762335 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3519e6c6-18d7-4033-9184-2eabe2f7467e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.458117 Sep 01 05:23:38.763309 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2864/5775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:38 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:39.006439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.007154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:39.011033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:39.019689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.020161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.020934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.021783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.022328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.022925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.188777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:39.198647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:39.200264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:39.201479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89457ab5-e842-4a1a-9f40-090187515c59 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1597 microversion: 2.20 time: 0.199374 Sep 01 05:23:39.202067 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2912/5776] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1597 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:39.226624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.227023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:39.233537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.234028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.234468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.235214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.235667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.236091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.324197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e24901c-9f59-4f05-af11-bbaed73fafb1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102036 Sep 01 05:23:39.325120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2865/5777] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:39.784831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:39.785488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:39.792574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.793049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.793482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.794429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:39.794848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:39.795499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:39.949899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:39.961613 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-831c9c17-066a-41bd-b421-75d70df86fc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.180954 Sep 01 05:23:39.962806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2913/5778] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:39 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:40.576513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1260f400-3f52-49ea-b2d2-de5e68432295 req-837fd36c-fddc-4c73-bda9-83323b5f4f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:40.598133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1260f400-3f52-49ea-b2d2-de5e68432295 req-837fd36c-fddc-4c73-bda9-83323b5f4f25 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:40.599566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1260f400-3f52-49ea-b2d2-de5e68432295 req-837fd36c-fddc-4c73-bda9-83323b5f4f25 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:40.600671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1260f400-3f52-49ea-b2d2-de5e68432295 req-837fd36c-fddc-4c73-bda9-83323b5f4f25 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:40.627914 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1260f400-3f52-49ea-b2d2-de5e68432295 req-837fd36c-fddc-4c73-bda9-83323b5f4f25 service nova] Creating event network-changed:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:23:40.638915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1260f400-3f52-49ea-b2d2-de5e68432295 req-837fd36c-fddc-4c73-bda9-83323b5f4f25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068438 Sep 01 05:23:40.645592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2866/5779] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:40.989502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:40.990791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:40.998802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:40.999634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.000239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.001199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:41.001841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:41.005638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:41.179336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:41.188769 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70172fe5-50bc-462e-a93f-e61979b151be tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.203208 Sep 01 05:23:41.189335 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2914/5780] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:40 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:42.212227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:42.213008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:42.220819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.221568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.222142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.222937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.223495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.224104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.397127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:42.407209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-942d5fa4-ac7b-4e9c-a2a4-fe7fcba57558 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1675 microversion: 2.1 time: 0.199054 Sep 01 05:23:42.407209 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2867/5781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:42 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:42.566094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:42.568805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:42.576844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.577338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.579257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.580270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:42.581055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:42.581510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:42.654977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39f4ace8-d484-4793-a618-298c484a31c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action" status: 200 len: 24577 microversion: 2.1 time: 0.093407 Sep 01 05:23:42.655953 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2915/5782] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:23:42 2022] POST /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99/action => generated 24577 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:43.436296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:43.437418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:43.445914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.446707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.447182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.448825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.448825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.449185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.648576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:43.656277 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f95b8365-1003-463d-8b16-2edf9611dc2e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1652 microversion: 2.1 time: 0.230622 Sep 01 05:23:43.656895 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2868/5783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:43 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1652 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:43.679334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d2cf9de-7f2b-4ae3-940a-18883924478e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:43.689009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d2cf9de-7f2b-4ae3-940a-18883924478e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.689505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d2cf9de-7f2b-4ae3-940a-18883924478e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.689948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d2cf9de-7f2b-4ae3-940a-18883924478e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.719242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d2cf9de-7f2b-4ae3-940a-18883924478e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Going to try to start instance {{(pid=128862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:23:43.830227 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d2cf9de-7f2b-4ae3-940a-18883924478e tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action" status: 202 len: 0 microversion: 2.1 time: 0.154938 Sep 01 05:23:43.835249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2916/5784] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:23:43 2022] POST /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:23:43.843833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:43.844741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:43.853776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.854990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.855859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:43.856780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:43.857500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:43.858233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:44.110940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:44.120136 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-434384e2-e95c-45c9-a3b0-9e272fcf1ac6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1661 microversion: 2.1 time: 0.282111 Sep 01 05:23:44.121125 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2869/5785] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:43 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1661 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:45.144039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:45.145387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:45.154501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.155334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.155762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.156485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.156944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.157367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.191464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:45.194970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:45.209327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.209903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.210930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.212197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:45.212784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:45.213323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:45.301915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58db1711-c699-4575-83d8-e1cff55ca9c5 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b/action" status: 200 len: 24544 microversion: 2.1 time: 0.114295 Sep 01 05:23:45.304493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2870/5786] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:23:45 2022] POST /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b/action => generated 24544 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:45.395094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:45.408058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cfc0173-77e3-43bc-9d8e-c3bb91f75cc1 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1661 microversion: 2.1 time: 0.269673 Sep 01 05:23:45.409157 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2917/5787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:45 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1661 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:46.433291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:46.433999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:46.445102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:46.445102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:46.446075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:46.447046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:46.447514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:46.447968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:46.636869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:46.645675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4148ec1-0940-4c76-931e-3d582519ef0f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1665 microversion: 2.1 time: 0.217219 Sep 01 05:23:46.646501 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2871/5788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:46 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1665 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:48.884268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:48.889546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:48.900604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.901337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.902054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:48.903312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:48.904067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:48.904737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:49.211250 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49f39169-f0f1-4944-946d-a0ddf891c805 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1833 microversion: 2.1 time: 0.338606 Sep 01 05:23:49.212167 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2918/5789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:48 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1833 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:51.412785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:51.413436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:51.417959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dbe8959f-4054-4f99-9214-d24905aca86d req-86a631ec-8b2b-4731-b829-9db8d50daaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:51.424771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.425290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.425730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.426447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.427004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.427619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.470251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:23:51.471079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dbe8959f-4054-4f99-9214-d24905aca86d req-86a631ec-8b2b-4731-b829-9db8d50daaef service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.472060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dbe8959f-4054-4f99-9214-d24905aca86d req-86a631ec-8b2b-4731-b829-9db8d50daaef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.472624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dbe8959f-4054-4f99-9214-d24905aca86d req-86a631ec-8b2b-4731-b829-9db8d50daaef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.514705 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dbe8959f-4054-4f99-9214-d24905aca86d req-86a631ec-8b2b-4731-b829-9db8d50daaef service nova] Creating event network-changed:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h1-820368-37 Sep 01 05:23:51.526220 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dbe8959f-4054-4f99-9214-d24905aca86d req-86a631ec-8b2b-4731-b829-9db8d50daaef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120743 Sep 01 05:23:51.527451 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2919/5790] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:23:51.650112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44ee547f-c064-4c71-8864-ee75730ac1cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 204 len: 0 microversion: 2.1 time: 0.246752 Sep 01 05:23:51.653065 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2872/5791] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:23:51 2022] DELETE /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:23:51.672659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:51.674809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:51.699266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.700572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.701683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.703927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:51.705729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:51.708073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:51.750688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:52.023378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:52.036868 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c458c21-9036-461b-ad75-038a10e10dce tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1686 microversion: 2.1 time: 0.378141 Sep 01 05:23:52.045013 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2920/5792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:51 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1686 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:23:53.074383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:53.084135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:53.104790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.108201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.113693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.115207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.116080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:53.117929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:53.481879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:53.491677 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7debf5a-b9cb-4806-9155-96c05b79ccc1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1686 microversion: 2.1 time: 0.427528 Sep 01 05:23:53.509435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2873/5793] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:53 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1686 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:53.954069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-46c34177-60f6-4f7d-be67-784546b28d64 req-9ec4a752-6d11-4b87-9262-738ef52a013c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa4a724-dab0-4974-aa66-4f8cafdd0a99", "name": "network-vif-deleted", "tag": "14b87d00-6734-429e-b073-73a18c89885e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:53.979258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-46c34177-60f6-4f7d-be67-784546b28d64 req-9ec4a752-6d11-4b87-9262-738ef52a013c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:53.981228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-46c34177-60f6-4f7d-be67-784546b28d64 req-9ec4a752-6d11-4b87-9262-738ef52a013c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.002697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-46c34177-60f6-4f7d-be67-784546b28d64 req-9ec4a752-6d11-4b87-9262-738ef52a013c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.036612 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-46c34177-60f6-4f7d-be67-784546b28d64 req-9ec4a752-6d11-4b87-9262-738ef52a013c service nova] Creating event network-vif-deleted:14b87d00-6734-429e-b073-73a18c89885e for instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 on n-h1-820368-37 Sep 01 05:23:54.047455 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-46c34177-60f6-4f7d-be67-784546b28d64 req-9ec4a752-6d11-4b87-9262-738ef52a013c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097845 Sep 01 05:23:54.049115 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2921/5794] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:54.519029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:54.520565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:54.532105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.533106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.533658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.536039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.537961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.539422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.543215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:54.586710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:54.588124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:54.588874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:54.589606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lazy-loading 'fault' on Instance uuid 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:23:54.671197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:23:54.687369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef93af77-a891-4efd-9c04-19c7ab792c28 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 200 len: 1506 microversion: 2.1 time: 0.173949 Sep 01 05:23:54.688581 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2874/5795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:54 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:55.722831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:55.723693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 2fa4a724-dab0-4974-aa66-4f8cafdd0a99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:23:55.733583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.734393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.735175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.736267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:23:55.736828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:23:55.737358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:23:55.754505 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] HTTP exception thrown: Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 could not be found. Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Request method failure captured: Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 HTTP/1.1 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEE9O7r8QEDrOleCeqlZ6ESI-jZDqXltbxvuHTZjNuHvJdQhVT7qyY03LC9bbEpcPWHl9QecKhHmg4OrLOc-hc0FuosvhShpzEQG-iGLVHS8NoHnmvqGHIhlK1qs_TjvSmQMKcQoNXi2Pj19dLJyNixJ5nhww25BUQVR6IyOPxtKTYE Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a364e33225b4d809f8ed613574899ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 25d7775b3f5c493ea05d42d8c5dd8176 Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 could not be found. Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2fa4a724-dab0-4974-aa66-4f8cafdd0a99'} Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 could not be found. Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 could not be found. Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:55.756278 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 could not be found. Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Returning 404 to user: Instance 2fa4a724-dab0-4974-aa66-4f8cafdd0a99 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1b7a315-ef3c-4b77-9966-9c664ddc5551 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99" status: 404 len: 111 microversion: 2.1 time: 0.041096 Sep 01 05:23:55.763643 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2922/5796] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:23:55 2022] GET /compute/v2.1/servers/2fa4a724-dab0-4974-aa66-4f8cafdd0a99 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:24:01.103647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d771b0a-5678-4ca8-877d-bc58d5aa934c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '.version_select at 0x7fa75be68f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:01.123398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:01.143461 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d771b0a-5678-4ca8-877d-bc58d5aa934c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1817326578" status: 202 len: 0 microversion: 2.1 time: 0.045820 Sep 01 05:24:01.145073 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2875/5797] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 05:24:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1817326578 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:24:01.198233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b96157a0-281f-4b07-a19f-5735aaf1255d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: .version_select at 0x7fa7603f3c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1330600555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN7/ecONQF6Mbv+aaqD4EA9UA4Hy0dNxURLOFSEz/JdfMe4rG4q81ZLS6fIudI71o/fYZTovizztOzvk3Xz72jW8MkGcKdiqsVYYc6WgRw8uMmPifSthA9lKNPRADhjGQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:01.219845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b96157a0-281f-4b07-a19f-5735aaf1255d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:24:01.227196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b96157a0-281f-4b07-a19f-5735aaf1255d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:24:01.259299 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b96157a0-281f-4b07-a19f-5735aaf1255d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.064960 Sep 01 05:24:01.260004 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2923/5798] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:24:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:11.633020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:11.648760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1287543986", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "fa921c0a-1896-470a-ad1d-3e4cf703a6df"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1330600555", "security_groups": [{"name": "tempest-secgroup-smoke-1946086720"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:11.830152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] validate_networks() for [('fa921c0a-1896-470a-ad1d-3e4cf703a6df', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:24:12.392137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:24:12.393625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:24:12.394544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:24:12.395203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:24:12.395808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:24:12.405801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.406558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.407017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.408069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:12.408690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:12.409400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:12.432631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:24:12.439288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:24:12.458494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:24:12.461450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:24:12.516233 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ed67574-511f-4149-945f-e5770811de43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.887316 Sep 01 05:24:12.517563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2876/5799] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:24:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:24:12.528826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa8dc17c-b29e-40b1-a525-2010e6e22330 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:12.530307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa8dc17c-b29e-40b1-a525-2010e6e22330 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:12.538202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=7 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:12.539521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:12.540481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:12.652909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa8dc17c-b29e-40b1-a525-2010e6e22330 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:12.669571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa8dc17c-b29e-40b1-a525-2010e6e22330 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1267 microversion: 2.1 time: 0.144468 Sep 01 05:24:12.679634 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2924/5800] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:12 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:13.704373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:13.705705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:13.712847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:13.713704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:13.714149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.714919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:13.715385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:13.715812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:13.803605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:13.817863 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df7075a4-8ae7-4859-aa3b-a4fc9aff8680 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1319 microversion: 2.1 time: 0.118901 Sep 01 05:24:13.819263 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2877/5801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:13 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:14.841889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:14.842577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:14.867493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.870113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.870476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:14.871272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:14.871747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:14.872177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:15.039678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:15.049188 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-575d7ac6-7ceb-4bf2-b3f9-36442336e5c3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1325 microversion: 2.1 time: 0.210933 Sep 01 05:24:15.050426 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2925/5802] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:14 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1325 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:16.080308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:16.086759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:16.097545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.098144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.098872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.101906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:16.104263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:16.104656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:16.402610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:16.416367 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6cf778cd-c9ad-4be6-822e-6a76e920144b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1393 microversion: 2.1 time: 0.346597 Sep 01 05:24:16.416877 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2878/5803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:16 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1393 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:17.065170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:17.065677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:17.076932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.080374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.082462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.083949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.085051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.086093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.118151 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9607500f-21c9-40d0-901e-ca18d9cc5c82 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.057521 Sep 01 05:24:17.119099 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2926/5804] 10.222.0.26 () {60 vars in 1289 bytes} [Thu Sep 1 05:24:17 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:17.438847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:17.440465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:17.450605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.451841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.452741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.453729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.454565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.455264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.463578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-718ef713-eb62-4cb3-9167-46fe5ab49078 req-de0e0c75-2647-4970-affe-1663728656be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:17.483379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-718ef713-eb62-4cb3-9167-46fe5ab49078 req-de0e0c75-2647-4970-affe-1663728656be service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:17.484608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-718ef713-eb62-4cb3-9167-46fe5ab49078 req-de0e0c75-2647-4970-affe-1663728656be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:17.485334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-718ef713-eb62-4cb3-9167-46fe5ab49078 req-de0e0c75-2647-4970-affe-1663728656be service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:17.520839 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-718ef713-eb62-4cb3-9167-46fe5ab49078 req-de0e0c75-2647-4970-affe-1663728656be service nova] Creating event network-changed:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:24:17.535715 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-718ef713-eb62-4cb3-9167-46fe5ab49078 req-de0e0c75-2647-4970-affe-1663728656be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075670 Sep 01 05:24:17.537975 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2927/5805] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:18.179237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:18.189104 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44d6069d-8feb-4c9e-b21d-57c2fdcbea94 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1393 microversion: 2.1 time: 0.754618 Sep 01 05:24:18.189986 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2879/5806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:17 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1393 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:19.196752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:19.198165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:19.212928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:19.214504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.215399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.216302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:19.216485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.217708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.220744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.221302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.232198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.233661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.235974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.237864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.239077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.240170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.271159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lazy-loading 'flavor' on Instance uuid 4e39a76a-f784-4c95-902e-219ecd3806b3 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:24:19.511528 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c2df321-2dbe-47a6-b315-0d565e0f5e00 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/action" status: 202 len: 0 microversion: 2.20 time: 0.321950 Sep 01 05:24:19.517002 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2928/5807] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:24:19 2022] POST /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:24:19.536583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:19.537673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:19.545594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.546439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.546866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.547800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:19.548438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:19.548863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:19.584492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:19.597646 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-903c79fc-d6b2-41a3-ad5a-24cedb13654e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1393 microversion: 2.1 time: 0.390864 Sep 01 05:24:19.598146 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2880/5808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:19 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1393 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:19.724727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:19.734833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:19.736534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:19.737827 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c4794f5-5fc4-45fd-be89-f040fb31590b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.218853 Sep 01 05:24:19.738401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2929/5809] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:19 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:20.622357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:20.623223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:20.633175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.633967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.634414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.635760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.636723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.637256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.762728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:20.764241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:20.778444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.779651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.780618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:20.782608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:20.783473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:20.784253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:21.042236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:21.058321 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55cfd94a-1467-4108-877b-6f766cf28b35 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1393 microversion: 2.1 time: 0.439641 Sep 01 05:24:21.060068 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2881/5810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:20 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1393 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:21.196229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:21.208313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:21.210230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:21.211713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d5c4d6b-87f7-4b9a-89b4-c42e3284bc5d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.454360 Sep 01 05:24:21.212476 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2930/5811] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:20 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:22.092425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:22.093320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:22.101444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.101934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.102345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.103104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.103654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.104257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.252135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:22.252836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:22.261251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.261754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.262191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.262967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:22.263427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:22.263855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:22.387884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:22.396410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fef5c05-5eaf-4ff7-94c6-5d4fcf8cf497 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1393 microversion: 2.1 time: 0.308279 Sep 01 05:24:22.396991 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2882/5812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:22 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1393 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:22.508017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:22.517366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:22.518948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:22.520285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-221a61e4-aa90-4b18-ae28-228ba4a05a44 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.272456 Sep 01 05:24:22.520967 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2931/5813] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:22 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:23.066006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-69c70aa7-be21-49e5-95a3-b928cc2b7c5b req-d8de859b-07ce-4ec6-bcc5-1a31724b591c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "name": "network-vif-plugged", "status": "completed", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:23.081825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:23.083319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:23.090322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-69c70aa7-be21-49e5-95a3-b928cc2b7c5b req-d8de859b-07ce-4ec6-bcc5-1a31724b591c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.092086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-69c70aa7-be21-49e5-95a3-b928cc2b7c5b req-d8de859b-07ce-4ec6-bcc5-1a31724b591c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.094285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-69c70aa7-be21-49e5-95a3-b928cc2b7c5b req-d8de859b-07ce-4ec6-bcc5-1a31724b591c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.127808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-69c70aa7-be21-49e5-95a3-b928cc2b7c5b req-d8de859b-07ce-4ec6-bcc5-1a31724b591c service nova] Creating event network-vif-plugged:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:24:23.135651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-69c70aa7-be21-49e5-95a3-b928cc2b7c5b req-d8de859b-07ce-4ec6-bcc5-1a31724b591c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078839 Sep 01 05:24:23.136640 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2883/5814] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:23.418767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:23.419421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:23.421618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:23.428758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.429939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.430096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.430756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.431446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.431944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.550779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:23.551589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:23.559147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.559808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.560243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.561101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:23.561560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:23.561980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:23.733629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:23.742350 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7ba14f4b-6d88-443e-8ddc-9d21b78ec80a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1393 microversion: 2.1 time: 0.327662 Sep 01 05:24:23.742999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2932/5815] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:23 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1393 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:23.839637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:23.858166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:23.859980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:23.861395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6dd26bf-855f-4240-ba10-b5380bbaac48 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.315307 Sep 01 05:24:23.863032 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2884/5816] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:23 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:24.729256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:24.731706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:24.739147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.739647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.740088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.740846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.741542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.741979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.771702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:24.773425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:24.782768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.783582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.783898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.784642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.785047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.785478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.837508 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01ccd800-4c96-4695-9b66-7d2b190365f3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "POST /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b/action" status: 200 len: 32616 microversion: 2.1 time: 0.111780 Sep 01 05:24:24.838535 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2933/5817] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:24:24 2022] POST /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b/action => generated 32616 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:24.891771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:24.892476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:24.900669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.901274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.901711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.902507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:24.903323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:24.903948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:24.967939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:24.976876 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f59da97-e459-40da-9a64-69b0974076d4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1566 microversion: 2.1 time: 0.209153 Sep 01 05:24:24.977632 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2885/5818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:24 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:24.998777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:25.001111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:25.008684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:25.009466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:25.010113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:25.011658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:25.012299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:25.012884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:25.141708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:25.160093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:25.164268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:25.166930 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55d2719a-0081-4dd0-b6b1-a7ee2019f458 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.282440 Sep 01 05:24:25.168393 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2934/5819] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:24 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:25.233844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:25.248686 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c33978d-90f4-47da-a15c-644fb877c902 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1566 microversion: 2.1 time: 0.253470 Sep 01 05:24:25.249764 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2886/5820] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:24 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:26.203190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.204102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:26.214079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.214609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.215525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.216371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.216850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.217486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.490463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.491401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:26.508888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.509737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.510781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.512285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.513768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.514695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.572421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:24:26.628141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:26.644638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:26.651036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:26.652361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23b90f5e-a8c5-45ce-8536-8a90dd870aa5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.455226 Sep 01 05:24:26.656432 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2935/5821] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:26.667503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-643e6205-77b7-46aa-a095-f121d268ac2b req-c6f486ac-125a-4055-b433-23556adc0a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53bf5c5-c730-4b3e-ae86-80f0263ba84b", "tag": "f372549e-0562-4049-a68f-93a5426e7215"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:26.697155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-643e6205-77b7-46aa-a095-f121d268ac2b req-c6f486ac-125a-4055-b433-23556adc0a37 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.698284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-643e6205-77b7-46aa-a095-f121d268ac2b req-c6f486ac-125a-4055-b433-23556adc0a37 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.698949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-643e6205-77b7-46aa-a095-f121d268ac2b req-c6f486ac-125a-4055-b433-23556adc0a37 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.714236 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-643e6205-77b7-46aa-a095-f121d268ac2b req-c6f486ac-125a-4055-b433-23556adc0a37 service nova] Creating event network-changed:f372549e-0562-4049-a68f-93a5426e7215 for instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b on n-h2-820368-37 Sep 01 05:24:26.723050 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-643e6205-77b7-46aa-a095-f121d268ac2b req-c6f486ac-125a-4055-b433-23556adc0a37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064713 Sep 01 05:24:26.724806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2936/5822] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:26.734801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-defe4d6a-73c7-4fd6-b004-e6d1f4be75b8 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 204 len: 0 microversion: 2.1 time: 0.253177 Sep 01 05:24:26.736274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2887/5823] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:24:26 2022] DELETE /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:24:26.753115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:26.761401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:26.770586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.773729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.775878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:26.778266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:26.779076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:26.779689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.127799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:27.138777 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07c54e7b-0f20-41d7-ac8e-0533cbd88fb3 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1668 microversion: 2.1 time: 0.395173 Sep 01 05:24:27.155388 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2937/5824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:26 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1668 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:27.681782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:27.683205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:27.691545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.692383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.693005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:27.694024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:27.695052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:27.695849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.164177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:28.167195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:28.186010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.187030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.187708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.188775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:28.189482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:28.190694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:28.377944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:28.407012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:28.408616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:28.409956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4651d116-3bc4-42df-acc3-b513365cc72f tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.733276 Sep 01 05:24:28.410642 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2888/5825] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:27 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:28.594037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:28.606490 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5e165ba-7f19-411a-a90e-b97936af3898 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1668 microversion: 2.1 time: 0.447763 Sep 01 05:24:28.612575 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2938/5826] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:28 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1668 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:29.119876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.120921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:29.136813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.137492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.138958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.139803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.142507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.145480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.177782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d93ad175-8145-4029-af58-ab4b4e0f53ed req-8f1f611b-44c3-4d94-8504-7da2c91ad50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:29.202799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d93ad175-8145-4029-af58-ab4b4e0f53ed req-8f1f611b-44c3-4d94-8504-7da2c91ad50c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.203364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d93ad175-8145-4029-af58-ab4b4e0f53ed req-8f1f611b-44c3-4d94-8504-7da2c91ad50c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.208122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d93ad175-8145-4029-af58-ab4b4e0f53ed req-8f1f611b-44c3-4d94-8504-7da2c91ad50c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.237387 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d93ad175-8145-4029-af58-ab4b4e0f53ed req-8f1f611b-44c3-4d94-8504-7da2c91ad50c service nova] Creating event network-changed:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:24:29.244291 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d93ad175-8145-4029-af58-ab4b4e0f53ed req-8f1f611b-44c3-4d94-8504-7da2c91ad50c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070369 Sep 01 05:24:29.245324 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2939/5827] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:29.440659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.441386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:29.453288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.454791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.455652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.456944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.457605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.459044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.570846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:29.582772 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c8989b8-3e80-4316-8eb3-b474d12ab496 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1566 microversion: 2.1 time: 0.468027 Sep 01 05:24:29.583741 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2889/5828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1566 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:29.633703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:29.635648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:29.652067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.652716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.656131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.660241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:29.661085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:29.662488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:29.817638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:29.831585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:29.837044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:29.838771 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1dbf41a-0e57-419f-b232-bf31c4b94fd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.407458 Sep 01 05:24:29.855452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2940/5829] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:29.975350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:29.985109 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef027b35-c503-48da-98b3-96849072cc54 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1550 microversion: 2.1 time: 0.359543 Sep 01 05:24:29.985999 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2890/5830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:29 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1550 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:30.565208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-766867d2-c91d-491d-bbfe-c93237711158 req-c9e05b8c-b260-4c96-b4ed-32c4ee6cc734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53bf5c5-c730-4b3e-ae86-80f0263ba84b", "name": "network-vif-deleted", "tag": "f372549e-0562-4049-a68f-93a5426e7215"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:30.593277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-766867d2-c91d-491d-bbfe-c93237711158 req-c9e05b8c-b260-4c96-b4ed-32c4ee6cc734 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.594371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-766867d2-c91d-491d-bbfe-c93237711158 req-c9e05b8c-b260-4c96-b4ed-32c4ee6cc734 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.594371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-766867d2-c91d-491d-bbfe-c93237711158 req-c9e05b8c-b260-4c96-b4ed-32c4ee6cc734 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.619901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-766867d2-c91d-491d-bbfe-c93237711158 req-c9e05b8c-b260-4c96-b4ed-32c4ee6cc734 service nova] Creating event network-vif-deleted:f372549e-0562-4049-a68f-93a5426e7215 for instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b on n-h2-820368-37 Sep 01 05:24:30.639384 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-766867d2-c91d-491d-bbfe-c93237711158 req-c9e05b8c-b260-4c96-b4ed-32c4ee6cc734 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077901 Sep 01 05:24:30.639950 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2941/5831] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:30.870105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:30.875686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:30.927281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.937069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.937694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:30.938481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:30.939037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:30.939467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.006628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:31.008200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:31.025724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.026436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.027076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.027925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.028400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.028835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.070507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:31.071346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:31.071951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:31.072574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lazy-loading 'fault' on Instance uuid f53bf5c5-c730-4b3e-ae86-80f0263ba84b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:24:31.092972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:31.214614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a11eb4b2684c369eaff25fe84e837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a8447c65d94100bd959f7eeba4aa15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:31.244330 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f00e948-7934-4bb1-aa00-1579544323b6 tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 200 len: 1338 microversion: 2.1 time: 0.242048 Sep 01 05:24:31.259249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2942/5832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:31 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 1338 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:31.264609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:31.295040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:31.296905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:31.298156 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e139d3e8-102f-466b-b1ba-9521e0eaaad9 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1743 microversion: 2.20 time: 0.432408 Sep 01 05:24:31.298737 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2891/5833] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:30 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1743 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:32.271426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.272240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] [instance: f53bf5c5-c730-4b3e-ae86-80f0263ba84b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:32.279986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.280506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.281327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.281991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.282689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.283332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.299771 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] HTTP exception thrown: Instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b could not be found. Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Request method failure captured: Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b HTTP/1.1 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEDk78amUL5VwpnUB8cm1bhi3DPKGYBDJpZrd_W60X8fHPqUjWhfBqPvNGGwSh-l5nXbI-ymzZ_WPwQkDivGv0QEZVi3saUrz76VTe9KgaqtS3fA-5FfAD0ZtQezkBx-n8Msq8WDMYZ_Gnc-XZQqmO08N-GcwllUAD8-t7lCcYbvtM Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 82a8447c65d94100bd959f7eeba4aa15 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82a8447c65d94100bd959f7eeba4aa15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 82a8447c65d94100bd959f7eeba4aa15 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkBasicOps-1779558484 Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkBasicOps-1779558484-project Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 50a11eb4b2684c369eaff25fe84e837c Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkBasicOps-1779558484-project Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b could not be found. Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'f53bf5c5-c730-4b3e-ae86-80f0263ba84b'} Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b could not be found. Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b could not be found. Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:24:32.301499 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b could not be found. Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Returning 404 to user: Instance f53bf5c5-c730-4b3e-ae86-80f0263ba84b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e33cf83-a28d-413e-806b-a0028071156d tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b" status: 404 len: 111 microversion: 2.1 time: 0.035555 Sep 01 05:24:32.308778 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2943/5834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:32 2022] GET /compute/v2.1/servers/f53bf5c5-c730-4b3e-ae86-80f0263ba84b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:24:32.328574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.329259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:32.342787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.343311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.343746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.344461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:32.344915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:32.345337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:32.357010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:32.584004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:32.595583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:32.597665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:32.600262 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36ea2f98-f6d3-40da-b95b-1a44c4fa0450 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.275676 Sep 01 05:24:32.602714 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2892/5835] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:32 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:32.626628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de202071-e5c2-4fc9-af47-dcd5c8bc26df tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] Calling method '.version_select at 0x7fa75aefe4c0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:32.655863 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de202071-e5c2-4fc9-af47-dcd5c8bc26df tempest-TestNetworkBasicOps-1779558484 tempest-TestNetworkBasicOps-1779558484-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-504514576" status: 202 len: 0 microversion: 2.1 time: 0.033737 Sep 01 05:24:32.656474 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2944/5836] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Sep 1 05:24:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-504514576 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:24:33.246050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-acc2e4a3-557b-4a37-a8df-457c2af78d6e req-1771cf04-5e28-4c80-97a3-6f9078cb828f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "name": "network-vif-plugged", "status": "completed", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:33.277419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-acc2e4a3-557b-4a37-a8df-457c2af78d6e req-1771cf04-5e28-4c80-97a3-6f9078cb828f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.279052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-acc2e4a3-557b-4a37-a8df-457c2af78d6e req-1771cf04-5e28-4c80-97a3-6f9078cb828f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.280464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-acc2e4a3-557b-4a37-a8df-457c2af78d6e req-1771cf04-5e28-4c80-97a3-6f9078cb828f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.314065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-acc2e4a3-557b-4a37-a8df-457c2af78d6e req-1771cf04-5e28-4c80-97a3-6f9078cb828f service nova] Creating event network-vif-plugged:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:24:33.328844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-acc2e4a3-557b-4a37-a8df-457c2af78d6e req-1771cf04-5e28-4c80-97a3-6f9078cb828f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089335 Sep 01 05:24:33.335004 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2893/5837] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:33.628342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:33.629541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:33.653691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.654797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.656122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.659502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:33.660963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:33.663440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:33.942922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:33.960045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:33.961700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:33.962976 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d530341a-99b8-4ca6-ac5b-80ab0df2efd1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.341128 Sep 01 05:24:33.979221 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2945/5838] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:33 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:34.992729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:34.993902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:35.046653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.047474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.048156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:35.049347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:35.050079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:35.057962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:36.051170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:36.087954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:36.092938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:36.098199 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16e1e4c1-09e7-4585-ad64-495c51d91f94 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 1.111724 Sep 01 05:24:36.130856 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2894/5839] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:34 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:37.151559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:37.152470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:37.183452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.184980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.186005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.187500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:37.188341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:37.189476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:37.569460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:37.590761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:37.596539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:37.600151 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b915f7cf-ed93-4431-9575-8dd9ecb155cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.454204 Sep 01 05:24:37.630570 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2946/5840] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:37 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:38.647876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:38.648552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:38.656760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.657753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.658324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.659182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:38.659763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:38.660549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:38.978929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:38.989956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:38.991937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:38.993624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ec60c73-2e64-4627-a395-96ada8a7af13 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.351545 Sep 01 05:24:38.994700 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2895/5841] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:38 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:40.024135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:40.026393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:40.049494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.051775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.056080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.058531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:40.061957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:40.064630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:40.389795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:40.408875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:40.410378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:40.419992 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b2ac06c-9961-4bea-a739-d423e9817dcf tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.402669 Sep 01 05:24:40.423192 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2947/5842] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:40 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:41.449262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:41.449904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:41.467856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.467856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.467856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.467856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:41.467856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:41.467856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:41.836113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:41.845750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:41.847550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:41.848778 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb869cf6-1ddc-437b-a011-8e4d90d82366 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.405345 Sep 01 05:24:41.849765 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2896/5843] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:41 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:42.877982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:42.879250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:42.882659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:42.902623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.903173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.903649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:42.904385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:42.904891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:42.905321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:43.233100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:43.246746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:43.248310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:43.249597 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2c87efa0-8936-4641-8fb0-03998886ecd8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.377072 Sep 01 05:24:43.250212 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2948/5844] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:42 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:44.279566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:44.279566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:44.282130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:44.300682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:44.305598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:44.306176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:44.307181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:44.313809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:44.314660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:44.700672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:44.745251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:44.752261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:44.754811 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2df1162-8ea4-45d9-8106-2eec0c62c359 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.481431 Sep 01 05:24:44.755866 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2897/5845] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:44 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:45.796040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:45.797919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:45.812279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.813658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.814475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:45.816004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:45.817372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:45.818058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:46.275686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:46.290367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:46.296280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:46.298060 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a5c4b3f-fb47-45ee-9af0-77a51b9e30ed tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.507897 Sep 01 05:24:46.302629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2949/5846] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:45 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:47.329422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:47.330048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:47.367274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.367823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.368273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.369020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:47.369470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:47.376414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:47.845070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-321612474", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "2c074ab1-f784-490c-911e-307c34e54ffe"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:47.961518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] validate_networks() for [('2c074ab1-f784-490c-911e-307c34e54ffe', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:24:48.186074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:48.215278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:48.219062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:48.224090 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23b148a1-dbe6-40dc-8075-b6d429052f29 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.900262 Sep 01 05:24:48.255036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2898/5847] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:47 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:49.276895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:49.278368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:49.288690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.289535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.290165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.291174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.291835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.292440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.743118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:24:49.743743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:24:49.744010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:24:49.745208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:24:49.745817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:24:49.773139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.773659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.774316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.775342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:49.776045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:49.776674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:49.839560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Getting quotas for project 47507077a2fd4f8d82c74efc2c5d52cc. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:24:49.865225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Getting quotas for user 4d3343c0d2f247f2b5b53ccb93cc2e21 and project 47507077a2fd4f8d82c74efc2c5d52cc. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:24:49.914826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:24:49.918928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:24:50.003452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:50.030033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:50.039232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:50.042575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a8ae57b-21d0-43e4-8c8c-0d4567990ced tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.771206 Sep 01 05:24:50.059742 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2899/5848] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:49 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:50.074526 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0df3be9f-4f99-4dbc-8217-81cae1ce1570 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.479246 Sep 01 05:24:50.076011 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2950/5849] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:24:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:24:50.101109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94c0a8f8-1a3a-471f-a9df-04f6003da766 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:50.102501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94c0a8f8-1a3a-471f-a9df-04f6003da766 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:50.194277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94c0a8f8-1a3a-471f-a9df-04f6003da766 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:50.209490 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94c0a8f8-1a3a-471f-a9df-04f6003da766 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1214 microversion: 2.1 time: 0.118235 Sep 01 05:24:50.228774 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2900/5850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:50 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:50.235146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:50.238984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:50.254027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:50.256232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:50.257357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:50.258757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:50.259535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:50.260486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:50.341442 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-848ae3c2-4eb5-41ab-866e-03d82c23c873 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action" status: 200 len: 24573 microversion: 2.1 time: 0.111350 Sep 01 05:24:50.344685 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2951/5851] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:24:50 2022] POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action => generated 24573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:51.074590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:51.075317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:51.096278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.100683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.101844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.104197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.108263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.110686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.254705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:51.256599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:51.277221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.278262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.279838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.280996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:51.281699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:51.282550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:51.686501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:51.698936 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-92d1b386-bf2c-4401-974d-c79f13797c4c tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1218 microversion: 2.1 time: 0.456385 Sep 01 05:24:51.703252 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2952/5852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:51 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1218 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:51.933140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:51.956154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:51.967277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:51.970205 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdb63aaa-530b-4d3f-8493-79ecb4ac0e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1738 microversion: 2.20 time: 0.899467 Sep 01 05:24:51.975380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2901/5853] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:51 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1738 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:52.724570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:52.726151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:52.748506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:52.749398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:52.750015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:52.751025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:52.752931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:52.753721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:52.912076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:52.930450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-751ec9d9-a1ca-42af-bcea-5022bfa9ee1a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1272 microversion: 2.1 time: 0.212357 Sep 01 05:24:52.931103 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2953/5854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:52 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:53.004682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.006114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:53.026806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.027738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.028423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.029423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.030118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.030728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.424082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:53.442050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:53.444019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:53.445664 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a52d74e-56f6-4303-885a-737626e370a1 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1720 microversion: 2.20 time: 0.448340 Sep 01 05:24:53.446260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2902/5855] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:52 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1720 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:53.529080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.537986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:53.553750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.558475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.559286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.564070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.564865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.565720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.625098 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e43d8e4a-21b7-4d64-9bf8-6ab490bd6725 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094230 Sep 01 05:24:53.626314 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2954/5856] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:24:53 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:24:53.755114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.755643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:53.767948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.768500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.768896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.769679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.770239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.770646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.817490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:24:53.954586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.956637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:53.966083 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed6e8afd-3f08-4cdf-96c6-f3f6579b3757 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 204 len: 0 microversion: 2.1 time: 0.215394 Sep 01 05:24:53.966711 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2903/5857] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:24:53 2022] DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:24:53.979702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.985116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:53.985663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.986436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.987435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:53.988103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:53.988697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:53.989811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:54.006050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.006823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.006959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.007721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.008187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.008620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.136989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:54.166355 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9807aef4-61e9-49a1-97bc-c7e0ffb15cd9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1272 microversion: 2.1 time: 0.217968 Sep 01 05:24:54.167704 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2955/5858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:53 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:54.451590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:54.467062 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b66816a-2657-43e7-90f4-31cfd7a62326 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1671 microversion: 2.1 time: 0.489874 Sep 01 05:24:54.467972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2904/5859] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:53 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1671 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:54.478062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:54.478755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:54.488791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.489421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.490113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.491365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:54.492285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:54.492732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:54.706461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:54.715569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:54.717042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:54.718517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-26efa203-dc94-4013-b28c-06ec7fa96c09 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1720 microversion: 2.20 time: 0.246052 Sep 01 05:24:54.719398 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2956/5860] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:54 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:55.205043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:55.206679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:55.221400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.222237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.224153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.225956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.227654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.228676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.353266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ffe8a7b6-ccf6-4158-8e7b-5213fb60ca6a req-61dd25a4-fdd1-4887-8262-da2c73fb0cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "name": "network-vif-unplugged", "status": "completed", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:55.364728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ffe8a7b6-ccf6-4158-8e7b-5213fb60ca6a req-61dd25a4-fdd1-4887-8262-da2c73fb0cc2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.365592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ffe8a7b6-ccf6-4158-8e7b-5213fb60ca6a req-61dd25a4-fdd1-4887-8262-da2c73fb0cc2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.366253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ffe8a7b6-ccf6-4158-8e7b-5213fb60ca6a req-61dd25a4-fdd1-4887-8262-da2c73fb0cc2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.389998 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ffe8a7b6-ccf6-4158-8e7b-5213fb60ca6a req-61dd25a4-fdd1-4887-8262-da2c73fb0cc2 service nova] Creating event network-vif-unplugged:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:24:55.404630 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ffe8a7b6-ccf6-4158-8e7b-5213fb60ca6a req-61dd25a4-fdd1-4887-8262-da2c73fb0cc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055739 Sep 01 05:24:55.405682 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2957/5861] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:55.493636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:55.495391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:55.507811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.510258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.510965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.511979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.512916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.515448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.530698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:55.560073 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c56810e2-19c4-4b9d-9bdd-df304ff1e6e1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.374333 Sep 01 05:24:55.597628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2905/5862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:55 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:55.744101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:55.744845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:55.777526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.779293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.781548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:55.782366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:55.782800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:55.783260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.058849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:56.068027 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47b3f81a-d17b-4d4b-9f55-95416b59542b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1671 microversion: 2.1 time: 0.581862 Sep 01 05:24:56.069460 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2958/5863] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:55 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1671 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:56.099300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:56.110184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:56.112203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:56.113762 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb85701b-e8f9-4772-9850-da00c77838f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1720 microversion: 2.20 time: 0.375749 Sep 01 05:24:56.114347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2906/5864] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:55 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1720 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:56.618317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:56.620198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:56.628948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:56.629764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:56.630401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.631888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:56.633595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:56.634257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:56.918143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:56.944243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01211131-7077-4e61-9e1f-f888a3c264a9 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.340369 Sep 01 05:24:56.949600 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2959/5865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:56 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:57.094356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:57.096883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:57.106319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.107228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.107855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.109062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.109687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.110290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.138410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:57.139438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:57.153744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.155051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.160177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.161197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.162160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.163125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.503720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:57.516283 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2446a263-ae73-4834-9988-3e1d7c26a29c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1671 microversion: 2.1 time: 0.426308 Sep 01 05:24:57.523057 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2907/5866] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:57 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1671 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:57.543385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4897ec6d-c0d1-46a9-895c-01a352e8e5bc req-46175f33-4a7c-4aea-b53c-e5a584ffba63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27a859d-c939-4890-958f-4fbbee4aba53", "tag": "adb42884-a15d-441c-abec-634645f2ece3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:57.564617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4897ec6d-c0d1-46a9-895c-01a352e8e5bc req-46175f33-4a7c-4aea-b53c-e5a584ffba63 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.565500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4897ec6d-c0d1-46a9-895c-01a352e8e5bc req-46175f33-4a7c-4aea-b53c-e5a584ffba63 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.566105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4897ec6d-c0d1-46a9-895c-01a352e8e5bc req-46175f33-4a7c-4aea-b53c-e5a584ffba63 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.571292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:57.588637 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4897ec6d-c0d1-46a9-895c-01a352e8e5bc req-46175f33-4a7c-4aea-b53c-e5a584ffba63 service nova] Creating event network-changed:adb42884-a15d-441c-abec-634645f2ece3 for instance f27a859d-c939-4890-958f-4fbbee4aba53 on n-h2-820368-37 Sep 01 05:24:57.590558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:57.601340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:57.602613 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-258cb32d-c7e7-49cb-bf22-713f0b6d0eae tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1663 microversion: 2.20 time: 0.468702 Sep 01 05:24:57.602752 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4897ec6d-c0d1-46a9-895c-01a352e8e5bc req-46175f33-4a7c-4aea-b53c-e5a584ffba63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063222 Sep 01 05:24:57.604076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2908/5867] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:24:57.604292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2960/5868] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:57 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1663 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:57.642321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d797cc2-f0a4-4cdb-b8d4-40cb370073ae"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:57.656212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:57.669297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.669612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.670990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.670990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.671349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:57.671696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:57.697641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:57.973904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:57.975354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:57.995687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:57.996188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.000556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.001328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.001817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.002250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.137386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83c4575a-db67-42e3-843e-c4c61e14bae8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.501987 Sep 01 05:24:58.139197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2909/5869] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Sep 1 05:24:57 2022] POST /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-volume_attachments => generated 188 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:24:58.451423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:58.451978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:58.465223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.465782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.466227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.469196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:58.471534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:58.472184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:58.997758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:59.039061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38d0731d-05c4-4179-a0e6-386f6c8fe415 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 1.070903 Sep 01 05:24:59.063649 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2961/5870] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:57 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:24:59.103410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:59.104476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:59.126367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.136418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.149678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.150821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.151451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.156934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.278833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:59.403530 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c84296e4-6717-46a3-bb8e-e8fc74e1acbe tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-volume_attachments/1d797cc2-f0a4-4cdb-b8d4-40cb370073ae" status: 202 len: 0 microversion: 2.20 time: 0.958199 Sep 01 05:24:59.407566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2910/5871] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Sep 1 05:24:58 2022] DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-volume_attachments/1d797cc2-f0a4-4cdb-b8d4-40cb370073ae => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:24:59.409885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-86dba619-cf15-4a72-8622-60718be1dd08 req-8cfa0f32-396b-4fd7-8923-f6790d099a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a706f82-fb41-4b07-aab0-8308a90e077d", "name": "network-vif-deleted", "tag": "49cf8aac-855f-4013-af31-fb86ce23a37d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:59.439940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:24:59.453496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86dba619-cf15-4a72-8622-60718be1dd08 req-8cfa0f32-396b-4fd7-8923-f6790d099a1a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.455872 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b84ec16-31ce-4255-b3df-b9594a4af2d9 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1321 microversion: 2.1 time: 0.377659 Sep 01 05:24:59.456836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2962/5872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:24:59 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:59.469805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86dba619-cf15-4a72-8622-60718be1dd08 req-8cfa0f32-396b-4fd7-8923-f6790d099a1a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.470402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86dba619-cf15-4a72-8622-60718be1dd08 req-8cfa0f32-396b-4fd7-8923-f6790d099a1a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.502785 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-86dba619-cf15-4a72-8622-60718be1dd08 req-8cfa0f32-396b-4fd7-8923-f6790d099a1a service nova] Creating event network-vif-deleted:49cf8aac-855f-4013-af31-fb86ce23a37d for instance 9a706f82-fb41-4b07-aab0-8308a90e077d on n-h2-820368-37 Sep 01 05:24:59.514422 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-86dba619-cf15-4a72-8622-60718be1dd08 req-8cfa0f32-396b-4fd7-8923-f6790d099a1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108537 Sep 01 05:24:59.528594 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2911/5873] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:59.554064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:24:59.555021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:59.569754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.570342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.570874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.571816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.572403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.572912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.657372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:24:59.826763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:59.852490 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d5c1caf-88ab-4fcf-98fd-192609a80d36 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "POST /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/action" status: 202 len: 0 microversion: 2.20 time: 0.304846 Sep 01 05:24:59.854682 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2963/5874] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 1 05:24:59 2022] POST /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:24:59.863950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:59.864661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:24:59.884453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.884962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.885412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:24:59.886160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:24:59.886630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:24:59.903066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.084552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:00.085294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:00.096033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:00.101197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.102158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.103435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.105488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.106691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.109350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.203104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:00.409455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:00.431918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:00.437755 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f95151e7-3ab0-47de-b704-fd8f90520140 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.359094 Sep 01 05:25:00.439761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2964/5875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:00 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:00.446575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:00.448094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:00.449314 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea06c92f-5f9b-4cbf-b20c-805c6e9b40f4 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1671 microversion: 2.20 time: 0.590410 Sep 01 05:25:00.454363 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2912/5876] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:24:59 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1671 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:00.498611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:00.499666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:00.534684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.536363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.543397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.544247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.544725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.548646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.638184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:00.638721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:00.643572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:00.644431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lazy-loading 'fault' on Instance uuid 9a706f82-fb41-4b07-aab0-8308a90e077d {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:25:00.719839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:00.755867 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eee6b0d3-3d62-4b57-94f2-a98c73414a24 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1326 microversion: 2.1 time: 0.261487 Sep 01 05:25:00.762505 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2965/5877] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:00 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1326 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:01.421307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:01.422391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:01.445564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.453755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.454827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.457541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.459399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.463521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.482954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:01.483642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:01.502835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.509020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.516339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.517441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.518712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.519452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.883088 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1871a4a5-5d43-4879-b77a-b78f7278431f tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1838 microversion: 2.1 time: 0.473374 Sep 01 05:25:01.883972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2913/5878] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:01 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1838 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:01.905094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:01.905094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:01.908637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.909151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.909837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.910584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:01.911080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:01.911519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:01.958425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:01.970183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:01.972474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:01.974144 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2967ae5c-e6dd-4209-8d9a-575e6650c404 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1673 microversion: 2.20 time: 0.495727 Sep 01 05:25:01.975350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2966/5879] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:01 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1673 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:01.981883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:01.993447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:02.009375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.010342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.011976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.012976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.013536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.015502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.096352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.096907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.097462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.098326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lazy-loading 'fault' on Instance uuid 9a706f82-fb41-4b07-aab0-8308a90e077d {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:25:02.172281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:02.185583 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb46bfb5-2aed-4177-9d55-6254b9b88d11 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.300347 Sep 01 05:25:02.188955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:02.197287 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2914/5880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:01 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:02.208536 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72795f4e-d01b-4591-a9a5-6a94b0311dfb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 200 len: 1326 microversion: 2.1 time: 0.231605 Sep 01 05:25:02.209295 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2967/5881] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:01 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 1326 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:02.217354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:02.218486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:02.232706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.233372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.233828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.234769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.235289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.235722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.487885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:02.506735 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ae62f73-061a-4618-9ee2-1db641909613 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1685 microversion: 2.1 time: 0.305990 Sep 01 05:25:02.524152 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2915/5882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:02 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1685 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:02.626925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:02.630233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:02.638854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.639838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.640465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.641379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.642054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.642654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.707581 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6feae1e5-613f-4614-a3d9-4712bf849795 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action" status: 200 len: 32642 microversion: 2.1 time: 0.083391 Sep 01 05:25:02.718571 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2968/5883] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:02 2022] POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action => generated 32642 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:25:02.863436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:02.864407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:02.871403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.872240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.872878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.873854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:02.874318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:02.874974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:02.930190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f0a6c5077b246c2aa26d8dc6649aa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dbca68536c472e8a8cfca5bc29347c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:02.931384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] flavor_id is None. Assuming migration. {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4194}} Sep 01 05:25:02.932554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:25:03.006345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.008587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:03.018367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.019431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.020258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.024354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.025434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.026255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.347123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:03.373937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:03.379282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce00ff12-9760-4621-b753-32d9acf5c7c7 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action" status: 202 len: 0 microversion: 2.1 time: 0.520281 Sep 01 05:25:03.379990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:03.383003 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2916/5884] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:02 2022] POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:25:03.384834 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21f4df02-d733-4b05-9a44-d30eec52a6b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.384949 Sep 01 05:25:03.388773 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2969/5885] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:02 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:03.400906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.402112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.403051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:03.405958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:03.429938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.430506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.431277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.431883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.432338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.433137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.434875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.435882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.436984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.437610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.440160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.440612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.501674 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] HTTP exception thrown: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Request method failure captured: Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d HTTP/1.1 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEEPL1Hy9xZBUYHEs-YH1BgsUPCCv1g6DegXrGbd9zb8NWzbvghN6r743djwGPUcH9VlThWQfvaR5LH05nVRZjOQ-WlMmh-Dv3W-CXZ7OEI_gKtD6GWzC0bXIlXIK6MFStiGFR6-FJJ3yJAqvC_Clefb1yARggylCD1xmg3qfyD1kQ Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_effcb18d84544e18b42c5c4df340e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 8dd890dfc9e743388863785f3ce4b266 Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9a706f82-fb41-4b07-aab0-8308a90e077d'} Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:25:03.503441 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:25:03.508386 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:03.509616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Returning 404 to user: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:25:03.510011 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37c5b500-1064-4da2-bcd3-0dfe5ea5b3f8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 404 len: 111 microversion: 2.1 time: 0.119737 Sep 01 05:25:03.510924 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2970/5886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:03 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:25:03.521774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.522526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:03.531669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.532173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.532609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.533439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:03.533904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:03.534366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:03.696879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:03.716294 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca632b20-1a26-4eb6-aac3-6db3b45246b8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.328254 Sep 01 05:25:03.725948 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2917/5887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:03 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:03.740631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb7ee7b6-f7d1-410e-9f1e-57fe385d6983 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '.version_select at 0x7fa75be68820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:03.802584 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb7ee7b6-f7d1-410e-9f1e-57fe385d6983 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-820299156" status: 202 len: 0 microversion: 2.1 time: 0.073628 Sep 01 05:25:03.804563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2918/5888] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-820299156 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:25:03.862774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:03.876479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a44cc6af-fe67-4b26-8b7b-8b48dbb15775 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1694 microversion: 2.1 time: 0.364430 Sep 01 05:25:03.877490 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2971/5889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:03 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1694 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:04.421054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:04.421868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:04.448204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.455008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.455932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.457082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.457961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.464434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.746536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:04.747196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:04.761507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.762473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.762957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.766047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:04.766794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:04.767487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:04.945104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:04.961389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:04.968927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:04.970582 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-303ea80e-033b-4b08-9c74-d36d7649f06c tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.559829 Sep 01 05:25:04.971796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2919/5890] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:04 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:04.985180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:04.986230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:04.998176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:05.002545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:05.003039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:05.008063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:05.008665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:05.009157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:05.682528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:05.725858 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3443a330-3d70-4c29-9595-190011fc108b tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.983114 Sep 01 05:25:05.756504 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2972/5891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:04 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:05.870076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:05.904894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8b46e5c-8078-4802-a6ff-0879b099e81c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1694 microversion: 2.1 time: 0.931533 Sep 01 05:25:05.908667 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2920/5892] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:04 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1694 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:06.007506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:06.008275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:06.027826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.032595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.033767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.037706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.039499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.045897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.213765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50244ced-5db2-4bb9-9c23-058ac9975125 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: .version_select at 0x7fa75b0f79d0>, body: {"keypair": {"name": "tempest-keypair-337838872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwIy1YH1K3yDiDcFAqap484U1zJsLuE3SdKT3AswZZ5HyZg7MnDKrkuieSR5/gxZFxXl1O4yS/LaKYPRk5/smi6DFyuoPxa0+Lhe95dHMkmCEG8aWS8okFpvkL0PJ7fRw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:06.289510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-50244ced-5db2-4bb9-9c23-058ac9975125 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for project effcb18d84544e18b42c5c4df340e298. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:25:06.313634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-50244ced-5db2-4bb9-9c23-058ac9975125 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for user 8dd890dfc9e743388863785f3ce4b266 and project effcb18d84544e18b42c5c4df340e298. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:25:06.415993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:06.417936 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50244ced-5db2-4bb9-9c23-058ac9975125 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203698 Sep 01 05:25:06.417936 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2921/5893] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:25:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:06.429459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:06.434542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:06.447157 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4048aaf9-bb68-4904-86b0-30f4b7c157bc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.444957 Sep 01 05:25:06.451760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2973/5894] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:06 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:25:06.776054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:06.778157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:06.791410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.792524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.793332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.794538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.797039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.797800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.807786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:06.937488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:06.938082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:06.952295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.952826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.958973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:06.959938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:06.960430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:06.960880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.241087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:07.258545 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8467ad2d-74f7-4653-af34-307394f851a5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.487852 Sep 01 05:25:07.262234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2922/5895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:06 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:07.478054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:07.479157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:07.492821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:07.493221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:07.493875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.494614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:07.495118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:07.496545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:07.621903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:07.638428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ce0b26f-8f23-4d67-9bbc-2e52e2a313cc tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1694 microversion: 2.1 time: 0.712193 Sep 01 05:25:07.654924 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2974/5896] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:06 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1694 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:07.884904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:07.915417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:07.919280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:07.922097 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27fdb2f5-2bed-4ea3-8c96-eebc3a1f1189 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.447842 Sep 01 05:25:07.948578 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2923/5897] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:07 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:25:08.286485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:08.291585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:08.315208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.316082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.316797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.321328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.322543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.323496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.695964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:08.698089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:08.728617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.729719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.730646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.732442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.733702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.740282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.772686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:08.791216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bc3b167-429e-436e-ad12-6c176f0b8fa7 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.509856 Sep 01 05:25:08.794464 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2975/5898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:08 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:08.964720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:08.965358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:08.988477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.988982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.989965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:08.991175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:08.991667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:08.992179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:09.424660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:09.435566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:09.453846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:09.459768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:09.464609 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef2ba5e9-4721-4610-9a72-a9171294a4b0 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.504633 Sep 01 05:25:09.465217 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2976/5899] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:08 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:09.483656 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f554596-3c5f-4684-a8c0-de77c2f43152 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.774073 Sep 01 05:25:09.484366 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2924/5900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:08 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:09.832058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:09.832682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:09.851399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:09.851903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:09.852345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:09.853079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:09.853540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:09.853957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.248427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c1812efa-acd9-4edb-9907-11186b64cbfb req-de2c77b4-e849-4592-8844-7596f2b85bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27a859d-c939-4890-958f-4fbbee4aba53", "name": "network-vif-plugged", "status": "completed", "tag": "adb42884-a15d-441c-abec-634645f2ece3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:10.335549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1812efa-acd9-4edb-9907-11186b64cbfb req-de2c77b4-e849-4592-8844-7596f2b85bea service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.336620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1812efa-acd9-4edb-9907-11186b64cbfb req-de2c77b4-e849-4592-8844-7596f2b85bea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.337419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1812efa-acd9-4edb-9907-11186b64cbfb req-de2c77b4-e849-4592-8844-7596f2b85bea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.393332 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c1812efa-acd9-4edb-9907-11186b64cbfb req-de2c77b4-e849-4592-8844-7596f2b85bea service nova] Creating event network-vif-plugged:adb42884-a15d-441c-abec-634645f2ece3 for instance f27a859d-c939-4890-958f-4fbbee4aba53 on n-h2-820368-37 Sep 01 05:25:10.428582 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c1812efa-acd9-4edb-9907-11186b64cbfb req-de2c77b4-e849-4592-8844-7596f2b85bea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185825 Sep 01 05:25:10.471149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2925/5901] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:10.492539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:10.497923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:10.529648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.532101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.532865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.534218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.535454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.539628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.546836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:10.571598 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cfd1cd3-514a-4a3b-9c40-54514c9aa1d1 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.740013 Sep 01 05:25:10.577778 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2977/5902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:09 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:10.597165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:10.598163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:10.620869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.622033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.622940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.624110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:10.624816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:10.625471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:10.675892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:11.062037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:11.073202 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90e411b1-3be7-4bbb-b0b4-4abf06217ff1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.493462 Sep 01 05:25:11.082992 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2978/5903] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:10 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:11.093850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-580160215", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22bee5f0-b7bc-4321-940b-b22ffa3ba17b"}], "security_groups": [{"name": "tempest-securitygroup--1342688947"}], "key_name": "tempest-keypair-337838872", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:11.121393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:11.138802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:11.143705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:11.145088 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83bb1082-cbfa-4587-a70b-25aadba60c98 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.657554 Sep 01 05:25:11.145686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2926/5904] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:10 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:25:11.281435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] validate_networks() for [('22bee5f0-b7bc-4321-940b-b22ffa3ba17b', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:25:11.602162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:11.603815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:11.617598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:11.623771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:11.624732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:11.625921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:11.626638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:11.635104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.032788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:12.074123 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67318c2f-f665-435c-a0f0-721bef1fba61 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1314 microversion: 2.1 time: 0.477849 Sep 01 05:25:12.074797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2927/5905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:11 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:12.113549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:12.114043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:12.135389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.136013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.136466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.137214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.137672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.138094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.342353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:25:12.343183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:25:12.344114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:25:12.344848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:25:12.345962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:25:12.372740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.373181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.373625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.381500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.382050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.382539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.433334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for project effcb18d84544e18b42c5c4df340e298. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:25:12.450612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Getting quotas for user 8dd890dfc9e743388863785f3ce4b266 and project effcb18d84544e18b42c5c4df340e298. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:25:12.479918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:25:12.484054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:25:12.506523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:12.521810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:12.530327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d615334a-0b59-421f-820a-7bac59218653 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.431365 Sep 01 05:25:12.553140 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2928/5906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:12 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:12.574981 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6e12a09-202e-4ec1-90a9-f0c4262e2da6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.496859 Sep 01 05:25:12.578425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:12.581685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:12.583733 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2979/5907] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:25:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:25:12.591626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02367774-bb4f-4f99-922b-95aa186fe7e6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:12.592624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02367774-bb4f-4f99-922b-95aa186fe7e6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:12.598348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.601211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.604419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.606580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:12.607613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:12.609460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:12.762758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02367774-bb4f-4f99-922b-95aa186fe7e6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:12.774152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02367774-bb4f-4f99-922b-95aa186fe7e6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1236 microversion: 2.1 time: 0.188570 Sep 01 05:25:12.775109 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2980/5908] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:12 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1236 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:13.098526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:13.100673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:13.105217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:13.115016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:13.116848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:13.119801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.120360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.123286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.124218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.124674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.125194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.133733 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3890acd8-e4ea-457d-82e5-42a7826802a5 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.574759 Sep 01 05:25:13.134982 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2929/5909] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:12 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:13.533080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:13.560397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:13.561292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:13.588782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98146b70-f487-4b48-9624-1e9673e29329 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1500 microversion: 2.1 time: 0.490087 Sep 01 05:25:13.589632 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2981/5910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:13 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1500 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:13.601700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.602297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.603348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.609821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.610468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.611115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.631164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:13.633321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:13.651331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.652152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.652762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:13.653797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:13.654462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:13.657750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.242256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.263563 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-773922bb-a58e-4c5e-893f-0018c1b0674c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.707991 Sep 01 05:25:14.279904 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2930/5911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:13 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:14.285164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.299970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:14.314288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dce41adb-5709-4184-9a34-fff4cc571b29 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1500 microversion: 2.1 time: 0.705427 Sep 01 05:25:14.315883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:14.327103 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2982/5912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:13 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1500 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:14.343529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:14.347722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:14.350032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.355323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.356213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.357263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.357987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.358728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.369359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.370305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.371030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.372096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.373679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.375472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.513484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.554743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4adbc78a-374b-4fd7-b4ae-a3eba4c51467 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1232 microversion: 2.1 time: 0.271527 Sep 01 05:25:14.558544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2931/5913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:14 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1232 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:14.582286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:14.583877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:14.607923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:14.613157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.613795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.616272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.618602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.619130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.619575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.686333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lazy-loading 'flavor' on Instance uuid f27a859d-c939-4890-958f-4fbbee4aba53 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:25:14.811040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.825590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.827514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:14.833260 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30dc7ac9-9700-45fa-ba53-2408b284dbe8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action" status: 202 len: 0 microversion: 2.1 time: 0.271259 Sep 01 05:25:14.836970 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2932/5914] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:14 2022] POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:25:14.838916 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2bdd66c3-8dd9-4691-8b30-04eeb766c9cc tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.510058 Sep 01 05:25:14.840059 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2983/5915] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:14 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:14.851750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:14.854826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:14.875138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.877017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.877665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:14.878353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:14.878789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:14.883843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.273508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:15.307014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:15.307828 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f773388c-42e2-4aff-962c-081b2ed77ece tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1508 microversion: 2.1 time: 0.454000 Sep 01 05:25:15.307828 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2933/5916] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:14 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:15.316287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:15.363254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.370373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.371148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.372098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.372728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.374842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.580605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:15.581645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:15.595840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.596327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.596761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.597580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.597907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.598396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.799639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:15.809806 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de1419ad-440b-40c0-8e7b-0f4ded861a1b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.524478 Sep 01 05:25:15.824256 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2984/5917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:15 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:15.835497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:15.843858 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-924889bb-d37f-4c6d-a6aa-01bbabb51c3f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1288 microversion: 2.1 time: 0.269103 Sep 01 05:25:15.857765 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2934/5918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:15 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1288 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:15.865641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:15.866897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:15.874933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.875755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.876372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:15.877989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:15.878640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:15.879413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:16.250226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:16.259609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:16.261644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:16.263316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdc1b27e-7d6f-41ea-852b-1dc59ba4227e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.402367 Sep 01 05:25:16.264208 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2985/5919] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:15 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:16.328200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:16.329155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:16.337773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:16.338711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:16.339421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:16.340422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:16.341115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:16.341777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:16.342613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:16.833782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:16.834734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:16.843542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:16.844072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:16.844499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:16.845215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:16.845689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:16.846121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:16.979444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.003012 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8eb27724-1bdf-43cf-84d3-1ec9b262c310 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1491 microversion: 2.1 time: 0.678364 Sep 01 05:25:17.006948 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2935/5920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:16 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1491 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:17.022634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:17.024461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:17.043257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.043978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.044505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.045295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.045915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.046563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.151525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.159472 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5b394b6-49f5-41a1-b06d-4b5b60c2d34c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1296 microversion: 2.1 time: 0.142323 Sep 01 05:25:17.160324 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2936/5921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:17 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1296 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:17.165426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:17.165951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:17.171860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.176905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.177226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.177759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.178497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.179227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.179665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.192096 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11b2d51f-b3cb-4bc8-aa61-b42005f0c3e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.361207 Sep 01 05:25:17.193253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2986/5922] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:16 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:17.211810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:17.276311 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9cd1a0b1-a8a7-4c79-ab28-2c7ce2817ec5 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action" status: 202 len: 0 microversion: 2.1 time: 0.114953 Sep 01 05:25:17.278952 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2937/5923] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:17 2022] POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:25:17.286387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:17.287874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:17.300545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.301340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.302103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.302253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:17.303474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.304360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.305033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.305255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:17.317668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.318313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.318747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.319491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:17.319948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:17.320374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:17.702749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.714417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.715617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.719346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:17.722182 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11050f8e-c9c6-4058-b99c-bc2ae8b4be73 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.431797 Sep 01 05:25:17.723563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2938/5924] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:17 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:17.741473 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e5f01ff-2404-4970-a0ea-93aeea38f9dd tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1497 microversion: 2.1 time: 0.459136 Sep 01 05:25:17.742116 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2987/5925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:17 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:18.182392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:18.191379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:18.205319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.205721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.207793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.209487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.211549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.212286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.217481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:18.219730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:18.238377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.240299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.243178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.245006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.248561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.250692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.325226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:18.341350 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2355214-af07-4d23-a60a-2aa529d49feb tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1294 microversion: 2.1 time: 0.162645 Sep 01 05:25:18.355500 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2939/5926] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:18 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1294 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:18.570408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:18.589940 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00095a84-20d4-4b27-ad20-e66b13b0e993 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.376532 Sep 01 05:25:18.596062 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2988/5927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:18 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:18.747929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:18.749886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:18.760941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.761899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.762576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.763572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.764277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.764903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.766818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:18.768220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:18.787160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.788123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.788924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:18.789783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:18.790385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:18.790844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.309563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.330438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.342761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.344881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.346445 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba43740b-247e-4094-8289-ceaa3188e2b2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.602919 Sep 01 05:25:19.347627 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2940/5928] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:18 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:25:19.354175 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d551cafc-6a7d-44d7-9be3-5f68ba345404 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1497 microversion: 2.1 time: 0.593582 Sep 01 05:25:19.355586 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2989/5929] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:18 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1497 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:19.381491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:19.384347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:19.404104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.405042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.405705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.412262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.413117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.413573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.618829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:19.618829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:19.626267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.627112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.627769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.628548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.629069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.629528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.761226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.771507 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6e198ea-3251-4bb8-a499-dfd810a80b11 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.396413 Sep 01 05:25:19.772460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2941/5930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:19 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:19.819811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-810555b6-44a1-46b7-842b-3646122dab86 req-066f6b9d-9d7d-4db0-9d05-f2cdeb88c42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9498fe9c-4501-47f8-8d4e-79651ca78263", "tag": "94738a4a-8ce4-4a80-80eb-e05a156af26d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:19.832845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-810555b6-44a1-46b7-842b-3646122dab86 req-066f6b9d-9d7d-4db0-9d05-f2cdeb88c42a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:19.833766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-810555b6-44a1-46b7-842b-3646122dab86 req-066f6b9d-9d7d-4db0-9d05-f2cdeb88c42a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:19.835261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-810555b6-44a1-46b7-842b-3646122dab86 req-066f6b9d-9d7d-4db0-9d05-f2cdeb88c42a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:19.851576 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-810555b6-44a1-46b7-842b-3646122dab86 req-066f6b9d-9d7d-4db0-9d05-f2cdeb88c42a service nova] Creating event network-changed:94738a4a-8ce4-4a80-80eb-e05a156af26d for instance 9498fe9c-4501-47f8-8d4e-79651ca78263 on n-h1-820368-37 Sep 01 05:25:19.858586 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-810555b6-44a1-46b7-842b-3646122dab86 req-066f6b9d-9d7d-4db0-9d05-f2cdeb88c42a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042956 Sep 01 05:25:19.859633 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2942/5931] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:19.891995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:19.902871 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2aac78b9-68f0-4fb5-ae84-652d567633a4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1699 microversion: 2.1 time: 0.290074 Sep 01 05:25:19.904097 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2990/5932] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:19 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1699 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:20.406084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:20.407567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:20.410296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:20.412756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:20.417497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.418487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.419491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.420436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.421073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.421697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.428378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.429580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.430595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.432572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.433568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.434565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.793470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:20.816590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:20.818736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:20.819261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:20.822241 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e5fa0cc5-90fa-4617-a884-0d0f48979e19 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.419627 Sep 01 05:25:20.824096 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2991/5933] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:20 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:20.835372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:20.837114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:20.849655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.851483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.853324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.856347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.857470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.858667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.860812 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61773419-1382-44a3-9967-a02359ed93d8 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1500 microversion: 2.1 time: 0.461150 Sep 01 05:25:20.864079 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2943/5934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:20 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1500 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:20.923588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:20.924257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:20.942370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.942836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.943367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:20.944842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:20.945297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:20.961448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.010559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lazy-loading 'flavor' on Instance uuid f27a859d-c939-4890-958f-4fbbee4aba53 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:25:21.119957 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a7367d3-8fbc-405f-9ac0-3b0fbfc8bd8d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action" status: 202 len: 0 microversion: 2.1 time: 0.223754 Sep 01 05:25:21.121999 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2944/5935] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:20 2022] POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:25:21.128488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:21.129226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:21.137490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.137996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.138442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.139207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.139754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.140189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.736086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:21.757981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:21.772878 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb6cc635-eae4-4990-a810-ed3793bbba76 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1698 microversion: 2.1 time: 0.649009 Sep 01 05:25:21.774017 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70a1391d-bf57-45c7-bbde-a6f9f1496d55 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.947327 Sep 01 05:25:21.774826 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2992/5936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:20 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:21.780235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:21.781614 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2945/5937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:21 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1698 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:21.786714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-45f0084a-e7ed-4dd8-8337-2249a64a71e9 req-6544e297-6aed-4e0d-a639-5f377f082e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "name": "network-vif-plugged", "status": "completed", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:21.788596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:21.801101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.804066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.805418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.806239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.806723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.807617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.810316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45f0084a-e7ed-4dd8-8337-2249a64a71e9 req-6544e297-6aed-4e0d-a639-5f377f082e58 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.810838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45f0084a-e7ed-4dd8-8337-2249a64a71e9 req-6544e297-6aed-4e0d-a639-5f377f082e58 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.811559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45f0084a-e7ed-4dd8-8337-2249a64a71e9 req-6544e297-6aed-4e0d-a639-5f377f082e58 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.839456 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-45f0084a-e7ed-4dd8-8337-2249a64a71e9 req-6544e297-6aed-4e0d-a639-5f377f082e58 service nova] Creating event network-vif-plugged:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:25:21.854505 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-45f0084a-e7ed-4dd8-8337-2249a64a71e9 req-6544e297-6aed-4e0d-a639-5f377f082e58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071243 Sep 01 05:25:21.855250 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2946/5938] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:21.874388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:21.875201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:21.886558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.887117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.887567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:21.888296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:21.888800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:21.889353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.255110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:22.264199 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4741021-de8e-4227-9d9c-93a0c215cf28 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1508 microversion: 2.1 time: 0.487964 Sep 01 05:25:22.267386 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2993/5939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:21 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1508 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:22.272993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:22.273177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "name": "network-vif-unplugged", "status": "completed", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:22.285526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:22.289009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.289706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:22.289885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.290472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.291326 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09d3a4f5-cff7-4735-81c6-bdf2ba966389 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.427799 Sep 01 05:25:22.292085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2947/5940] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:21 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:22.305714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] Creating event network-vif-unplugged:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h2-820368-37 Sep 01 05:25:22.313220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] Instance d501c465-220b-463d-b3a7-9a1e8ec9320f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:25:22.325597 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dd6503c8-3b33-457b-aab9-65551ccd4159 req-0bd8b1b7-9fdb-4d07-b889-ed915ca0ea89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056566 Sep 01 05:25:22.326220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2994/5941] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:22.807924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:22.808729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:22.811238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:22.811784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:22.815576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:22.816536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:22.823657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.823906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.824518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.824777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.825380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.825590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.826336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.826667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:22.827316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.827597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:22.828042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:22.828237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.232709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.246680 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ca3d323-859c-4278-bd23-7ddba0d3f568 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.438678 Sep 01 05:25:23.247424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2995/5942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:22 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:23.261464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.272405 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85726249-9937-40a3-bc8a-7b7618abe03c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1698 microversion: 2.1 time: 0.471016 Sep 01 05:25:23.273921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2948/5943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:22 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1698 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:23.293848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:23.294465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:23.311123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.312031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.313018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.315159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:23.315772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:23.315900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.316957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.317823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.325592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.330622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.331538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.332474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.333088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.333518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.681731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.690863 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb7cba73-1b6c-4d8f-b1c0-2ac278ca245f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1491 microversion: 2.1 time: 0.400781 Sep 01 05:25:23.691359 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2996/5944] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:23 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1491 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:23.693963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.704365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.705761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:23.707051 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82364985-73d2-4a09-ac77-e40a6a518747 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.396434 Sep 01 05:25:23.714017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:23.714837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:23.723264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.724787 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2949/5945] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:23 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:23.725546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.725755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.726519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.727052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.727484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.732700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:23.829606 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e664be4d-6689-4943-b681-4e0e99c0a055 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action" status: 202 len: 0 microversion: 2.1 time: 0.120359 Sep 01 05:25:23.831365 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2997/5946] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:23 2022] POST /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:25:23.840096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:23.843227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:23.851716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.852292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.853032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:23.853843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:23.854350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:23.854743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.025386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.037230 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eafdf47-f165-4251-8b61-2b495c1d557f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1497 microversion: 2.1 time: 0.201162 Sep 01 05:25:24.039974 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2950/5947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:23 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:24.268663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:24.269536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:24.276759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.277243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.278398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.279485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.280105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.280690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.296874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:24.297419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:24.304328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.304918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.305423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.306200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.307081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.307188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.551792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.557548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.561605 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eada28cd-73da-43f1-82d3-de143f849b83 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.297226 Sep 01 05:25:24.563084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2998/5948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:24 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:24.568676 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fd00b21-c09b-4e31-ae29-636e64c9dd19 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1696 microversion: 2.1 time: 0.275672 Sep 01 05:25:24.569273 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2951/5949] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:24 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1696 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:24.588383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:24.598648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.599132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.599874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.613112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] Creating event network-changed:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h2-820368-37 Sep 01 05:25:24.624918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] Instance d501c465-220b-463d-b3a7-9a1e8ec9320f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:25:24.638014 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dcc56cce-d4ed-4632-96ff-bb893e99dbb2 req-9d1c2842-e533-4c17-903d-beb1eeb30c8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073418 Sep 01 05:25:24.638648 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 2999/5950] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:24.734964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:24.736452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:24.745632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.746697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.747618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.748644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:24.749449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:24.750107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:24.975987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.987841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.989615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:24.991010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75bea2a0-68d0-4263-849b-df213f549661 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1729 microversion: 2.20 time: 0.261373 Sep 01 05:25:24.991603 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2952/5951] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:24 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:25.070576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:25.072086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:25.080242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.081040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.081752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.082663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.083318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.084001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.317852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:25.330709 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36d469cb-a337-482d-a3db-a32e4b6aeb9f tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1497 microversion: 2.1 time: 0.272356 Sep 01 05:25:25.343930 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3000/5952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:25 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:25.583888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:25.584769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:25.590700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:25.591790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:25.603716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.606361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.607193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.607872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.608477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.609322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.609848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.610865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:25.611541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.612251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.612885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:25.618698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:25.622537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:25.893915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:25.904348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c86cf4a3-f014-4d12-98f6-c2d05902608f tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.324446 Sep 01 05:25:25.909172 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2953/5953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:25 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:25.944069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:25.954203 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64120508-93a8-47be-8abd-8d899e43a419 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1696 microversion: 2.1 time: 0.367312 Sep 01 05:25:25.957089 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3001/5954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:25 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1696 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:26.026776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:26.027727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:26.036379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.036991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.038214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.039323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.039970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.040447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.201339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:26.211131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:26.213075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:26.214417 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59d62737-c8ba-4829-a36b-b742031e61f2 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1716 microversion: 2.20 time: 0.195185 Sep 01 05:25:26.214878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2954/5955] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:25:26 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1716 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:25:26.355845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:26.366845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:26.378560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.379101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.379542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.380258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.380817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.381247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.670149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:26.686032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5349479f-97c7-426d-b992-715b9c4a4db3 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1497 microversion: 2.1 time: 0.334076 Sep 01 05:25:26.699800 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3002/5956] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:26 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:26.930244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:26.931534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:26.955491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.956411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.958360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.960243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.962242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.962799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.978136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:26.978753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:26.985335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.985827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.986261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:26.987318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:26.987773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:26.988198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.326995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:27.336747 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72ea01ac-adb9-4263-bbab-0b8b2b27c473 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.410506 Sep 01 05:25:27.351187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:27.353397 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2955/5957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:26 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:27.365710 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f4e9c5c-631d-43d3-856a-c2b77f582962 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1693 microversion: 2.1 time: 0.391500 Sep 01 05:25:27.379499 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3003/5958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:26 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1693 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:27.388434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:27.389453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:27.396196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.397230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.397975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.398871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.399679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.400587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.527541 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4810772-5e96-46db-a39b-4c8401ab90a9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action" status: 202 len: 0 microversion: 2.1 time: 0.142778 Sep 01 05:25:27.528279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2956/5959] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:25:27 2022] POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:25:27.539603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:27.541466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:27.553752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.554500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.555347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.556295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.557083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.557492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.589983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e26005f5-ba34-4ac9-b24c-5611d1fb3c37 req-fcfb76ab-e5c3-475e-b3df-4fbc902ef4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9498fe9c-4501-47f8-8d4e-79651ca78263", "name": "network-vif-plugged", "status": "completed", "tag": "94738a4a-8ce4-4a80-80eb-e05a156af26d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:27.608140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e26005f5-ba34-4ac9-b24c-5611d1fb3c37 req-fcfb76ab-e5c3-475e-b3df-4fbc902ef4ab service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.608529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e26005f5-ba34-4ac9-b24c-5611d1fb3c37 req-fcfb76ab-e5c3-475e-b3df-4fbc902ef4ab service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.609829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e26005f5-ba34-4ac9-b24c-5611d1fb3c37 req-fcfb76ab-e5c3-475e-b3df-4fbc902ef4ab service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.636558 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e26005f5-ba34-4ac9-b24c-5611d1fb3c37 req-fcfb76ab-e5c3-475e-b3df-4fbc902ef4ab service nova] Creating event network-vif-plugged:94738a4a-8ce4-4a80-80eb-e05a156af26d for instance 9498fe9c-4501-47f8-8d4e-79651ca78263 on n-h1-820368-37 Sep 01 05:25:27.646600 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e26005f5-ba34-4ac9-b24c-5611d1fb3c37 req-fcfb76ab-e5c3-475e-b3df-4fbc902ef4ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060786 Sep 01 05:25:27.648937 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2957/5960] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:27.714359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:27.715495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:27.728204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.729185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.730313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.732527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:27.733310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:27.734185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:27.910909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:27.936238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a94f0596-41f2-406a-a623-f6f1cc9f0811 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.403155 Sep 01 05:25:27.937300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3004/5961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:27 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:28.365973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:28.367507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:28.387553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.388378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.390394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.392179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.393544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.395483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.413478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:28.434758 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee8cc837-d3c1-4f24-bd26-ce6d9fb9c40a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1497 microversion: 2.1 time: 0.717013 Sep 01 05:25:28.436197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2958/5962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:27 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1497 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:28.697181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:28.712977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ad9b065-6126-4ca6-9c2e-e6a94ebf4bd6 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1362 microversion: 2.1 time: 0.355505 Sep 01 05:25:28.714980 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3005/5963] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:28 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:28.959437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:28.960579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:28.967663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.968178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.968585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:28.969568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:28.970295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:28.970655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.210455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:29.220134 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2eb0dd7-235f-4817-891d-4dc6f9fb3f5a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.265049 Sep 01 05:25:29.235324 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2959/5964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:28 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:29.458188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:29.459565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:29.466371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.466870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.467336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.468090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.468530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.469185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.736288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:29.737552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:29.745841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.746324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.746788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.747588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.748038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.748427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.837552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:29.848753 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0d1c6f6-bd4c-416a-a662-6b681c92fe58 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1500 microversion: 2.1 time: 0.394920 Sep 01 05:25:29.850934 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3006/5965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:29 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:29.870013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:29.870537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:29.877205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.877713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.878156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.879471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.879643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.880432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.930671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:25:29.951511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:29.962252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3114b0fd-4730-4019-8291-f030192fc431 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1546 microversion: 2.1 time: 0.229938 Sep 01 05:25:29.968149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2960/5966] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:29 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1546 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:29.983800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:29.984579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:29.991835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.992555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.993189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:29.993896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:29.994531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:29.994981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.044033 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-90cb5972-a25a-4f2b-b692-df4925a3d8c0 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 204 len: 0 microversion: 2.1 time: 0.177867 Sep 01 05:25:30.044854 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3007/5967] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:25:29 2022] DELETE /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:25:30.053947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:30.054799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:30.062075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.062698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.063421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.064296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.065823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.069181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.089789 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1425688b-b307-477c-a51e-c99fc9dc059c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109930 Sep 01 05:25:30.090576 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2961/5968] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:25:29 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:25:30.243301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:30.244150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:30.250790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.251522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.252141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.253028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.253647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.254240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.410337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:30.422561 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fde2a6b6-a4cd-43fc-baa1-fccb2e82b402 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1506 microversion: 2.1 time: 0.372992 Sep 01 05:25:30.432279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3008/5969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:30 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:30.432279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "name": "network-vif-plugged", "status": "completed", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:30.443795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:30.444302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:30.444744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:30.457870 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] Creating event network-vif-plugged:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h2-820368-37 Sep 01 05:25:30.467495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] Instance d501c465-220b-463d-b3a7-9a1e8ec9320f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:25:30.481449 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-19b0bdfa-a95c-4e29-9f36-5b646cdfe7a2 req-0f1fd45a-6bf1-4cfa-8f66-94a37baffead service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056044 Sep 01 05:25:30.482687 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3009/5970] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:30.538060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:30.550296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c94f2b2-a267-42aa-aeff-c226ad28fa87 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.312185 Sep 01 05:25:30.552120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2962/5971] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:30 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:31.399038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-48f9e1b9-fae4-4a51-a4ee-7f481d3028bd req-02c6bb98-b169-49c4-9c97-84ee76d0df20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9498fe9c-4501-47f8-8d4e-79651ca78263", "tag": "94738a4a-8ce4-4a80-80eb-e05a156af26d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:31.411194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-48f9e1b9-fae4-4a51-a4ee-7f481d3028bd req-02c6bb98-b169-49c4-9c97-84ee76d0df20 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.411849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-48f9e1b9-fae4-4a51-a4ee-7f481d3028bd req-02c6bb98-b169-49c4-9c97-84ee76d0df20 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.412318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-48f9e1b9-fae4-4a51-a4ee-7f481d3028bd req-02c6bb98-b169-49c4-9c97-84ee76d0df20 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.425393 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-48f9e1b9-fae4-4a51-a4ee-7f481d3028bd req-02c6bb98-b169-49c4-9c97-84ee76d0df20 service nova] Creating event network-changed:94738a4a-8ce4-4a80-80eb-e05a156af26d for instance 9498fe9c-4501-47f8-8d4e-79651ca78263 on n-h1-820368-37 Sep 01 05:25:31.431244 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-48f9e1b9-fae4-4a51-a4ee-7f481d3028bd req-02c6bb98-b169-49c4-9c97-84ee76d0df20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037572 Sep 01 05:25:31.432454 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3010/5972] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:31.444694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:31.446110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:31.454185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.454941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.455678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.456541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.457368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.458014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.577482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:31.578181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:31.585361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.586239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.586924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.587883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:31.588810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:31.589415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:31.808696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:31.818657 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f202e23c-7ff9-4f7e-9656-b620fd37147d tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1506 microversion: 2.1 time: 0.377915 Sep 01 05:25:31.819768 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2963/5973] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:31 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:31.870789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:31.883673 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36176ccd-89cf-4e8f-9632-0b06be087519 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.310325 Sep 01 05:25:31.899076 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3011/5974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:31 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:32.847426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:32.848764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:32.871925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.872477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.872924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.873655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.874150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.874574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.914392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:32.915875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:32.926391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.932061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.932528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.933281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:32.933917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:32.934542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:32.972404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:33.715245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:33.725162 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a1b5ddd-7cc9-408b-90bb-d7eb4a6b9b05 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1506 microversion: 2.1 time: 0.882694 Sep 01 05:25:33.726242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2964/5975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:32 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1506 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:33.770509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:33.780286 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3de874b8-4bf3-4590-8032-b36ff05f5722 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.871595 Sep 01 05:25:33.781127 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3012/5976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:32 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:34.426130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7edbd828-cf89-4cdd-9602-df7fcb0abeca req-d3667453-a2c1-45d8-b10e-0b288ae55105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27a859d-c939-4890-958f-4fbbee4aba53", "name": "network-vif-deleted", "tag": "adb42884-a15d-441c-abec-634645f2ece3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:34.459937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7edbd828-cf89-4cdd-9602-df7fcb0abeca req-d3667453-a2c1-45d8-b10e-0b288ae55105 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.465066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7edbd828-cf89-4cdd-9602-df7fcb0abeca req-d3667453-a2c1-45d8-b10e-0b288ae55105 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.465840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7edbd828-cf89-4cdd-9602-df7fcb0abeca req-d3667453-a2c1-45d8-b10e-0b288ae55105 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.481821 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7edbd828-cf89-4cdd-9602-df7fcb0abeca req-d3667453-a2c1-45d8-b10e-0b288ae55105 service nova] Creating event network-vif-deleted:adb42884-a15d-441c-abec-634645f2ece3 for instance f27a859d-c939-4890-958f-4fbbee4aba53 on n-h2-820368-37 Sep 01 05:25:34.487729 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7edbd828-cf89-4cdd-9602-df7fcb0abeca req-d3667453-a2c1-45d8-b10e-0b288ae55105 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065765 Sep 01 05:25:34.489148 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2965/5977] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:34.747603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.748972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:34.756715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.757556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.758246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.759222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.759890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.760838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.798370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.799160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.800321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.801086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lazy-loading 'fault' on Instance uuid f27a859d-c939-4890-958f-4fbbee4aba53 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:25:34.803112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:34.804206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:34.810984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.811827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.812499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.813434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:34.814136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:34.814619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:34.960506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d3343c0d2f247f2b5b53ccb93cc2e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47507077a2fd4f8d82c74efc2c5d52cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:34.988966 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ce1790c-23ed-46f3-a909-a8882fc89155 tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 200 len: 1304 microversion: 2.1 time: 0.245348 Sep 01 05:25:34.990015 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3013/5978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:35.232582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:35.248705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57b2db2e-a005-4ca7-bb1d-594db760b801 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.449553 Sep 01 05:25:35.250066 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2966/5979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:34 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:25:36.015960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:36.018515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] [instance: f27a859d-c939-4890-958f-4fbbee4aba53] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:36.048678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.049616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.050280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.051270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.052045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.052788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.082054 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] HTTP exception thrown: Instance f27a859d-c939-4890-958f-4fbbee4aba53 could not be found. Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Request method failure captured: Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 HTTP/1.1 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEIclpruARjU5Y8-Ld1qMXRyPRTD2LgrZkeCkgPifo3fmCIbswpPfzJgEDl4qy1fNrqGLEXgjGBt-SSzH7-BpY_vSJZp5zw3S2KpXTIeXq8SGz6wwdWAVILI8BQrzl6wlm3U0xw2nCc01h01xJ75jD38Rek_Nzpbii3zb3bNVckCTJs Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 47507077a2fd4f8d82c74efc2c5d52cc Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestServerAdvancedOps-302828942 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47507077a2fd4f8d82c74efc2c5d52cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47507077a2fd4f8d82c74efc2c5d52cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47507077a2fd4f8d82c74efc2c5d52cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47507077a2fd4f8d82c74efc2c5d52cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestServerAdvancedOps-302828942 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 47507077a2fd4f8d82c74efc2c5d52cc Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestServerAdvancedOps-302828942 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestServerAdvancedOps-302828942-project Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 4d3343c0d2f247f2b5b53ccb93cc2e21 Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestServerAdvancedOps-302828942-project Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance f27a859d-c939-4890-958f-4fbbee4aba53 could not be found. Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'f27a859d-c939-4890-958f-4fbbee4aba53'} Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27a859d-c939-4890-958f-4fbbee4aba53 could not be found. Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27a859d-c939-4890-958f-4fbbee4aba53 could not be found. Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:25:36.086040 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27a859d-c939-4890-958f-4fbbee4aba53 could not be found. Sep 01 05:25:36.093540 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:25:36.096571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] Returning 404 to user: Instance f27a859d-c939-4890-958f-4fbbee4aba53 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:25:36.097695 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09f5a02a-abf3-46e3-b8cb-e9571133134a tempest-TestServerAdvancedOps-302828942 tempest-TestServerAdvancedOps-302828942-project] 10.222.0.26 "GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53" status: 404 len: 111 microversion: 2.1 time: 0.088874 Sep 01 05:25:36.100310 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3014/5980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:36 2022] GET /compute/v2.1/servers/f27a859d-c939-4890-958f-4fbbee4aba53 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:25:36.274827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:36.275799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:36.290519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.291443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.292124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.293175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.294500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.295354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.490698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:36.499345 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c20ab097-75f7-43cc-bcd6-b4378d87b495 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.228799 Sep 01 05:25:36.500080 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2967/5981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:36 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:36.524014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "name": "network-vif-unplugged", "status": "completed", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}, {"name": "network-changed", "server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:36.534682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:36.535511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:36.535936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:36.551660 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Creating event network-vif-unplugged:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:25:36.552218 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Creating event network-changed:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:25:36.559411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] Instance d501c465-220b-463d-b3a7-9a1e8ec9320f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:25:36.574668 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a10223ca-719c-434f-8788-afc01adc6395 req-bd944b87-0117-41ec-9ebe-7b493a8a3ab0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.055465 Sep 01 05:25:36.575628 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3015/5982] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:37.524995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:37.525911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:37.543679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:37.544217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:37.544673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:37.547519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:37.550437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:37.554211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:37.890370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:37.905229 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-353bf85d-0c8c-44a3-95fa-de34f5d549f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1692 microversion: 2.1 time: 0.387716 Sep 01 05:25:37.913557 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2968/5983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:37 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1692 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:38.959311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:38.960460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:38.983275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:38.984799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:38.985859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:38.987406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:38.988428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:38.991137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:39.341528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:25:39.358118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35984764-f7bd-416a-bf6c-bb53ec7df00c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1685 microversion: 2.1 time: 0.427954 Sep 01 05:25:39.361211 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3016/5984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:38 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1685 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:41.941470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3b2bc6bd-9fb3-42fa-893b-834d5b68c753 req-59f86cbd-6233-4042-bb6e-01bec692f912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "name": "network-vif-plugged", "status": "completed", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:41.961666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b2bc6bd-9fb3-42fa-893b-834d5b68c753 req-59f86cbd-6233-4042-bb6e-01bec692f912 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:41.962065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b2bc6bd-9fb3-42fa-893b-834d5b68c753 req-59f86cbd-6233-4042-bb6e-01bec692f912 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:41.962514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b2bc6bd-9fb3-42fa-893b-834d5b68c753 req-59f86cbd-6233-4042-bb6e-01bec692f912 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:42.001949 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3b2bc6bd-9fb3-42fa-893b-834d5b68c753 req-59f86cbd-6233-4042-bb6e-01bec692f912 service nova] Creating event network-vif-plugged:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:25:42.011760 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3b2bc6bd-9fb3-42fa-893b-834d5b68c753 req-59f86cbd-6233-4042-bb6e-01bec692f912 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075403 Sep 01 05:25:42.012677 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2969/5985] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:55.271950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:55.277883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=22 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:55.655128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:55.657653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:55.658145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:55.658581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:55.659350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:55.659798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:55.660214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:55.707199 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5bd32d83-2eef-40de-9d43-5ba4c3f32efa tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.452600 Sep 01 05:25:55.711690 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3017/5986] 10.222.0.26 () {58 vars in 1185 bytes} [Thu Sep 1 05:25:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:25:55.845519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1768234752", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "availability_zone": "nova:n-h1-820368-37", "networks": [{"uuid": "52530e83-ad62-410b-a9b3-aa7ab43d41f4"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:55.858361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=79 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:55.859004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:25:55.926556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] validate_networks() for [('52530e83-ad62-410b-a9b3-aa7ab43d41f4', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:25:56.610680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:25:56.611205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:25:56.611844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:25:56.612347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:25:56.612823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:25:56.625502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:56.626017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:56.626460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:56.627271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:56.627742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:56.628182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:56.652622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Getting quotas for project 1ea7a3a4125748bcaf2f02b4fe9db57a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:25:56.660380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Getting quotas for user ffb0a12f88af4facb901ccd2779d54a6 and project 1ea7a3a4125748bcaf2f02b4fe9db57a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:25:56.675114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:25:56.678339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:25:56.743641 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-430f33e4-ad1c-40fa-a415-e3819436cfbe tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902261 Sep 01 05:25:56.751612 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2970/5987] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:25:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:25:56.758085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b59b1ab1-4259-4ba9-9b2f-b3f012afedfc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:56.759587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b59b1ab1-4259-4ba9-9b2f-b3f012afedfc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:56.859329 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b59b1ab1-4259-4ba9-9b2f-b3f012afedfc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1329 microversion: 2.1 time: 0.106510 Sep 01 05:25:56.875299 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3018/5988] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:56 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1329 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:57.883990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:57.884605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:57.892498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:57.892994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:57.893878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:57.894588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:57.895095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:57.895502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:57.975279 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62b77e7e-7bf0-40f0-89ba-3c44a7a09543 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1418 microversion: 2.1 time: 0.095672 Sep 01 05:25:57.976659 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2971/5989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:57 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1418 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:59.005079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:25:59.005754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:25:59.022496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:59.023055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:59.023688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:59.025686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:59.028335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:59.028845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:59.337562 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19a53d6e-2a4d-4389-9f32-58d27b21b99a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.341341 Sep 01 05:25:59.341999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3019/5990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:25:58 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:25:59.890070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-44b4a3ab-03db-42f0-af06-3f757dc59cae req-e9c2c74c-54a3-46a1-a0c4-e8b3474b8526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1323555-b368-4fbf-a951-ea17e939117a", "tag": "5d30691a-3d98-4c08-bde7-11ba54471ee1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:25:59.902707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-44b4a3ab-03db-42f0-af06-3f757dc59cae req-e9c2c74c-54a3-46a1-a0c4-e8b3474b8526 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:25:59.903491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-44b4a3ab-03db-42f0-af06-3f757dc59cae req-e9c2c74c-54a3-46a1-a0c4-e8b3474b8526 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:25:59.904116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-44b4a3ab-03db-42f0-af06-3f757dc59cae req-e9c2c74c-54a3-46a1-a0c4-e8b3474b8526 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:25:59.919445 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-44b4a3ab-03db-42f0-af06-3f757dc59cae req-e9c2c74c-54a3-46a1-a0c4-e8b3474b8526 service nova] Creating event network-changed:5d30691a-3d98-4c08-bde7-11ba54471ee1 for instance a1323555-b368-4fbf-a951-ea17e939117a on n-h1-820368-37 Sep 01 05:25:59.925322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-44b4a3ab-03db-42f0-af06-3f757dc59cae req-e9c2c74c-54a3-46a1-a0c4-e8b3474b8526 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038960 Sep 01 05:25:59.926466 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2972/5991] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:00.117727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:00.120460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:00.133724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.134455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.135677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.137522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.138597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.139608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.203902 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63cbc39f-5018-4f89-b435-9331b1ab276d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.091957 Sep 01 05:26:00.207150 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3020/5992] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 1 05:26:00 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:00.292853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:00.293834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:00.300889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.301676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.302522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.303461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.304098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.304697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.347192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:26:00.365080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:00.365949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:00.376859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.379230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.381296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.382270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.384053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.384393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.490449 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f31c2621-2a87-473f-adad-315ba7a6e75d tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 204 len: 0 microversion: 2.20 time: 0.200984 Sep 01 05:26:00.492666 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2973/5993] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:26:00 2022] DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:26:00.509153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:00.509599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:00.531513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.532313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.533143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.534024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:00.534701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:00.535901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:00.650040 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-183459f9-16bc-49cc-b60c-b14852d2a86b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.286125 Sep 01 05:26:00.651379 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3021/5994] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:00 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:00.763877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:00.773153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:00.774922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:00.776348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab9f8b7-a48f-45c8-997d-3291a7cf1234 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.272777 Sep 01 05:26:00.777127 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2974/5995] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:00 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:26:01.687555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:01.688214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:01.695312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:01.695776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:01.696201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:01.696895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:01.697339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:01.697761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:01.802492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:01.803283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:01.812262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:01.813164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:01.813863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:01.814979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:01.816224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:01.816865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:01.841745 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54e485f5-a862-47cb-90a1-d768afef39bb tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.157734 Sep 01 05:26:01.852657 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3022/5996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:01 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:01.962066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:01.971382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:01.972900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:01.974146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf8543b9-7f37-4e6c-9d24-bdde36d9c26b tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.176859 Sep 01 05:26:01.974733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2975/5997] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:01 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:26:02.791666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2085583154", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "7edf4ecf-43d3-4f0e-8852-8469bfab59f4"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:02.859267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] validate_networks() for [('7edf4ecf-43d3-4f0e-8852-8469bfab59f4', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:26:02.864331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:02.865176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:02.873826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:02.874812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:02.875457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:02.876652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:02.877481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:02.878330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:03.230015 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d518ff3c-e9ab-42b8-9387-444f5269e9e4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.369144 Sep 01 05:26:03.244969 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2976/5998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:02 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:03.254363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:03.260249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:03.272623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:03.273502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:03.283380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:03.285113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:03.286959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:03.288028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:03.705445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:03.721330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:03.722946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:03.733179 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9700bcc6-9d25-4147-b0ad-23f8ba3a960e tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1722 microversion: 2.20 time: 0.486311 Sep 01 05:26:03.734153 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2977/5999] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:03 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1722 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:26:03.783751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:26:03.784466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:26:03.785523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:26:03.786338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:26:03.792269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:26:03.814685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:03.815630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:03.816585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:03.818922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:03.819782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:03.820569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:03.857094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Getting quotas for project dafb3f7bed3942edbd1ae8fcd778e03b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:26:03.865924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Getting quotas for user 736427abad2a41a69ddb78020900bf4d and project dafb3f7bed3942edbd1ae8fcd778e03b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:26:03.882346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:26:03.884835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:26:03.944694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-515c6d6b-a28e-4902-a0e4-7784e32073d5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302118 Sep 01 05:26:03.946166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3023/6000] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:26:03.956921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32e1b8ea-dc25-4aec-b7cf-eca43e31b27d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:03.958475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32e1b8ea-dc25-4aec-b7cf-eca43e31b27d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:04.114513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32e1b8ea-dc25-4aec-b7cf-eca43e31b27d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:04.118990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5125ef28-c1a5-4dbe-9000-2a067febe6b5 req-2e03ccea-1bc6-4ccb-bf27-4aa058b4e2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39a76a-f784-4c95-902e-219ecd3806b3", "name": "network-vif-deleted", "tag": "f03e4c6d-b764-4076-a38c-3119b80e6f7c"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:04.124330 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32e1b8ea-dc25-4aec-b7cf-eca43e31b27d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1214 microversion: 2.1 time: 0.171199 Sep 01 05:26:04.127755 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2978/6001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:03 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:04.151636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5125ef28-c1a5-4dbe-9000-2a067febe6b5 req-2e03ccea-1bc6-4ccb-bf27-4aa058b4e2b2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:04.153218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5125ef28-c1a5-4dbe-9000-2a067febe6b5 req-2e03ccea-1bc6-4ccb-bf27-4aa058b4e2b2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:04.154564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5125ef28-c1a5-4dbe-9000-2a067febe6b5 req-2e03ccea-1bc6-4ccb-bf27-4aa058b4e2b2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:04.175015 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5125ef28-c1a5-4dbe-9000-2a067febe6b5 req-2e03ccea-1bc6-4ccb-bf27-4aa058b4e2b2 service nova] Creating event network-vif-deleted:f03e4c6d-b764-4076-a38c-3119b80e6f7c for instance 4e39a76a-f784-4c95-902e-219ecd3806b3 on n-h1-820368-37 Sep 01 05:26:04.182600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5125ef28-c1a5-4dbe-9000-2a067febe6b5 req-2e03ccea-1bc6-4ccb-bf27-4aa058b4e2b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204312 Sep 01 05:26:04.184849 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3024/6002] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:04.265490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:04.266126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:04.277217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:04.278199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:04.279016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:04.280660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:04.281343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:04.282076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:04.467236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d97f134-4e4a-4e6d-9706-1097ea126fde tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.206388 Sep 01 05:26:04.468410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2979/6003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:04 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:04.760333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:04.762077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:04.771034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:04.771519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:04.774225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:04.775004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:04.775575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:04.776013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:04.819936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:04.820545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:04.820839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:04.821296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lazy-loading 'fault' on Instance uuid 4e39a76a-f784-4c95-902e-219ecd3806b3 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:04.882094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:04.891212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:04.892784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac2c5b97f8ca4163b94de75a6095987e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d01164358d4590b20329062498a698', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:04.894353 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-035b769f-7222-41f2-9f13-6fe961576f91 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 200 len: 1371 microversion: 2.20 time: 0.138383 Sep 01 05:26:04.895306 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3025/6004] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:04 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 1371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:26:05.146124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:05.147224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:05.155340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:05.156017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:05.156526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:05.157339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:05.157781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:05.158208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:05.229239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:05.237681 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c5e5e4e-a4f4-4230-a8e2-966f70e96d23 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1266 microversion: 2.1 time: 0.095870 Sep 01 05:26:05.238242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2980/6005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:05 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:05.488941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:05.490017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:05.497749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:05.498734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:05.498980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:05.499782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:05.500479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:05.501140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:05.714117 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02084b84-ef0a-4caf-8236-c1a96f8de9fc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.229577 Sep 01 05:26:05.714715 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3026/6006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:05 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:05.921661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:05.922376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:05.931647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:05.931647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:05.932052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:05.932799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:05.933266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:05.933966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:05.950853 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] HTTP exception thrown: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Request method failure captured: Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 HTTP/1.1 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEEnLZ4n_POHs79uXi0CWYb9RIiYM-_AWq0tCu6zN09_c4oQowiIJZuyEE34HNTET_v-tpE3mjnqxE-aYo1FZD2p5uL_vZun_J-nslAKp2qNO3m1oQW142ulpoB0WyVxMecmeUa-aOKHFZC5WaiiXMQM4fSLKXbZHMepEFdf15VYZxc Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07d01164358d4590b20329062498a698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07d01164358d4590b20329062498a698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ac2c5b97f8ca4163b94de75a6095987e Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4e39a76a-f784-4c95-902e-219ecd3806b3'} Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:05.952650 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Returning 404 to user: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49051806-0017-44f3-b29f-99b476fcb9ec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 404 len: 111 microversion: 2.20 time: 0.037803 Sep 01 05:26:05.960240 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2981/6007] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:05 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:26:05.964707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3fe257a-f139-440d-b184-da996fe82b30 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '.version_select at 0x7fa75afebca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:05.989531 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3fe257a-f139-440d-b184-da996fe82b30 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240623847" status: 204 len: 0 microversion: 2.20 time: 0.028898 Sep 01 05:26:05.991555 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3027/6008] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 1 05:26:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240623847 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:26:06.111734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f3310c87-4476-482c-9603-cd24f065d460 req-ecd3e9f2-846e-48a3-b93d-192826583290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1323555-b368-4fbf-a951-ea17e939117a", "name": "network-vif-plugged", "status": "completed", "tag": "5d30691a-3d98-4c08-bde7-11ba54471ee1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:06.122492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3310c87-4476-482c-9603-cd24f065d460 req-ecd3e9f2-846e-48a3-b93d-192826583290 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:06.123450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3310c87-4476-482c-9603-cd24f065d460 req-ecd3e9f2-846e-48a3-b93d-192826583290 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:06.124115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f3310c87-4476-482c-9603-cd24f065d460 req-ecd3e9f2-846e-48a3-b93d-192826583290 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:06.138193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f3310c87-4476-482c-9603-cd24f065d460 req-ecd3e9f2-846e-48a3-b93d-192826583290 service nova] Creating event network-vif-plugged:5d30691a-3d98-4c08-bde7-11ba54471ee1 for instance a1323555-b368-4fbf-a951-ea17e939117a on n-h1-820368-37 Sep 01 05:26:06.144991 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f3310c87-4476-482c-9603-cd24f065d460 req-ecd3e9f2-846e-48a3-b93d-192826583290 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037314 Sep 01 05:26:06.146256 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2982/6009] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:26:06.260188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:06.261129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:06.273591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:06.274309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:06.274536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:06.275366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:06.275892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:06.276416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:06.493472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:06.503142 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f626bb9-f50c-47fe-a648-b58613841c96 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.246853 Sep 01 05:26:06.503725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3028/6010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:06 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:06.735023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:06.742973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:06.744333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:06.753636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:06.754292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:06.755017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:06.756166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:06.756741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:06.757264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.076944 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-052c8933-ba5f-4eca-9bc6-d6c063c4a2fd tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1466 microversion: 2.1 time: 0.343729 Sep 01 05:26:07.078358 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2983/6011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:06 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1466 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:07.410952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-295eb5ef-e215-4887-bb5a-e9f884667aba req-7c92f8e6-0bd0-40cb-90f0-5541e2b5a2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9293e9-e676-4806-ae45-60189a28ddff", "tag": "359f5335-f728-4aae-907a-ca1c4c8e8cfa"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:07.428803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-295eb5ef-e215-4887-bb5a-e9f884667aba req-7c92f8e6-0bd0-40cb-90f0-5541e2b5a2ee service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.430049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-295eb5ef-e215-4887-bb5a-e9f884667aba req-7c92f8e6-0bd0-40cb-90f0-5541e2b5a2ee service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.430659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-295eb5ef-e215-4887-bb5a-e9f884667aba req-7c92f8e6-0bd0-40cb-90f0-5541e2b5a2ee service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.447395 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-295eb5ef-e215-4887-bb5a-e9f884667aba req-7c92f8e6-0bd0-40cb-90f0-5541e2b5a2ee service nova] Creating event network-changed:359f5335-f728-4aae-907a-ca1c4c8e8cfa for instance cb9293e9-e676-4806-ae45-60189a28ddff on n-h2-820368-37 Sep 01 05:26:07.454251 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-295eb5ef-e215-4887-bb5a-e9f884667aba req-7c92f8e6-0bd0-40cb-90f0-5541e2b5a2ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054621 Sep 01 05:26:07.454945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3029/6012] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:07.525737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:07.526232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:07.533202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.533836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.534340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.535139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.535668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.536417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.763685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:07.776463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6dcc16e-76e7-4842-a602-425f9862d048 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.255144 Sep 01 05:26:07.777506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2984/6013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:07 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:07.783799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:07.784999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:07.793552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.794308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.795442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.796315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.796989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.797588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.832387 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-941672e0-93ed-47cf-b5f0-60412758d6d3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/ips" status: 200 len: 143 microversion: 2.1 time: 0.053320 Sep 01 05:26:07.833643 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2985/6014] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:26:07 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/ips => generated 143 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:07.877131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:07.879512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:07.887655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.888367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.889090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.889979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:07.890615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:07.891381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:07.961671 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1335af39-b45f-4af9-ac28-89f571280a38 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action" status: 200 len: 63249 microversion: 2.1 time: 0.277471 Sep 01 05:26:07.963161 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3030/6015] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:26:07 2022] POST /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f/action => generated 63249 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:26:08.099957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:08.100594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:08.107915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.108577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.109081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.110083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.110554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.111014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.277911 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7afc8e6-1555-4484-91c5-730d8e054d18 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1650 microversion: 2.1 time: 0.181684 Sep 01 05:26:08.278512 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2986/6016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:08 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1650 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:08.302626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:08.303619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:08.313567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.314239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.314734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.315621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.316089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.316577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.497366 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3f6017f-c404-4a64-b994-34aff7656f52 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1650 microversion: 2.1 time: 0.201236 Sep 01 05:26:08.498799 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3031/6017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:08 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1650 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:08.524115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:08.525826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:08.543114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.544224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.544898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.545870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.546714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.547450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.693185 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47457e5a-5e60-4e46-9012-195d91439a5c tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1650 microversion: 2.1 time: 0.178077 Sep 01 05:26:08.693957 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2987/6018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:08 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1650 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:08.800599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:08.801209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:08.809704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.810488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.811148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.812043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:08.812649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:08.813469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:08.846117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-523806817", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "availability_zone": "nova:n-h2-820368-37", "networks": [{"uuid": "52530e83-ad62-410b-a9b3-aa7ab43d41f4"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:08.927881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] validate_networks() for [('52530e83-ad62-410b-a9b3-aa7ab43d41f4', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:26:09.077604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:09.090654 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23d8a702-5a85-4ff2-9e4a-d17b51f8dec0 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.294009 Sep 01 05:26:09.091997 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3032/6019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:08 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:09.098075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:09.099670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:09.110479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:09.111358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:09.112139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:09.113340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:09.114003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:09.114662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:09.132703 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] HTTP exception thrown: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Request method failure captured: Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 HTTP/1.1 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEnLZ4n_POHs79uXi0CWYb9RIiYM-_AWq0tCu6zN09_c4oQowiIJZuyEE34HNTET_v-tpE3mjnqxE-aYo1FZD2p5uL_vZun_J-nslAKp2qNO3m1oQW142ulpoB0WyVxMecmeUa-aOKHFZC5WaiiXMQM4fSLKXbZHMepEFdf15VYZxc Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07d01164358d4590b20329062498a698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07d01164358d4590b20329062498a698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ac2c5b97f8ca4163b94de75a6095987e Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '4e39a76a-f784-4c95-902e-219ecd3806b3'} Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:09.135303 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.140805 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.142875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Returning 404 to user: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:09.144261 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-731394de-393d-4527-9a07-9e95aa67d9f8 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 404 len: 111 microversion: 2.20 time: 0.050657 Sep 01 05:26:09.145041 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3033/6020] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:26:09 2022] DELETE /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:26:09.154520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:09.155460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 4e39a76a-f784-4c95-902e-219ecd3806b3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:09.163630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:09.164390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:09.165103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:09.166075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:09.166698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:09.167377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:09.188660 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] HTTP exception thrown: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Request method failure captured: Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 HTTP/1.1 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEnLZ4n_POHs79uXi0CWYb9RIiYM-_AWq0tCu6zN09_c4oQowiIJZuyEE34HNTET_v-tpE3mjnqxE-aYo1FZD2p5uL_vZun_J-nslAKp2qNO3m1oQW142ulpoB0WyVxMecmeUa-aOKHFZC5WaiiXMQM4fSLKXbZHMepEFdf15VYZxc Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07d01164358d4590b20329062498a698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07d01164358d4590b20329062498a698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ac2c5b97f8ca4163b94de75a6095987e Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '4e39a76a-f784-4c95-902e-219ecd3806b3'} Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.190694 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. Sep 01 05:26:09.195832 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:09.199757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Returning 404 to user: Instance 4e39a76a-f784-4c95-902e-219ecd3806b3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:09.203744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d526b872-be24-4b70-8098-8f98b7e25862 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3" status: 404 len: 111 microversion: 2.20 time: 0.053301 Sep 01 05:26:09.203744 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3034/6021] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:09 2022] GET /compute/v2.1/servers/4e39a76a-f784-4c95-902e-219ecd3806b3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:26:09.478783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:26:09.479229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:26:09.479698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:26:09.480101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:26:09.480503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:26:09.491100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:09.491595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:09.492031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:09.492758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:09.493208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:09.493625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:09.511978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Getting quotas for project 1ea7a3a4125748bcaf2f02b4fe9db57a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:26:09.518343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Getting quotas for user ffb0a12f88af4facb901ccd2779d54a6 and project 1ea7a3a4125748bcaf2f02b4fe9db57a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:26:09.533003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:26:09.535437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:26:09.590401 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b13415db-ee90-42e4-b833-a8623622d046 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755749 Sep 01 05:26:09.596943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2988/6022] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:26:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:26:09.602520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-600789e1-578c-4d56-b4d3-c8561c513b3e tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:09.603530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-600789e1-578c-4d56-b4d3-c8561c513b3e tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:09.677279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-600789e1-578c-4d56-b4d3-c8561c513b3e tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1328 microversion: 2.1 time: 0.078846 Sep 01 05:26:09.679063 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3035/6023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:09 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1328 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:10.117426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:10.119054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:10.129355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:10.130178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:10.131063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:10.131940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:10.132502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:10.133332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:10.157889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:10.287272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:10.296093 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99b5c579-1d9b-4d8f-9a87-3eb2d7b751ed tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.183322 Sep 01 05:26:10.296676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2989/6024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:10 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:10.345912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2487b6a4-482c-4370-92d4-d98235e98e3f"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:10.348731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:10.355990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:10.356764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:10.357403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:10.358306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:10.358979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:10.359593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:10.705618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:10.706646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:10.710428 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97d9ccd4-921c-4e25-a603-4ea73e3a3b1d tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368339 Sep 01 05:26:10.717256 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3036/6025] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:26:10 2022] POST /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:10.726565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:10.727722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:10.728770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:10.730814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:10.731898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:10.733221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:10.910524 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-575df565-a814-4276-8ced-6355ccb4b26b tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1337 microversion: 2.1 time: 0.209910 Sep 01 05:26:10.911303 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2990/6026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:10 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1337 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:11.320399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:11.321005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:11.344802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:11.345598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:11.346235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:11.347178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:11.347827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:11.348586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:11.665016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:11.675182 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-656a3539-7485-4395-b8cb-7dcd534c0a8f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.360761 Sep 01 05:26:11.679292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3037/6027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:11 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:11.934075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:11.934842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:11.950210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:11.951152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:11.951825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:11.952809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:11.953536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:11.954197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:12.053417 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc4c60df-b4eb-4093-9fde-7624a849cb39 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1423 microversion: 2.1 time: 0.123281 Sep 01 05:26:12.068028 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2991/6028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:11 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:12.701133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:12.703162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:12.733394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:12.739319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:12.740680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:12.742718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:12.744113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:12.748600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.078130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:13.079011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:13.095281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.095540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.096953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.101655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.102475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.103134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.170379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:13.184448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c87756b-9fbe-4312-8067-19b94720bfe5 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.488588 Sep 01 05:26:13.185357 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3038/6029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:12 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:13.354078 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0584b186-755e-4de0-a9fe-775da44dbe26 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1465 microversion: 2.1 time: 0.280507 Sep 01 05:26:13.370915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2992/6030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:13 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1465 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:13.642994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-561ad1a5-292f-4ae1-9e4d-d175a005262b req-81ccb3a6-3dba-4ce2-8319-dfa5036320ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4137366a-4b9b-4f44-a1a9-a3ef94ab9de0", "tag": "0243ac98-28fb-493b-b77e-3575ee1f7543"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:13.662643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-561ad1a5-292f-4ae1-9e4d-d175a005262b req-81ccb3a6-3dba-4ce2-8319-dfa5036320ab service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.663830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-561ad1a5-292f-4ae1-9e4d-d175a005262b req-81ccb3a6-3dba-4ce2-8319-dfa5036320ab service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.664465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-561ad1a5-292f-4ae1-9e4d-d175a005262b req-81ccb3a6-3dba-4ce2-8319-dfa5036320ab service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.669461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:13.680243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-561ad1a5-292f-4ae1-9e4d-d175a005262b req-81ccb3a6-3dba-4ce2-8319-dfa5036320ab service nova] Creating event network-changed:0243ac98-28fb-493b-b77e-3575ee1f7543 for instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 on n-h2-820368-37 Sep 01 05:26:13.700782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-561ad1a5-292f-4ae1-9e4d-d175a005262b req-81ccb3a6-3dba-4ce2-8319-dfa5036320ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061669 Sep 01 05:26:13.701430 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3039/6031] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:13.734761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:13.735918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:13.752295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.753956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.756122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.759371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.760651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.761578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.805849 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] HTTP exception thrown: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Request method failure captured: Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 HTTP/1.1 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEEnLZ4n_POHs79uXi0CWYb9RIiYM-_AWq0tCu6zN09_c4oQowiIJZuyEE34HNTET_v-tpE3mjnqxE-aYo1FZD2p5uL_vZun_J-nslAKp2qNO3m1oQW142ulpoB0WyVxMecmeUa-aOKHFZC5WaiiXMQM4fSLKXbZHMepEFdf15VYZxc Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07d01164358d4590b20329062498a698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07d01164358d4590b20329062498a698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ac2c5b97f8ca4163b94de75a6095987e Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '6dd5f7a6-41a4-4b47-93bb-2332bd719bc6'} Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:13.809921 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Returning 404 to user: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3385567a-fc71-4de1-a23c-562fb5c3b571 tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 404 len: 111 microversion: 2.20 time: 0.088657 Sep 01 05:26:13.814544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2993/6032] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 1 05:26:13 2022] DELETE /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:26:13.830074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:13.831374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] [instance: 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:13.838413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:13.848203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.849255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.850108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.851749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:13.853002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:13.854017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:13.881146 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] HTTP exception thrown: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Request method failure captured: Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 HTTP/1.1 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEnLZ4n_POHs79uXi0CWYb9RIiYM-_AWq0tCu6zN09_c4oQowiIJZuyEE34HNTET_v-tpE3mjnqxE-aYo1FZD2p5uL_vZun_J-nslAKp2qNO3m1oQW142ulpoB0WyVxMecmeUa-aOKHFZC5WaiiXMQM4fSLKXbZHMepEFdf15VYZxc Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07d01164358d4590b20329062498a698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07d01164358d4590b20329062498a698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07d01164358d4590b20329062498a698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 07d01164358d4590b20329062498a698 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-207028526 Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ac2c5b97f8ca4163b94de75a6095987e Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-207028526-project Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '6dd5f7a6-41a4-4b47-93bb-2332bd719bc6'} Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.884929 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. Sep 01 05:26:13.891265 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:13.892949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] Returning 404 to user: Instance 6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:13.894015 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-881614f1-eaa3-4a54-a4d6-45b3fc8e1eec tempest-AttachVolumeShelveTestJSON-207028526 tempest-AttachVolumeShelveTestJSON-207028526-project] 10.222.0.26 "GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6" status: 404 len: 111 microversion: 2.20 time: 0.072753 Sep 01 05:26:13.905136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3040/6033] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 1 05:26:13 2022] GET /compute/v2.1/servers/6dd5f7a6-41a4-4b47-93bb-2332bd719bc6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:26:14.223054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:14.224162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:14.252717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:14.253401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:14.254126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:14.255422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:14.255992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:14.257314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:14.567692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:14.570336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:14.595470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:14.600740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:14.601667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:14.607841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:14.609405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:14.610536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:14.753444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:14.780035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48cd094b-9565-46cd-a627-7863b4caf95f tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.563537 Sep 01 05:26:14.789152 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3041/6034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:14 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:14.798611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:14.808210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:14.836263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:14.844758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:14.845766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:14.847577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:14.848649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:14.849623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:15.047836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fc2ee69-4bfe-4e58-90fa-2f8094660efe tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1838 microversion: 2.1 time: 0.882214 Sep 01 05:26:15.063043 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2994/6035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:14 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1838 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:15.091518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2fdd24cf-22e2-4a2e-a879-853261e9d945 req-f92c484e-f5ef-47ce-a7e2-ed532277d23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9293e9-e676-4806-ae45-60189a28ddff", "name": "network-vif-plugged", "status": "completed", "tag": "359f5335-f728-4aae-907a-ca1c4c8e8cfa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:15.127598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2fdd24cf-22e2-4a2e-a879-853261e9d945 req-f92c484e-f5ef-47ce-a7e2-ed532277d23d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:15.128270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2fdd24cf-22e2-4a2e-a879-853261e9d945 req-f92c484e-f5ef-47ce-a7e2-ed532277d23d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:15.129018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2fdd24cf-22e2-4a2e-a879-853261e9d945 req-f92c484e-f5ef-47ce-a7e2-ed532277d23d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:15.156952 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2fdd24cf-22e2-4a2e-a879-853261e9d945 req-f92c484e-f5ef-47ce-a7e2-ed532277d23d service nova] Creating event network-vif-plugged:359f5335-f728-4aae-907a-ca1c4c8e8cfa for instance cb9293e9-e676-4806-ae45-60189a28ddff on n-h2-820368-37 Sep 01 05:26:15.165462 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2fdd24cf-22e2-4a2e-a879-853261e9d945 req-f92c484e-f5ef-47ce-a7e2-ed532277d23d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100075 Sep 01 05:26:15.169302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2995/6036] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:15.362384 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-93cfb5f9-557e-427f-94c4-1c6c075d1f21 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1465 microversion: 2.1 time: 0.570840 Sep 01 05:26:15.376897 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3042/6037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:14 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1465 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:15.811828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:15.812774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:15.819876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:15.820380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:15.821097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:15.822098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:15.822784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:15.823459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.139666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:16.151798 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ee9542e-a841-4e78-8391-1113d23e28ce tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.344906 Sep 01 05:26:16.165691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2996/6038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:15 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:16.387974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9936d8cb-4413-41ff-94f6-5e641aeb2184 req-5616f1ff-1fe3-4a15-902f-4769c9137450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:16.393298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:16.394191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:16.430334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.444691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.445596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.446932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.447743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.448410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.459487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9936d8cb-4413-41ff-94f6-5e641aeb2184 req-5616f1ff-1fe3-4a15-902f-4769c9137450 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.460357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9936d8cb-4413-41ff-94f6-5e641aeb2184 req-5616f1ff-1fe3-4a15-902f-4769c9137450 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.461125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9936d8cb-4413-41ff-94f6-5e641aeb2184 req-5616f1ff-1fe3-4a15-902f-4769c9137450 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.534165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9936d8cb-4413-41ff-94f6-5e641aeb2184 req-5616f1ff-1fe3-4a15-902f-4769c9137450 service nova] Creating event network-changed:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:26:16.557638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9936d8cb-4413-41ff-94f6-5e641aeb2184 req-5616f1ff-1fe3-4a15-902f-4769c9137450 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176376 Sep 01 05:26:16.565444 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2997/6039] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:16.574220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:26:16.587316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:16.588852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:16.625323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.626233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.627039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.639118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.642292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.648328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.730049 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87de64d9-1c42-4fb2-bc7a-f88920ef257f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 204 len: 0 microversion: 2.1 time: 0.356763 Sep 01 05:26:16.731223 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3043/6040] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:26:16 2022] DELETE /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:26:16.744907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:16.747426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:16.767289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.768387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.769809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:16.773628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:16.794491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:16.808101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:17.259602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9ae19e3-ecc7-43dc-a8bf-2ce5f18d8eef tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1465 microversion: 2.1 time: 0.688602 Sep 01 05:26:17.262252 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2998/6041] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:16 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1465 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:17.273279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:17.278819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:17.289285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:17.308306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:17.309192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:17.309928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:17.311626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:17.312394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:17.313032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:17.523611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:17.542849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f1ac873-2fa6-49bc-a587-6813a3550e0a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1691 microversion: 2.1 time: 0.805056 Sep 01 05:26:17.552662 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3044/6042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:16 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1691 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:17.698249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:17.709122 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3ac0eb6-f3f2-4048-857b-b958fa97e6cb tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.445225 Sep 01 05:26:17.710007 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2999/6043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:17 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:18.286172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:18.287746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:18.321882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:18.322976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:18.323941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:18.325377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:18.326234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:18.339969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:18.582023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:18.587738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:18.596810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:18.597454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:18.598165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:18.599387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:18.600097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:18.600600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:18.796938 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e0431c6-44bf-4ee5-820c-4b74fda429c3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1465 microversion: 2.1 time: 0.510920 Sep 01 05:26:18.796938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3045/6044] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:18 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1465 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:18.802555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:18.805355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:18.814495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:18.815245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:18.815477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:18.816201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:18.816883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:18.817543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:18.990706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:19.004095 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ed82afe-7a19-47a5-b26a-436251cc4438 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1572 microversion: 2.1 time: 0.431394 Sep 01 05:26:19.005961 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3000/6045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:18 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1572 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:19.220469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:19.237213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d612b4f-9d6b-4bb3-8a55-fda084dc8080 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1314 microversion: 2.1 time: 0.444193 Sep 01 05:26:19.238376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3046/6046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:18 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:19.479940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-86d9e83d-0057-4607-8855-b1d6b8a950ae req-2264dc65-0844-4ea6-9460-93cb2e719ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d501c465-220b-463d-b3a7-9a1e8ec9320f", "name": "network-vif-deleted", "tag": "309b21eb-50ff-40f0-921f-fc0ba42b6332"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:19.490529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86d9e83d-0057-4607-8855-b1d6b8a950ae req-2264dc65-0844-4ea6-9460-93cb2e719ed8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:19.491361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86d9e83d-0057-4607-8855-b1d6b8a950ae req-2264dc65-0844-4ea6-9460-93cb2e719ed8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:19.491961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86d9e83d-0057-4607-8855-b1d6b8a950ae req-2264dc65-0844-4ea6-9460-93cb2e719ed8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:19.516121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:19.523386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-86d9e83d-0057-4607-8855-b1d6b8a950ae req-2264dc65-0844-4ea6-9460-93cb2e719ed8 service nova] Creating event network-vif-deleted:309b21eb-50ff-40f0-921f-fc0ba42b6332 for instance d501c465-220b-463d-b3a7-9a1e8ec9320f on n-h1-820368-37 Sep 01 05:26:19.534936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:19.538657 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-86d9e83d-0057-4607-8855-b1d6b8a950ae req-2264dc65-0844-4ea6-9460-93cb2e719ed8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062698 Sep 01 05:26:19.540096 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3001/6047] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:19.818427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:19.819665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:19.831005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=10 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:19.870351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:19.871286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:19.871839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:19.872709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:19.874572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:19.875301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.040403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:20.042307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:20.048400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:20.049247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:20.049441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.050125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:20.055230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:20.056342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.115358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:20.116303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:20.117136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.117963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lazy-loading 'fault' on Instance uuid d501c465-220b-463d-b3a7-9a1e8ec9320f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:20.216156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:20.234610 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-32a9c457-81c4-488a-8458-737ff3447ba4 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1465 microversion: 2.1 time: 0.424383 Sep 01 05:26:20.235681 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3047/6048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:19 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1465 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:20.235862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90f8af1b-7696-4260-abed-d49294b4baae tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 200 len: 1357 microversion: 2.1 time: 0.204082 Sep 01 05:26:20.237026 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3002/6049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:20 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:20.280188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:20.282123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:20.293664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:20.295137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:20.295931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.297240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:20.298326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:20.299443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.567920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:20.577624 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4edaad99-e5cc-4e38-b2a8-beee2011fad8 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1497 microversion: 2.1 time: 0.304280 Sep 01 05:26:20.579164 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3048/6050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:20 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1497 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:20.814755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d15c523f-a89e-4560-accc-1e75771d37b6 req-4a0eac19-7958-4c68-b48b-72d1534c4305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4137366a-4b9b-4f44-a1a9-a3ef94ab9de0", "name": "network-vif-plugged", "status": "completed", "tag": "0243ac98-28fb-493b-b77e-3575ee1f7543"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:20.840834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d15c523f-a89e-4560-accc-1e75771d37b6 req-4a0eac19-7958-4c68-b48b-72d1534c4305 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:20.841551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d15c523f-a89e-4560-accc-1e75771d37b6 req-4a0eac19-7958-4c68-b48b-72d1534c4305 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:20.842281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d15c523f-a89e-4560-accc-1e75771d37b6 req-4a0eac19-7958-4c68-b48b-72d1534c4305 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:20.878500 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d15c523f-a89e-4560-accc-1e75771d37b6 req-4a0eac19-7958-4c68-b48b-72d1534c4305 service nova] Creating event network-vif-plugged:0243ac98-28fb-493b-b77e-3575ee1f7543 for instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 on n-h2-820368-37 Sep 01 05:26:20.890810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d15c523f-a89e-4560-accc-1e75771d37b6 req-4a0eac19-7958-4c68-b48b-72d1534c4305 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079679 Sep 01 05:26:20.894278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3003/6051] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:21.261041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:21.261902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:21.265751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:21.266999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: d501c465-220b-463d-b3a7-9a1e8ec9320f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:21.277620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:21.278147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:21.278599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:21.282038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:21.284171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:21.286171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:21.294083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:21.294777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:21.298077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:21.307608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:21.308621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:21.309546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:21.369399 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] HTTP exception thrown: Instance d501c465-220b-463d-b3a7-9a1e8ec9320f could not be found. Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Request method failure captured: Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f HTTP/1.1 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEE9O7r8QEDrOleCeqlZ6ESI-jZDqXltbxvuHTZjNuHvJdQhVT7qyY03LC9bbEpcPWHl9QecKhHmg4OrLOc-hc0FuosvhShpzEQG-iGLVHS8NoHnmvqGHIhlK1qs_TjvSmQMKcQoNXi2Pj19dLJyNixJ5nhww25BUQVR6IyOPxtKTYE Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a364e33225b4d809f8ed613574899ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 25d7775b3f5c493ea05d42d8c5dd8176 Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance d501c465-220b-463d-b3a7-9a1e8ec9320f could not be found. Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'd501c465-220b-463d-b3a7-9a1e8ec9320f'} Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d501c465-220b-463d-b3a7-9a1e8ec9320f could not be found. Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d501c465-220b-463d-b3a7-9a1e8ec9320f could not be found. Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:21.371949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d501c465-220b-463d-b3a7-9a1e8ec9320f could not be found. Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Returning 404 to user: Instance d501c465-220b-463d-b3a7-9a1e8ec9320f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3ba18f1-6abf-4942-9f2f-1647f654622f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f" status: 404 len: 111 microversion: 2.1 time: 0.115944 Sep 01 05:26:21.384607 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3004/6052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:21 2022] GET /compute/v2.1/servers/d501c465-220b-463d-b3a7-9a1e8ec9320f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:26:21.727807 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba4572ce-a5ba-49a2-b4af-d71e5416eaf3 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1465 microversion: 2.1 time: 0.474857 Sep 01 05:26:21.729256 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3049/6053] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:21 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1465 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:22.756052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:22.759563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:22.770288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:22.771168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:22.771901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:22.773047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:22.773677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:22.774435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:22.981103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-779356e5-a9d5-4a85-869c-f148c7deba41 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1649 microversion: 2.1 time: 0.232351 Sep 01 05:26:22.982472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3005/6054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:22 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1649 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:23.018160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:23.019255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:23.031268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.032082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.033028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.034025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.034944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.035444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.292602 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-441616c2-43f6-49b0-9d64-5385b553fb9a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1649 microversion: 2.1 time: 0.281357 Sep 01 05:26:23.293371 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3050/6055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:23 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1649 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:23.313569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:23.314515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:23.321465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.322262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.322914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.323648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.324224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.324650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.582289 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef294cf9-69ee-4973-9c1e-a0e27ed1b583 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1649 microversion: 2.1 time: 0.272421 Sep 01 05:26:23.596713 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3006/6056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:23 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1649 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:23.627269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:23.627537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:23.640342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:23.643731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.644744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.646065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.648635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.649511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.650333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.712530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:26:23.878461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6af70668-15c8-47f5-95a8-49e8697d19c7 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 204 len: 0 microversion: 2.1 time: 0.260697 Sep 01 05:26:23.879507 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3051/6057] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:26:23 2022] DELETE /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:26:23.894159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:23.896364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:23.904125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.905001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.905696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:23.906710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:23.907462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:23.908106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:24.093117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcb1c6e3-1515-4d77-8c71-4d5c17ecda65 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1655 microversion: 2.1 time: 0.209161 Sep 01 05:26:24.094504 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3007/6058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:23 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1655 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:24.520252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:24.525322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:24.549685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:24.550197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:24.550973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:24.552663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:24.553463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:24.554184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:24.615323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fa111f0-da68-4755-9923-c863a129e71b tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108835 Sep 01 05:26:24.619077 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3052/6059] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:26:24 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:24.627129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:24.627717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:24.639948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:24.640478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:24.641263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:24.642342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:24.642967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:24.643569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:24.714507 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abfc3383-f832-4320-bd52-62f28b3929b0 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/2487b6a4-482c-4370-92d4-d98235e98e3f" status: 200 len: 194 microversion: 2.1 time: 0.091540 Sep 01 05:26:24.721121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3008/6060] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Sep 1 05:26:24 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/2487b6a4-482c-4370-92d4-d98235e98e3f => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:25.121136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:25.121946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:25.134482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:25.139909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:25.141358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:25.143033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:25.145281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:25.146776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:25.208289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:25.209424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:25.230754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:25.231793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:25.233514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:25.236139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:25.236808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:25.237417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:25.313465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:26:25.327506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:25.506059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c620a346-ef51-441d-b115-30e633f385d2 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 204 len: 0 microversion: 2.1 time: 0.301927 Sep 01 05:26:25.510226 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3009/6061] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:26:25 2022] DELETE /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:26:25.528284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:25.529038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:25.544411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:25.544916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:25.545768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:25.546684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:25.547578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:25.548305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:25.751304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:25.755720 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88530d81-9c94-4bdd-8a4b-ccdafdad016a tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1655 microversion: 2.1 time: 0.638742 Sep 01 05:26:25.770739 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3053/6062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:25 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1655 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:25.964884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:25.979420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0246870-096e-452e-8504-abf252d9039d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1503 microversion: 2.1 time: 0.467591 Sep 01 05:26:25.986467 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3010/6063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:25 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1503 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:26.792972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:26.793600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:26.803558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:26.804344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:26.805213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:26.806114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:26.806744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:26.807209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:26.958537 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-736397f6-2d95-4905-891a-69cb4b13c7f5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1655 microversion: 2.1 time: 0.171092 Sep 01 05:26:26.959234 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3054/6064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:26 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1655 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:27.011819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:27.012957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:27.028977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:27.033107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:27.033939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:27.035322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:27.036888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:27.037704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:27.462389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-df1cc27b-0627-4aa4-aaa3-8cc185a7c1cd req-b3896d44-3c23-4c80-b940-273f9fd4ccf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4137366a-4b9b-4f44-a1a9-a3ef94ab9de0", "name": "network-vif-deleted", "tag": "0243ac98-28fb-493b-b77e-3575ee1f7543"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:27.478138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-df1cc27b-0627-4aa4-aaa3-8cc185a7c1cd req-b3896d44-3c23-4c80-b940-273f9fd4ccf7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:27.478622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-df1cc27b-0627-4aa4-aaa3-8cc185a7c1cd req-b3896d44-3c23-4c80-b940-273f9fd4ccf7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:27.479788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-df1cc27b-0627-4aa4-aaa3-8cc185a7c1cd req-b3896d44-3c23-4c80-b940-273f9fd4ccf7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:27.513443 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-df1cc27b-0627-4aa4-aaa3-8cc185a7c1cd req-b3896d44-3c23-4c80-b940-273f9fd4ccf7 service nova] Creating event network-vif-deleted:0243ac98-28fb-493b-b77e-3575ee1f7543 for instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 on n-h2-820368-37 Sep 01 05:26:27.522747 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-df1cc27b-0627-4aa4-aaa3-8cc185a7c1cd req-b3896d44-3c23-4c80-b940-273f9fd4ccf7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064117 Sep 01 05:26:27.523916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3055/6065] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:26:27.547809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70db7b65-3c78-4f7e-89e8-fa0d8d83d317 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '.version_select at 0x7fa75b9b4550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:27.606009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70db7b65-3c78-4f7e-89e8-fa0d8d83d317 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1330600555" status: 202 len: 0 microversion: 2.1 time: 0.079859 Sep 01 05:26:27.612756 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3056/6066] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 05:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1330600555 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:26:27.623324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12d81564-1dba-43aa-9a5a-128a0bbacba5"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:27.627116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:27.666242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:27.670277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:27.670728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:27.671519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:27.671982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:27.672404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:27.933313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:27.943996 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a39c4c83-42ee-4796-9adf-137ac2f5288d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1503 microversion: 2.1 time: 0.935929 Sep 01 05:26:27.945134 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3011/6067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:27 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1503 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:27.950534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8a9fa73-890c-4d2b-863c-310ca289fa3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: .version_select at 0x7fa75ac70e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-234332936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpUmIN05vc1tuHsRwmGaa0WM34m7R6D4BT8p3HAMElo/2rt/foUVehY6Bz9K7rXyZPqTL7j6EwKAfXc+b1uU8tR1zzCHc04Em3hLXGoAXKoo7KkFrj/aUva/mmXHOUofw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:27.968429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d8a9fa73-890c-4d2b-863c-310ca289fa3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:26:27.977510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d8a9fa73-890c-4d2b-863c-310ca289fa3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:26:28.009959 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8a9fa73-890c-4d2b-863c-310ca289fa3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.063545 Sep 01 05:26:28.011444 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3012/6068] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:26:27 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:28.017094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:28.018878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:28.026898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:28.027626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:28.028371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:28.029352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:28.030102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:28.031134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:28.090250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:28.090999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:28.091793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:28.092649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lazy-loading 'fault' on Instance uuid 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:28.198989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3108e2bf-f205-48b1-81ab-67eb8e44a8c5 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 200 len: 1455 microversion: 2.1 time: 0.185930 Sep 01 05:26:28.201455 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3013/6069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:28 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:28.355035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16878796-5079-46d6-bd9f-b42c5c297a18 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "POST /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739806 Sep 01 05:26:28.356659 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3057/6070] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:26:27 2022] POST /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:28.409043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ce3f08b3-2b51-4731-a0b2-ff093d5848d3 req-045e5be1-e9bb-4aae-87cc-0c7b57c27ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9293e9-e676-4806-ae45-60189a28ddff", "name": "network-vif-deleted", "tag": "359f5335-f728-4aae-907a-ca1c4c8e8cfa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:28.421526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ce3f08b3-2b51-4731-a0b2-ff093d5848d3 req-045e5be1-e9bb-4aae-87cc-0c7b57c27ba6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:28.422473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ce3f08b3-2b51-4731-a0b2-ff093d5848d3 req-045e5be1-e9bb-4aae-87cc-0c7b57c27ba6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:28.423385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ce3f08b3-2b51-4731-a0b2-ff093d5848d3 req-045e5be1-e9bb-4aae-87cc-0c7b57c27ba6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:28.439634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ce3f08b3-2b51-4731-a0b2-ff093d5848d3 req-045e5be1-e9bb-4aae-87cc-0c7b57c27ba6 service nova] Creating event network-vif-deleted:359f5335-f728-4aae-907a-ca1c4c8e8cfa for instance cb9293e9-e676-4806-ae45-60189a28ddff on n-h2-820368-37 Sep 01 05:26:28.446329 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ce3f08b3-2b51-4731-a0b2-ff093d5848d3 req-045e5be1-e9bb-4aae-87cc-0c7b57c27ba6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041761 Sep 01 05:26:28.447147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3014/6071] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:28.967201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:28.967899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:28.981969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:28.982465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:28.982912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:28.984056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:28.984210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:28.984508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.028780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.029267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.029692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.030139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lazy-loading 'fault' on Instance uuid cb9293e9-e676-4806-ae45-60189a28ddff {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:29.116675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736427abad2a41a69ddb78020900bf4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafb3f7bed3942edbd1ae8fcd778e03b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:29.128755 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-47699220-9a34-42e1-9152-4278b0a91cb9 tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 200 len: 1304 microversion: 2.1 time: 0.166215 Sep 01 05:26:29.143832 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3058/6072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:28 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:29.231211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:29.233840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:29.249772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.251015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.252068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.254119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.255300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.256314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.286150 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] HTTP exception thrown: Instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 could not be found. Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Request method failure captured: Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 HTTP/1.1 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEJjaxMagcqlsDnzHfaRD-rhbnOXSKsBst8acZzCQTGJLE6pyRdYKUBvvSt1An5nlNqfSgrQxcLBtzu6xr3ufNYuYtSUTcbWyZjwZVMiapg9fR00CeNAojx90bc015RdEEsQgxpTL09ixso1FQ1E40UNitEDiF7Qf-86hSwpbcY8Ews Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 1ea7a3a4125748bcaf2f02b4fe9db57a Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestServerMultinode-1824780645 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestServerMultinode-1824780645 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 1ea7a3a4125748bcaf2f02b4fe9db57a Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestServerMultinode-1824780645 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestServerMultinode-1824780645-project-admin Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ffb0a12f88af4facb901ccd2779d54a6 Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestServerMultinode-1824780645-project-admin Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 could not be found. Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4137366a-4b9b-4f44-a1a9-a3ef94ab9de0'} Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 could not be found. Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 could not be found. Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:29.289645 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 could not be found. Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:26:29.297203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Returning 404 to user: Instance 4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:29.297952 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b072d5f-96a4-47c4-924d-3e2fa4b2fdb1 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0" status: 404 len: 111 microversion: 2.1 time: 0.076554 Sep 01 05:26:29.298926 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3015/6073] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:29 2022] GET /compute/v2.1/servers/4137366a-4b9b-4f44-a1a9-a3ef94ab9de0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:26:29.311822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:29.315792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:29.324724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.324958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.325335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.326541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.327040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.327475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.367289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:26:29.524853 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dae388e0-192e-470d-baf9-5a08f6408e68 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 204 len: 0 microversion: 2.1 time: 0.214517 Sep 01 05:26:29.524853 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3059/6074] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:26:29 2022] DELETE /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:26:29.532471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:29.533065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:29.543936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.544739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.545335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:29.546548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:29.547216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:29.547845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:30.126982 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58646761-7cb9-4a1a-be72-7d927e1b2996 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1656 microversion: 2.1 time: 0.598293 Sep 01 05:26:30.128158 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3016/6075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:29 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1656 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:30.159275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:30.160263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] [instance: cb9293e9-e676-4806-ae45-60189a28ddff] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:30.169075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:30.169822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:30.170426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:30.171639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:30.175864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:30.177180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:30.196035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] HTTP exception thrown: Instance cb9293e9-e676-4806-ae45-60189a28ddff could not be found. Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Request method failure captured: Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff HTTP/1.1 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEJpHJ4jQd-5-caEWdhTosj7i0QXyAKveLDl-_opkBeYxslWouLLkZLY_HjTo9R3kZLeU4GjfLdPGydxV1BwF4_Wg4c2eAFOZ0v52iXeFRC8hKbSyA_BEWgr2U9V1KLgvdIizUxmgfZ8siT78LJ2NzABiSBMKANBunDZr2lnbJ5nGK8 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: dafb3f7bed3942edbd1ae8fcd778e03b Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesActionsTest-1220961030 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dafb3f7bed3942edbd1ae8fcd778e03b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dafb3f7bed3942edbd1ae8fcd778e03b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dafb3f7bed3942edbd1ae8fcd778e03b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dafb3f7bed3942edbd1ae8fcd778e03b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesActionsTest-1220961030 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: dafb3f7bed3942edbd1ae8fcd778e03b Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesActionsTest-1220961030 Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesActionsTest-1220961030-project Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 736427abad2a41a69ddb78020900bf4d Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesActionsTest-1220961030-project Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance cb9293e9-e676-4806-ae45-60189a28ddff could not be found. Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'cb9293e9-e676-4806-ae45-60189a28ddff'} Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb9293e9-e676-4806-ae45-60189a28ddff could not be found. Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb9293e9-e676-4806-ae45-60189a28ddff could not be found. Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:30.197955 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb9293e9-e676-4806-ae45-60189a28ddff could not be found. Sep 01 05:26:30.203333 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:30.204889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] Returning 404 to user: Instance cb9293e9-e676-4806-ae45-60189a28ddff could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:30.206388 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e38084bf-d471-4920-89b2-1f09de08157d tempest-VolumesActionsTest-1220961030 tempest-VolumesActionsTest-1220961030-project] 10.222.0.26 "GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff" status: 404 len: 111 microversion: 2.1 time: 0.055666 Sep 01 05:26:30.210846 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3060/6076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:30 2022] GET /compute/v2.1/servers/cb9293e9-e676-4806-ae45-60189a28ddff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:26:31.148420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:31.149298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:31.159249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:31.160451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:31.163494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:31.164557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:31.165517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:31.166338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:31.483068 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b517180d-dd45-4e78-a1cc-a784ac9d1aa9 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1656 microversion: 2.1 time: 0.338050 Sep 01 05:26:31.484025 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3017/6077] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:31 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1656 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:32.033670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-70b529a6-96d8-4338-8dd7-2db768fb5533 req-4311c33c-d449-419c-842b-1bb68a54e55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1323555-b368-4fbf-a951-ea17e939117a", "name": "network-vif-deleted", "tag": "5d30691a-3d98-4c08-bde7-11ba54471ee1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:32.066459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-70b529a6-96d8-4338-8dd7-2db768fb5533 req-4311c33c-d449-419c-842b-1bb68a54e55d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:32.068448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-70b529a6-96d8-4338-8dd7-2db768fb5533 req-4311c33c-d449-419c-842b-1bb68a54e55d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:32.068948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-70b529a6-96d8-4338-8dd7-2db768fb5533 req-4311c33c-d449-419c-842b-1bb68a54e55d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:32.083576 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-70b529a6-96d8-4338-8dd7-2db768fb5533 req-4311c33c-d449-419c-842b-1bb68a54e55d service nova] Creating event network-vif-deleted:5d30691a-3d98-4c08-bde7-11ba54471ee1 for instance a1323555-b368-4fbf-a951-ea17e939117a on n-h1-820368-37 Sep 01 05:26:32.091193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-70b529a6-96d8-4338-8dd7-2db768fb5533 req-4311c33c-d449-419c-842b-1bb68a54e55d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061543 Sep 01 05:26:32.092134 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3061/6078] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:32.508121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:32.511956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:32.523388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:32.524367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:32.525110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:32.526811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:32.528305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:32.528816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:32.574428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:32.575965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:32.576763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:32.578144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lazy-loading 'fault' on Instance uuid a1323555-b368-4fbf-a951-ea17e939117a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:32.687196 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0b9f543-cb35-473c-9217-589dab9980cc tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 200 len: 1456 microversion: 2.1 time: 0.184649 Sep 01 05:26:32.697232 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3018/6079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:32 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 1456 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:33.712046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:33.712632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] [instance: a1323555-b368-4fbf-a951-ea17e939117a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:33.731482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:33.732092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:33.732535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:33.733283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:33.733734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:33.734152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:33.774693 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] HTTP exception thrown: Instance a1323555-b368-4fbf-a951-ea17e939117a could not be found. Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Request method failure captured: Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a HTTP/1.1 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEJjaxMagcqlsDnzHfaRD-rhbnOXSKsBst8acZzCQTGJLE6pyRdYKUBvvSt1An5nlNqfSgrQxcLBtzu6xr3ufNYuYtSUTcbWyZjwZVMiapg9fR00CeNAojx90bc015RdEEsQgxpTL09ixso1FQ1E40UNitEDiF7Qf-86hSwpbcY8Ews Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 1ea7a3a4125748bcaf2f02b4fe9db57a Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestServerMultinode-1824780645 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1ea7a3a4125748bcaf2f02b4fe9db57a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestServerMultinode-1824780645 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 1ea7a3a4125748bcaf2f02b4fe9db57a Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestServerMultinode-1824780645 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestServerMultinode-1824780645-project-admin Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ffb0a12f88af4facb901ccd2779d54a6 Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestServerMultinode-1824780645-project-admin Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a1323555-b368-4fbf-a951-ea17e939117a could not be found. Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a1323555-b368-4fbf-a951-ea17e939117a'} Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1323555-b368-4fbf-a951-ea17e939117a could not be found. Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1323555-b368-4fbf-a951-ea17e939117a could not be found. Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:26:33.793513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1323555-b368-4fbf-a951-ea17e939117a could not be found. Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] Returning 404 to user: Instance a1323555-b368-4fbf-a951-ea17e939117a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:26:33.799331 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-38adf1b4-bb27-4739-8826-bbc6979491b2 tempest-TestServerMultinode-1824780645 tempest-TestServerMultinode-1824780645-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a" status: 404 len: 111 microversion: 2.1 time: 0.088840 Sep 01 05:26:33.807038 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3062/6080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:33 2022] GET /compute/v2.1/servers/a1323555-b368-4fbf-a951-ea17e939117a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:26:40.930851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-840769999", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "21248b18-ad52-489e-9804-ff464eae2055"}], "key_name": "tempest-TestNetworkAdvancedServerOps-234332936", "security_groups": [{"name": "tempest-secgroup-smoke-1970583092"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:40.964348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:41.280324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] validate_networks() for [('21248b18-ad52-489e-9804-ff464eae2055', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:26:42.183509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:26:42.184209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:26:42.184675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:26:42.185366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:26:42.185984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:26:42.207644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.209220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.209841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.211363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.212497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.215392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.275548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:26:42.291148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:26:42.324165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:42.326680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:42.354214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.354214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.354214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.358829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.359052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.359503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:26:42.363074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.365668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:26:42.460279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb33b346-fa3b-48d0-bc7a-8234695ea83c tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.140081 Sep 01 05:26:42.462800 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3063/6081] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:26:42 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:42.482638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-622d2ac8-00e4-4e19-bd57-18d289f4981b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.555530 Sep 01 05:26:42.486312 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3019/6082] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:26:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:26:42.513054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c621327-60c1-4657-8a86-2356f311b7eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:42.513763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c621327-60c1-4657-8a86-2356f311b7eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:42.606384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:42.606878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:42.631038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.632203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.632732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.633534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.634541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.635347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.696044 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63a573a9-9cbf-4d0e-99c8-d92274dfdc23 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/2487b6a4-482c-4370-92d4-d98235e98e3f" status: 200 len: 194 microversion: 2.1 time: 0.094120 Sep 01 05:26:42.703404 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3020/6083] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Sep 1 05:26:42 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/2487b6a4-482c-4370-92d4-d98235e98e3f => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:26:42.708191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:42.708700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:42.720213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.720712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.721147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.721853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:42.722304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:42.722724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:42.823278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c621327-60c1-4657-8a86-2356f311b7eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:42.849132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c621327-60c1-4657-8a86-2356f311b7eb tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1265 microversion: 2.1 time: 0.343971 Sep 01 05:26:42.855285 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3064/6084] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:42 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:42.893384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lazy-loading 'services' on Instance uuid 9498fe9c-4501-47f8-8d4e-79651ca78263 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:43.064717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-493ac0e2-810f-4fe8-852c-c61165dd7b59 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/2487b6a4-482c-4370-92d4-d98235e98e3f" status: 202 len: 0 microversion: 2.1 time: 0.360857 Sep 01 05:26:43.066155 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3021/6085] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:26:42 2022] DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/2487b6a4-482c-4370-92d4-d98235e98e3f => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:26:43.873599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:43.874388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:43.904841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:43.906027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:43.910327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:43.912614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:43.913472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:43.913919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:44.040988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:44.064808 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7631bd9-5dce-42a3-ae81-48d22baf3286 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1317 microversion: 2.1 time: 0.195815 Sep 01 05:26:44.066262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3065/6086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:43 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:45.089214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:45.091337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:45.106466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:45.107862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:45.113828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:45.141053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:45.142433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:45.143729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:45.510564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:45.527919 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af81a648-848d-451a-8e96-1ceccd2247f2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1323 microversion: 2.1 time: 0.443420 Sep 01 05:26:45.545596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3022/6087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:45 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1323 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:46.564401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:46.566000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:46.584072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:46.584571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:46.585047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:46.585743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:46.586203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:46.586689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:46.854813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:46.881822 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-802356ab-d3b6-4da4-b854-e7111532cd43 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1323 microversion: 2.1 time: 0.322379 Sep 01 05:26:46.882848 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3066/6088] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:46 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:47.903195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:47.904695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:47.908238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:47.925503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:47.928391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:47.929744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:47.932822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:47.936167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:47.937114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:49.155252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:49.183554 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67449183-d2aa-4a3a-9ab4-5f035192debe tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 1.283974 Sep 01 05:26:49.185092 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3023/6089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:47 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:26:49.773317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aa194477-690f-4617-994a-8fc1c6b5ec73 req-797b5d9f-4ed2-4122-a198-d3b3307bfdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:49.806245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa194477-690f-4617-994a-8fc1c6b5ec73 req-797b5d9f-4ed2-4122-a198-d3b3307bfdf7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:49.818469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa194477-690f-4617-994a-8fc1c6b5ec73 req-797b5d9f-4ed2-4122-a198-d3b3307bfdf7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:49.819256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aa194477-690f-4617-994a-8fc1c6b5ec73 req-797b5d9f-4ed2-4122-a198-d3b3307bfdf7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:49.835094 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aa194477-690f-4617-994a-8fc1c6b5ec73 req-797b5d9f-4ed2-4122-a198-d3b3307bfdf7 service nova] Creating event network-changed:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h2-820368-37 Sep 01 05:26:49.844367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aa194477-690f-4617-994a-8fc1c6b5ec73 req-797b5d9f-4ed2-4122-a198-d3b3307bfdf7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083841 Sep 01 05:26:49.846501 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3067/6090] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:50.232657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:50.237039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:50.274931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:50.276926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:50.278385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:50.280046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:50.281973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:50.282606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:50.819431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:50.836622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee95c683-06d9-4b61-9f70-025b34eb3f3b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.614335 Sep 01 05:26:50.840940 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3024/6091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:50 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:51.865785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:51.867046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:51.883757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:51.885945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:51.886606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:51.896274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:51.896765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:51.897213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:52.230816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:52.252363 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a94bba3-2b10-46d1-9173-0e84317d14d9 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.393780 Sep 01 05:26:52.254938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3068/6092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:51 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:53.282125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:53.282744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:53.286420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:53.289046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:53.298745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:53.302054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:53.303287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:53.304925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:53.306664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:53.307722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:53.490133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:53.490942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:53.506770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:53.522522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:53.523958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:53.524911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:53.527474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:53.530302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:53.531068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:53.607018 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5146fffa-e1a0-4793-9214-672b186939f5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/12d81564-1dba-43aa-9a5a-128a0bbacba5" status: 200 len: 194 microversion: 2.1 time: 0.122827 Sep 01 05:26:53.607687 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3069/6093] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Sep 1 05:26:53 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/12d81564-1dba-43aa-9a5a-128a0bbacba5 => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:53.622700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:53.631654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:53.641062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:53.642310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:53.643214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:53.644287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:53.645427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:53.647489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:53.794698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lazy-loading 'services' on Instance uuid 9498fe9c-4501-47f8-8d4e-79651ca78263 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:26:53.985143 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-328555f2-4fb3-413a-8b64-1e3db96eb3af tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/12d81564-1dba-43aa-9a5a-128a0bbacba5" status: 202 len: 0 microversion: 2.1 time: 0.366365 Sep 01 05:26:53.990041 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3070/6094] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:26:53 2022] DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments/12d81564-1dba-43aa-9a5a-128a0bbacba5 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:26:54.138116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:54.160100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-938f1bcd-08b7-4121-9b91-e7b670c84b15 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.884138 Sep 01 05:26:54.178179 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3025/6095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:53 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:55.198401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:55.199980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:55.202787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:55.210443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:55.211114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:55.211812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:55.212626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:55.213292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:55.213964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:55.420138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:55.424237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:55.434903 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b596c89b-3be6-4878-a3e5-e11a999ed7c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.247475 Sep 01 05:26:55.435521 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3071/6096] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:55 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:56.457452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:56.458088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:56.472038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:56.473222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:56.474337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:56.475249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:56.475851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:56.476409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:56.481053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:26:56.663639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:56.673192 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba995903-0599-45ee-a74f-add83727947a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.220082 Sep 01 05:26:56.685210 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3026/6097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:56 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:57.696843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:57.698611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:57.709739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:57.722309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:57.731230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:57.732333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:57.733220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:57.733844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:57.970803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:57.986191 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-926b93d9-f6e8-4903-b406-c46d07725d49 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.294134 Sep 01 05:26:57.987516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3072/6098] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:57 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:26:58.834344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-67f1994d-3626-45d7-bbcb-5d83506acc49 req-e35eb003-968a-419b-bc73-55a85499b153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "name": "network-vif-plugged", "status": "completed", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:26:58.856705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-67f1994d-3626-45d7-bbcb-5d83506acc49 req-e35eb003-968a-419b-bc73-55a85499b153 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:58.857195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-67f1994d-3626-45d7-bbcb-5d83506acc49 req-e35eb003-968a-419b-bc73-55a85499b153 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:58.857633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-67f1994d-3626-45d7-bbcb-5d83506acc49 req-e35eb003-968a-419b-bc73-55a85499b153 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.009199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:26:59.009826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:26:59.045592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:59.046099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:59.046606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.047613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:26:59.053212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:26:59.053902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:26:59.181697 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-67f1994d-3626-45d7-bbcb-5d83506acc49 req-e35eb003-968a-419b-bc73-55a85499b153 service nova] Creating event network-vif-plugged:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h2-820368-37 Sep 01 05:26:59.187452 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-67f1994d-3626-45d7-bbcb-5d83506acc49 req-e35eb003-968a-419b-bc73-55a85499b153 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357686 Sep 01 05:26:59.188676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3027/6099] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:26:59.348789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:26:59.359600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4524d18e-b0b9-437a-bcd7-9024aef103e0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.354465 Sep 01 05:26:59.360958 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3073/6100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:26:59 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:00.384044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:00.384987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:00.400200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:00.400625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:00.401222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:00.401809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:00.403231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:00.403669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:00.588772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:00.599195 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e125b087-b31b-4597-876c-cba806d5ba1e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1391 microversion: 2.1 time: 0.220313 Sep 01 05:27:00.600308 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3028/6101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:00 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:00.716535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:00.719233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:00.730952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:00.731422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:00.731855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:00.734521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:00.739321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:00.739952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:00.795988 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-feb0e669-0509-47cc-b314-4c7fa2da4b73 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083821 Sep 01 05:27:00.797656 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3074/6102] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:27:00 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:27:00.955107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:00.957368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:00.964223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:00.964984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:00.965563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:00.966425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:00.966997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:00.967342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:00.999800 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1783013-45dd-4aea-ac65-8bde05b72348 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049278 Sep 01 05:27:01.029445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3029/6103] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:27:00 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:27:01.086943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:01.087448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:01.094013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.094730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.095376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.096394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.096983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.097540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.131365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:27:01.245419 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29ffef6b-020d-4a0b-a79f-474a15ca3557 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 204 len: 0 microversion: 2.1 time: 0.161929 Sep 01 05:27:01.255979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:01.258855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:01.263724 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3075/6104] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:27:01 2022] DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:27:01.270497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.272158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.272636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.274283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.274718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.275391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.504763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:01.516025 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0245d25-cefa-4283-a420-92eaa46f8b76 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1670 microversion: 2.1 time: 0.265201 Sep 01 05:27:01.516623 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3030/6105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:01 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:01.621596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:01.622359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:01.628856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.629431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.630059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.630789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.631950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.632381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.782624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:01.792705 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd307145-e6ba-40dd-b94a-85ffdaa67b06 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1562 microversion: 2.1 time: 0.175381 Sep 01 05:27:01.793409 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3076/6106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:01 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:01.814939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:01.815544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:01.822193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.822767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.823254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.824120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:01.824675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:01.825104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:01.993333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:02.005837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee72654e-3e74-48e1-a131-d14ddc9623c5 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1562 microversion: 2.1 time: 0.194374 Sep 01 05:27:02.006820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3031/6107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:01 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:02.541526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:02.541526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:02.559073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:02.561570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:02.562169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:02.563511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:02.567297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:02.568626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:02.918476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:02.927168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f9d9c63-3e99-44b4-8f72-592eff7d6eb7 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1670 microversion: 2.1 time: 0.393194 Sep 01 05:27:02.927774 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3077/6108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:02 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:03.951618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:03.952341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:03.959245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:03.960100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:03.960790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:03.961731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:03.962398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:03.963063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:04.407298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:04.417258 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43e45411-b760-414d-a317-20c0002dfddc tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1670 microversion: 2.1 time: 0.470522 Sep 01 05:27:04.423718 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3032/6109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:03 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1670 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:05.339411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-42f9aa0e-1fcc-4cc9-8a22-565e99862102 req-53d06c94-41eb-4ed2-9b61-737a8896bfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9498fe9c-4501-47f8-8d4e-79651ca78263", "name": "network-vif-deleted", "tag": "94738a4a-8ce4-4a80-80eb-e05a156af26d"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:27:05.364471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-42f9aa0e-1fcc-4cc9-8a22-565e99862102 req-53d06c94-41eb-4ed2-9b61-737a8896bfb2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:05.365654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-42f9aa0e-1fcc-4cc9-8a22-565e99862102 req-53d06c94-41eb-4ed2-9b61-737a8896bfb2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:05.368904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-42f9aa0e-1fcc-4cc9-8a22-565e99862102 req-53d06c94-41eb-4ed2-9b61-737a8896bfb2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:05.412576 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-42f9aa0e-1fcc-4cc9-8a22-565e99862102 req-53d06c94-41eb-4ed2-9b61-737a8896bfb2 service nova] Creating event network-vif-deleted:94738a4a-8ce4-4a80-80eb-e05a156af26d for instance 9498fe9c-4501-47f8-8d4e-79651ca78263 on n-h1-820368-37 Sep 01 05:27:05.427898 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-42f9aa0e-1fcc-4cc9-8a22-565e99862102 req-53d06c94-41eb-4ed2-9b61-737a8896bfb2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114057 Sep 01 05:27:05.428589 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3078/6110] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:05.446510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:05.447830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:05.463801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:05.464320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:05.471330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:05.472942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:05.474902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:05.477197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:05.593507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:05.603620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:05.604696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:05.606860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lazy-loading 'fault' on Instance uuid 9498fe9c-4501-47f8-8d4e-79651ca78263 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:27:05.679565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd890dfc9e743388863785f3ce4b266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effcb18d84544e18b42c5c4df340e298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:05.690525 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83fca60c-3d62-4e22-85f9-9f5fe99d84b5 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 200 len: 1326 microversion: 2.1 time: 0.248576 Sep 01 05:27:05.696144 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3033/6111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:05 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 1326 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:05.936705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:05.937853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:05.945743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:05.946659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:05.947574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:05.948560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:05.949362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:05.950141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:06.245543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:27:06.265752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83020572-cd87-4918-ac4a-3f11bd96d8f3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1562 microversion: 2.1 time: 0.335355 Sep 01 05:27:06.281261 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3079/6112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:05 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1562 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:06.718934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:06.719623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:06.768395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:06.768897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:06.769340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:06.770363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:06.771076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:06.771520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:06.816958 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] HTTP exception thrown: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Request method failure captured: Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 HTTP/1.1 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEEEPL1Hy9xZBUYHEs-YH1BgsUPCCv1g6DegXrGbd9zb8NWzbvghN6r743djwGPUcH9VlThWQfvaR5LH05nVRZjOQ-WlMmh-Dv3W-CXZ7OEI_gKtD6GWzC0bXIlXIK6MFStiGFR6-FJJ3yJAqvC_Clefb1yARggylCD1xmg3qfyD1kQ Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_effcb18d84544e18b42c5c4df340e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 8dd890dfc9e743388863785f3ce4b266 Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9498fe9c-4501-47f8-8d4e-79651ca78263'} Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:06.822857 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Returning 404 to user: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f9199d3-4f0a-4eb2-bec4-b92b8ee7a6a3 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 404 len: 111 microversion: 2.1 time: 0.110012 Sep 01 05:27:06.833431 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3034/6113] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:06 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:06.840589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd0f0ec9-97aa-414b-be5c-e551bb9ab7e8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '.version_select at 0x7fa75bc41820>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:06.900978 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd0f0ec9-97aa-414b-be5c-e551bb9ab7e8 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337838872" status: 202 len: 0 microversion: 2.1 time: 0.069012 Sep 01 05:27:06.908616 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3080/6114] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 1 05:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337838872 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:27:07.513974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-12953960-0f79-442c-a086-c5c92323e15b req-8da8c0a9-871a-493a-9ef1-dd2ce4aee517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:27:07.540221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12953960-0f79-442c-a086-c5c92323e15b req-8da8c0a9-871a-493a-9ef1-dd2ce4aee517 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:07.541249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12953960-0f79-442c-a086-c5c92323e15b req-8da8c0a9-871a-493a-9ef1-dd2ce4aee517 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:07.542103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12953960-0f79-442c-a086-c5c92323e15b req-8da8c0a9-871a-493a-9ef1-dd2ce4aee517 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:07.574813 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-12953960-0f79-442c-a086-c5c92323e15b req-8da8c0a9-871a-493a-9ef1-dd2ce4aee517 service nova] Creating event network-changed:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h2-820368-37 Sep 01 05:27:07.582822 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-12953960-0f79-442c-a086-c5c92323e15b req-8da8c0a9-871a-493a-9ef1-dd2ce4aee517 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078175 Sep 01 05:27:07.587606 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3035/6115] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:27:17.809115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:17.811031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:17.819075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:17.819936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:17.834872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:17.836355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:17.837119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:17.839010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:17.839818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:17.840851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:17.870123 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] HTTP exception thrown: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Request method failure captured: Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 HTTP/1.1 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEEPL1Hy9xZBUYHEs-YH1BgsUPCCv1g6DegXrGbd9zb8NWzbvghN6r743djwGPUcH9VlThWQfvaR5LH05nVRZjOQ-WlMmh-Dv3W-CXZ7OEI_gKtD6GWzC0bXIlXIK6MFStiGFR6-FJJ3yJAqvC_Clefb1yARggylCD1xmg3qfyD1kQ Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_effcb18d84544e18b42c5c4df340e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 8dd890dfc9e743388863785f3ce4b266 Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9498fe9c-4501-47f8-8d4e-79651ca78263'} Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:27:17.871968 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Returning 404 to user: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f2f5f78-822d-4b6e-ae84-434b0e6aaf85 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 404 len: 111 microversion: 2.1 time: 0.068459 Sep 01 05:27:17.878479 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3081/6116] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:27:17 2022] DELETE /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:17.892033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:17.893512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9498fe9c-4501-47f8-8d4e-79651ca78263] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:17.899746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=27 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:17.901002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=49 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:17.914998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:17.915915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:17.916714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:17.918038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:17.918932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:17.919985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:17.951766 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] HTTP exception thrown: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Request method failure captured: Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 HTTP/1.1 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEEEPL1Hy9xZBUYHEs-YH1BgsUPCCv1g6DegXrGbd9zb8NWzbvghN6r743djwGPUcH9VlThWQfvaR5LH05nVRZjOQ-WlMmh-Dv3W-CXZ7OEI_gKtD6GWzC0bXIlXIK6MFStiGFR6-FJJ3yJAqvC_Clefb1yARggylCD1xmg3qfyD1kQ Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_effcb18d84544e18b42c5c4df340e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 8dd890dfc9e743388863785f3ce4b266 Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9498fe9c-4501-47f8-8d4e-79651ca78263'} Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:17.956586 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. Sep 01 05:27:17.965146 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:17.968286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Returning 404 to user: Instance 9498fe9c-4501-47f8-8d4e-79651ca78263 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:17.969615 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0868ba9c-36ce-4c80-9c6a-8f5c1f5b3284 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263" status: 404 len: 111 microversion: 2.1 time: 0.085653 Sep 01 05:27:17.974339 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3036/6117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:17 2022] GET /compute/v2.1/servers/9498fe9c-4501-47f8-8d4e-79651ca78263 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:22.700626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:22.702321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:22.730293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:22.731676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:22.732781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:22.744965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:22.748168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:22.752130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:22.855982 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] HTTP exception thrown: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Request method failure captured: Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d HTTP/1.1 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEEEPL1Hy9xZBUYHEs-YH1BgsUPCCv1g6DegXrGbd9zb8NWzbvghN6r743djwGPUcH9VlThWQfvaR5LH05nVRZjOQ-WlMmh-Dv3W-CXZ7OEI_gKtD6GWzC0bXIlXIK6MFStiGFR6-FJJ3yJAqvC_Clefb1yARggylCD1xmg3qfyD1kQ Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_effcb18d84544e18b42c5c4df340e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 8dd890dfc9e743388863785f3ce4b266 Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9a706f82-fb41-4b07-aab0-8308a90e077d'} Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:27:22.870076 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.873984 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.875799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Returning 404 to user: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:22.876687 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e731bc7d-5f7d-4d5d-ab42-41157dd0a051 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 404 len: 111 microversion: 2.1 time: 0.195548 Sep 01 05:27:22.877331 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3082/6118] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:27:22 2022] DELETE /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:22.891352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:22.892367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] [instance: 9a706f82-fb41-4b07-aab0-8308a90e077d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:22.921579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:22.922071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:22.924289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:22.925339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:22.926057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:22.926978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:22.945631 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] HTTP exception thrown: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Request method failure captured: Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d HTTP/1.1 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEEEPL1Hy9xZBUYHEs-YH1BgsUPCCv1g6DegXrGbd9zb8NWzbvghN6r743djwGPUcH9VlThWQfvaR5LH05nVRZjOQ-WlMmh-Dv3W-CXZ7OEI_gKtD6GWzC0bXIlXIK6MFStiGFR6-FJJ3yJAqvC_Clefb1yARggylCD1xmg3qfyD1kQ Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_effcb18d84544e18b42c5c4df340e298"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/effcb18d84544e18b42c5c4df340e298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: effcb18d84544e18b42c5c4df340e298 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-219630610 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 8dd890dfc9e743388863785f3ce4b266 Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeTestJSON-219630610-project Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9a706f82-fb41-4b07-aab0-8308a90e077d'} Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:22.947282 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] Returning 404 to user: Instance 9a706f82-fb41-4b07-aab0-8308a90e077d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e96ce44c-6189-494f-94a5-6903386d9391 tempest-AttachVolumeTestJSON-219630610 tempest-AttachVolumeTestJSON-219630610-project] 10.222.0.26 "GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d" status: 404 len: 111 microversion: 2.1 time: 0.066508 Sep 01 05:27:22.954949 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3037/6119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:27:22 2022] GET /compute/v2.1/servers/9a706f82-fb41-4b07-aab0-8308a90e077d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:31.633986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f10b05f6-5caa-4570-aab7-88ebfdd6f523 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Action: 'create', calling method: .version_select at 0x7fa75b9b4f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-58799159"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:27:31.996344 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f10b05f6-5caa-4570-aab7-88ebfdd6f523 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.522153 Sep 01 05:27:31.997379 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3083/6120] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Sep 1 05:27:31 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 524 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:27:32.014725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63b9eefc-8420-480a-b847-4a550ab080af tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b09d1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:32.115211 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63b9eefc-8420-480a-b847-4a550ab080af tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 200 len: 343 microversion: 2.1 time: 0.105337 Sep 01 05:27:32.115796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3038/6121] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:32 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 343 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:33.132189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:33.133693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:33.138445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1ff2c25-29b2-4638-aac3-b230dbc8534e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75bbbb790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:33.194122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1ff2c25-29b2-4638-aac3-b230dbc8534e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 200 len: 343 microversion: 2.1 time: 0.068533 Sep 01 05:27:33.195950 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3084/6122] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:33 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:27:34.206389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:34.208856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:34.218679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fef85888-9e34-42cd-898e-9ae3fef99a29 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75bf39e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:34.295757 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fef85888-9e34-42cd-898e-9ae3fef99a29 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 200 len: 344 microversion: 2.1 time: 0.090096 Sep 01 05:27:34.304593 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3039/6123] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:34 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:34.314652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9eabf6ef-b63b-4c16-9fe5-856370d6e952 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Action: 'create', calling method: .version_select at 0x7fa75b7be700>, body: {"snapshot": {"volume_id": "df66ce11-5184-4d04-8bb0-d040abf4325f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1990793477"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:27:34.698722 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9eabf6ef-b63b-4c16-9fe5-856370d6e952 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.392759 Sep 01 05:27:34.699395 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3085/6124] 10.222.0.26 () {60 vars in 1162 bytes} [Thu Sep 1 05:27:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:34.717782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa70c64b-b247-4885-a0aa-184f99e9e244 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b14daf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:34.773569 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa70c64b-b247-4885-a0aa-184f99e9e244 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 200 len: 287 microversion: 2.1 time: 0.063734 Sep 01 05:27:34.774841 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3040/6125] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:34 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:27:34.795067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-24182d79-3078-4eb7-9f96-919f60c95470 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75a9e3310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:34.862979 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-24182d79-3078-4eb7-9f96-919f60c95470 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.076881 Sep 01 05:27:34.864376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3086/6126] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 1 05:27:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:27:34.886462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba68268f-8217-47cf-a698-4a4964a2751e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b09da60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:34.985349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba68268f-8217-47cf-a698-4a4964a2751e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 200 len: 287 microversion: 2.1 time: 0.106911 Sep 01 05:27:34.986449 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3041/6127] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:34 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:36.012697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-35fd1de0-5b05-43f3-9faa-96a1de7f80a0 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75a9e3b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:36.140984 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-35fd1de0-5b05-43f3-9faa-96a1de7f80a0 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 200 len: 287 microversion: 2.1 time: 0.141952 Sep 01 05:27:36.142407 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3087/6128] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:35 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:37.161281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2a099b0-4a2a-405b-9c9d-1adfafcf79e6 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75abf2dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:37.206486 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2a099b0-4a2a-405b-9c9d-1adfafcf79e6 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 200 len: 288 microversion: 2.1 time: 0.053057 Sep 01 05:27:37.207896 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3042/6129] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:37 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 288 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:37.219059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-352dcaa2-c5e9-4176-8ed0-459bc9e5d220 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b961b80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:37.328783 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-352dcaa2-c5e9-4176-8ed0-459bc9e5d220 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 202 len: 0 microversion: 2.1 time: 0.113355 Sep 01 05:27:37.330063 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3088/6130] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Sep 1 05:27:37 2022] DELETE /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:27:37.340767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7141a0ed-2844-46b1-928e-ec2d542fc99a tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b14d310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:37.414286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7141a0ed-2844-46b1-928e-ec2d542fc99a tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 200 len: 287 microversion: 2.1 time: 0.078630 Sep 01 05:27:37.420400 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3043/6131] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:37 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:38.429571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68d09837-2416-404a-a0e7-aca6b6f87072 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75bcaab80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:38.487334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68d09837-2416-404a-a0e7-aca6b6f87072 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 200 len: 287 microversion: 2.1 time: 0.062461 Sep 01 05:27:38.488218 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3089/6132] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:38 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:39.501049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ac982b0-1744-48b8-be0f-7da6a0089b8f tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75ac17820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:39.541182 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6ac982b0-1744-48b8-be0f-7da6a0089b8f tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] HTTP exception thrown: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ac982b0-1744-48b8-be0f-7da6a0089b8f tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Request method failure captured: Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 HTTP/1.1 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEELDufRa_7QOaOMiD618qtvSeVupUGLpDexI6p_va5OfFD4ZKo6SjFGTo3xHtZW26UiAWXPwTFBzUjehpbJfWluYjjv43v7crN_O2w2Ad9ht1ilR7pWWjuzXQSeBahG7X8reGT8NeZIloszV0mz12pCAx0emY5B2mzvEKMbZ-nbShK8 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c85f2f7eb47a4099a588e68ff867c20e Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: exception: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'cf315f42-985b-4018-b6b8-73fb22f8a019'} Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. (HTTP 404) (Request-ID: req-33856cbe-9789-43c7-a452-49181422b2b7) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:27:39.552331 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. Sep 01 05:27:39.560369 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:39.566068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ac982b0-1744-48b8-be0f-7da6a0089b8f tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Returning 404 to user: Snapshot cf315f42-985b-4018-b6b8-73fb22f8a019 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:39.567906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ac982b0-1744-48b8-be0f-7da6a0089b8f tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019" status: 404 len: 111 microversion: 2.1 time: 0.071152 Sep 01 05:27:39.568813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3044/6133] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 05:27:39 2022] GET /compute/v2.1/os-snapshots/cf315f42-985b-4018-b6b8-73fb22f8a019 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:39.579323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b460c545-b1af-4974-b54a-42016a4011cd tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa76417f670>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:39.674564 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b460c545-b1af-4974-b54a-42016a4011cd tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 202 len: 0 microversion: 2.1 time: 0.100313 Sep 01 05:27:39.678261 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3090/6134] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:27:39 2022] DELETE /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:27:39.693862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6077f0f2-ebb5-4ceb-b209-0f12723d4d8d tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b14d5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:39.802662 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6077f0f2-ebb5-4ceb-b209-0f12723d4d8d tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 200 len: 343 microversion: 2.1 time: 0.117447 Sep 01 05:27:39.803736 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3045/6135] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:39 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 343 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:40.822820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ddccfa5f-a25b-4c96-9987-f4d2628b825c tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa76417fca0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:40.906448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ddccfa5f-a25b-4c96-9987-f4d2628b825c tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 200 len: 343 microversion: 2.1 time: 0.092371 Sep 01 05:27:40.918729 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3091/6136] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:40 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 343 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:40.996048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:27:40.999435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:27:41.007935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:41.008685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:41.009315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:41.010054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:41.010522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:41.011683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:41.121323 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-200f93f0-89c9-4df7-9321-aa5ead0613b8 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action" status: 200 len: 24567 microversion: 2.1 time: 0.129825 Sep 01 05:27:41.129528 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3046/6137] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:27:40 2022] POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action => generated 24567 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:27:41.922873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd6f74bd-6384-40ad-952c-ead883b8bcf7 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b07aaf0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:42.034057 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd6f74bd-6384-40ad-952c-ead883b8bcf7 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 200 len: 343 microversion: 2.1 time: 0.115882 Sep 01 05:27:42.035051 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3092/6138] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:41 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 343 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:43.049538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-853fe4bb-9a08-4936-9df8-756a13342293 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75b0cc5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:43.103243 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-853fe4bb-9a08-4936-9df8-756a13342293 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] HTTP exception thrown: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-853fe4bb-9a08-4936-9df8-756a13342293 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Request method failure captured: Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f HTTP/1.1 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEELDufRa_7QOaOMiD618qtvSeVupUGLpDexI6p_va5OfFD4ZKo6SjFGTo3xHtZW26UiAWXPwTFBzUjehpbJfWluYjjv43v7crN_O2w2Ad9ht1ilR7pWWjuzXQSeBahG7X8reGT8NeZIloszV0mz12pCAx0emY5B2mzvEKMbZ-nbShK8 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c85f2f7eb47a4099a588e68ff867c20e Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: exception: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'df66ce11-5184-4d04-8bb0-d040abf4325f'} Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. (HTTP 404) (Request-ID: req-0304928c-434c-440c-a281-87f8600f644d) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:27:43.107652 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.113949 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.121197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-853fe4bb-9a08-4936-9df8-756a13342293 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Returning 404 to user: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:43.121197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-853fe4bb-9a08-4936-9df8-756a13342293 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 404 len: 109 microversion: 2.1 time: 0.075511 Sep 01 05:27:43.121197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3047/6139] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:43 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:43.136834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-198e1ffb-62c6-4c7d-8874-942201464d4e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75a9e3550>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:43.192648 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-198e1ffb-62c6-4c7d-8874-942201464d4e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] HTTP exception thrown: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-198e1ffb-62c6-4c7d-8874-942201464d4e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Request method failure captured: Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f HTTP/1.1 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEELDufRa_7QOaOMiD618qtvSeVupUGLpDexI6p_va5OfFD4ZKo6SjFGTo3xHtZW26UiAWXPwTFBzUjehpbJfWluYjjv43v7crN_O2w2Ad9ht1ilR7pWWjuzXQSeBahG7X8reGT8NeZIloszV0mz12pCAx0emY5B2mzvEKMbZ-nbShK8 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: c85f2f7eb47a4099a588e68ff867c20e Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: method: Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: exception: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'df66ce11-5184-4d04-8bb0-d040abf4325f'} Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. (HTTP 404) (Request-ID: req-ba92e498-378b-40a1-b04a-fe85bd816d86) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:27:43.196082 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-198e1ffb-62c6-4c7d-8874-942201464d4e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Returning 404 to user: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-198e1ffb-62c6-4c7d-8874-942201464d4e tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 404 len: 109 microversion: 2.1 time: 0.069288 Sep 01 05:27:43.203279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3093/6140] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 1 05:27:43 2022] DELETE /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:27:43.212980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7be24af3-73e6-4d45-9308-b6fe01894231 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Calling method '.version_select at 0x7fa75bf24b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:43.307027 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7be24af3-73e6-4d45-9308-b6fe01894231 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] HTTP exception thrown: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7be24af3-73e6-4d45-9308-b6fe01894231 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Request method failure captured: Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f HTTP/1.1 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEELDufRa_7QOaOMiD618qtvSeVupUGLpDexI6p_va5OfFD4ZKo6SjFGTo3xHtZW26UiAWXPwTFBzUjehpbJfWluYjjv43v7crN_O2w2Ad9ht1ilR7pWWjuzXQSeBahG7X8reGT8NeZIloszV0mz12pCAx0emY5B2mzvEKMbZ-nbShK8 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5fec89a3cc2c432faf9bcb6f2182c8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 5fec89a3cc2c432faf9bcb6f2182c8d3 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-102524721 Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: c85f2f7eb47a4099a588e68ff867c20e Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-102524721-project Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: method: Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: exception: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'df66ce11-5184-4d04-8bb0-d040abf4325f'} Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. (HTTP 404) (Request-ID: req-a35c62f2-22fa-481d-9d43-b9c7d890bfc4) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:27:43.313104 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7be24af3-73e6-4d45-9308-b6fe01894231 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] Returning 404 to user: Volume df66ce11-5184-4d04-8bb0-d040abf4325f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7be24af3-73e6-4d45-9308-b6fe01894231 tempest-VolumesSnapshotsTestJSON-102524721 tempest-VolumesSnapshotsTestJSON-102524721-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f" status: 404 len: 109 microversion: 2.1 time: 0.106880 Sep 01 05:27:43.322394 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3048/6141] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 1 05:27:43 2022] GET /compute/v2.1/os-volumes/df66ce11-5184-4d04-8bb0-d040abf4325f => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:28:20.113588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:20.113588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:20.120341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:20.120956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:20.121980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:20.122933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:20.123761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:20.123961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:20.327243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:20.341525 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e8bdd3d9-4842-478f-8187-acd2c01b5558 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1680 microversion: 2.1 time: 0.240108 Sep 01 05:28:20.342714 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3094/6142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:20 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:20.485440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:20.488916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:20.492125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:20.492775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:20.502854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:20.503450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:20.504105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:20.504849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:20.505388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:20.505956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:20.581147 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8c14876-63b0-4e28-a40a-cfac58470897 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action" status: 200 len: 32642 microversion: 2.1 time: 0.099281 Sep 01 05:28:20.588340 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3049/6143] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:28:20 2022] POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action => generated 32642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:28:20.786044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:20.786659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:20.796149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:20.796701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:20.799606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:20.800403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:20.800654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:20.801060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:20.961374 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fb34a77-782a-4894-8334-7ac92862c220 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1833 microversion: 2.1 time: 0.178087 Sep 01 05:28:20.962027 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3095/6144] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:20 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1833 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:20.997510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:21.001175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:21.028005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:21.028529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:21.028976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:21.029718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:21.030278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:21.030817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:21.072172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lazy-loading 'flavor' on Instance uuid 46d63344-b7cd-4bcd-8a5e-16833fd82c99 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:28:21.089055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Going to try to live migrate instance to another host {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Sep 01 05:28:23.887935 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e83ded4e-be79-4504-a0d0-8ab8143c17ca tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action" status: 202 len: 0 microversion: 2.1 time: 2.895750 Sep 01 05:28:23.889442 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3050/6145] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:28:20 2022] POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action => generated 0 bytes in 2900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:28:23.903422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:23.907238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:23.942738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:23.943388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:23.943891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:23.944696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:23.945221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:23.945903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:24.349920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:24.364527 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b478955-3c04-47e3-bbbc-5704a8a9cb48 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.468225 Sep 01 05:28:24.367428 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3096/6146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:23 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:25.407141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:25.413436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:25.433307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:25.442925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:25.443400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:25.444175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:25.444654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:25.445077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:26.408950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:26.425411 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a8f85fa-0b8f-49e7-ab06-128d7445a6f1 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 1.025585 Sep 01 05:28:26.426649 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3051/6147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:25 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:27.436335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-61bf71d9-caf2-4d2a-b944-0ab8c256b041 req-5c7a5f1d-ed7f-4b0c-8708-da473486f2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "name": "network-vif-unplugged", "status": "completed", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:27.455775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61bf71d9-caf2-4d2a-b944-0ab8c256b041 req-5c7a5f1d-ed7f-4b0c-8708-da473486f2b7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:27.456789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61bf71d9-caf2-4d2a-b944-0ab8c256b041 req-5c7a5f1d-ed7f-4b0c-8708-da473486f2b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:27.458643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-61bf71d9-caf2-4d2a-b944-0ab8c256b041 req-5c7a5f1d-ed7f-4b0c-8708-da473486f2b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:27.464938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:27.464938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:27.472452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:27.472944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:27.473382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:27.474266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:27.474544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:27.474990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:27.487386 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-61bf71d9-caf2-4d2a-b944-0ab8c256b041 req-5c7a5f1d-ed7f-4b0c-8708-da473486f2b7 service nova] Creating event network-vif-unplugged:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h2-820368-37 Sep 01 05:28:27.502650 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-61bf71d9-caf2-4d2a-b944-0ab8c256b041 req-5c7a5f1d-ed7f-4b0c-8708-da473486f2b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.354762 Sep 01 05:28:27.520569 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3097/6148] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:27.803743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:27.819071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2115ef83-66b9-4faf-80a7-409b34dd218e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.358346 Sep 01 05:28:27.819948 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3052/6149] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:27 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:28:28.863946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:28.865311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:28.872740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:28.873245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:28.873679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:28.874780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:28.875472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:28.875903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:29.078629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:29.091435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e08702b9-75be-4b71-924c-7153c3fd5975 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.232942 Sep 01 05:28:29.092087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3098/6150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:28 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:29.544738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-766dcff2-5156-44a3-9f9d-30e30d629ada req-3c5b0d66-9a1c-40bc-986e-8af5b4ea99fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:29.555952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-766dcff2-5156-44a3-9f9d-30e30d629ada req-3c5b0d66-9a1c-40bc-986e-8af5b4ea99fc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:29.556408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-766dcff2-5156-44a3-9f9d-30e30d629ada req-3c5b0d66-9a1c-40bc-986e-8af5b4ea99fc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:29.557139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-766dcff2-5156-44a3-9f9d-30e30d629ada req-3c5b0d66-9a1c-40bc-986e-8af5b4ea99fc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:29.571796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-766dcff2-5156-44a3-9f9d-30e30d629ada req-3c5b0d66-9a1c-40bc-986e-8af5b4ea99fc service nova] Creating event network-changed:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h2-820368-37 Sep 01 05:28:29.577293 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-766dcff2-5156-44a3-9f9d-30e30d629ada req-3c5b0d66-9a1c-40bc-986e-8af5b4ea99fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036208 Sep 01 05:28:29.578085 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3053/6151] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:30.118008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:30.119173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:30.151148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:30.151977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:30.152739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:30.153695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:30.154367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:30.155134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:30.424922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:30.436118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9038ac98-025e-4090-a8ab-e2971b01177b tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.326757 Sep 01 05:28:30.439095 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3099/6152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:30 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:31.461987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:31.462725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:31.471718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:31.472228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:31.472662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:31.473382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:31.473843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:31.474715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:31.682050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:31.692168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5795cc54-60ed-4e63-a671-1a7326c64c1a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.234456 Sep 01 05:28:31.692350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3054/6153] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:31 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:32.717313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:32.718365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:32.726435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:32.727569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:32.728034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:32.729045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:32.729520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:32.729935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:32.966138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:32.982642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d28bfff-541e-4f80-8d93-a0b3358fc1f6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.272715 Sep 01 05:28:32.983318 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3100/6154] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:32 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:34.008470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:34.009205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:34.016087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:34.016893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:34.017335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:34.018058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:34.018698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:34.019163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:34.283978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:34.293231 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76ca9f7c-ee15-4c25-836b-779aa156b36c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.288630 Sep 01 05:28:34.294042 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3055/6155] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:34 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:35.316879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:35.318560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:35.328150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:35.329418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:35.330559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:35.331698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:35.332588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:35.333490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:35.702832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:35.712148 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-432501ba-0967-440c-a6a1-246211fe7e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1690 microversion: 2.1 time: 0.400419 Sep 01 05:28:35.730718 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3101/6156] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:35 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1690 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:36.738098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:36.738854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:36.746194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:36.747155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:36.747608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:36.748419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:36.748928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:36.749376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:36.927672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:36.936880 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8155fc1b-2cdf-44fb-bbca-a8c29cd376f7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1680 microversion: 2.1 time: 0.202844 Sep 01 05:28:36.937585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3056/6157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:36 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:36.960300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:36.960895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:36.971740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:36.972602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:36.973315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:36.974547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:36.975461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:36.976629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:37.175362 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e4cbbc2-668d-46a6-9276-60597bb06d60 tempest-TestNetworkAdvancedServerOps-727140940 tempest-TestNetworkAdvancedServerOps-727140940-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1833 microversion: 2.1 time: 0.219110 Sep 01 05:28:37.175981 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3102/6158] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:36 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1833 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:37.197807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:37.198403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:37.207567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:37.208247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:37.208849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:37.209724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:37.210472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:37.211087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:37.445578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:37.454581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-284fa3ee-3583-45d7-9614-6e278d031c12 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1680 microversion: 2.1 time: 0.260600 Sep 01 05:28:37.455467 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3057/6159] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:37 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:39.572659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:39.576065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:39.586098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:39.586853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:39.587646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:39.598001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:39.598875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:39.599687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:39.675533 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c92edb5-1003-41a0-9271-40329ac40370 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action" status: 200 len: 38644 microversion: 2.1 time: 0.109164 Sep 01 05:28:39.677308 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3103/6160] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:28:39 2022] POST /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99/action => generated 38644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:28:41.138728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:41.139445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:41.149725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1fba6677-81a1-4cf1-9329-bc550b13bfa4 req-93116049-859b-43fe-a236-c06105db098a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:41.163311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.163825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.164286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.165040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.165511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.165949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.172495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fba6677-81a1-4cf1-9329-bc550b13bfa4 req-93116049-859b-43fe-a236-c06105db098a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.172993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fba6677-81a1-4cf1-9329-bc550b13bfa4 req-93116049-859b-43fe-a236-c06105db098a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.173429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1fba6677-81a1-4cf1-9329-bc550b13bfa4 req-93116049-859b-43fe-a236-c06105db098a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.203579 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1fba6677-81a1-4cf1-9329-bc550b13bfa4 req-93116049-859b-43fe-a236-c06105db098a service nova] Creating event network-changed:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h1-820368-37 Sep 01 05:28:41.211951 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1fba6677-81a1-4cf1-9329-bc550b13bfa4 req-93116049-859b-43fe-a236-c06105db098a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067441 Sep 01 05:28:41.212747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:28:41.213338 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3104/6161] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:28:41.345684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97b63572-d647-4672-90c9-e9da8ebd3e47 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 204 len: 0 microversion: 2.1 time: 0.210531 Sep 01 05:28:41.346345 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3058/6162] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:28:41 2022] DELETE /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:28:41.356736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:41.357874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:41.367836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.368646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.369432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.370611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:41.371291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:41.372033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:41.797837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:28:41.808185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-51ba1623-7755-476c-92c8-72e606592fca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 200 len: 1686 microversion: 2.1 time: 0.456927 Sep 01 05:28:41.809397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3105/6163] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:41 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 1686 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:28:42.832137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:42.832909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 46d63344-b7cd-4bcd-8a5e-16833fd82c99] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:28:42.849903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:42.852343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:42.852854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:42.853667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:42.854160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:42.855641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:42.897191 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] HTTP exception thrown: Instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 could not be found. Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Request method failure captured: Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 HTTP/1.1 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEE9O7r8QEDrOleCeqlZ6ESI-jZDqXltbxvuHTZjNuHvJdQhVT7qyY03LC9bbEpcPWHl9QecKhHmg4OrLOc-hc0FuosvhShpzEQG-iGLVHS8NoHnmvqGHIhlK1qs_TjvSmQMKcQoNXi2Pj19dLJyNixJ5nhww25BUQVR6IyOPxtKTYE Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a364e33225b4d809f8ed613574899ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 25d7775b3f5c493ea05d42d8c5dd8176 Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 could not be found. Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '46d63344-b7cd-4bcd-8a5e-16833fd82c99'} Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 could not be found. Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 could not be found. Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:28:42.901338 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 could not be found. Sep 01 05:28:42.905618 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:28:42.907424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Returning 404 to user: Instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:28:42.909244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d5aa325-43f9-4e70-9c81-705229cbb28f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99" status: 404 len: 111 microversion: 2.1 time: 0.083133 Sep 01 05:28:42.911750 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3059/6164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:28:42 2022] GET /compute/v2.1/servers/46d63344-b7cd-4bcd-8a5e-16833fd82c99 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:28:43.230863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-022744e1-bf55-49ae-8a88-366d98d2f591 req-4e49c2da-95c8-4248-83cf-63c2d81bfedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d63344-b7cd-4bcd-8a5e-16833fd82c99", "name": "network-vif-deleted", "tag": "f3408e6e-1f55-49e7-9622-f3fbdab06a99"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:43.243942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-022744e1-bf55-49ae-8a88-366d98d2f591 req-4e49c2da-95c8-4248-83cf-63c2d81bfedd service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:43.244417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-022744e1-bf55-49ae-8a88-366d98d2f591 req-4e49c2da-95c8-4248-83cf-63c2d81bfedd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:43.245081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-022744e1-bf55-49ae-8a88-366d98d2f591 req-4e49c2da-95c8-4248-83cf-63c2d81bfedd service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:43.260740 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-022744e1-bf55-49ae-8a88-366d98d2f591 req-4e49c2da-95c8-4248-83cf-63c2d81bfedd service nova] Creating event network-vif-deleted:f3408e6e-1f55-49e7-9622-f3fbdab06a99 for instance 46d63344-b7cd-4bcd-8a5e-16833fd82c99 on n-h1-820368-37 Sep 01 05:28:43.266622 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-022744e1-bf55-49ae-8a88-366d98d2f591 req-4e49c2da-95c8-4248-83cf-63c2d81bfedd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039343 Sep 01 05:28:43.267829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3106/6165] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:47.526753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b6b0a77-8454-4ce5-b550-180820338264 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '.version_select at 0x7fa75bf39d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:28:47.592533 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b6b0a77-8454-4ce5-b550-180820338264 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-234332936" status: 202 len: 0 microversion: 2.1 time: 0.073480 Sep 01 05:28:47.597788 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3060/6166] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Sep 1 05:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-234332936 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:28:47.634166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd3afe99-f80c-4902-847d-475107242ce4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: .version_select at 0x7fa75a7b8280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1046453740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA0q1KpLbhN7M2MbHGVBTJMtj1fqZSHIaKfqfhpjZCQku5+zsfN1f4id4GHa9wTFvUbiqdQbk3NeQ2zNx+bnpbWgahKgSTPWqKk9qlOc0d0K/IyblsTxvNqFlBJj7StlA=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:47.652232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cd3afe99-f80c-4902-847d-475107242ce4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:28:47.659526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cd3afe99-f80c-4902-847d-475107242ce4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:28:47.699875 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd3afe99-f80c-4902-847d-475107242ce4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.071734 Sep 01 05:28:47.701455 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3107/6167] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:28:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:28:58.742101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:58.744748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:28:58.751297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-851769890", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "eb213e65-9c90-4d73-9a78-b3722e85ebcb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1046453740", "security_groups": [{"name": "tempest-secgroup-smoke-784181539"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:28:59.002038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] validate_networks() for [('eb213e65-9c90-4d73-9a78-b3722e85ebcb', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:28:59.898598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:28:59.899299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:28:59.899794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:28:59.900216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:28:59.901071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:28:59.929192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:59.929698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:59.930151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:59.930925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:59.931402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:59.931840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:59.981151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:28:59.993007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Getting quotas for user 25d7775b3f5c493ea05d42d8c5dd8176 and project 4a364e33225b4d809f8ed613574899ea. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:00.017213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:29:00.019799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:29:00.104639 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce71714e-75b8-447b-8019-6c95bb13f659 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.364579 Sep 01 05:29:00.105480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3061/6168] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:28:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:29:00.114444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=64 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:00.117055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:00.117885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:00.122373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e3f9c72-b0ce-4dd3-9c6a-c560fc1515ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:00.123133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e3f9c72-b0ce-4dd3-9c6a-c560fc1515ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:00.186869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e3f9c72-b0ce-4dd3-9c6a-c560fc1515ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:00.195922 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e3f9c72-b0ce-4dd3-9c6a-c560fc1515ad tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1266 microversion: 2.1 time: 0.083174 Sep 01 05:29:00.212007 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3108/6169] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:00 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:01.219686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:01.221106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:01.238384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:01.239273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:01.240005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:01.241095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:01.241885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:01.242523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:01.393965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:01.411079 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b012cbd9-8dc1-48f5-9cd0-2bcad71b92b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1318 microversion: 2.1 time: 0.195154 Sep 01 05:29:01.414860 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3062/6170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:01 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:02.434625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:02.435973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:02.444166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:02.444931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:02.445587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:02.446691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:02.447843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:02.448460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:02.569730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:02.608711 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff085e9f-3260-43a7-b982-6feb42208289 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1324 microversion: 2.1 time: 0.177827 Sep 01 05:29:02.613929 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3109/6171] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:02 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:03.638382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:03.639494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:03.649975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:03.650485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:03.650975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:03.651892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:03.653092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:03.653861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:04.627033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:04.635978 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c026bc7-2ed3-40fb-abf9-cd4bb63b5aa2 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 1.003067 Sep 01 05:29:04.636797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3063/6172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:03 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:05.657021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:05.657733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:05.670563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:05.673428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:05.675329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:05.676347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:05.678439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:05.680392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:05.769027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4531d1a2-148b-4e2c-bc1a-ea1fa811c02a req-c9ebefdf-0336-48be-b848-f7eecb4e214b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:05.784900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4531d1a2-148b-4e2c-bc1a-ea1fa811c02a req-c9ebefdf-0336-48be-b848-f7eecb4e214b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:05.785646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4531d1a2-148b-4e2c-bc1a-ea1fa811c02a req-c9ebefdf-0336-48be-b848-f7eecb4e214b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:05.786261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4531d1a2-148b-4e2c-bc1a-ea1fa811c02a req-c9ebefdf-0336-48be-b848-f7eecb4e214b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:05.801172 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4531d1a2-148b-4e2c-bc1a-ea1fa811c02a req-c9ebefdf-0336-48be-b848-f7eecb4e214b service nova] Creating event network-changed:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:29:05.814563 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4531d1a2-148b-4e2c-bc1a-ea1fa811c02a req-c9ebefdf-0336-48be-b848-f7eecb4e214b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050466 Sep 01 05:29:05.815593 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3064/6173] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:29:06.253768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:06.272841 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-153e352f-73a6-433c-a19f-f11af031420c tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.619945 Sep 01 05:29:06.274231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3110/6174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:05 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:07.302780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:07.303540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:07.310549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:07.311353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:07.312161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:07.313532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:07.313958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:07.314379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:07.517533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:07.528500 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a63c57c7-e25d-4138-bea0-10d095a0131d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.234564 Sep 01 05:29:07.536764 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3065/6175] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:07 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:08.560541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:08.561901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:08.574855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:08.575739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:08.576512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:08.578215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:08.579295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:08.580225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:08.790688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:08.806560 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e96ee0d-0e9b-421c-9a8b-b26995e43381 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.256165 Sep 01 05:29:08.807324 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3111/6176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:08 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:09.828483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:09.829099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:09.838157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:09.838669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:09.839127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:09.839840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:09.840296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:09.840686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:09.955168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:10.006035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:10.220665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:10.234900 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7daa57f-f9ee-48d6-9ba3-d93021d451c4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.410192 Sep 01 05:29:10.236481 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3066/6177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:09 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:11.272954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:11.273817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:11.281294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:11.284716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:11.285520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:11.286565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:11.287602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:11.288415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:11.289118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:11.536879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:11.545800 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb5e010f-3983-4e96-816a-fa250bd58696 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.279582 Sep 01 05:29:11.546524 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3112/6178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:11 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:12.568782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:12.570030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:12.578787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:12.579674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:12.580324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:12.581445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:12.582469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:12.583147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:12.758560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:12.769461 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8c38e47-740f-4c0b-a2c8-bcc437b7dafd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.205371 Sep 01 05:29:12.770859 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3067/6179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:12 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:13.819919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:13.828235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:13.840848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:13.841657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:13.843488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:13.844468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:13.846340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:13.846966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:14.020994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1c4b5be3-2323-41f5-9797-62d6210fd5be req-737dc287-5cb0-4ce9-bb3a-962511e9bfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "name": "network-vif-plugged", "status": "completed", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:14.032570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c4b5be3-2323-41f5-9797-62d6210fd5be req-737dc287-5cb0-4ce9-bb3a-962511e9bfa5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:14.033045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c4b5be3-2323-41f5-9797-62d6210fd5be req-737dc287-5cb0-4ce9-bb3a-962511e9bfa5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:14.033468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1c4b5be3-2323-41f5-9797-62d6210fd5be req-737dc287-5cb0-4ce9-bb3a-962511e9bfa5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:14.053198 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1c4b5be3-2323-41f5-9797-62d6210fd5be req-737dc287-5cb0-4ce9-bb3a-962511e9bfa5 service nova] Creating event network-vif-plugged:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:29:14.069435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1c4b5be3-2323-41f5-9797-62d6210fd5be req-737dc287-5cb0-4ce9-bb3a-962511e9bfa5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307318 Sep 01 05:29:14.070182 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3113/6180] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:14.070343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:14.078763 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b1809ae-386f-4a77-be2b-0022955035de tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.291467 Sep 01 05:29:14.079983 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3068/6181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:13 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:15.104897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:15.107585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:15.129301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:15.130003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:15.133531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:15.143164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:15.143906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:15.144373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:15.884406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:15.896898 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3ee2a0c8-62a1-4802-a82d-1e7a0634cd96 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1391 microversion: 2.1 time: 0.799355 Sep 01 05:29:15.914212 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3114/6182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:15 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1391 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:16.941562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:16.943105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:16.956826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:16.957968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:16.960353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:16.961495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:16.962213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:16.963306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:17.191609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:17.205748 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7a7803f-2d60-4072-928a-b7f360c69b63 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1563 microversion: 2.1 time: 0.266590 Sep 01 05:29:17.221343 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3069/6183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:16 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1563 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:17.234058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:17.235492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:17.244837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:17.245510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:17.246099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:17.247107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:17.247745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:17.248318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:17.460180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:17.469899 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de00bdb2-5951-4f0d-a0a0-c5185e72ee84 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1563 microversion: 2.1 time: 0.241980 Sep 01 05:29:17.470516 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3115/6184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:17 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:20.119230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b6ef33a1-ce9a-4e23-b498-0b23d456040e req-5d04897c-7cbf-4f1f-9e7f-d42598bc2abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:20.122666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:20.123375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:20.152045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:20.154334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:20.157033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:20.158553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:20.161718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:20.162207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:20.167874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6ef33a1-ce9a-4e23-b498-0b23d456040e req-5d04897c-7cbf-4f1f-9e7f-d42598bc2abb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:20.172233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6ef33a1-ce9a-4e23-b498-0b23d456040e req-5d04897c-7cbf-4f1f-9e7f-d42598bc2abb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:20.176513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b6ef33a1-ce9a-4e23-b498-0b23d456040e req-5d04897c-7cbf-4f1f-9e7f-d42598bc2abb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:20.218523 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b6ef33a1-ce9a-4e23-b498-0b23d456040e req-5d04897c-7cbf-4f1f-9e7f-d42598bc2abb service nova] Creating event network-changed:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:29:20.228663 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b6ef33a1-ce9a-4e23-b498-0b23d456040e req-5d04897c-7cbf-4f1f-9e7f-d42598bc2abb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113683 Sep 01 05:29:20.233197 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3116/6185] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:29:20.474420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:20.487485 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9740145-f9fc-437e-b809-6ee532e6d6a0 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1563 microversion: 2.1 time: 0.377536 Sep 01 05:29:20.492901 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3070/6186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:20 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1563 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:55.322525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=20 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:55.324194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=40 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:55.328281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:55.330994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:55.339460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.339959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.340399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.341225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.342074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.342512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.415671 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff07ab82-5c31-4ea6-ba6f-0ce7e1a45213 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381/action" status: 200 len: 24573 microversion: 2.1 time: 0.094375 Sep 01 05:29:55.417026 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3117/6187] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:29:55 2022] POST /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381/action => generated 24573 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:30:32.289254 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:30:32.289864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:32.290624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=52 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:32.296637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1004832458", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "604b5a41-f8fd-43b6-bd3a-7ab203e4c5e2"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:32.355230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] validate_networks() for [('604b5a41-f8fd-43b6-bd3a-7ab203e4c5e2', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:30:32.793207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:30:32.793806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:30:32.794802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:30:32.795325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:30:32.795748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:30:32.807489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:32.807984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:32.808423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:32.809157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:32.809668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:32.810100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:32.833293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Getting quotas for project f611af9198284dd3adf6401152883b58. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:32.840800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Getting quotas for user 33492ac723214e25b7f1d23f790015e8 and project f611af9198284dd3adf6401152883b58. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:32.861872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:30:32.863740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:30:32.914523 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a6d3fed-ccab-4dab-baf3-2d7e8f5bca90 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627538 Sep 01 05:30:32.915251 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3071/6188] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:30:32.930403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc895691-8da7-45a7-a015-5424ed081505 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:32.931391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc895691-8da7-45a7-a015-5424ed081505 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:32.936812 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:30:32.937007 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:30:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 (ip 10.222.0.26) !!! Sep 01 05:30:32.939086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:32.940629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:33.003462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc895691-8da7-45a7-a015-5424ed081505 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:33.011536 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc895691-8da7-45a7-a015-5424ed081505 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1214 microversion: 2.1 time: 0.088495 Sep 01 05:30:33.012336 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3118/6189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:32 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:34.036051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e51449b-f5e7-4097-8c8c-349c994d5fa8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:34.036794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e51449b-f5e7-4097-8c8c-349c994d5fa8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.068250 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40052. Sep 01 05:30:34.099447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e51449b-f5e7-4097-8c8c-349c994d5fa8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:34.107794 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e51449b-f5e7-4097-8c8c-349c994d5fa8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1214 microversion: 2.1 time: 0.078341 Sep 01 05:30:34.108685 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3072/6190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:34 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:34.426679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:34.426679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.429501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.429918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.430382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.431692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.432082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.432845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.547642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:30:34.548342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:30:34.549131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:30:34.549710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:30:34.550314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:30:34.638599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.645625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.646122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.646561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.647349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.648044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.648788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.700457 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8780ff24-b341-49b7-a7f5-c3cd67cfb131 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381/action" status: 202 len: 1137 microversion: 2.1 time: 0.313876 Sep 01 05:30:34.701818 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3119/6191] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:30:34 2022] POST /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381/action => generated 1137 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 01 05:30:34.721585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:34.722209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.729750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.730635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.732017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.732696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.733401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.734084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.980133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:34.991927 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6450004e-21f4-4068-a292-46c854dcf3e7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.276311 Sep 01 05:30:34.992696 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3073/6192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:34 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:35.133403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-181e05ad-7889-4cd6-8221-bc16d09935c5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:35.135008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-181e05ad-7889-4cd6-8221-bc16d09935c5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:35.247845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-181e05ad-7889-4cd6-8221-bc16d09935c5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:35.256776 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-181e05ad-7889-4cd6-8221-bc16d09935c5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1214 microversion: 2.1 time: 0.128177 Sep 01 05:30:35.257784 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3120/6193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:35 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:36.016755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:36.017501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:36.025552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.026397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.026842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.028114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.028601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.029042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.253843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:36.281055 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67f7c783-37c8-44ef-8254-ef7e73720a7f tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.268058 Sep 01 05:30:36.282111 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3074/6194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:36 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:36.299085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:36.301054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:36.314090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.314705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.315287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.316327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.316962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.317594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.407996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:36.424332 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4be2830e-dc5e-491f-87fd-28e145fc2152 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1266 microversion: 2.1 time: 0.134921 Sep 01 05:30:36.426118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3121/6195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:36 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:37.320354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:37.321161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:37.331419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.331927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.332373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.333102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.333571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.334078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.459319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:37.460588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:37.476464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.477189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.477963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.478940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.479581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.480166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.767957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:37.783671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edb766bc-47c7-474e-b044-1173bd6428b6 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.469815 Sep 01 05:30:37.784708 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3075/6196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:37 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:37.801158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:37.812178 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a7839e24-72a9-47ec-ba48-2d7840046d85 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1314 microversion: 2.1 time: 0.358444 Sep 01 05:30:37.812920 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3122/6197] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:37 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:38.612318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a6107f60-a24c-442a-abe0-380692ad271d req-4b7384ea-ca53-4dcd-9d16-e536b822f5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed2d022-5d06-4874-b0c4-b5e645d0b0a5", "tag": "1f82ed58-a73b-4b85-9c93-49cc05dce444"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:38.640101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a6107f60-a24c-442a-abe0-380692ad271d req-4b7384ea-ca53-4dcd-9d16-e536b822f5ef service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.640889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a6107f60-a24c-442a-abe0-380692ad271d req-4b7384ea-ca53-4dcd-9d16-e536b822f5ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.641744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a6107f60-a24c-442a-abe0-380692ad271d req-4b7384ea-ca53-4dcd-9d16-e536b822f5ef service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.663253 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a6107f60-a24c-442a-abe0-380692ad271d req-4b7384ea-ca53-4dcd-9d16-e536b822f5ef service nova] Creating event network-changed:1f82ed58-a73b-4b85-9c93-49cc05dce444 for instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 on n-h1-820368-37 Sep 01 05:30:38.671172 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a6107f60-a24c-442a-abe0-380692ad271d req-4b7384ea-ca53-4dcd-9d16-e536b822f5ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082016 Sep 01 05:30:38.672507 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3076/6198] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:38.810138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:38.811071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:38.820185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.821026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.821563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.822482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.823140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.823676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.844480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:38.846121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:38.855627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.856561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.857292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.858168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.858782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.859388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.242169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:39.252278 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b348a943-f712-4e21-987c-a27d5c0f54dd tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.448171 Sep 01 05:30:39.253171 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3123/6199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:38 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:39.275440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:39.285498 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38c2ea89-c81e-402a-b34f-4ef348f0b6c0 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1314 microversion: 2.1 time: 0.447610 Sep 01 05:30:39.286420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3077/6200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:38 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:40.285634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.286333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:40.294254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.294911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.295706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.296451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.297024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.297686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.309233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.309886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:40.317618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.318542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.319236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.320171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.320640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.321235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:41.038327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:41.057483 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98ede084-1c7e-405f-9929-79af8d2f0eef tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.777591 Sep 01 05:30:41.063145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:41.072038 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5afbc15-210b-4760-80f8-38b6470bb7d3 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1314 microversion: 2.1 time: 0.766855 Sep 01 05:30:41.076993 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3078/6202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:41.078275 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3124/6202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:42.098157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.099605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:42.107771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.108281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.109108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.109950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.110429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.110860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.119319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.120346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:42.128146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.129215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.129215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.129857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.130232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.130867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.389984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:42.399687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:42.403829 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1601d0d4-bd96-4607-8624-63404f5731ca tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.312182 Sep 01 05:30:42.405127 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3079/6203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:42.428290 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8415c47-63a0-4515-b916-a58ea4b9c55b tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1314 microversion: 2.1 time: 0.313817 Sep 01 05:30:42.440320 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3125/6204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:43.299700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e913fa0e-0285-4e3f-b489-2cf12e06add2 req-235b397f-57ad-45bf-89e1-e46a9ab5eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed2d022-5d06-4874-b0c4-b5e645d0b0a5", "name": "network-vif-plugged", "status": "completed", "tag": "1f82ed58-a73b-4b85-9c93-49cc05dce444"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:43.307099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:43.314601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e913fa0e-0285-4e3f-b489-2cf12e06add2 req-235b397f-57ad-45bf-89e1-e46a9ab5eb63 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.315471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e913fa0e-0285-4e3f-b489-2cf12e06add2 req-235b397f-57ad-45bf-89e1-e46a9ab5eb63 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.316139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e913fa0e-0285-4e3f-b489-2cf12e06add2 req-235b397f-57ad-45bf-89e1-e46a9ab5eb63 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.333692 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e913fa0e-0285-4e3f-b489-2cf12e06add2 req-235b397f-57ad-45bf-89e1-e46a9ab5eb63 service nova] Creating event network-vif-plugged:1f82ed58-a73b-4b85-9c93-49cc05dce444 for instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 on n-h1-820368-37 Sep 01 05:30:43.342679 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e913fa0e-0285-4e3f-b489-2cf12e06add2 req-235b397f-57ad-45bf-89e1-e46a9ab5eb63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046403 Sep 01 05:30:43.343722 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3080/6205] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:43.434012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.435427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:43.443634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.444129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.444564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.445506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.445967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.446395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.464166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.465941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:43.479882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.481430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.482701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.484527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.485753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.486819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.730135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:43.741080 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3344b61f-0070-4ed2-96f4-3b093150b944 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.311050 Sep 01 05:30:43.742340 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3126/6206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:43.763911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:43.778597 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-777aa363-9d2a-44d5-9e12-a16148b94374 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1314 microversion: 2.1 time: 0.322548 Sep 01 05:30:43.780149 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3081/6207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:44.780955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:44.781666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:44.790322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.791352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.792211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.793723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.794655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.795504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.813997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:44.815692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:44.826272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:44.831263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.832185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.833068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.834677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.835713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.837553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.151332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:45.154937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:45.169049 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4191b8eb-813b-41d9-9213-acdb068324b2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1499 microversion: 2.1 time: 0.362228 Sep 01 05:30:45.169438 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-983be9fe-dabe-4e6c-9876-c6ab4fb0a6b4 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.392260 Sep 01 05:30:45.181074 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3082/6208] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1499 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:45.181335 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3127/6209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:45.700012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.700780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:45.709006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.709506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.709945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.710685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.711190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.711642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.743495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:30:45.855531 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12c37b80-8835-4b71-b91c-035e8ed8c583 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 204 len: 0 microversion: 2.1 time: 0.159824 Sep 01 05:30:45.856957 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3083/6210] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:30:45 2022] DELETE /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:30:45.867484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.868215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:45.870229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:45.877396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.878168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.878596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.879321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.879948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.880368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.077738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:46.089669 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d296b535-0f6e-4bd5-964c-cf5851a99639 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1505 microversion: 2.1 time: 0.226564 Sep 01 05:30:46.090495 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3128/6211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:45 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:46.217105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:46.218258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:46.230281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.231275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.231640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.232535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.233067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.233561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.443430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:46.457918 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d99f5578-3b0f-4387-81d7-d3eb4723996e tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1691 microversion: 2.1 time: 0.246558 Sep 01 05:30:46.458877 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3084/6212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:46 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:47.121558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:47.122702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:47.131984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.133249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.134287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.135620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.136961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.137590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.413048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:47.423995 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd26fcdb-88f9-4186-a259-974a2b42a80d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 200 len: 1505 microversion: 2.1 time: 0.307213 Sep 01 05:30:47.424612 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3129/6213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:47 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:47.486250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:47.486929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:47.494108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.494570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.495079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.495748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.496552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.496983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.716048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:47.736352 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f976aa70-2e23-4a83-80dc-3e78c158a2b7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1697 microversion: 2.1 time: 0.254486 Sep 01 05:30:47.737350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3085/6214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:47 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1697 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:47.810268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-abda239f-753c-4506-a0d2-104043e5c22d req-b20db9c8-cfc3-4d96-b956-b248496673b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed2d022-5d06-4874-b0c4-b5e645d0b0a5", "name": "network-vif-deleted", "tag": "1f82ed58-a73b-4b85-9c93-49cc05dce444"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:47.821854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-abda239f-753c-4506-a0d2-104043e5c22d req-b20db9c8-cfc3-4d96-b956-b248496673b3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.822422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-abda239f-753c-4506-a0d2-104043e5c22d req-b20db9c8-cfc3-4d96-b956-b248496673b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.823152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-abda239f-753c-4506-a0d2-104043e5c22d req-b20db9c8-cfc3-4d96-b956-b248496673b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.837805 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-abda239f-753c-4506-a0d2-104043e5c22d req-b20db9c8-cfc3-4d96-b956-b248496673b3 service nova] Creating event network-vif-deleted:1f82ed58-a73b-4b85-9c93-49cc05dce444 for instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 on n-h1-820368-37 Sep 01 05:30:47.843646 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-abda239f-753c-4506-a0d2-104043e5c22d req-b20db9c8-cfc3-4d96-b956-b248496673b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037329 Sep 01 05:30:47.844260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3130/6215] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:48.454650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.455442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:48.462787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.463615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.464050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.464755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.465559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.465991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.481369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] HTTP exception thrown: Instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 could not be found. Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Request method failure captured: Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 HTTP/1.1 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEN2-QdGyGpcXaKkZQkAzruBc59M-jH-JAbYu58tKx5oh4-cxurkj8o1wGY3DstNKvWiFLSCyXArSY_uUwCjC3wCHxnkuKkyd1n_-5i7RiQcw9Xt7F_YqRsQY0XSLBVLf7RIKCRPHwQcvm-o7favDUSCUu8vG8TdWQmtLFgdRvWwmXI Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f611af9198284dd3adf6401152883b58 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesActionsTest-1966300728 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f611af9198284dd3adf6401152883b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f611af9198284dd3adf6401152883b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f611af9198284dd3adf6401152883b58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f611af9198284dd3adf6401152883b58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesActionsTest-1966300728 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f611af9198284dd3adf6401152883b58 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesActionsTest-1966300728 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesActionsTest-1966300728-project Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 33492ac723214e25b7f1d23f790015e8 Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesActionsTest-1966300728-project Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 could not be found. Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9ed2d022-5d06-4874-b0c4-b5e645d0b0a5'} Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 could not be found. Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 could not be found. Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.483260 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 could not be found. Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Returning 404 to user: Instance 9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-725b3724-68ea-4e3f-b732-662a3f639be2 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5" status: 404 len: 111 microversion: 2.1 time: 0.034204 Sep 01 05:30:48.489274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3086/6216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:48 2022] GET /compute/v2.1/servers/9ed2d022-5d06-4874-b0c4-b5e645d0b0a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:48.546913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1485793344", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "604b5a41-f8fd-43b6-bd3a-7ab203e4c5e2"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:48.608786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] validate_networks() for [('604b5a41-f8fd-43b6-bd3a-7ab203e4c5e2', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:30:48.761454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.762254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:48.772783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.773407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.773914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.774720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.775361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.775876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.026401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:49.036377 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-839ce470-ab82-4b23-ac47-64d0aa267635 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1697 microversion: 2.1 time: 0.279217 Sep 01 05:30:49.037230 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3087/6217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:48 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1697 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:49.259799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:30:49.260234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:30:49.260714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:30:49.261125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:30:49.261560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:30:49.271370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.271861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.272357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.273086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.273731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.274159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.292596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Getting quotas for project f611af9198284dd3adf6401152883b58. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:49.298391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Getting quotas for user 33492ac723214e25b7f1d23f790015e8 and project f611af9198284dd3adf6401152883b58. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:49.311775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:30:49.314223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:30:49.364407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b5120d8c-b35e-4603-9a0a-a24febafddba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823006 Sep 01 05:30:49.365265 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3131/6218] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:30:49.376613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-824267d6-9819-4426-ab18-fb0c84f38dd8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.377695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-824267d6-9819-4426-ab18-fb0c84f38dd8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:49.446275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-824267d6-9819-4426-ab18-fb0c84f38dd8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:49.456167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-824267d6-9819-4426-ab18-fb0c84f38dd8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1214 microversion: 2.1 time: 0.083646 Sep 01 05:30:49.456768 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3088/6219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:50.069605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5f75d214-1c78-48bc-8ef8-2d03a831e60a req-3fc7b383-b34d-43e3-a9b7-0282c6ae390e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "name": "network-vif-unplugged", "status": "completed", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:50.072795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.075712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:50.096966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.097865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.098531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.100014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.100698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.101641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.105055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f75d214-1c78-48bc-8ef8-2d03a831e60a req-3fc7b383-b34d-43e3-a9b7-0282c6ae390e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.105665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f75d214-1c78-48bc-8ef8-2d03a831e60a req-3fc7b383-b34d-43e3-a9b7-0282c6ae390e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.106304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f75d214-1c78-48bc-8ef8-2d03a831e60a req-3fc7b383-b34d-43e3-a9b7-0282c6ae390e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.135403 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5f75d214-1c78-48bc-8ef8-2d03a831e60a req-3fc7b383-b34d-43e3-a9b7-0282c6ae390e service nova] Creating event network-vif-unplugged:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:30:50.141486 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5f75d214-1c78-48bc-8ef8-2d03a831e60a req-3fc7b383-b34d-43e3-a9b7-0282c6ae390e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079065 Sep 01 05:30:50.142690 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3089/6220] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:50.269609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:50.279243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73149604-ce63-4d2b-a459-a3dd2988c120 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1697 microversion: 2.1 time: 0.225094 Sep 01 05:30:50.279796 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3132/6221] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1697 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:50.480024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.480943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:50.487903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.488388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.488993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.489702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.490173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.490592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.562866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:50.571340 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3c50b59-7fc6-44ea-acba-d41c528a00d7 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1266 microversion: 2.1 time: 0.096495 Sep 01 05:30:50.582289 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3090/6222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:51.301493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:51.302107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:51.310859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.311380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.312019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.312758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.313211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.313632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.596936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:51.597854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:51.608086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.608790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.609474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.610376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.610993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.611629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.630581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:51.864294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:51.874609 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b1f3caf9-ba5e-451d-a94e-349cd3b96716 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1697 microversion: 2.1 time: 0.577193 Sep 01 05:30:51.884420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3133/6223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:51 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1697 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:51.904681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:51.914859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ec274db-a185-4a35-8446-f417d56b0386 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1314 microversion: 2.1 time: 0.324910 Sep 01 05:30:51.919061 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3091/6224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:51 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:52.570411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e38ba3df-816c-49d9-8417-0bfd6617b491 req-ad46db40-7468-4d6e-a877-a2931d660db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9241d4-bebe-41fa-8057-f928f80d2ea7", "tag": "7c2ed1c2-4233-4e2f-8e78-cc6a8eb00c15"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:52.585814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e38ba3df-816c-49d9-8417-0bfd6617b491 req-ad46db40-7468-4d6e-a877-a2931d660db8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.586571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e38ba3df-816c-49d9-8417-0bfd6617b491 req-ad46db40-7468-4d6e-a877-a2931d660db8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.587931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e38ba3df-816c-49d9-8417-0bfd6617b491 req-ad46db40-7468-4d6e-a877-a2931d660db8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.606035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e38ba3df-816c-49d9-8417-0bfd6617b491 req-ad46db40-7468-4d6e-a877-a2931d660db8 service nova] Creating event network-changed:7c2ed1c2-4233-4e2f-8e78-cc6a8eb00c15 for instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 on n-h1-820368-37 Sep 01 05:30:52.612257 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e38ba3df-816c-49d9-8417-0bfd6617b491 req-ad46db40-7468-4d6e-a877-a2931d660db8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045968 Sep 01 05:30:52.613601 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3134/6225] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:52.904513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:52.909976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:52.930381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.931343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.932047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.933318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.934166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.938468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:52.939741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:52.951752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.960805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.966464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.967866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.969529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.971409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.973907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:53.240891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:53.265822 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e04bfe9f-f479-4a7d-960e-32b9df9d3c8e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1314 microversion: 2.1 time: 0.332086 Sep 01 05:30:53.267241 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3135/6226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:52 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:53.335002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:53.347769 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d794220-39e0-4329-b1f8-05b8e99b0f78 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1682 microversion: 2.1 time: 0.452363 Sep 01 05:30:53.354147 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3092/6227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:52 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1682 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:54.259546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2e15b5f8-e69d-4d6e-8f1c-b65ca4e0061d req-339b9108-4973-4b54-89da-d89e71e8930b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "name": "network-vif-plugged", "status": "completed", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:54.275484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e15b5f8-e69d-4d6e-8f1c-b65ca4e0061d req-339b9108-4973-4b54-89da-d89e71e8930b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.276002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e15b5f8-e69d-4d6e-8f1c-b65ca4e0061d req-339b9108-4973-4b54-89da-d89e71e8930b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.276436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2e15b5f8-e69d-4d6e-8f1c-b65ca4e0061d req-339b9108-4973-4b54-89da-d89e71e8930b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.291044 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2e15b5f8-e69d-4d6e-8f1c-b65ca4e0061d req-339b9108-4973-4b54-89da-d89e71e8930b service nova] Creating event network-vif-plugged:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:30:54.296938 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2e15b5f8-e69d-4d6e-8f1c-b65ca4e0061d req-339b9108-4973-4b54-89da-d89e71e8930b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047584 Sep 01 05:30:54.297825 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3136/6228] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:54.305614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:54.306415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:54.314928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.315953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.316432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.317150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.317695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.318196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.541361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:54.551418 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ddd3f65-6eb0-4100-bbeb-5542505689ba tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1314 microversion: 2.1 time: 0.249608 Sep 01 05:30:54.552493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3093/6229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:54 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:55.584970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:55.586321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:55.600493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.601801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.602821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.605578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.606673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.607700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.617260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:55.906554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:55.915465 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d009e231-9614-45c2-8b64-01e6b5e82f89 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1314 microversion: 2.1 time: 0.344771 Sep 01 05:30:55.916725 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3137/6230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:55 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:56.937813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:56.938423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:56.945736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:56.946222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:56.946649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:56.947455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:56.947952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:56.948406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.119322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:57.130148 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-265bd91d-7bde-4863-b7d2-7f2fb246911d tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1314 microversion: 2.1 time: 0.196164 Sep 01 05:30:57.143727 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3094/6231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:56 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:57.312198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d029629d-78f7-42a5-ac10-df8b733dcdbe req-ced576f2-d27b-454a-9945-0559a5452e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9241d4-bebe-41fa-8057-f928f80d2ea7", "name": "network-vif-plugged", "status": "completed", "tag": "7c2ed1c2-4233-4e2f-8e78-cc6a8eb00c15"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:57.342545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d029629d-78f7-42a5-ac10-df8b733dcdbe req-ced576f2-d27b-454a-9945-0559a5452e0f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.343172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d029629d-78f7-42a5-ac10-df8b733dcdbe req-ced576f2-d27b-454a-9945-0559a5452e0f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.343491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d029629d-78f7-42a5-ac10-df8b733dcdbe req-ced576f2-d27b-454a-9945-0559a5452e0f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.364166 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d029629d-78f7-42a5-ac10-df8b733dcdbe req-ced576f2-d27b-454a-9945-0559a5452e0f service nova] Creating event network-vif-plugged:7c2ed1c2-4233-4e2f-8e78-cc6a8eb00c15 for instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 on n-h1-820368-37 Sep 01 05:30:57.370867 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d029629d-78f7-42a5-ac10-df8b733dcdbe req-ced576f2-d27b-454a-9945-0559a5452e0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072498 Sep 01 05:30:57.373256 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3138/6232] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:58.154544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:58.155474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:58.163590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.164185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.164709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.165532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.167198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.167198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.371377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:58.387364 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bdea926-3e7e-4288-9414-8597531953c8 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1314 microversion: 2.1 time: 0.234759 Sep 01 05:30:58.387364 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3095/6233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:58 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:59.407539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:59.409011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:59.413734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:59.414433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:59.422266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:59.422749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:59.423212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:59.423916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:59.424372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:59.424880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:59.589315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:59.598815 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ce95911-a39b-402c-ba78-5b68e92c783e tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1499 microversion: 2.1 time: 0.192541 Sep 01 05:30:59.600710 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3139/6234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:59 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1499 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:00.207830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:00.209041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:00.212463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:00.219509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.220007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.220438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.221166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.221624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.222040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.255875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:31:00.373310 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43bbbaf4-baea-4e8a-86f5-c52856e2ab4a tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 204 len: 0 microversion: 2.1 time: 0.169464 Sep 01 05:31:00.374588 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3096/6235] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:31:00 2022] DELETE /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:31:00.389428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:00.390661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:00.401763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.402772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.403896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.405425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.406227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.407006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.594945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:00.603603 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-513524ed-3e2b-4087-9083-43a82d038186 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1505 microversion: 2.1 time: 0.221699 Sep 01 05:31:00.604345 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3140/6236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:00 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:01.626651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:01.627930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:01.637826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.638390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.638974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.639905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.640609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.641169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.901697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33492ac723214e25b7f1d23f790015e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f611af9198284dd3adf6401152883b58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:01.917448 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-771329bd-943b-4e35-8386-eef194487d9f tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 200 len: 1505 microversion: 2.1 time: 0.295224 Sep 01 05:31:01.918932 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3097/6237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:01 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:02.266583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6774e11a-6a0f-4f0e-8879-b1dec32eba0b req-313c9748-8d66-43ba-8cf2-f6cf9c852814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9241d4-bebe-41fa-8057-f928f80d2ea7", "name": "network-vif-deleted", "tag": "7c2ed1c2-4233-4e2f-8e78-cc6a8eb00c15"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:02.279927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6774e11a-6a0f-4f0e-8879-b1dec32eba0b req-313c9748-8d66-43ba-8cf2-f6cf9c852814 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.280522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6774e11a-6a0f-4f0e-8879-b1dec32eba0b req-313c9748-8d66-43ba-8cf2-f6cf9c852814 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.281240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6774e11a-6a0f-4f0e-8879-b1dec32eba0b req-313c9748-8d66-43ba-8cf2-f6cf9c852814 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.295267 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6774e11a-6a0f-4f0e-8879-b1dec32eba0b req-313c9748-8d66-43ba-8cf2-f6cf9c852814 service nova] Creating event network-vif-deleted:7c2ed1c2-4233-4e2f-8e78-cc6a8eb00c15 for instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 on n-h1-820368-37 Sep 01 05:31:02.300689 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6774e11a-6a0f-4f0e-8879-b1dec32eba0b req-313c9748-8d66-43ba-8cf2-f6cf9c852814 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039226 Sep 01 05:31:02.301320 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3141/6238] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:02.943735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:02.944712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] [instance: 2a9241d4-bebe-41fa-8057-f928f80d2ea7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:02.950132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:02.960366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.961223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.961996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.963289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.964049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.964880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.986697 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] HTTP exception thrown: Instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 could not be found. Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Request method failure captured: Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 HTTP/1.1 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEN2-QdGyGpcXaKkZQkAzruBc59M-jH-JAbYu58tKx5oh4-cxurkj8o1wGY3DstNKvWiFLSCyXArSY_uUwCjC3wCHxnkuKkyd1n_-5i7RiQcw9Xt7F_YqRsQY0XSLBVLf7RIKCRPHwQcvm-o7favDUSCUu8vG8TdWQmtLFgdRvWwmXI Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f611af9198284dd3adf6401152883b58 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesActionsTest-1966300728 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f611af9198284dd3adf6401152883b58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f611af9198284dd3adf6401152883b58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f611af9198284dd3adf6401152883b58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f611af9198284dd3adf6401152883b58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesActionsTest-1966300728 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f611af9198284dd3adf6401152883b58 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesActionsTest-1966300728 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-VolumesActionsTest-1966300728-project Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 33492ac723214e25b7f1d23f790015e8 Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesActionsTest-1966300728-project Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 could not be found. Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '2a9241d4-bebe-41fa-8057-f928f80d2ea7'} Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 could not be found. Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 could not be found. Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:02.988423 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 could not be found. Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] Returning 404 to user: Instance 2a9241d4-bebe-41fa-8057-f928f80d2ea7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-693c4065-e4d6-45c8-bc86-163913265ce5 tempest-VolumesActionsTest-1966300728 tempest-VolumesActionsTest-1966300728-project] 10.222.0.26 "GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7" status: 404 len: 111 microversion: 2.1 time: 0.053900 Sep 01 05:31:02.992539 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3098/6239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:02 2022] GET /compute/v2.1/servers/2a9241d4-bebe-41fa-8057-f928f80d2ea7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:31:29.758782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:29.761114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=20 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:30.156693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:30.160737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.169023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.169517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.169961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.170677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.171166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.171590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.247076 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd240214-7da9-4295-9a93-83920888d2ab tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "POST /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381/action" status: 200 len: 24568 microversion: 2.1 time: 0.497170 Sep 01 05:31:30.248050 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3142/6240] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:31:29 2022] POST /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381/action => generated 24568 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:31:51.235013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-257240814", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5daaa4aa-1247-47f5-9755-2514866b1b19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:51.247345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:51.439252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:31:52.292451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:52.293048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:52.293380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:52.293774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:52.294184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:52.305115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.305855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.306508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.307665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:52.308275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:52.308864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:52.328449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:52.335698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:52.400415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:52.402861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5daaa4aa-1247-47f5-9755-2514866b1b19',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:52.554799 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26198802-4a29-4044-9d60-3c9271035055 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323759 Sep 01 05:31:52.555760 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3099/6241] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:52.567126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-370f6396-8021-4afe-9843-91cca3a2021d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:52.568479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-370f6396-8021-4afe-9843-91cca3a2021d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:52.599024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:52.599617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:52.818293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-370f6396-8021-4afe-9843-91cca3a2021d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:52.827002 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-370f6396-8021-4afe-9843-91cca3a2021d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1056 microversion: 2.1 time: 0.263787 Sep 01 05:31:52.827585 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3143/6242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:52 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1056 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:53.847472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:53.849022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:53.859780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.860303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.860723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.861584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:53.862222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:53.862814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:53.930457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:53.939002 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0b4f955-7f29-44c1-bda3-5499e58ac6de tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1154 microversion: 2.1 time: 0.095813 Sep 01 05:31:53.940054 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3100/6243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:53 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1154 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:54.971307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.973586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.991171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.996025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.996485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.997624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.997752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.998112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.310893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.331900 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2e927eb9-89ac-4843-a1bd-c9cb2d0f8aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1214 microversion: 2.1 time: 0.368655 Sep 01 05:31:55.332514 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3144/6244] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1214 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:56.185576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f453680f-1aa7-4a91-8ca4-d30f1c644064 req-65c5306c-3543-4572-8bc7-ee7b10f6f597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edfc05e3-61b9-4e48-ba41-e3f42d717742", "tag": "6f9a2f02-bcb8-4e33-8fbe-2bf507bdf3ee"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:56.204971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f453680f-1aa7-4a91-8ca4-d30f1c644064 req-65c5306c-3543-4572-8bc7-ee7b10f6f597 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.205470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f453680f-1aa7-4a91-8ca4-d30f1c644064 req-65c5306c-3543-4572-8bc7-ee7b10f6f597 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.205911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f453680f-1aa7-4a91-8ca4-d30f1c644064 req-65c5306c-3543-4572-8bc7-ee7b10f6f597 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.219570 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f453680f-1aa7-4a91-8ca4-d30f1c644064 req-65c5306c-3543-4572-8bc7-ee7b10f6f597 service nova] Creating event network-changed:6f9a2f02-bcb8-4e33-8fbe-2bf507bdf3ee for instance edfc05e3-61b9-4e48-ba41-e3f42d717742 on n-h1-820368-37 Sep 01 05:31:56.224878 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f453680f-1aa7-4a91-8ca4-d30f1c644064 req-65c5306c-3543-4572-8bc7-ee7b10f6f597 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043266 Sep 01 05:31:56.225874 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3101/6245] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:31:56.354538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.355214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.381226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.382091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.383533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.387169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.387958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.390224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.776681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.785861 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d617da9-bbd9-4e08-a757-dcf834fa1417 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1214 microversion: 2.1 time: 0.436496 Sep 01 05:31:56.787220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3145/6246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1214 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:57.814473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.816347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.825028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.825880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.827235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.828577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.829234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.829819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.046431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.059714 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03660935-685b-42d7-9f61-5ed9227b9c05 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1214 microversion: 2.1 time: 0.255280 Sep 01 05:31:58.062958 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3102/6247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:59.092647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.093244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.100688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.101380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.101869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.102772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.103341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.103802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.316402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.329257 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74efde9e-2e1f-4877-811f-2cefb8cd7f1b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1214 microversion: 2.1 time: 0.240230 Sep 01 05:31:59.330453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3146/6248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:00.352936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.354289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.362148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.363075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.363749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.364681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.365356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.365787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.548688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.558006 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6ea715b-5ca7-46b9-95bd-6485812ed5c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1214 microversion: 2.1 time: 0.208973 Sep 01 05:32:00.558688 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3103/6249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:01.582858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:01.583787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:01.592759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.593577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.597776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.597776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.597776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.597776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.742588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.751301 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b533d8a1-4dd4-422c-b6f0-39010e632198 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.172480 Sep 01 05:32:01.751885 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3147/6250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:01 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:02.773454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.774109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.778144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:02.779149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:02.787504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.788011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.788454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.789215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.789687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.790304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.964439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.978805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95679e8c-4de0-4809-9aab-db96b20a944a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.209775 Sep 01 05:32:02.980247 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3104/6251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:03.256637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1607162826", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:03.265499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:03.325526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] validate_networks() for None {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:32:03.886855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:32:03.887465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:32:03.888196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:32:03.888728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:32:03.889318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:32:03.900685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.901281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.901763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.902511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.903006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.903424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.921738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Getting quotas for project f0e81cc6e8b14fe78fc9a4276c319a04. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:03.927473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Getting quotas for user a53cd6780e8e4950900d26dbd07edd7f and project f0e81cc6e8b14fe78fc9a4276c319a04. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:03.941632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:32:03.944032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:32:04.000404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.001478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.009755 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99f900cb-2ff1-4b63-a0c6-d3a135a87199 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756675 Sep 01 05:32:04.011797 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3148/6252] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:32:04.012737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.013357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.013924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.014762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.015376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.015927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.030064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29ed748a-9102-41d0-96e1-22389b27859e tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.031295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29ed748a-9102-41d0-96e1-22389b27859e tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.138411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29ed748a-9102-41d0-96e1-22389b27859e tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.148154 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29ed748a-9102-41d0-96e1-22389b27859e tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1214 microversion: 2.1 time: 0.124791 Sep 01 05:32:04.149184 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3149/6253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:04.226702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.235774 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eadf604b-5214-437b-a9d1-dd727601c72f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.239228 Sep 01 05:32:04.236379 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3105/6254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.171490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.172051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.183068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.183599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.184253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.185055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.185625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.186288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.262206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.268095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.268716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.270492 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e92215c1-25f9-43bb-9144-55505641ebf2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1266 microversion: 2.1 time: 0.103308 Sep 01 05:32:05.271584 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3150/6255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.277370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.277370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.277738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.278256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.278720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.279179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.515344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.524166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28564d5e-86a6-4235-8268-3ad101a715a4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.259870 Sep 01 05:32:05.524768 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3106/6256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:06.294971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.296195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.303799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.304289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.304906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.305647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.306101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.306660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.528206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.537116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db92bb51-38dd-4e8e-b2b0-772171f1b9ea tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.246980 Sep 01 05:32:06.537837 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3151/6257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:06.545783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.546576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.556857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.557541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.557988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.558712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.559214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.559646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.818007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.827792 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24ccf7b3-f06c-442e-b7f1-b33494e58d2e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.285954 Sep 01 05:32:06.828837 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3107/6258] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:07.194784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-95eba5f5-be1c-4acc-8f64-46e62f2eb3de req-9600ea65-83d1-478e-8b5d-349e8c445d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7aca1fe-11a5-4ad7-813b-b50514a49e74", "tag": "a9573e66-b6f9-4201-8fbc-a9e7d70517bf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:07.207604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95eba5f5-be1c-4acc-8f64-46e62f2eb3de req-9600ea65-83d1-478e-8b5d-349e8c445d45 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.208030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95eba5f5-be1c-4acc-8f64-46e62f2eb3de req-9600ea65-83d1-478e-8b5d-349e8c445d45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.208613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95eba5f5-be1c-4acc-8f64-46e62f2eb3de req-9600ea65-83d1-478e-8b5d-349e8c445d45 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.220725 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-95eba5f5-be1c-4acc-8f64-46e62f2eb3de req-9600ea65-83d1-478e-8b5d-349e8c445d45 service nova] Creating event network-changed:a9573e66-b6f9-4201-8fbc-a9e7d70517bf for instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 on n-h2-820368-37 Sep 01 05:32:07.227377 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-95eba5f5-be1c-4acc-8f64-46e62f2eb3de req-9600ea65-83d1-478e-8b5d-349e8c445d45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037393 Sep 01 05:32:07.228039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3152/6259] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:07.564474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:07.565643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:07.579104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.579986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.580801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.582138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.583050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.583772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.794600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:07.803025 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-194e4858-6faf-47b6-8914-e9b3c1339356 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.246297 Sep 01 05:32:07.804377 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3108/6260] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:07 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:07.850526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:07.851289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:07.859052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.859544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.859990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.860692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.861143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.861584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.026656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.042727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0064440d-2f22-4d22-8f9f-67bec8195281 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.196147 Sep 01 05:32:08.043988 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3153/6261] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:07 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:08.827472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.828355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.835927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.836432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.836867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.837575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.838003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.838945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.988917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.998406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a8b65b7-3043-4614-af7c-e307169ce186 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.177035 Sep 01 05:32:08.999036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3109/6262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:09.073405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.074164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.083046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.083610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.084229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.085046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.085641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.086151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.241037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.251359 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33f15e34-2928-4791-9e3a-058d0e7e182b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.183366 Sep 01 05:32:09.252117 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3154/6263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:09.603619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f47d7f7d-c8b4-4b4b-95bf-6156b896ddea req-16290611-cf74-447f-ac99-48a10c82e4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edfc05e3-61b9-4e48-ba41-e3f42d717742", "name": "network-vif-plugged", "status": "completed", "tag": "6f9a2f02-bcb8-4e33-8fbe-2bf507bdf3ee"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:09.614798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f47d7f7d-c8b4-4b4b-95bf-6156b896ddea req-16290611-cf74-447f-ac99-48a10c82e4b0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.615348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f47d7f7d-c8b4-4b4b-95bf-6156b896ddea req-16290611-cf74-447f-ac99-48a10c82e4b0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.615842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f47d7f7d-c8b4-4b4b-95bf-6156b896ddea req-16290611-cf74-447f-ac99-48a10c82e4b0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.639623 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f47d7f7d-c8b4-4b4b-95bf-6156b896ddea req-16290611-cf74-447f-ac99-48a10c82e4b0 service nova] Creating event network-vif-plugged:6f9a2f02-bcb8-4e33-8fbe-2bf507bdf3ee for instance edfc05e3-61b9-4e48-ba41-e3f42d717742 on n-h1-820368-37 Sep 01 05:32:09.648327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f47d7f7d-c8b4-4b4b-95bf-6156b896ddea req-16290611-cf74-447f-ac99-48a10c82e4b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049495 Sep 01 05:32:09.648925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3110/6264] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:10.024796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.025508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.029091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.030087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.041650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.048195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.048812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.050285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.050689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.050979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.051539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.051649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.052362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.053538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.054382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.055321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.103390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:32:10.206650 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9152bc5-bdb0-44af-8bb1-f4443a2500c7 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 204 len: 0 microversion: 2.1 time: 0.185464 Sep 01 05:32:10.207321 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3111/6265] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:32:10 2022] DELETE /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:32:10.298172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.306577 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5a247a0-3f1e-42db-b1d6-5ee30e7a56b5 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.285985 Sep 01 05:32:10.307457 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3155/6266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:10.314936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.315646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.322009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.322655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.323544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.324337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.324872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.325368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.412953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7d613aad-6212-4633-a441-003752f5a295 req-dd5c69f1-3dde-4d82-8e1a-160a26b17931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:10.424573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7d613aad-6212-4633-a441-003752f5a295 req-dd5c69f1-3dde-4d82-8e1a-160a26b17931 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.425061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7d613aad-6212-4633-a441-003752f5a295 req-dd5c69f1-3dde-4d82-8e1a-160a26b17931 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.425909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7d613aad-6212-4633-a441-003752f5a295 req-dd5c69f1-3dde-4d82-8e1a-160a26b17931 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.440441 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7d613aad-6212-4633-a441-003752f5a295 req-dd5c69f1-3dde-4d82-8e1a-160a26b17931 service nova] Creating event network-changed:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:32:10.448949 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7d613aad-6212-4633-a441-003752f5a295 req-dd5c69f1-3dde-4d82-8e1a-160a26b17931 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236607 Sep 01 05:32:10.450056 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3112/6267] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:10.461028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.461760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.468951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.469456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.469904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.470620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.471119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.471550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.486751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.496991 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28fa5cee-db9b-4697-829d-1222e571077d tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1688 microversion: 2.1 time: 0.187881 Sep 01 05:32:10.497599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3156/6268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:10.617542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.627175 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b16aa25a-de7d-42ec-8057-574051002f18 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1202 microversion: 2.1 time: 0.174664 Sep 01 05:32:10.627638 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3113/6269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:11.328723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.329535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.336854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.337344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.338093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.339621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.340086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.340683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.519257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.519909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.528087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.528642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.529082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.529835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.530311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.530742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.540959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.550399 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a917aff-5d66-4ada-9ef8-bd249de15aae tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.225576 Sep 01 05:32:11.551010 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3157/6270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:11.648924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.649541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.656301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.656796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.657750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.658430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.658964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.659341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.913717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.923893 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46a3cea5-07bd-4509-90fd-f1503c412d4a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1688 microversion: 2.1 time: 0.408421 Sep 01 05:32:11.938792 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3114/6271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1688 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:12.327691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.337070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d71cb2f0-1602-4645-bf5c-132d788ddf33 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1390 microversion: 2.1 time: 0.692448 Sep 01 05:32:12.338168 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3158/6272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1390 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:12.359033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.359546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.362561 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:32:12.362780 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 (ip 10.222.0.26) !!! Sep 01 05:32:12.380915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.381889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.382417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.383662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.384048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.386922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.573652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.574582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.581175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.581656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.582315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.583348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.583933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.584564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.645771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.656910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2efd4206-e9a2-474b-b261-80ae7fc17412 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1390 microversion: 2.1 time: 0.302095 Sep 01 05:32:12.657964 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3115/6273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:12.679515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.680444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.688003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.688871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.689470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.690071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.690518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.690990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.720924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:12.840564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.849574 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53a0a676-fe45-4e95-81b4-fcd399f6c03a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.280523 Sep 01 05:32:12.850489 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3159/6274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:12.947861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.949733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.953730 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:32:12.954006 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:32:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 (ip 10.222.0.26) !!! Sep 01 05:32:12.967579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.969639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.970251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.970834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.972049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.973010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.973710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.982409 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74d66abc-ae85-4a94-9391-8195bb2e50ff tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1390 microversion: 2.1 time: 0.306217 Sep 01 05:32:12.983841 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3116/6275] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1390 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:12.989250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a7bd58d5-95d7-4a04-a074-5d46114264b4 req-9a3f07b0-73e8-4ba1-8962-b86c9290a21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bd3ab9-a86a-4506-a917-4232279a7381", "name": "network-vif-deleted", "tag": "c2de0846-e657-4b4b-a2a3-a3c70a254f36"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:13.006095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7bd58d5-95d7-4a04-a074-5d46114264b4 req-9a3f07b0-73e8-4ba1-8962-b86c9290a21d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.007415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7bd58d5-95d7-4a04-a074-5d46114264b4 req-9a3f07b0-73e8-4ba1-8962-b86c9290a21d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.008073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7bd58d5-95d7-4a04-a074-5d46114264b4 req-9a3f07b0-73e8-4ba1-8962-b86c9290a21d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.034395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a7bd58d5-95d7-4a04-a074-5d46114264b4 req-9a3f07b0-73e8-4ba1-8962-b86c9290a21d service nova] Creating event network-vif-deleted:c2de0846-e657-4b4b-a2a3-a3c70a254f36 for instance 95bd3ab9-a86a-4506-a917-4232279a7381 on n-h2-820368-37 Sep 01 05:32:13.039935 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a7bd58d5-95d7-4a04-a074-5d46114264b4 req-9a3f07b0-73e8-4ba1-8962-b86c9290a21d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054684 Sep 01 05:32:13.040727 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3117/6276] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:13.046175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.046752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.053560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.054152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.054497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.055261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.055729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.056163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.068430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25d7775b3f5c493ea05d42d8c5dd8176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a364e33225b4d809f8ed613574899ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.077116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b82aa3d9-86a5-4c5e-82f8-a581f4a31973 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 200 len: 1502 microversion: 2.1 time: 0.134870 Sep 01 05:32:13.078093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3160/6277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 1502 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:13.089084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:32:13.189543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f076bca-6eb7-4548-bd1d-8822d64d760d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 204 len: 0 microversion: 2.1 time: 0.147416 Sep 01 05:32:13.193459 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3118/6278] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:32:13 2022] DELETE /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:32:13.200594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.201211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.217575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.220506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.220974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.222004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.222644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.223908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.381713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.395045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-54761811-12e8-499b-8b58-16dab41df915 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1396 microversion: 2.1 time: 0.198951 Sep 01 05:32:13.395833 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3161/6279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1396 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:13.871194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.871786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.879083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.879856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.880290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.880993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.881426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.881843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.022169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.031316 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d313636-20db-4a0f-9649-f42e8f9c5184 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.164515 Sep 01 05:32:14.031934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3119/6280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:14.101232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.101954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] [instance: 95bd3ab9-a86a-4506-a917-4232279a7381] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.103975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:14.109923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.110399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.110836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.111563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.112017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.112437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.128271 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] HTTP exception thrown: Instance 95bd3ab9-a86a-4506-a917-4232279a7381 could not be found. Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Request method failure captured: Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 HTTP/1.1 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEE9O7r8QEDrOleCeqlZ6ESI-jZDqXltbxvuHTZjNuHvJdQhVT7qyY03LC9bbEpcPWHl9QecKhHmg4OrLOc-hc0FuosvhShpzEQG-iGLVHS8NoHnmvqGHIhlK1qs_TjvSmQMKcQoNXi2Pj19dLJyNixJ5nhww25BUQVR6IyOPxtKTYE Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a364e33225b4d809f8ed613574899ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a364e33225b4d809f8ed613574899ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 4a364e33225b4d809f8ed613574899ea Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-689712978 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 25d7775b3f5c493ea05d42d8c5dd8176 Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-689712978-project Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 95bd3ab9-a86a-4506-a917-4232279a7381 could not be found. Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '95bd3ab9-a86a-4506-a917-4232279a7381'} Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bd3ab9-a86a-4506-a917-4232279a7381 could not be found. Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bd3ab9-a86a-4506-a917-4232279a7381 could not be found. Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:32:14.129852 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bd3ab9-a86a-4506-a917-4232279a7381 could not be found. Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Returning 404 to user: Instance 95bd3ab9-a86a-4506-a917-4232279a7381 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae1c3e7b-8f47-4bc5-958c-afa6f346153a tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381" status: 404 len: 111 microversion: 2.1 time: 0.033980 Sep 01 05:32:14.134688 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3162/6281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/95bd3ab9-a86a-4506-a917-4232279a7381 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:32:14.418703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.419600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.426336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.426829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.427393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.428248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.428706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.429106 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.632881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.645563 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19aea2be-1015-4959-8bba-14b22ad1e9c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1396 microversion: 2.1 time: 0.230684 Sep 01 05:32:14.646455 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3120/6282] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1396 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:14.758214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c913fbcd-9aa2-4fcc-a2b1-0fde4e8300a5 req-55377640-056d-4717-859c-b1ec0343179e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7aca1fe-11a5-4ad7-813b-b50514a49e74", "name": "network-vif-plugged", "status": "completed", "tag": "a9573e66-b6f9-4201-8fbc-a9e7d70517bf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:14.764298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:14.780033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c913fbcd-9aa2-4fcc-a2b1-0fde4e8300a5 req-55377640-056d-4717-859c-b1ec0343179e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.780524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c913fbcd-9aa2-4fcc-a2b1-0fde4e8300a5 req-55377640-056d-4717-859c-b1ec0343179e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.781173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c913fbcd-9aa2-4fcc-a2b1-0fde4e8300a5 req-55377640-056d-4717-859c-b1ec0343179e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.796664 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c913fbcd-9aa2-4fcc-a2b1-0fde4e8300a5 req-55377640-056d-4717-859c-b1ec0343179e service nova] Creating event network-vif-plugged:a9573e66-b6f9-4201-8fbc-a9e7d70517bf for instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 on n-h2-820368-37 Sep 01 05:32:14.803675 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c913fbcd-9aa2-4fcc-a2b1-0fde4e8300a5 req-55377640-056d-4717-859c-b1ec0343179e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048912 Sep 01 05:32:14.804897 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3163/6283] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:15.055179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:15.055996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:15.063862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.064420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.064860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.065550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.066448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.066925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.289527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.301038 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d57e1f66-53e8-45d4-81b5-e8c6dc9885f2 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.250665 Sep 01 05:32:15.314878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3121/6284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:15 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:15.423542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9fee9d5e-2792-46d8-9b15-8c65963ab5ed req-2b7eafed-18e6-4001-981e-f020f9344113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edfc05e3-61b9-4e48-ba41-e3f42d717742", "name": "network-vif-deleted", "tag": "6f9a2f02-bcb8-4e33-8fbe-2bf507bdf3ee"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:15.451067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9fee9d5e-2792-46d8-9b15-8c65963ab5ed req-2b7eafed-18e6-4001-981e-f020f9344113 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.452539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9fee9d5e-2792-46d8-9b15-8c65963ab5ed req-2b7eafed-18e6-4001-981e-f020f9344113 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.454383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9fee9d5e-2792-46d8-9b15-8c65963ab5ed req-2b7eafed-18e6-4001-981e-f020f9344113 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.465093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:15.495441 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9fee9d5e-2792-46d8-9b15-8c65963ab5ed req-2b7eafed-18e6-4001-981e-f020f9344113 service nova] Creating event network-vif-deleted:6f9a2f02-bcb8-4e33-8fbe-2bf507bdf3ee for instance edfc05e3-61b9-4e48-ba41-e3f42d717742 on n-h1-820368-37 Sep 01 05:32:15.505581 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9fee9d5e-2792-46d8-9b15-8c65963ab5ed req-2b7eafed-18e6-4001-981e-f020f9344113 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089308 Sep 01 05:32:15.506219 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3164/6285] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:15.680746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:15.683503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:15.699050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.700346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.701367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.702424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.703099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.703713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.778633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.788312 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecf654fa-2a81-44a3-bd68-43d6364b73f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1187 microversion: 2.1 time: 0.121068 Sep 01 05:32:15.789005 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3122/6286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:15 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:16.324116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.324994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.331920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.332414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.333164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.334283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.335087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.335529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.525701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.536206 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44f715ad-7003-4b47-866d-1de43dc27776 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1314 microversion: 2.1 time: 0.217896 Sep 01 05:32:16.537335 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3165/6287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:16.824583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.825379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.845991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.850096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.851047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.854277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.857080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.857983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.048098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:17.077602 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5d210d7-2c5d-44a1-95f8-34c1dadce57b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1187 microversion: 2.1 time: 0.253837 Sep 01 05:32:17.078742 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3123/6288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1187 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:17.564089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.565071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.582349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.584566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.587488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.588525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.589023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.589464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.774850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:17.786028 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a80d595-3988-4aed-95d2-2ced298fbe70 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1464 microversion: 2.1 time: 0.226960 Sep 01 05:32:17.786853 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3166/6289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1464 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:17.824768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf464ad-fceb-4c9e-9786-1af2df87a644", "device": "/dev/sdb"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:17.830138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.843432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.844265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.845036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.846276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.847148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.847900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.104770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:18.106423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:18.146329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.147611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.148389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.149675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.168123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.169175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.287948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.301645 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e26db760-6155-4726-a63a-dcf61380399a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1187 microversion: 2.1 time: 0.204864 Sep 01 05:32:18.306612 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3167/6290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:18 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1187 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:18.380671 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1dc85a9-9186-4138-afb8-d4a78e88e0a7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "POST /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562185 Sep 01 05:32:18.387369 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3124/6291] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:32:17 2022] POST /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:18.913183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5ed3713-093b-48f6-9b55-6dfe4aa1c7e3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] Calling method '.version_select at 0x7fa75bde4f70>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:18.966737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5ed3713-093b-48f6-9b55-6dfe4aa1c7e3 tempest-TestNetworkAdvancedServerOps-689712978 tempest-TestNetworkAdvancedServerOps-689712978-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1046453740" status: 202 len: 0 microversion: 2.1 time: 0.057163 Sep 01 05:32:18.968630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3168/6292] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 05:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1046453740 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:32:19.330443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:19.331792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:19.339504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.339994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.340439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.341169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.341636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.342068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.432632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.442478 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0672b75a-de97-4a2d-805c-693f6a1c7ae0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1187 microversion: 2.1 time: 0.117891 Sep 01 05:32:19.444677 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3125/6293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:19 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:20.484861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:20.485887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:20.496391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.497264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.498210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.499243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:20.499923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:20.500551 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:20.582454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:20.598806 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e329706-9b27-43c0-b51b-72c1c419e3e9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 200 len: 1187 microversion: 2.1 time: 0.121142 Sep 01 05:32:20.603401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3169/6294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:20 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 1187 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:21.639975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:21.640647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: edfc05e3-61b9-4e48-ba41-e3f42d717742] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:21.644829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:21.653734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.654823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.655848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.656865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.657913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.658748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.681698 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance edfc05e3-61b9-4e48-ba41-e3f42d717742 could not be found. Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 HTTP/1.1 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance edfc05e3-61b9-4e48-ba41-e3f42d717742 could not be found. Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'edfc05e3-61b9-4e48-ba41-e3f42d717742'} Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edfc05e3-61b9-4e48-ba41-e3f42d717742 could not be found. Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edfc05e3-61b9-4e48-ba41-e3f42d717742 could not be found. Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:21.684393 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edfc05e3-61b9-4e48-ba41-e3f42d717742 could not be found. Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance edfc05e3-61b9-4e48-ba41-e3f42d717742 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-134e4e0a-d555-4931-93c1-a930eabcef5d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742" status: 404 len: 111 microversion: 2.1 time: 0.051347 Sep 01 05:32:21.690866 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3126/6295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:21 2022] GET /compute/v2.1/servers/edfc05e3-61b9-4e48-ba41-e3f42d717742 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:32:30.905367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1604133121", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3f2b5508-dcff-48b4-80c8-6930848a55e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:30.948345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:30.950243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=24 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:31.075780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:32:31.770286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:32:31.770768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:32:31.771276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:32:31.771712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:32:31.772211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:32:31.782766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:31.783736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:31.784157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.785115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:31.785760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:31.786181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.818088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:31.826507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:31.897297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:32:31.900014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f2b5508-dcff-48b4-80c8-6930848a55e2',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:32:32.192324 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bcd27a23-65d7-41b8-b73f-57bf2e4f2434 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310939 Sep 01 05:32:32.208004 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3170/6296] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:32:32.208151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46148937-c03f-4a65-af18-2c06d594198b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:32.208812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46148937-c03f-4a65-af18-2c06d594198b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:32.215698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:32.341006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46148937-c03f-4a65-af18-2c06d594198b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.353811 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46148937-c03f-4a65-af18-2c06d594198b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1057 microversion: 2.1 time: 0.149992 Sep 01 05:32:32.354432 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3127/6297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:32 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1057 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:33.382157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:33.383541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:33.407461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.419547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.423697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.428957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.431313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.435088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.584049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.612349 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f2150d3-0653-48b9-b5f7-a5517afba61c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1155 microversion: 2.1 time: 0.237933 Sep 01 05:32:33.614176 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3171/6298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:33 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1155 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:34.644184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:34.645747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:34.663328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.664352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.667237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.668975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.670955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.672665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.870866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.885642 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9dab02bf-3ced-4dc9-8b5a-bc35b2f5f47d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1173 microversion: 2.1 time: 0.243858 Sep 01 05:32:34.896878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3128/6299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:34 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1173 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:35.922523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:35.923348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:35.938256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.940720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.941340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.942327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.945039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.945819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:36.378517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.390355 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-118ffae9-b411-4546-bc32-dac9337031b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1215 microversion: 2.1 time: 0.470793 Sep 01 05:32:36.391026 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3172/6300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:35 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1215 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:37.440617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:37.443617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:37.459728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.460651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.462568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.465843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.466611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.467280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.789413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.813065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9a5e279-b748-40cc-b3ea-67e9cdab75e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1215 microversion: 2.1 time: 0.393256 Sep 01 05:32:37.828647 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3129/6301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:37 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1215 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:38.559445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5cf05ed2-60bb-45a7-ba6a-e3a7d1fab4d8 req-b3ff761e-e30d-4fe3-9098-dac146e5d6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707789d1-4711-413d-92cf-c764daaa59ba", "tag": "164d2d26-2e13-4143-a044-03ff3f021850"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:38.585229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5cf05ed2-60bb-45a7-ba6a-e3a7d1fab4d8 req-b3ff761e-e30d-4fe3-9098-dac146e5d6e7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.585721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5cf05ed2-60bb-45a7-ba6a-e3a7d1fab4d8 req-b3ff761e-e30d-4fe3-9098-dac146e5d6e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.586154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5cf05ed2-60bb-45a7-ba6a-e3a7d1fab4d8 req-b3ff761e-e30d-4fe3-9098-dac146e5d6e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.621775 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5cf05ed2-60bb-45a7-ba6a-e3a7d1fab4d8 req-b3ff761e-e30d-4fe3-9098-dac146e5d6e7 service nova] Creating event network-changed:164d2d26-2e13-4143-a044-03ff3f021850 for instance 707789d1-4711-413d-92cf-c764daaa59ba on n-h1-820368-37 Sep 01 05:32:38.642436 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5cf05ed2-60bb-45a7-ba6a-e3a7d1fab4d8 req-b3ff761e-e30d-4fe3-9098-dac146e5d6e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087200 Sep 01 05:32:38.643144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3173/6302] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:38.838414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:38.839942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:38.855850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.856877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.857507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.858676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.860578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.862079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.010727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-462bbc77-7754-46bc-b910-1d0fc274b79f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Action: 'create', calling method: .version_select at 0x7fa75ac178b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1682256707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHQYMr8bJUEaMk5ySZoTqboP5+lwegLNim542g9ZXatPQ3cQ9a8fOTJEm1bDIoYYTLd4VJL2C4DCoUvI5u52kVlxb8yXb9/24HwWWzmRgNOobPVqMf38x2+c1W+HSWG1A=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:39.039079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-462bbc77-7754-46bc-b910-1d0fc274b79f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Getting quotas for project a906b86c3bdc4c91b9bf03fe629a6d4b. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:39.047683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-462bbc77-7754-46bc-b910-1d0fc274b79f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Getting quotas for user d71f16e5e919429abf026690506eff11 and project a906b86c3bdc4c91b9bf03fe629a6d4b. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:39.099235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-462bbc77-7754-46bc-b910-1d0fc274b79f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.352958 Sep 01 05:32:39.100120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3130/6303] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:32:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:39.303970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.337392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f204a11-46bb-4e2d-aae5-1be31202e4f9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1215 microversion: 2.1 time: 0.503989 Sep 01 05:32:39.339730 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3174/6304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:38 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1215 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:40.363459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:40.364620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:40.376928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.380087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.380743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.381866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.382504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.386034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.636195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.653883 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c20d186f-78fc-474e-93ab-59e1ffc861a9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1215 microversion: 2.1 time: 0.289919 Sep 01 05:32:40.655527 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3131/6305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:40 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:41.039727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1902531942", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1682256707", "security_groups": [{"name": "tempest-secgroup-smoke-616227637"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c077d02f-dcbd-4630-86ce-37ed75518cf7"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:41.217238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] validate_networks() for [('c077d02f-dcbd-4630-86ce-37ed75518cf7', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:32:41.678685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.680759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.690102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.690874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.691627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.692892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.694620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.695326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.726506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Getting quotas for project a906b86c3bdc4c91b9bf03fe629a6d4b. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:41.742308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Getting quotas for user d71f16e5e919429abf026690506eff11 and project a906b86c3bdc4c91b9bf03fe629a6d4b. Resources: dict_keys(['metadata_items']) {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:41.786630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:32:41.787406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:32:41.788097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:32:41.788975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:32:41.790090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:32:41.796040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:41.805275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.805789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.806476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.807433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.808160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.809462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.842879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Getting quotas for project a906b86c3bdc4c91b9bf03fe629a6d4b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:41.856005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Getting quotas for user d71f16e5e919429abf026690506eff11 and project a906b86c3bdc4c91b9bf03fe629a6d4b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:41.872131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:32:41.875255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:32:41.963375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.986172 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a5f4806-c524-4df4-bfc6-c5603025619b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1215 microversion: 2.1 time: 0.312931 Sep 01 05:32:41.989859 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41f3e43e-a3ca-4217-ad7b-3eec559443ed tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.955945 Sep 01 05:32:41.998087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3175/6306] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:32:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:32:42.013379 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3132/6307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:42.015480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58fa4001-edc2-49f7-acf1-def08e5167bd tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:42.016649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-58fa4001-edc2-49f7-acf1-def08e5167bd tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:42.174516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-58fa4001-edc2-49f7-acf1-def08e5167bd tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.190536 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58fa4001-edc2-49f7-acf1-def08e5167bd tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1303 microversion: 2.1 time: 0.190121 Sep 01 05:32:42.199712 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3176/6308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:43.027622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:43.029622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:43.040193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.041376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.042137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.043663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.045185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.046246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.220472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:43.224154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:43.250275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.251321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.251995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.254094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.254576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.255250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.379792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.381678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.393225 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3c38dc8-102b-457c-8422-2f12843b5c2c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.371413 Sep 01 05:32:43.395945 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3133/6309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:43.418631 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01683fb1-0d7a-4700-87b7-c16da1e862e6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1299 microversion: 2.1 time: 0.207363 Sep 01 05:32:43.419946 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3177/6310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:44.424224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.424833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.434372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.434874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.438857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.441930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.442652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.447609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.469394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.470022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.494693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.495672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.497398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.498397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.499452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.500689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.685188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.699134 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f005612-eefa-4bf6-b43c-301aaf57b331 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1361 microversion: 2.1 time: 0.250894 Sep 01 05:32:44.701678 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3178/6311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:44.777623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.792035 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f2a264f-eb58-469e-9f5d-ec3c2ed3f91d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.372757 Sep 01 05:32:44.799683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3134/6312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:45.722864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:45.723512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:45.735654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.736396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.737287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.737287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.739059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.739059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.818622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:45.819945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:45.829057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.830532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.831180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.832086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.832835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.833423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.187769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.198337 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89d191b0-a50f-46e0-bf7e-64211cfeab9f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.479299 Sep 01 05:32:46.199667 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3179/6313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:45 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:46.231934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.246746 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c1942e6-0eec-426a-b963-934303aeba17 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.433263 Sep 01 05:32:46.250573 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3135/6314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:45 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:46.458090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-11f037b2-17c0-4bff-a7ec-1150e1a816df req-b3c456ef-b780-4610-996a-b5750dfec9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104c4a33-abbf-4221-8cbb-45255ef15c22", "tag": "d5711038-a87d-4510-9c55-8bbfe88fc6da"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:46.473641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11f037b2-17c0-4bff-a7ec-1150e1a816df req-b3c456ef-b780-4610-996a-b5750dfec9cb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.475126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11f037b2-17c0-4bff-a7ec-1150e1a816df req-b3c456ef-b780-4610-996a-b5750dfec9cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.476595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-11f037b2-17c0-4bff-a7ec-1150e1a816df req-b3c456ef-b780-4610-996a-b5750dfec9cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.516994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-11f037b2-17c0-4bff-a7ec-1150e1a816df req-b3c456ef-b780-4610-996a-b5750dfec9cb service nova] Creating event network-changed:d5711038-a87d-4510-9c55-8bbfe88fc6da for instance 104c4a33-abbf-4221-8cbb-45255ef15c22 on n-h2-820368-37 Sep 01 05:32:46.523368 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-11f037b2-17c0-4bff-a7ec-1150e1a816df req-b3c456ef-b780-4610-996a-b5750dfec9cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068881 Sep 01 05:32:46.524520 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3180/6315] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:47.235335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.237257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.245995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.246496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.246959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.247698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.248239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.248665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.288702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.290057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.297809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.298223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.298859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.299797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.300239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.300674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.453887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.463016 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be57eb23-662f-4ba3-8260-fd5666692830 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.232123 Sep 01 05:32:47.467050 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3136/6316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:47.493943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.504315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9c39e22b-8c4f-4ccd-b6e9-f8e5b0e2d016 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.224433 Sep 01 05:32:47.504942 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3181/6317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:48.490289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:48.491034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:48.498820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.499593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.501071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.501598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.502598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.503361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.533033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:48.536760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:48.545542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.546031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.546495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.547276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.547727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.548148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.745562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.749216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.754246 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dc3f067-e500-43f0-a046-b8939796047c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.272688 Sep 01 05:32:48.754844 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3137/6318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:48.760113 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f70e15f-4018-4051-bfbe-a590f2ccd0e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.236778 Sep 01 05:32:48.760711 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3182/6319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:49.782079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.784524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.785685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.786866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.799863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:49.805173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.808868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.809190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.809945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.810639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.811698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.812531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.813524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.814241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.814879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.815600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.817618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.493023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.520349 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fdf70875-e24f-406b-b50b-bd06fbb679bb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.742966 Sep 01 05:32:50.521391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.521804 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3183/6320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:50.537703 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22e5d672-f03f-4f8b-b125-10f7ee1c1bb6 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.766165 Sep 01 05:32:50.538590 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3138/6321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:51.545083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:51.545847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:51.553517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.554319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.555066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.556061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.557036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.558775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.562603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:51.569072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:51.593143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.594423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.598980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.600405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.601338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.602178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.824211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:51.841218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.851990 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a5924ea-36b1-4c12-9533-275c07f7475c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.312702 Sep 01 05:32:51.867108 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3184/6322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:51 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:51.878436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.888198 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd056bd1-c8ea-4f57-91fb-6b0c515fe5f7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.330906 Sep 01 05:32:51.901947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0d4ad6d0-3044-45a6-8105-63078017230e req-a927c35b-2074-4a44-872d-30b009b1e63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707789d1-4711-413d-92cf-c764daaa59ba", "name": "network-vif-plugged", "status": "completed", "tag": "164d2d26-2e13-4143-a044-03ff3f021850"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:51.903201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3139/6323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:51 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:51.915650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d4ad6d0-3044-45a6-8105-63078017230e req-a927c35b-2074-4a44-872d-30b009b1e63c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.916124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d4ad6d0-3044-45a6-8105-63078017230e req-a927c35b-2074-4a44-872d-30b009b1e63c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.916582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0d4ad6d0-3044-45a6-8105-63078017230e req-a927c35b-2074-4a44-872d-30b009b1e63c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.928827 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0d4ad6d0-3044-45a6-8105-63078017230e req-a927c35b-2074-4a44-872d-30b009b1e63c service nova] Creating event network-vif-plugged:164d2d26-2e13-4143-a044-03ff3f021850 for instance 707789d1-4711-413d-92cf-c764daaa59ba on n-h1-820368-37 Sep 01 05:32:51.940829 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0d4ad6d0-3044-45a6-8105-63078017230e req-a927c35b-2074-4a44-872d-30b009b1e63c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044787 Sep 01 05:32:51.941631 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3185/6324] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:52.874560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:52.875348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:52.885223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.885926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.886661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.887571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.888213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.888737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.914546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:52.916822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:52.924214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=18 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:52.928467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.929296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.930993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.931981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.932622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.933215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.176845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.186393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.196942 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23b6fd17-2d92-4ebb-bf61-32bb3b65914c tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.289703 Sep 01 05:32:53.197249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f5e7520-6826-49c1-86ee-f6bb2b68470d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1203 microversion: 2.1 time: 0.327175 Sep 01 05:32:53.197943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3140/6325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:52 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1203 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:53.200593 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3186/6326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:52 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:53.958599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ef1bb2da-c773-4794-8be1-7e8d2f9cd53b req-8534db6f-8f68-49c4-b781-dd91f6a112cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104c4a33-abbf-4221-8cbb-45255ef15c22", "name": "network-vif-plugged", "status": "completed", "tag": "d5711038-a87d-4510-9c55-8bbfe88fc6da"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:53.974703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef1bb2da-c773-4794-8be1-7e8d2f9cd53b req-8534db6f-8f68-49c4-b781-dd91f6a112cb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.975603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef1bb2da-c773-4794-8be1-7e8d2f9cd53b req-8534db6f-8f68-49c4-b781-dd91f6a112cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.976352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef1bb2da-c773-4794-8be1-7e8d2f9cd53b req-8534db6f-8f68-49c4-b781-dd91f6a112cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.990783 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ef1bb2da-c773-4794-8be1-7e8d2f9cd53b req-8534db6f-8f68-49c4-b781-dd91f6a112cb service nova] Creating event network-vif-plugged:d5711038-a87d-4510-9c55-8bbfe88fc6da for instance 104c4a33-abbf-4221-8cbb-45255ef15c22 on n-h2-820368-37 Sep 01 05:32:53.997695 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ef1bb2da-c773-4794-8be1-7e8d2f9cd53b req-8534db6f-8f68-49c4-b781-dd91f6a112cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041847 Sep 01 05:32:53.997695 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3141/6327] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:54.226015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.228944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.231318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.231938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.241949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.242262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.242504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.242678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.242909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.243532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.244436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.244916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.245347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.248958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.249496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.249939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.597436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.606497 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b05be9f-8562-451c-8f5a-9468c92f4247 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.385232 Sep 01 05:32:54.607287 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3142/6328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:54.610576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.619168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14cd786e-1045-4054-85cf-44541eb2f086 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1390 microversion: 2.1 time: 0.402035 Sep 01 05:32:54.619985 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3187/6329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1390 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:54.642285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.642920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.649279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.649783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.650223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.650968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.651440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.651870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.805437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:54.814166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c07e5076-4996-4006-96a1-9d9dafa5f9c4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1390 microversion: 2.1 time: 0.175888 Sep 01 05:32:54.814989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3143/6330] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:54.837733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.838252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.845269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.845757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.846185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.846877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.847354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.847806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.999944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.008566 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0a23507-c2f8-4c64-8860-e599d4b14093 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1390 microversion: 2.1 time: 0.175819 Sep 01 05:32:55.009959 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3188/6331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:55.030165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.030749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.039701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.040325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.040921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.041626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.042077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.042489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.079191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:32:55.143826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:55.180972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edf5afb8-2a39-4ba9-8932-a5d62c8d0aae tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 204 len: 0 microversion: 2.1 time: 0.154401 Sep 01 05:32:55.181676 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3144/6332] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:32:55 2022] DELETE /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:32:55.190502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.191540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.198592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.199212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.199671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.200419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.200949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.201428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.357217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.365401 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-37344374-1a8d-4bf0-8ca5-016a8ad8a479 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1396 microversion: 2.1 time: 0.179011 Sep 01 05:32:55.365990 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3189/6333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:55 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1396 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:55.631927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.633627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.640848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.641345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.641791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.642507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.643000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.643620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.804595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.814384 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08c0426c-49f6-47df-8fea-18d40b7b483d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1428 microversion: 2.1 time: 0.187799 Sep 01 05:32:55.814384 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3145/6334] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:55 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1428 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:56.386487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:56.387162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:56.394977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.395471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.395907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.396610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.397064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.397489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.564674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.568307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=100 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:56.574879 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-81a32f6f-2ec6-4f29-bc48-99a16edf50d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1396 microversion: 2.1 time: 0.192771 Sep 01 05:32:56.575522 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3190/6335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:56 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1396 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:56.834752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:56.835557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:56.843225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.843857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.844437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.845249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.845889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.846395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.219830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.234793 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-202dae3e-ebb5-4839-ba85-38f893f0056b tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1608 microversion: 2.1 time: 0.403925 Sep 01 05:32:57.235459 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3146/6336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:56 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1608 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:57.257080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.258054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.271300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.271910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.272362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.273112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.273570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.273990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.595799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.597155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.597698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.608620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.609122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.609559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.610269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.615206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.615776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.617257 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-97e795ff-c619-4b5d-8a90-2b3c7b1b55f8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1608 microversion: 2.1 time: 0.364087 Sep 01 05:32:57.618610 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3191/6337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1608 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:57.644020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.644832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.667594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.668292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.668756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.669947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.670617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.671152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.040010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.053909 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71a10ddc-f67c-4d83-9b7b-d3041b43bc2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1396 microversion: 2.1 time: 0.460644 Sep 01 05:32:58.056112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3147/6338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1396 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:58.099583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.117418 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c42ccacc-ca9b-4b79-b412-db3643ba060a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1608 microversion: 2.1 time: 0.478882 Sep 01 05:32:58.118508 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3192/6339] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1608 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:58.127166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-34219e64-a422-47e5-99dd-11677c82295a req-919fc112-b746-43f2-9f35-339e9953b960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707789d1-4711-413d-92cf-c764daaa59ba", "name": "network-vif-deleted", "tag": "164d2d26-2e13-4143-a044-03ff3f021850"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:58.144638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-34219e64-a422-47e5-99dd-11677c82295a req-919fc112-b746-43f2-9f35-339e9953b960 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.146495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-34219e64-a422-47e5-99dd-11677c82295a req-919fc112-b746-43f2-9f35-339e9953b960 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.147789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-34219e64-a422-47e5-99dd-11677c82295a req-919fc112-b746-43f2-9f35-339e9953b960 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.174286 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-34219e64-a422-47e5-99dd-11677c82295a req-919fc112-b746-43f2-9f35-339e9953b960 service nova] Creating event network-vif-deleted:164d2d26-2e13-4143-a044-03ff3f021850 for instance 707789d1-4711-413d-92cf-c764daaa59ba on n-h1-820368-37 Sep 01 05:32:58.183653 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-34219e64-a422-47e5-99dd-11677c82295a req-919fc112-b746-43f2-9f35-339e9953b960 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065416 Sep 01 05:32:58.185338 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3148/6340] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:59.089303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.090052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.098790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.099612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.100230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.101125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.101746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.102332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.226945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.239223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e263b60e-fece-4dc6-a109-a074285d973e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1188 microversion: 2.1 time: 0.154031 Sep 01 05:32:59.254398 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3193/6341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1188 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:00.268989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.271141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:00.282130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.283467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.284717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.285921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.286657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.287361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.433239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.447859 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cf55e49-9c46-4a90-b764-838c59879b16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1188 microversion: 2.1 time: 0.188940 Sep 01 05:33:00.462254 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3149/6342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:00 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1188 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:01.024639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5c74f486-036c-4cca-933b-9e7e9a230d90 req-a328d651-d356-4e84-b97d-04ea22a3f31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104c4a33-abbf-4221-8cbb-45255ef15c22", "tag": "d5711038-a87d-4510-9c55-8bbfe88fc6da"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:01.033030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:01.041761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c74f486-036c-4cca-933b-9e7e9a230d90 req-a328d651-d356-4e84-b97d-04ea22a3f31b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.043625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c74f486-036c-4cca-933b-9e7e9a230d90 req-a328d651-d356-4e84-b97d-04ea22a3f31b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.044314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5c74f486-036c-4cca-933b-9e7e9a230d90 req-a328d651-d356-4e84-b97d-04ea22a3f31b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.072006 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5c74f486-036c-4cca-933b-9e7e9a230d90 req-a328d651-d356-4e84-b97d-04ea22a3f31b service nova] Creating event network-changed:d5711038-a87d-4510-9c55-8bbfe88fc6da for instance 104c4a33-abbf-4221-8cbb-45255ef15c22 on n-h2-820368-37 Sep 01 05:33:01.082676 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5c74f486-036c-4cca-933b-9e7e9a230d90 req-a328d651-d356-4e84-b97d-04ea22a3f31b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063281 Sep 01 05:33:01.085211 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3194/6343] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:01.469695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:01.470545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:01.490197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.491050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.491524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.495201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.495782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.498122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.614123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:01.631961 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d0d6dcf-74ef-492d-8734-ade31d5f38a2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1188 microversion: 2.1 time: 0.166849 Sep 01 05:33:01.632637 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3150/6344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:01 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:02.670491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:02.671900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:02.678806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.679682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.680315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.681579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.682352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.683034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.755468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:02.768746 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-384788fc-0375-4a40-9a86-5317889e0f78 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1188 microversion: 2.1 time: 0.104058 Sep 01 05:33:02.770085 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3195/6345] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:02 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1188 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:03.791729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.793133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.796903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:03.804461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.806320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.807092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.808231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.808871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.809431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.861158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.861656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.862102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.862562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lazy-loading 'fault' on Instance uuid 707789d1-4711-413d-92cf-c764daaa59ba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:03.914644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.924984 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db5fb39d-5207-40d2-9d73-9a007c801adc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 200 len: 1193 microversion: 2.1 time: 0.136936 Sep 01 05:33:03.925800 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3151/6346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:03 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:04.948667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:04.949267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 707789d1-4711-413d-92cf-c764daaa59ba] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:04.957796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.958292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.958811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.959644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.960262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.960810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.980048 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 707789d1-4711-413d-92cf-c764daaa59ba could not be found. Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba HTTP/1.1 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 707789d1-4711-413d-92cf-c764daaa59ba could not be found. Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '707789d1-4711-413d-92cf-c764daaa59ba'} Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707789d1-4711-413d-92cf-c764daaa59ba could not be found. Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707789d1-4711-413d-92cf-c764daaa59ba could not be found. Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:04.981915 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707789d1-4711-413d-92cf-c764daaa59ba could not be found. Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 707789d1-4711-413d-92cf-c764daaa59ba could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e8c3036-3459-4d05-b581-cf2bde9b2da6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba" status: 404 len: 111 microversion: 2.1 time: 0.039960 Sep 01 05:33:04.988404 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3196/6347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:04 2022] GET /compute/v2.1/servers/707789d1-4711-413d-92cf-c764daaa59ba => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:33:31.083917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-574491544", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1e71f3fe-e378-4a66-8e51-352fff052b55", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:31.095900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.096758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.193234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:33:31.619978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:33:31.620712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:33:31.621185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:33:31.621593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:33:31.622020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:33:31.635183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.635679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.636149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.636961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.637441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.637900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.668580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:31.676165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:31.693070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:33:31.696494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1e71f3fe-e378-4a66-8e51-352fff052b55',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:33:31.776640 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cc11449-3546-4346-bce8-d6e9a40d60b0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698888 Sep 01 05:33:31.777485 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3152/6348] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:33:31.788966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36a1f54d-a41f-4de4-b701-634ec3ef405a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:31.790419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36a1f54d-a41f-4de4-b701-634ec3ef405a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:31.793159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.794553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=28 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.861888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36a1f54d-a41f-4de4-b701-634ec3ef405a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.870437 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36a1f54d-a41f-4de4-b701-634ec3ef405a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1056 microversion: 2.1 time: 0.085496 Sep 01 05:33:31.870966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3197/6349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:31 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1056 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:32.893338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:32.894255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:32.901497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.901989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.902426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.903161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.903618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.904142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.980850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.991612 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc39e474-0ba6-44af-8a89-035634001de6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1108 microversion: 2.1 time: 0.103363 Sep 01 05:33:33.007266 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3153/6350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:32 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1108 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:34.015406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:34.016539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:34.033339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.033845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.034275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.035026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.035483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.035903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.407219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.425568 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bd716a48-0530-4d28-b8f0-23f3b756e5bd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.412826 Sep 01 05:33:34.426496 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3198/6351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:34 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:35.087193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8a071260-87d1-40c4-a2da-b890a439334a req-23c837b7-8e7b-4c31-b7cd-c6c161a3d35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ba6f0d-a947-4b12-a55f-eec33897b13d", "tag": "479f786b-ae44-4b11-838a-ee066e7a6118"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:35.112021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a071260-87d1-40c4-a2da-b890a439334a req-23c837b7-8e7b-4c31-b7cd-c6c161a3d35f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.112752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a071260-87d1-40c4-a2da-b890a439334a req-23c837b7-8e7b-4c31-b7cd-c6c161a3d35f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.113380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a071260-87d1-40c4-a2da-b890a439334a req-23c837b7-8e7b-4c31-b7cd-c6c161a3d35f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.127668 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8a071260-87d1-40c4-a2da-b890a439334a req-23c837b7-8e7b-4c31-b7cd-c6c161a3d35f service nova] Creating event network-changed:479f786b-ae44-4b11-838a-ee066e7a6118 for instance f6ba6f0d-a947-4b12-a55f-eec33897b13d on n-h1-820368-37 Sep 01 05:33:35.134980 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8a071260-87d1-40c4-a2da-b890a439334a req-23c837b7-8e7b-4c31-b7cd-c6c161a3d35f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202782 Sep 01 05:33:35.136593 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3154/6352] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:35.455056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:35.460120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:35.483081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.483081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.483366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.486190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.486905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.487362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.898539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.911990 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f105eda-b288-47ad-9ff7-3dcffaa1f178 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.461666 Sep 01 05:33:35.912606 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3199/6353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:35 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:36.939213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.939934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.947654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.948154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.948594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.949317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.949776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.950330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.480007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:37.490298 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d42827d-d45d-4f6b-875e-fe8fae951b3d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.555208 Sep 01 05:33:37.491337 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3155/6354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:38.515769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:38.516444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:38.525025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:38.525935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:38.526481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.527668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:38.528432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:38.529136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.722447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.734101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e44d10ab-408a-4b58-8714-8008ff4c5b56 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.224132 Sep 01 05:33:38.734721 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3200/6355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:38 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:39.767951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:39.770086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:39.789831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.790583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.792455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.793671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.794732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.795233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.046293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.071454 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d15c18f6-14f5-4757-815b-bb013bf4f00f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.313798 Sep 01 05:33:40.072466 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3156/6356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:39 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:40.757764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.759032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.767118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.769318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.769946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.770689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.771297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.771713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.876315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lazy-loading 'services' on Instance uuid e7aca1fe-11a5-4ad7-813b-b50514a49e74 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:40.969233 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8cc9a692-9c60-4022-a029-0bd273839796 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74/os-volume_attachments/faf464ad-fceb-4c9e-9786-1af2df87a644" status: 202 len: 0 microversion: 2.1 time: 0.217310 Sep 01 05:33:40.979770 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3201/6357] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:33:40 2022] DELETE /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74/os-volume_attachments/faf464ad-fceb-4c9e-9786-1af2df87a644 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:33:41.125197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:41.127745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:41.142017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.142538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.143199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.144178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.145241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.145809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.340854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.350010 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bce23596-ff64-4fea-bdaf-fc8f2052b215 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.254350 Sep 01 05:33:41.350620 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3157/6358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:41 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:42.373352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:42.375172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:42.382689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:42.386694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.387460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.388057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.388957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.389454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.389846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.613929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.626000 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-56f99862-559b-42eb-a8b5-05dac4395002 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.256908 Sep 01 05:33:42.626607 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3202/6359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:42 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:43.648993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:43.649615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:43.651823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:43.652500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:43.659790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.660284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.660739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.661459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.661917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.662357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.836057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:43.845186 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3caac1fe-095b-4b6f-8062-3b3b47e4bb7a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.200674 Sep 01 05:33:43.845800 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3158/6360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:43 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:44.870800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:44.871638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:44.880381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.880925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.881425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.882406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.882875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.883316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.041848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.050238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c659ccd6-8894-4262-8d5e-0e96a20a0309 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.183887 Sep 01 05:33:45.050920 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3203/6361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:44 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:46.074629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.074629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.080544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.081051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.081460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.082451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.083185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.083615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.232240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.240775 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-131026bf-e0b7-432d-a2bd-c5983fcdf56a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.173454 Sep 01 05:33:46.241522 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3159/6362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:46 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:46.454074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.454643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.462972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.463584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.464026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.464732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.465172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.465789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.493544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:33:46.613944 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a46e4465-7410-4a3a-9e90-2d1e4f614733 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 204 len: 0 microversion: 2.1 time: 0.163468 Sep 01 05:33:46.614462 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3204/6363] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:33:46 2022] DELETE /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:33:46.626266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.626989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.635645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.636258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.636708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.637479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.638279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.639009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.788298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.797458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1731ed2b-e189-4c1e-8649-e79bb9ed6e2a tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1470 microversion: 2.1 time: 0.177783 Sep 01 05:33:46.798102 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3160/6364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:46 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:47.262961 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.263823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.270746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.271237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.271661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.272357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.273160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.273631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.424763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:47.434166 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc428f61-c197-477f-9ca8-bb2d70da9994 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.175730 Sep 01 05:33:47.434761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3205/6365] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:47.820288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.821378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.829807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.830314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.830766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.831533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.831998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.832425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.005145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.017574 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c667021c-26e1-407c-a97d-db4d36f84cd0 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1470 microversion: 2.1 time: 0.201398 Sep 01 05:33:48.018420 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3161/6366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1470 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:48.457301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:48.458739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:48.469150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.469793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.470432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.471629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.472423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.472958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.770342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.783175 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42986954-2919-4783-b90c-c812fae24cc6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.330991 Sep 01 05:33:48.784067 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3206/6367] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:48 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:49.040705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.041985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.050706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.051543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.051994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.052720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.053350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.053836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.136654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53cd6780e8e4950900d26dbd07edd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e81cc6e8b14fe78fc9a4276c319a04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.151103 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c46b68a7-091e-4e0f-9c26-1d218b5836d7 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 200 len: 1428 microversion: 2.1 time: 0.114305 Sep 01 05:33:49.152627 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3162/6368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:49.263213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8cee1b21-6639-4527-8e3c-59cbbf5eb3c4 req-af84fd4c-dc76-4aa2-9333-7b585a4d8535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7aca1fe-11a5-4ad7-813b-b50514a49e74", "name": "network-vif-deleted", "tag": "a9573e66-b6f9-4201-8fbc-a9e7d70517bf"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:49.286059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8cee1b21-6639-4527-8e3c-59cbbf5eb3c4 req-af84fd4c-dc76-4aa2-9333-7b585a4d8535 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.287256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8cee1b21-6639-4527-8e3c-59cbbf5eb3c4 req-af84fd4c-dc76-4aa2-9333-7b585a4d8535 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.289317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8cee1b21-6639-4527-8e3c-59cbbf5eb3c4 req-af84fd4c-dc76-4aa2-9333-7b585a4d8535 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.311945 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8cee1b21-6639-4527-8e3c-59cbbf5eb3c4 req-af84fd4c-dc76-4aa2-9333-7b585a4d8535 service nova] Creating event network-vif-deleted:a9573e66-b6f9-4201-8fbc-a9e7d70517bf for instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 on n-h2-820368-37 Sep 01 05:33:49.317462 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8cee1b21-6639-4527-8e3c-59cbbf5eb3c4 req-af84fd4c-dc76-4aa2-9333-7b585a4d8535 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062323 Sep 01 05:33:49.321437 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3207/6369] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:49.808080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.808899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.816062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.816867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.817302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.818225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.818809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.819361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.986061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.994658 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdf2ff44-9480-4154-8d08-3bdf037d2c50 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.193566 Sep 01 05:33:49.995309 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3163/6370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:50.174804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.175419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] [instance: e7aca1fe-11a5-4ad7-813b-b50514a49e74] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.183185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.183674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.184103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.184811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.185257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.185675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.201308 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] HTTP exception thrown: Instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 could not be found. Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Request method failure captured: Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 HTTP/1.1 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEPRVupP35XWOs3GHqd6kvv1nz7WgjK1Ma4vBAdoXmTsIKmCwDJaFgTKX1Qf2R5fEkUQzPU3mbI37ZSnapIq7xzJ-xL2jEtoCMdJ2JVRqvJ1C3Qj0glJxAUWGAqHkxLpP3UW_rgGBJ2pF-dhV9FBMZrdUg2TkK7-dDnb35Rs44ucMhg Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f0e81cc6e8b14fe78fc9a4276c319a04 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-VolumesBackupsTest-2079268131 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0e81cc6e8b14fe78fc9a4276c319a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0e81cc6e8b14fe78fc9a4276c319a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0e81cc6e8b14fe78fc9a4276c319a04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0e81cc6e8b14fe78fc9a4276c319a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-VolumesBackupsTest-2079268131 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f0e81cc6e8b14fe78fc9a4276c319a04 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-VolumesBackupsTest-2079268131 Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-VolumesBackupsTest-2079268131-project Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: a53cd6780e8e4950900d26dbd07edd7f Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-VolumesBackupsTest-2079268131-project Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 could not be found. Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e7aca1fe-11a5-4ad7-813b-b50514a49e74'} Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 could not be found. Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 could not be found. Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:50.203074 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 could not be found. Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] Returning 404 to user: Instance e7aca1fe-11a5-4ad7-813b-b50514a49e74 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6996f157-5f8a-4182-8489-d33259c2c973 tempest-VolumesBackupsTest-2079268131 tempest-VolumesBackupsTest-2079268131-project] 10.222.0.26 "GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74" status: 404 len: 111 microversion: 2.1 time: 0.035104 Sep 01 05:33:50.207479 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3208/6371] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/e7aca1fe-11a5-4ad7-813b-b50514a49e74 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:33:51.016704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.017332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.025933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.026432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.026873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.027622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.028085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.028530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.167230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.175839 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d90aea2-2c54-4047-803b-91ebd84b81cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1168 microversion: 2.1 time: 0.163302 Sep 01 05:33:51.176457 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3164/6372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:52.197286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.198070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.205623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.206108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.206535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.207257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.207704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.208118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.354344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.362641 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0bb8909a-7fea-411c-b772-a26e9ca7f606 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.169701 Sep 01 05:33:52.363249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3209/6373] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:53.384072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:53.384686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:53.392995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.393488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.393931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.394638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.395132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.395558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.540572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.549568 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8bbb4c7-f367-4df8-9b98-a8e947c606b6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.169580 Sep 01 05:33:53.550169 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3165/6374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:53 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:54.572384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:54.573008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:54.582222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.583007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.584368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.585586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.586503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.586688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.758496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.768001 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52669f49-7a46-4b24-82da-b0054435012a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.200200 Sep 01 05:33:54.769523 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3210/6375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:54 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:55.792715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:55.793365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:55.801898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.802391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.802829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.803691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.804177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.804607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.956670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.967856 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cceadc9-b61d-4570-9087-b2dcdf982074 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.180521 Sep 01 05:33:55.968474 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3166/6376] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:55 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:56.989982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:56.990614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:56.998028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.998526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.998994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.999703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.000153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.000577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.173186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:57.181622 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36879e15-c2a7-4425-9938-0336dd133cd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.195608 Sep 01 05:33:57.182216 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3211/6377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:56 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:58.205499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:58.206471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:58.217973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.219072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.219758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.220481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:58.221156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:58.221591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:58.381649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:58.390130 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbb7c040-30d7-4e2e-a3b0-a784a94ba6e0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.189914 Sep 01 05:33:58.391138 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3167/6378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:58 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:59.412363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:59.413161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:59.421616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.422433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.422856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.423608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:59.424054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:59.424450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:59.577433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:59.586135 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12978b73-782b-45a7-8c1d-3fb32986bf16 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.178125 Sep 01 05:33:59.586733 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3212/6379] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:59 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:00.259958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b78c9eb6-7503-4e09-9c0b-a349ad20ed2d req-02dd2921-8fe2-4cf0-a5e6-9b28bf760768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba6f0d-a947-4b12-a55f-eec33897b13d", "name": "network-vif-plugged", "status": "completed", "tag": "479f786b-ae44-4b11-838a-ee066e7a6118"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:00.273351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b78c9eb6-7503-4e09-9c0b-a349ad20ed2d req-02dd2921-8fe2-4cf0-a5e6-9b28bf760768 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.274178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b78c9eb6-7503-4e09-9c0b-a349ad20ed2d req-02dd2921-8fe2-4cf0-a5e6-9b28bf760768 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.274651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b78c9eb6-7503-4e09-9c0b-a349ad20ed2d req-02dd2921-8fe2-4cf0-a5e6-9b28bf760768 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.290297 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b78c9eb6-7503-4e09-9c0b-a349ad20ed2d req-02dd2921-8fe2-4cf0-a5e6-9b28bf760768 service nova] Creating event network-vif-plugged:479f786b-ae44-4b11-838a-ee066e7a6118 for instance f6ba6f0d-a947-4b12-a55f-eec33897b13d on n-h1-820368-37 Sep 01 05:34:00.297663 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b78c9eb6-7503-4e09-9c0b-a349ad20ed2d req-02dd2921-8fe2-4cf0-a5e6-9b28bf760768 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040888 Sep 01 05:34:00.297663 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3168/6380] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:00.614163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:00.614779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:00.623501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.624094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.624541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.625275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:00.626040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:00.626467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:00.647443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:00.817318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:00.827472 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8bbf8890-9632-43ba-a9d6-694d256db8f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1202 microversion: 2.1 time: 0.222817 Sep 01 05:34:00.828008 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3213/6381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:00 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1202 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:01.851624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:01.852262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:01.854098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:01.861520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.862022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.862509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.863395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:01.863853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:01.864276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:01.868982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=91 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:02.048056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.059035 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ea5c346-7fa2-4f23-b292-6fc5149b48d5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1390 microversion: 2.1 time: 0.213590 Sep 01 05:34:02.059663 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3169/6382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:01 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1390 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:02.083815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.084439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.087616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:02.093989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.094494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.095062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.095798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.096269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.096681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.284967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.294286 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2b9685b-c01d-4521-b2c7-fb0082f37136 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1390 microversion: 2.1 time: 0.215720 Sep 01 05:34:02.295189 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3214/6383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:02 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:02.315065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.316080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.322870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.323469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.323968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.324768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.325280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.325769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.477870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.486722 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d76874d-757f-4570-a0cc-9acc2b6c3424 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1390 microversion: 2.1 time: 0.175563 Sep 01 05:34:02.487360 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3170/6384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:02 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:02.584627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.585526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.592882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.593377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.593809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.594516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.594991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.595415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.631744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:34:02.740067 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3da7cffb-e718-48a6-af55-8ce12c64cf1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 204 len: 0 microversion: 2.1 time: 0.158549 Sep 01 05:34:02.741842 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3215/6385] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:02 2022] DELETE /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:34:02.750748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.751588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.758607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.759249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.759803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.760620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.761098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.761538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.957600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.967954 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0911b1b-1748-44d7-b281-4d35185f2ca9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1396 microversion: 2.1 time: 0.221329 Sep 01 05:34:02.968935 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3171/6386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:02 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1396 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:04.004571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.005286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.012943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.013468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.013910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.014628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.015132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.015559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.163670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.172284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f2c7ae6-8f31-4bab-bc2c-3386a4c7cc84 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1396 microversion: 2.1 time: 0.173074 Sep 01 05:34:04.173023 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3216/6387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1396 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:04.739325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-aabc3d56-126c-4dd8-99cc-417321a63238 req-492cdbf5-df2e-4023-9f4c-b49ac53dfda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba6f0d-a947-4b12-a55f-eec33897b13d", "name": "network-vif-deleted", "tag": "479f786b-ae44-4b11-838a-ee066e7a6118"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:04.753544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aabc3d56-126c-4dd8-99cc-417321a63238 req-492cdbf5-df2e-4023-9f4c-b49ac53dfda4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.754409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aabc3d56-126c-4dd8-99cc-417321a63238 req-492cdbf5-df2e-4023-9f4c-b49ac53dfda4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.755086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aabc3d56-126c-4dd8-99cc-417321a63238 req-492cdbf5-df2e-4023-9f4c-b49ac53dfda4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.777226 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-aabc3d56-126c-4dd8-99cc-417321a63238 req-492cdbf5-df2e-4023-9f4c-b49ac53dfda4 service nova] Creating event network-vif-deleted:479f786b-ae44-4b11-838a-ee066e7a6118 for instance f6ba6f0d-a947-4b12-a55f-eec33897b13d on n-h1-820368-37 Sep 01 05:34:04.793333 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-aabc3d56-126c-4dd8-99cc-417321a63238 req-492cdbf5-df2e-4023-9f4c-b49ac53dfda4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059605 Sep 01 05:34:04.798486 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3172/6388] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:05.200137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:05.200921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:05.209067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.209687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.210734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.211859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.212393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.212864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.290806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.301287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67ff021a-38fe-461e-8a7b-7f243365d8b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1187 microversion: 2.1 time: 0.105291 Sep 01 05:34:05.302175 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3217/6389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:05 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:06.326133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:06.326790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:06.334571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.335466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.335916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.336847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.337341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.337955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.409284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.418865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5907f90a-1c45-4c5f-9489-42c8ce9479c0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1187 microversion: 2.1 time: 0.097125 Sep 01 05:34:06.419689 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3173/6390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:06 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:07.440110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:07.440830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:07.449222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.449815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.450320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.451137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.451663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.452156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.521506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:07.532065 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d68537a-a263-42ef-abb6-f9e92881af06 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1187 microversion: 2.1 time: 0.095789 Sep 01 05:34:07.532836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3218/6391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:07 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:08.553869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:08.554529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:08.566499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.567334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.568044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.569104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.569978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.570685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.651769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:08.667874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-778b872f-3e20-43b7-a63a-cf2f3a7b6063 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 200 len: 1187 microversion: 2.1 time: 0.117561 Sep 01 05:34:08.668876 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3174/6392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:08 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 1187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:09.691225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:09.692629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:09.701098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:09.701878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:09.702530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:09.703281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:09.703733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:09.704233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:09.720417 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d HTTP/1.1 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'f6ba6f0d-a947-4b12-a55f-eec33897b13d'} Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:09.722123 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8ca11e05-345e-4a1a-86b3-948546ad3ce5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 404 len: 111 microversion: 2.1 time: 0.036406 Sep 01 05:34:09.728547 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3219/6393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:09 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:34:12.958223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:12.958859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:12.967810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.968413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.969049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.969760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.970219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.970640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.985752 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d HTTP/1.1 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'f6ba6f0d-a947-4b12-a55f-eec33897b13d'} Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:12.987698 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03015b1d-5a19-4c1c-a1eb-eb0b8d755255 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 404 len: 111 microversion: 2.1 time: 0.035275 Sep 01 05:34:12.995433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3175/6394] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:12 2022] DELETE /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:34:13.007289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:13.008131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: f6ba6f0d-a947-4b12-a55f-eec33897b13d] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:13.022852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.023391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.023830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.024550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.024999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.025421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.040692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d HTTP/1.1 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'f6ba6f0d-a947-4b12-a55f-eec33897b13d'} Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:13.042370 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance f6ba6f0d-a947-4b12-a55f-eec33897b13d could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-476e3a8d-61b8-4529-8df6-ff5a38bc5ad6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d" status: 404 len: 111 microversion: 2.1 time: 0.049713 Sep 01 05:34:13.050041 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3220/6395] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:12 2022] GET /compute/v2.1/servers/f6ba6f0d-a947-4b12-a55f-eec33897b13d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:34:19.231672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:19.232311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:19.241059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:19.241891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:19.242444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.243173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:19.243746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:19.244174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.276621 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a74418b1-8c64-4084-9168-27889e32b98a tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046917 Sep 01 05:34:19.276621 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3176/6396] 10.222.0.26 () {58 vars in 1293 bytes} [Thu Sep 1 05:34:19 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22/os-server-password => generated 116 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:36.363047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-273220317", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6a29ecc4-0aad-4ef0-88c1-4b712d667157", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:36.374304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:36.374968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:36.437464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:34:36.824580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:34:36.825004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:34:36.825843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:34:36.826256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:34:36.826729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:34:36.836795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.837288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.837727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.838458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.838903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.839343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.858179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:36.863973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:36.926100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:34:36.928373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a29ecc4-0aad-4ef0-88c1-4b712d667157',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:34:37.093178 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8f172b8-1f12-4d96-9508-b4b1c1f1f48d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733751 Sep 01 05:34:37.094237 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3221/6397] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:34:37.105439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7640d4e-dd86-4204-8a9b-db69ca357514 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.106104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7640d4e-dd86-4204-8a9b-db69ca357514 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.112135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=15 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:37.113466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=37 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:37.182323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7640d4e-dd86-4204-8a9b-db69ca357514 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.190442 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7640d4e-dd86-4204-8a9b-db69ca357514 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1070 microversion: 2.1 time: 0.089109 Sep 01 05:34:37.191052 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3177/6398] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1070 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:38.213476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.214803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.221602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.222188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.222587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.223333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.224218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.225754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.316722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.327116 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c438d9e-1478-4373-abb7-8159401ea934 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1176 microversion: 2.1 time: 0.119355 Sep 01 05:34:38.327954 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3222/6399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:38 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1176 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:39.353412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:39.354683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:39.370733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.371534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.372183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.375556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.376500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.377135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.617966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:39.638115 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03a9a58d-01e0-4900-b25e-29bb60888303 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1228 microversion: 2.1 time: 0.289376 Sep 01 05:34:39.639844 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3178/6400] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:39 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1228 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:39.840914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d2331061-813f-4f91-bbf9-fac5a275f2b3 req-6dc313f6-e1e4-4e3a-b91c-190f5ae88eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4741009-2fdc-42c3-a577-ec5e29404f4c", "tag": "9c19653f-b492-4be1-8d86-b0430452f05e"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:39.854579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d2331061-813f-4f91-bbf9-fac5a275f2b3 req-6dc313f6-e1e4-4e3a-b91c-190f5ae88eb0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.855506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d2331061-813f-4f91-bbf9-fac5a275f2b3 req-6dc313f6-e1e4-4e3a-b91c-190f5ae88eb0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.856004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d2331061-813f-4f91-bbf9-fac5a275f2b3 req-6dc313f6-e1e4-4e3a-b91c-190f5ae88eb0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.870238 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d2331061-813f-4f91-bbf9-fac5a275f2b3 req-6dc313f6-e1e4-4e3a-b91c-190f5ae88eb0 service nova] Creating event network-changed:9c19653f-b492-4be1-8d86-b0430452f05e for instance a4741009-2fdc-42c3-a577-ec5e29404f4c on n-h1-820368-37 Sep 01 05:34:39.890250 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d2331061-813f-4f91-bbf9-fac5a275f2b3 req-6dc313f6-e1e4-4e3a-b91c-190f5ae88eb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043656 Sep 01 05:34:39.891312 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3223/6401] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:40.662375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:40.663961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:40.672034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.672790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.673379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.674258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.674868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.675517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.934432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.946228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac89ede2-888a-491c-b521-7b968fc86742 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1228 microversion: 2.1 time: 0.288043 Sep 01 05:34:40.948771 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3179/6402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:40 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1228 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:41.983896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:41.984808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:41.992090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.992090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.993145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.994168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.994825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.995988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.160454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.169383 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4744f2ac-764f-43f3-a15e-d45d3c210653 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1228 microversion: 2.1 time: 0.199420 Sep 01 05:34:42.170093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3224/6403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:41 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:43.191286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:43.192161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:43.200838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.201134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.201547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.202278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.202739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.203409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.366280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.375705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b872611e-29ea-480a-addf-0ac5f6602a36 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1228 microversion: 2.1 time: 0.188471 Sep 01 05:34:43.387657 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3180/6404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:43 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:44.399273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:44.399887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:44.408473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.408964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.409398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.410106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.410658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.410991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.567835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.576392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-df77bda1-9751-4914-9f77-b574961f5efb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.182180 Sep 01 05:34:44.577003 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3225/6405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:44 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:45.601063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:45.603092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:45.616121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.616761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.617179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.617891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.618356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.618786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.766672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.775465 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-247cf331-5f2a-4bdc-82a5-a94e3fc1c437 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.179311 Sep 01 05:34:45.776056 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3181/6406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:45 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:46.798004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.798843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.806040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.806641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.806999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.807696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.808199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.808637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.846865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:46.872220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:46.946564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.954517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4374488e-f1e1-4b59-96d8-d07f8548d8cd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.160550 Sep 01 05:34:46.955115 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3226/6407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:46 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:47.976127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.976764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.979716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:47.985526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.986016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.986452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.987208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.987665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.988087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.132421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:48.140520 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea3e7d7a-eec5-4efd-9b60-4622a9e352e3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.168763 Sep 01 05:34:48.141109 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3182/6408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:49.162922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:49.163547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:49.171313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.171825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.172440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.173150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.173594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.174010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.326442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.336224 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-13465fdd-13cf-435e-a0f3-002a15069541 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.178003 Sep 01 05:34:49.336667 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3227/6409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:49 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:50.356684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:50.357297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:50.364354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.364914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.365616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.366366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.366871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.367329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.515327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.523395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-620f1445-6a2c-4996-8169-b19c2761bdc3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.170717 Sep 01 05:34:50.524220 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3183/6410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:50 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:51.545102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:51.545770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:51.553620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.554080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.554544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.555274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.555711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.556132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.693802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.702629 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53eb1788-1a70-4b66-812d-e76bc2917c32 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.161546 Sep 01 05:34:51.703250 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3228/6411] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:51 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:52.723054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:52.723598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:52.731484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.732785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.733234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.733988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.734812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.739478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.887103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.895323 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd8c8c2f-fb0f-49ae-a31f-94d333a69f74 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.176543 Sep 01 05:34:52.896156 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3184/6412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:52 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:53.918240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.918914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.926579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.927307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.927859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.928829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.929374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.929922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.068618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:54.076838 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd8dfb9f-ccd7-47e2-80be-a85df2efe20e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.162851 Sep 01 05:34:54.077413 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3229/6413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:53 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:54.585888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1706d1b5-1d70-4435-b335-5adbe3bc59f8 req-d9785869-5354-44a2-9b12-54b65a1b7b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4741009-2fdc-42c3-a577-ec5e29404f4c", "name": "network-vif-plugged", "status": "completed", "tag": "9c19653f-b492-4be1-8d86-b0430452f05e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:54.595980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1706d1b5-1d70-4435-b335-5adbe3bc59f8 req-d9785869-5354-44a2-9b12-54b65a1b7b69 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.596462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1706d1b5-1d70-4435-b335-5adbe3bc59f8 req-d9785869-5354-44a2-9b12-54b65a1b7b69 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.596897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1706d1b5-1d70-4435-b335-5adbe3bc59f8 req-d9785869-5354-44a2-9b12-54b65a1b7b69 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.613888 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1706d1b5-1d70-4435-b335-5adbe3bc59f8 req-d9785869-5354-44a2-9b12-54b65a1b7b69 service nova] Creating event network-vif-plugged:9c19653f-b492-4be1-8d86-b0430452f05e for instance a4741009-2fdc-42c3-a577-ec5e29404f4c on n-h1-820368-37 Sep 01 05:34:54.620709 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1706d1b5-1d70-4435-b335-5adbe3bc59f8 req-d9785869-5354-44a2-9b12-54b65a1b7b69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163024 Sep 01 05:34:54.621336 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3185/6414] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:55.098499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:55.099628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:55.107788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.108282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.108717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.109417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.109868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.110328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.246803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.255323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f4d04a5-1e62-47a9-b8cc-88a014713d04 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1216 microversion: 2.1 time: 0.160897 Sep 01 05:34:55.266916 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3230/6415] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:55 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:56.278762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.279490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.287088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.287088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.287495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.288207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.288670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.289095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.438069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.446876 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1292c083-bdec-4c0a-8c6c-2990e26d6129 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1403 microversion: 2.1 time: 0.173418 Sep 01 05:34:56.447472 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3186/6416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1403 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:56.467330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.467865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.475233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.475792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.476229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.476935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.477391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.477812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.615508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.623464 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c50282a-914f-4133-a1e7-c7a5eb1fa053 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1403 microversion: 2.1 time: 0.160142 Sep 01 05:34:56.624030 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3231/6417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1403 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:56.644331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-604152364"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:56.646991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.653395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.653885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.654320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.655386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.655839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.656390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.750204 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.compute.api [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Attempting to quiesce instance before volume snapshot. Sep 01 05:34:56.808243 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.compute.api [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 01 05:34:56.901558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Creating snapshot from volume 6a29ecc4-0aad-4ef0-88c1-4b712d667157. {{(pid=128863) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 01 05:34:57.713832 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e748ff30-7518-4d06-917f-1595b99486f1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c/action" status: 202 len: 0 microversion: 2.1 time: 1.073396 Sep 01 05:34:57.715294 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3187/6418] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:34:56 2022] POST /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c/action => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 05:34:59.016875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-198936098", "imageRef": "fda1bdaa-73b9-453e-987d-ccda6b13c8de", "flavorRef": "452", "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:59.081600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:34:59.479216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:34:59.480755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:34:59.481451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:34:59.481865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:34:59.482306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:34:59.492284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.492284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.492656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.493389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.493844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.494267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.511921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:59.517388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:59.531329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:34:59.534001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a3a8b28a-02c6-48f8-aedc-63698d92ff18',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:34:59.611061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d49eff42-b596-4358-be23-99eeb0ab3a6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598174 Sep 01 05:34:59.618151 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3232/6419] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:34:59.624984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e23601c9-1047-4c97-a60b-3f2f30b1a7b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:59.625717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e23601c9-1047-4c97-a60b-3f2f30b1a7b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:59.715938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e23601c9-1047-4c97-a60b-3f2f30b1a7b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.737678 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e23601c9-1047-4c97-a60b-3f2f30b1a7b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1229 microversion: 2.1 time: 0.115893 Sep 01 05:34:59.752152 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3188/6420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:59 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1229 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:00.762144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:00.762870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:00.771726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.772500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.772926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.774050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.774694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.775150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.849725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.857969 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28d7f662-dcc3-43f5-a3b0-06856cbd0cee tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1281 microversion: 2.1 time: 0.101494 Sep 01 05:35:00.858561 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3233/6421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:00 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:01.880127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.882059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.896107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.901921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.903079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.904944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.905721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.913430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.298158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.315580 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a43ae31f-62bf-4fa0-849d-10fa16b918b3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.440385 Sep 01 05:35:02.316191 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3189/6422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:03.150038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-37bd4ef4-5526-49be-af55-2af9a9cc459f req-674878de-e24e-44b9-b900-8e00fa9ced4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e88123-2321-440e-82ec-466c765929a8", "tag": "497d835b-cd60-4825-9b56-28dbd82ad456"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:03.171491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-37bd4ef4-5526-49be-af55-2af9a9cc459f req-674878de-e24e-44b9-b900-8e00fa9ced4c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.172219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-37bd4ef4-5526-49be-af55-2af9a9cc459f req-674878de-e24e-44b9-b900-8e00fa9ced4c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.172817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-37bd4ef4-5526-49be-af55-2af9a9cc459f req-674878de-e24e-44b9-b900-8e00fa9ced4c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.204274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-37bd4ef4-5526-49be-af55-2af9a9cc459f req-674878de-e24e-44b9-b900-8e00fa9ced4c service nova] Creating event network-changed:497d835b-cd60-4825-9b56-28dbd82ad456 for instance 96e88123-2321-440e-82ec-466c765929a8 on n-h2-820368-37 Sep 01 05:35:03.214897 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-37bd4ef4-5526-49be-af55-2af9a9cc459f req-674878de-e24e-44b9-b900-8e00fa9ced4c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070603 Sep 01 05:35:03.215967 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3234/6423] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:03.340810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.342386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.351289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.352347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.353130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.354736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.355462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.356237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.637154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.646993 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15e15eec-81d2-417e-babe-3cf8cddb2e0e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.310963 Sep 01 05:35:03.667035 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3190/6424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:04.673843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:04.674521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:04.682865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.683399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.683831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.684528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.684972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.685412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.833603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.842026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f9a5beb0-d53c-4222-b2b3-8a20efaa66d6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.172629 Sep 01 05:35:04.842863 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3235/6425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:04 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:05.865157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:05.865874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:05.872972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.873868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.874586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.875390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.875933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.876565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:06.122911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.142487 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ae0d795-e8c7-4c13-84d3-bc0281c5fc6c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.281927 Sep 01 05:35:06.143491 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3191/6426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:05 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:07.168042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.168690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:07.171744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:07.178232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.178718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.179288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.180168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.180799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.181516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.186398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=75 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:07.739714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:07.753180 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d9cf48b-9338-400c-bb21-272c9985e056 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.587945 Sep 01 05:35:07.754306 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3236/6427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:07 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:08.779145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:08.781208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:08.788404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=35 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:08.790361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:08.791440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:08.793890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.793890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:08.793890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:08.793890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:08.797365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:08.943173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:08.951594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d20de216-aff4-4f65-b66e-91b13c07d2c7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.176408 Sep 01 05:35:08.952534 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3192/6428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:08 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:09.979076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:09.980405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:09.983390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:09.985369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:09.992707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.993444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.994208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:09.995630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:09.996541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:09.997197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:10.208442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:10.217107 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-da5ceb28-3edc-490b-94ac-96df60500619 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.242079 Sep 01 05:35:10.218910 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3237/6429] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:09 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:11.241139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:11.241825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:11.244951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:11.257918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.258635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.259301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.260390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.260868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.261320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.415498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.423606 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a708f2d-fa6c-47f3-9212-e5fece57ea64 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.186529 Sep 01 05:35:11.424495 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3193/6430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:11 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:12.445915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.447121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:12.458837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.460060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.461391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.462704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.463678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.464575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.616589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:12.625738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be207fb2-c414-4f4e-8241-d48c999a8649 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.183826 Sep 01 05:35:12.626288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3238/6431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:12 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:13.648955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:13.650389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:13.658509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.659193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.659642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.660347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.660827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.661368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.831301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.841370 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27c71779-f15d-4670-80c4-7189a4f2b87d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.197209 Sep 01 05:35:13.843023 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3194/6432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:13 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:14.863532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:14.864308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.872095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.872851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.873308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.874017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.874771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.875292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.046563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.055892 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59244897-361a-4c0d-826b-b0285d28acda tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.196640 Sep 01 05:35:15.057070 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3239/6433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:14 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:16.078734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.079427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.087260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.088939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.089434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.090253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.090800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.091336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.245825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.254783 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90c280de-e7a0-4092-a2f2-0d355f203c65 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1341 microversion: 2.1 time: 0.180775 Sep 01 05:35:16.255694 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3195/6434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:17.284289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.284902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.293413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.293912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.294344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.295076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.295506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.295950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.449196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:17.458228 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2386021-5302-4287-b52b-638f38a3ca43 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.178555 Sep 01 05:35:17.458921 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3240/6435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:18.480974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:18.481582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:18.489728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.490371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.490874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.491582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:18.492060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:18.492511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.653472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.662528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47aee71a-0548-4b97-8c95-6b03102e7929 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.185434 Sep 01 05:35:18.663148 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3196/6436] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:18 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:19.684821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:19.685700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:19.702268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.702874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.703279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.704472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.705203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.706257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.871379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.879893 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd1d4eed-c935-4681-9bf8-d8cad739475a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.199344 Sep 01 05:35:19.880450 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3241/6437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:19 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:20.902194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.902826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.910878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.911407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.911832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.912660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.913130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.913564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.065971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:21.079267 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b0228ae-e8c8-4227-a449-d76f1008b6fe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.180689 Sep 01 05:35:21.079759 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3197/6438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:20 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:22.102486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:22.103281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:22.111188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.111783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.112222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.112934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.113576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.113994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.292423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.301016 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-905550c0-1c16-4c47-affe-8081ef1def87 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.202911 Sep 01 05:35:22.301622 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3242/6439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:22 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:23.324346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.324914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.332505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.333009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.333457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.334167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.334631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.335128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.472756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.481953 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-274f9110-9f29-461d-ad03-04005e8d43ec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.161748 Sep 01 05:35:23.482549 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3198/6440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:24.503658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.504383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.513680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.514214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.514772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.515853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.516423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.517117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.677834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.687087 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68598f4b-03fb-40d9-8dd7-6dcd5b9cfb1d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.187400 Sep 01 05:35:24.687785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3243/6441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:25.711323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.712824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.721520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.722416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.723194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.724133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.724625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.725163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.887103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.896955 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2050b129-14de-4126-b9f2-eb05a4f3810c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.190926 Sep 01 05:35:25.906595 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3199/6442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:26.920500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.921187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.929142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.929860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.930421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.931205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.931818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.932628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.102244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.119259 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1ca61f0-f190-4f34-a96a-f8472ffda172 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.203065 Sep 01 05:35:27.120023 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3244/6443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:27.611236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-81244984-35fc-4034-b520-07ae6145bf25 req-698c22d1-2a4f-40c9-ac43-e805fb19d8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e88123-2321-440e-82ec-466c765929a8", "name": "network-vif-plugged", "status": "completed", "tag": "497d835b-cd60-4825-9b56-28dbd82ad456"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:27.623572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-81244984-35fc-4034-b520-07ae6145bf25 req-698c22d1-2a4f-40c9-ac43-e805fb19d8b9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.624497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-81244984-35fc-4034-b520-07ae6145bf25 req-698c22d1-2a4f-40c9-ac43-e805fb19d8b9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.625277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-81244984-35fc-4034-b520-07ae6145bf25 req-698c22d1-2a4f-40c9-ac43-e805fb19d8b9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.639610 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-81244984-35fc-4034-b520-07ae6145bf25 req-698c22d1-2a4f-40c9-ac43-e805fb19d8b9 service nova] Creating event network-vif-plugged:497d835b-cd60-4825-9b56-28dbd82ad456 for instance 96e88123-2321-440e-82ec-466c765929a8 on n-h2-820368-37 Sep 01 05:35:27.645467 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-81244984-35fc-4034-b520-07ae6145bf25 req-698c22d1-2a4f-40c9-ac43-e805fb19d8b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040204 Sep 01 05:35:27.646618 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3200/6444] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:28.140948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.141742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.150055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.150561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.150988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.151879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.152379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.153191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.304817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.314315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f1eec5c-920f-4e24-a49b-3cf4e8bc9d2d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.177285 Sep 01 05:35:28.315261 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3245/6445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:29.338530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:29.339264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:29.346057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.346560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.347050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.347832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.348303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.348741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.501406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.512368 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5fe386ab-e6f2-48a6-9374-99f262aba572 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1375 microversion: 2.1 time: 0.179056 Sep 01 05:35:29.512988 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3201/6446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:29 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:30.537273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.537886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.546178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.546677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.547140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.547896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.548349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.548769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.698586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.706899 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70892b58-8d40-4428-a73c-cf8c16b0c3ba tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1562 microversion: 2.1 time: 0.173620 Sep 01 05:35:30.707488 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3246/6447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:30 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:30.728855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.729474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.736616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.737114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.737553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.738249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.738726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.739169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.887940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.895968 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcb5b2ae-1d5e-476a-94ca-88af073262b9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1562 microversion: 2.1 time: 0.171149 Sep 01 05:35:30.896535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3202/6448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:30 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:30.990069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.990807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.997338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.997921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.998405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.999214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.999750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.000233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.041621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:35:31.138821 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a05ae8ca-8f12-44b8-94aa-0ad7fa624116 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 204 len: 0 microversion: 2.1 time: 0.152695 Sep 01 05:35:31.139368 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3247/6449] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:30 2022] DELETE /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:35:31.148055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:31.148686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:31.155492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.156000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.156452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.157163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.157633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.158081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.293467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.301945 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8904f69d-5d5a-4ca4-919b-bd43da3361ef tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1568 microversion: 2.1 time: 0.158111 Sep 01 05:35:31.302564 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3203/6450] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:31 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:32.325326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.326030 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:32.334161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.334656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.335124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.336237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.336696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.337115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.492340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.500870 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b7c4695-3330-445d-b8a3-029c5739e1e2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1568 microversion: 2.1 time: 0.180084 Sep 01 05:35:32.501452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3248/6451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:32 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:33.343995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e93081cd-e831-4c6c-ab89-41508152827e req-46632eb6-9fef-45e9-8387-896334d8271c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e88123-2321-440e-82ec-466c765929a8", "name": "network-vif-deleted", "tag": "497d835b-cd60-4825-9b56-28dbd82ad456"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:33.356672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e93081cd-e831-4c6c-ab89-41508152827e req-46632eb6-9fef-45e9-8387-896334d8271c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.357348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e93081cd-e831-4c6c-ab89-41508152827e req-46632eb6-9fef-45e9-8387-896334d8271c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.357888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e93081cd-e831-4c6c-ab89-41508152827e req-46632eb6-9fef-45e9-8387-896334d8271c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.373874 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e93081cd-e831-4c6c-ab89-41508152827e req-46632eb6-9fef-45e9-8387-896334d8271c service nova] Creating event network-vif-deleted:497d835b-cd60-4825-9b56-28dbd82ad456 for instance 96e88123-2321-440e-82ec-466c765929a8 on n-h2-820368-37 Sep 01 05:35:33.382854 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e93081cd-e831-4c6c-ab89-41508152827e req-46632eb6-9fef-45e9-8387-896334d8271c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042679 Sep 01 05:35:33.384073 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3204/6452] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:33.521917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:33.522779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:33.539221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.541109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.541742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.542746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.543386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.543990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.641704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.651178 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2b5b2bb0-1f67-4905-9b9d-cb5b7ffab378 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1360 microversion: 2.1 time: 0.133136 Sep 01 05:35:33.651770 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3249/6453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:33 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1360 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:34.670833 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:35:34.671466 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:35:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 (ip 10.222.0.26) !!! Sep 01 05:35:34.677025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:34.678087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:34.686045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.686922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.687657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.688586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.689275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.689976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.781991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.792562 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7860f217-ef59-4f00-b9ef-59df4e130d39 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1360 microversion: 2.1 time: 0.123226 Sep 01 05:35:34.793726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3205/6454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:34 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1360 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:35.816508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:35.817118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:35.821123 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:35:35.821267 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:35:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 (ip 10.222.0.26) !!! Sep 01 05:35:35.827712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.828297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.828652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.829338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.829786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.830442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.901009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:35.909126 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b6096b29-053b-4e4e-a071-a1c9260025f4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1360 microversion: 2.1 time: 0.096808 Sep 01 05:35:35.919097 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3250/6455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:35 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1360 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:36.931937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:36.932713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:36.940365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:36.940793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:36.941244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.941967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:36.942442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:36.942941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.015507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:37.027119 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5ac46a6-9baa-46ba-98ab-0299893460f0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1360 microversion: 2.1 time: 0.099472 Sep 01 05:35:37.034813 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3206/6456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:36 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1360 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:38.058189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:38.058771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:38.061670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:38.071320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.071833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.072273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.073002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.073466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.074096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.077731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:38.149674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.160498 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2848c598-7487-402d-b970-835566ea633f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 200 len: 1360 microversion: 2.1 time: 0.107785 Sep 01 05:35:38.175061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3251/6457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:38 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 1360 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:39.188904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:39.190150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:39.193271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=30 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:39.199013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.200201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.200605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.201535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.202258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.202977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.213064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=82 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:39.230726 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 HTTP/1.1 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '96e88123-2321-440e-82ec-466c765929a8'} Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:39.234237 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14e9658c-5910-47d2-a36c-92d53099e987 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 404 len: 111 microversion: 2.1 time: 0.052806 Sep 01 05:35:39.245424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3207/6458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:39 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:43.601706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:43.603383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:43.612482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.614822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.614822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.614822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.615438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.615438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.643416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:35:43.740971 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee77b763-1144-4294-8da9-01c20a5a3320 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 204 len: 0 microversion: 2.1 time: 0.144125 Sep 01 05:35:43.742081 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3252/6459] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:43 2022] DELETE /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:35:43.751751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:43.752520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:43.760157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.760653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.761238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.761793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.762674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.762999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.910287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.932173 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68058e12-7866-46be-a108-3bca55ad011f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1409 microversion: 2.1 time: 0.185211 Sep 01 05:35:43.933319 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3208/6460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:43 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:44.954328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:44.955708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:44.964678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.965341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.965776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.966474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.966936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.967364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.111397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.120069 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9844b7d1-d7cd-480c-8999-0e3e6062f275 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1409 microversion: 2.1 time: 0.169870 Sep 01 05:35:45.120649 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3253/6461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:44 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:45.778014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b62c3d49-24be-4557-a611-c52b25a4cb68 req-81203c6a-241b-4f4d-ab28-436a98c905e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4741009-2fdc-42c3-a577-ec5e29404f4c", "name": "network-vif-deleted", "tag": "9c19653f-b492-4be1-8d86-b0430452f05e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:45.790775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b62c3d49-24be-4557-a611-c52b25a4cb68 req-81203c6a-241b-4f4d-ab28-436a98c905e2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.791305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b62c3d49-24be-4557-a611-c52b25a4cb68 req-81203c6a-241b-4f4d-ab28-436a98c905e2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.792004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b62c3d49-24be-4557-a611-c52b25a4cb68 req-81203c6a-241b-4f4d-ab28-436a98c905e2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.805071 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b62c3d49-24be-4557-a611-c52b25a4cb68 req-81203c6a-241b-4f4d-ab28-436a98c905e2 service nova] Creating event network-vif-deleted:9c19653f-b492-4be1-8d86-b0430452f05e for instance a4741009-2fdc-42c3-a577-ec5e29404f4c on n-h1-820368-37 Sep 01 05:35:45.821645 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b62c3d49-24be-4557-a611-c52b25a4cb68 req-81203c6a-241b-4f4d-ab28-436a98c905e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048139 Sep 01 05:35:45.822795 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3209/6462] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:35:46.141726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:46.142327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:46.150370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.150782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.151533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.152521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.153496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.154815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.226426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:46.237537 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e9eeb35e-0d35-468c-95cb-cbfca3d43512 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1201 microversion: 2.1 time: 0.099775 Sep 01 05:35:46.250647 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3254/6463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:46 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:47.267274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:47.268132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:47.276024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.276664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.277747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.279422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:47.280016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:47.281141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.365117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:47.373686 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-728dadb0-d2ab-4d31-8fe8-8adafe9dfa10 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1201 microversion: 2.1 time: 0.112404 Sep 01 05:35:47.386908 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3210/6464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:47 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1201 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:48.395580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:48.396204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:48.404375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.405015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.405471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.406206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.406655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.407108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.478379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.486851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-deda659a-2d56-439d-90b1-7b18896a19d3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1201 microversion: 2.1 time: 0.095294 Sep 01 05:35:48.487492 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3255/6465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:48 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:49.509265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:49.509924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:49.517302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.517800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.518248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.518991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.519454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.519873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.585238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.593488 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4d9eb16-912c-44e4-9a21-5db9758687c6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 200 len: 1201 microversion: 2.1 time: 0.088625 Sep 01 05:35:49.594088 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3211/6466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:49 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:50.615480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:50.617377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:50.625758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.626408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.626969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.627747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.628270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.628762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.645371 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c HTTP/1.1 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a4741009-2fdc-42c3-a577-ec5e29404f4c'} Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:50.647707 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1bec2e54-476a-4966-8d04-ba6a61d9ade9 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 404 len: 111 microversion: 2.1 time: 0.039184 Sep 01 05:35:50.653088 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3256/6467] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:50 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:54.919363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:54.919957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:54.927492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.928000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.928454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.929525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.930003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.930448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.945360 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 HTTP/1.1 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '96e88123-2321-440e-82ec-466c765929a8'} Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:54.947198 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50d34ea9-2de1-4b65-8969-5788a57ec82a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 404 len: 111 microversion: 2.1 time: 0.033442 Sep 01 05:35:54.951397 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3212/6468] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:54 2022] DELETE /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:54.962445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:54.963091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 96e88123-2321-440e-82ec-466c765929a8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:54.969572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.970059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.970485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.971230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:54.971676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:54.972095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.987228 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 HTTP/1.1 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '96e88123-2321-440e-82ec-466c765929a8'} Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:54.988775 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 96e88123-2321-440e-82ec-466c765929a8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a9b306e6-c112-4c1b-9012-0fe83726bf81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8" status: 404 len: 111 microversion: 2.1 time: 0.036350 Sep 01 05:35:54.992999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3257/6469] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:54 2022] GET /compute/v2.1/servers/96e88123-2321-440e-82ec-466c765929a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:55.476625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:55.479112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:55.490396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.490959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.491472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.492228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.492748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.493186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.510301 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c HTTP/1.1 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'a4741009-2fdc-42c3-a577-ec5e29404f4c'} Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:55.511939 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:55.515998 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4033ea01-bb4a-4415-ba85-4247c5c90acb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 404 len: 111 microversion: 2.1 time: 0.042677 Sep 01 05:35:55.517733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3213/6470] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:55 2022] DELETE /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:55.525439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:55.526417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: a4741009-2fdc-42c3-a577-ec5e29404f4c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:55.533885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.534377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.534811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.535545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.535995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.536420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.551746 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c HTTP/1.1 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a4741009-2fdc-42c3-a577-ec5e29404f4c'} Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:55.553325 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance a4741009-2fdc-42c3-a577-ec5e29404f4c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-090ac652-d754-4920-bd98-c27f676ad3e8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c" status: 404 len: 111 microversion: 2.1 time: 0.035712 Sep 01 05:35:55.557691 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3258/6471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:55 2022] GET /compute/v2.1/servers/a4741009-2fdc-42c3-a577-ec5e29404f4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:55.629589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df3ad37f-c235-4b06-9153-e6c2c15111c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: .version_select at 0x7fa764153310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1047361265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwcEF9j9Sk3Ffa8iXVrJ38LFg6KODzAIkrcLbiEMtQ7f06M4XHOaWgEZToZaoye/WiUACDzq4z9b6jToNgVNnrCLDOVUN1Sfhst8iVCN8syDJRJMLUgws7vVaYg7s0b4w=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:55.645547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-df3ad37f-c235-4b06-9153-e6c2c15111c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:35:55.651277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-df3ad37f-c235-4b06-9153-e6c2c15111c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:35:55.680381 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df3ad37f-c235-4b06-9153-e6c2c15111c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.054681 Sep 01 05:35:55.681015 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3214/6472] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:35:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:14.277613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1648763797", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1047361265", "security_groups": [{"name": "tempest-secgroup-smoke-1085971855"}], "block_device_mapping_v2": [{"uuid": "b60ba5dc-44e2-4bd4-ac56-5b053c5c187a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:14.289546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:14.290178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:14.404827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:36:14.917829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:36:14.918250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:36:14.918726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:36:14.919165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:36:14.919571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:36:14.929690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.930179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.930609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.931363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.931815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.932229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.950308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:36:14.955974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:36:15.027555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:36:15.030034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b60ba5dc-44e2-4bd4-ac56-5b053c5c187a',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:36:15.172038 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8342a621-5ec3-423f-9526-a35efca6aa2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.898294 Sep 01 05:36:15.179661 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3259/6473] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:36:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:36:15.184103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=25 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:15.184875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:15.186457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:15.194283 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08fcf546-c3c3-4a0b-974b-281286c7ed2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:15.195581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08fcf546-c3c3-4a0b-974b-281286c7ed2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:15.261542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08fcf546-c3c3-4a0b-974b-281286c7ed2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.270139 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08fcf546-c3c3-4a0b-974b-281286c7ed2b tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1095 microversion: 2.1 time: 0.089144 Sep 01 05:36:15.270859 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3215/6474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:15 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:16.294603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:16.295645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:16.304245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:16.305179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:16.305179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.305867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:16.306329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:16.306753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.751283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:16.760568 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a87c2762-b98c-4f8b-a7f2-7f82c1049749 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1193 microversion: 2.1 time: 0.472829 Sep 01 05:36:16.771900 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3260/6475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:16 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1193 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:17.784032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:17.785219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:17.792887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:17.793573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:17.794188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:17.795143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:17.795588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:17.796195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.072540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:18.085386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de7c9453-825e-4b92-9dad-721c27a53bf6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1279 microversion: 2.1 time: 0.305144 Sep 01 05:36:18.086861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3216/6476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:17 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1279 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:18.208671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e5247a94-cc76-41bd-962a-5cb2defb4484 req-915f00e9-f706-4ca7-8da0-40a6ced436d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9eb5cf-8232-420c-ac87-fcf78ddd66ab", "tag": "3c4a5984-b3ea-4f98-8575-29bcefb858a4"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:18.235045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5247a94-cc76-41bd-962a-5cb2defb4484 req-915f00e9-f706-4ca7-8da0-40a6ced436d8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.235805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5247a94-cc76-41bd-962a-5cb2defb4484 req-915f00e9-f706-4ca7-8da0-40a6ced436d8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.236251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e5247a94-cc76-41bd-962a-5cb2defb4484 req-915f00e9-f706-4ca7-8da0-40a6ced436d8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.260506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e5247a94-cc76-41bd-962a-5cb2defb4484 req-915f00e9-f706-4ca7-8da0-40a6ced436d8 service nova] Creating event network-changed:3c4a5984-b3ea-4f98-8575-29bcefb858a4 for instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab on n-h1-820368-37 Sep 01 05:36:18.267268 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e5247a94-cc76-41bd-962a-5cb2defb4484 req-915f00e9-f706-4ca7-8da0-40a6ced436d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065957 Sep 01 05:36:18.268423 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3261/6477] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:19.108577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:19.109322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:19.119524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.120354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.121032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.121843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.122521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.123178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.414561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:19.423423 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a0ac17d-a0aa-4fc6-a90a-f232e4a0239e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1279 microversion: 2.1 time: 0.320310 Sep 01 05:36:19.447955 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3217/6478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:19 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1279 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:20.449327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:20.450845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:20.458435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.458937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.459374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.460110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.460733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.461163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.619730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:20.628040 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e96ca05-e3e3-4882-aa72-647f18fa0dd6 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1279 microversion: 2.1 time: 0.183062 Sep 01 05:36:20.628611 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3262/6479] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:20 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:21.649984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:21.650702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:21.658104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.658605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.659093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.659810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.660460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.661058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.809645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:21.820407 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e55047ef-6581-4c3d-bfac-864eef9c14b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1279 microversion: 2.1 time: 0.174808 Sep 01 05:36:21.821138 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3218/6480] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:21 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:22.841774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:22.842364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:22.849515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.850149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.850449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.851193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.851646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.852071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.994050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:23.002539 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb54701b-8e09-4fa0-a8a5-eecd546d0540 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.164936 Sep 01 05:36:23.011097 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3263/6481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:22 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:24.023855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:24.024469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:24.032138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.032649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.033099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.033814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.034284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.034723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.171235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:24.179800 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff37a1d8-c57c-4dae-9c83-2d4e3fab9cb8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.159817 Sep 01 05:36:24.180645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3219/6482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:24 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:25.201818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:25.202458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:25.205466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:25.206107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:25.212830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:25.213324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:25.213760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:25.214466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:25.214939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:25.215365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:25.361403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:25.370481 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1d1866b9-d02c-4278-89c9-3a89a3baccc4 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.172550 Sep 01 05:36:25.371091 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3264/6483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:25 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:26.392959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:26.393623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:26.396653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:26.402627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.403174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.403964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.404702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.405178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.405618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.549877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:26.558841 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0ac2094-04f9-4810-923c-b957c7ed88c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.169792 Sep 01 05:36:26.559457 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3220/6484] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:26 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:27.580287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:27.580910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:27.588543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.589064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.589482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.590182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.590671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.591199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.731659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:27.740442 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76a8434b-b82e-4751-bd80-72abce3a0e3c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.163991 Sep 01 05:36:27.741077 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3265/6485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:27 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:28.762289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:28.762871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.769623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.770117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.771634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.772342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.772810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.773250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.920197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:28.928909 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c3bd2a2-c0ea-41e8-a8b3-00fc038b5fec tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.170683 Sep 01 05:36:28.929516 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3221/6486] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:28 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:29.950183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:29.950756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:29.958245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.958759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.959364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.959925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.960372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.960768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.100076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:30.108201 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-01cb726b-314d-4cf0-9eaa-bd38111287fc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.162024 Sep 01 05:36:30.108761 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3266/6487] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:29 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:31.130227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:31.130870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:31.139169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.139680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.140108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.140856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:31.141573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:31.141993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.290073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.298973 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c5de9a8-e310-43a8-b3e7-6ec789a2059d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.172745 Sep 01 05:36:31.299691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3222/6488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:31 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:32.321560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:32.322148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:32.329922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.330433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.330866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.331614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.332064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.332479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.482070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:32.490691 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10381584-0384-447e-bb0d-ccd5bf05a25c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.173780 Sep 01 05:36:32.491451 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3267/6489] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:32 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:33.057592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-93f948cd-a50c-4a0e-bef6-f9472d5afc3f req-788faca3-5d11-4b84-ac18-394af63b0d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9eb5cf-8232-420c-ac87-fcf78ddd66ab", "name": "network-vif-plugged", "status": "completed", "tag": "3c4a5984-b3ea-4f98-8575-29bcefb858a4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:33.069007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93f948cd-a50c-4a0e-bef6-f9472d5afc3f req-788faca3-5d11-4b84-ac18-394af63b0d5c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.069748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93f948cd-a50c-4a0e-bef6-f9472d5afc3f req-788faca3-5d11-4b84-ac18-394af63b0d5c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.070423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93f948cd-a50c-4a0e-bef6-f9472d5afc3f req-788faca3-5d11-4b84-ac18-394af63b0d5c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.083390 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-93f948cd-a50c-4a0e-bef6-f9472d5afc3f req-788faca3-5d11-4b84-ac18-394af63b0d5c service nova] Creating event network-vif-plugged:3c4a5984-b3ea-4f98-8575-29bcefb858a4 for instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab on n-h1-820368-37 Sep 01 05:36:33.088988 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-93f948cd-a50c-4a0e-bef6-f9472d5afc3f req-788faca3-5d11-4b84-ac18-394af63b0d5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Sep 01 05:36:33.090260 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3223/6490] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:33.514101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:33.514683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:33.524104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.524598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.525027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.526540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.527029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.527451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.673654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.682481 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a35f3c38-5dfe-4203-8d0e-b033c3331eb3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1267 microversion: 2.1 time: 0.173505 Sep 01 05:36:33.683370 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3268/6491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:33 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:34.706233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.707141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.714127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.714608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.715256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.715973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.716446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.716880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.868089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.876592 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ffd7bf03-3fe1-4bcf-aab2-dbb31e38226e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1455 microversion: 2.1 time: 0.175814 Sep 01 05:36:34.877176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3224/6492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:34.897310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.898003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.906108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.906964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.907411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.908131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.908582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.908999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.060035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:35.069063 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55043b27-e13f-439a-9b06-e373364c1fdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1455 microversion: 2.1 time: 0.175797 Sep 01 05:36:35.070944 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3269/6493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:36.850915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3b6e41d8-7b9c-4b29-93d8-fd9b73f8a5ca req-6e03fcc6-7f60-45e8-abe0-79e260bf8532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9eb5cf-8232-420c-ac87-fcf78ddd66ab", "tag": "3c4a5984-b3ea-4f98-8575-29bcefb858a4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:36.861582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b6e41d8-7b9c-4b29-93d8-fd9b73f8a5ca req-6e03fcc6-7f60-45e8-abe0-79e260bf8532 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.862077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b6e41d8-7b9c-4b29-93d8-fd9b73f8a5ca req-6e03fcc6-7f60-45e8-abe0-79e260bf8532 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.862513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b6e41d8-7b9c-4b29-93d8-fd9b73f8a5ca req-6e03fcc6-7f60-45e8-abe0-79e260bf8532 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.876059 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3b6e41d8-7b9c-4b29-93d8-fd9b73f8a5ca req-6e03fcc6-7f60-45e8-abe0-79e260bf8532 service nova] Creating event network-changed:3c4a5984-b3ea-4f98-8575-29bcefb858a4 for instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab on n-h1-820368-37 Sep 01 05:36:36.882190 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3b6e41d8-7b9c-4b29-93d8-fd9b73f8a5ca req-6e03fcc6-7f60-45e8-abe0-79e260bf8532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035156 Sep 01 05:36:36.882749 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3225/6494] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:22.823714 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:38:22.824368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:22.825133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=58 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:23.035513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:23.036011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:23.042326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.042802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.043276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.043962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.044403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.044820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.071673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:23.168734 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-88fbb706-5f10-44b1-af2a-68f52fee24af tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "DELETE /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 204 len: 0 microversion: 2.1 time: 0.347277 Sep 01 05:38:23.169794 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3270/6495] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:22 2022] DELETE /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:23.178129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:23.178934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=52 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:23.180468 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:38:23.180899 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 (ip 10.222.0.26) !!! Sep 01 05:38:23.197478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:23.198274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:23.207164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.207837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.208317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.209112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.209820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.210330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.427764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:23.435929 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff3ec44f-f611-4bff-a92a-836d35de1b4d tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1732 microversion: 2.1 time: 0.261634 Sep 01 05:38:23.436486 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3226/6496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:23 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1732 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:24.458660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:24.459262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:24.467648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.468406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.469013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.469737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.470188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.470583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.488052 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48232. Sep 01 05:38:24.825100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:24.834284 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-714867b9-76de-4d9a-86d5-201dc8e60bf7 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1732 microversion: 2.1 time: 0.380257 Sep 01 05:38:24.835212 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3271/6497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:24 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1732 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:25.264270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d57d97a6-2124-42fb-9ba1-a2d07d5f2239 req-02acc142-5a0b-40af-b3d6-c58d9f7264c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104c4a33-abbf-4221-8cbb-45255ef15c22", "name": "network-vif-deleted", "tag": "d5711038-a87d-4510-9c55-8bbfe88fc6da"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:25.285900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d57d97a6-2124-42fb-9ba1-a2d07d5f2239 req-02acc142-5a0b-40af-b3d6-c58d9f7264c8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.286729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d57d97a6-2124-42fb-9ba1-a2d07d5f2239 req-02acc142-5a0b-40af-b3d6-c58d9f7264c8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.287409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d57d97a6-2124-42fb-9ba1-a2d07d5f2239 req-02acc142-5a0b-40af-b3d6-c58d9f7264c8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.308351 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d57d97a6-2124-42fb-9ba1-a2d07d5f2239 req-02acc142-5a0b-40af-b3d6-c58d9f7264c8 service nova] Creating event network-vif-deleted:d5711038-a87d-4510-9c55-8bbfe88fc6da for instance 104c4a33-abbf-4221-8cbb-45255ef15c22 on n-h2-820368-37 Sep 01 05:38:25.319354 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d57d97a6-2124-42fb-9ba1-a2d07d5f2239 req-02acc142-5a0b-40af-b3d6-c58d9f7264c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058275 Sep 01 05:38:25.324231 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3227/6498] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:25.857201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.857868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:25.865973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.866460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.867108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.868094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.868769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.869414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.911787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.912771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.913640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.914560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lazy-loading 'fault' on Instance uuid 104c4a33-abbf-4221-8cbb-45255ef15c22 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:38:25.972003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71f16e5e919429abf026690506eff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906b86c3bdc4c91b9bf03fe629a6d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:25.980712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6aac1227-2750-45f5-a50e-7103b1a97c69 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 200 len: 1389 microversion: 2.1 time: 0.127946 Sep 01 05:38:25.981762 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3272/6499] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:25 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 1389 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:27.007170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:27.010188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:27.016882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.017438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.017865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.018592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.019139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.020339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.035390 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] HTTP exception thrown: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Request method failure captured: Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 HTTP/1.1 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEPsKLXH7BIVoC2uDk34-NuFk0bvSVUPAG3DuNRoQjOwfpvbBCqExR16O959HsGZW74ncrWTfDwiSTGhgmMVkE6NJb_cuAD300DjEm5zBxIO8J7HObmm4Js-e5HOvyHv3S_4XGjhSkxRnMXvJ3UMszLUsS579fgSEXj_XjW8JElz5RI Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a906b86c3bdc4c91b9bf03fe629a6d4b Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a906b86c3bdc4c91b9bf03fe629a6d4b Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestServerBasicOps-682908539-project Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d71f16e5e919429abf026690506eff11 Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestServerBasicOps-682908539-project Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '104c4a33-abbf-4221-8cbb-45255ef15c22'} Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:27.037118 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Returning 404 to user: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1316609-0f34-49c3-8ce4-ec0039081b7f tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 404 len: 111 microversion: 2.1 time: 0.038115 Sep 01 05:38:27.042796 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3228/6500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:26 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:27.515681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:27.516837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:27.524545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.525044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.525479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.526370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.527058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.528134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.554849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] HTTP exception thrown: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Request method failure captured: Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 HTTP/1.1 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEPsKLXH7BIVoC2uDk34-NuFk0bvSVUPAG3DuNRoQjOwfpvbBCqExR16O959HsGZW74ncrWTfDwiSTGhgmMVkE6NJb_cuAD300DjEm5zBxIO8J7HObmm4Js-e5HOvyHv3S_4XGjhSkxRnMXvJ3UMszLUsS579fgSEXj_XjW8JElz5RI Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: a906b86c3bdc4c91b9bf03fe629a6d4b Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: a906b86c3bdc4c91b9bf03fe629a6d4b Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestServerBasicOps-682908539-project Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: d71f16e5e919429abf026690506eff11 Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestServerBasicOps-682908539-project Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '104c4a33-abbf-4221-8cbb-45255ef15c22'} Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:27.557967 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Returning 404 to user: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:27.563236 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a8be4cf-925d-4304-aa23-5dd613a2d1a8 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "DELETE /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 404 len: 111 microversion: 2.1 time: 0.048136 Sep 01 05:38:27.565008 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3273/6501] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:27 2022] DELETE /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:27.572144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:27.572860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] [instance: 104c4a33-abbf-4221-8cbb-45255ef15c22] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:27.579485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.579907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.580351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.581068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:27.581985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:27.582526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:27.598033 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] HTTP exception thrown: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Request method failure captured: Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 HTTP/1.1 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEPsKLXH7BIVoC2uDk34-NuFk0bvSVUPAG3DuNRoQjOwfpvbBCqExR16O959HsGZW74ncrWTfDwiSTGhgmMVkE6NJb_cuAD300DjEm5zBxIO8J7HObmm4Js-e5HOvyHv3S_4XGjhSkxRnMXvJ3UMszLUsS579fgSEXj_XjW8JElz5RI Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: a906b86c3bdc4c91b9bf03fe629a6d4b Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a906b86c3bdc4c91b9bf03fe629a6d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: a906b86c3bdc4c91b9bf03fe629a6d4b Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestServerBasicOps-682908539 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestServerBasicOps-682908539-project Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: d71f16e5e919429abf026690506eff11 Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestServerBasicOps-682908539-project Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '104c4a33-abbf-4221-8cbb-45255ef15c22'} Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:27.599676 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Returning 404 to user: Instance 104c4a33-abbf-4221-8cbb-45255ef15c22 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aba9211-ee7d-4b3b-96f6-dc5030378aba tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22" status: 404 len: 111 microversion: 2.1 time: 0.033280 Sep 01 05:38:27.605072 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3229/6502] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:27 2022] GET /compute/v2.1/servers/104c4a33-abbf-4221-8cbb-45255ef15c22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:27.791622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b6e1f02-5053-4060-83ea-374941377509 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] Calling method '.version_select at 0x7fa75a741310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:27.856526 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b6e1f02-5053-4060-83ea-374941377509 tempest-TestServerBasicOps-682908539 tempest-TestServerBasicOps-682908539-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1682256707" status: 202 len: 0 microversion: 2.1 time: 0.075586 Sep 01 05:38:27.857173 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3274/6503] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Sep 1 05:38:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1682256707 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:38:33.396224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:33.397508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:33.405258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.406086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.406814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.407820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.408319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.408776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.447335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:33.650359 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-977cb2f0-10a8-4764-b51c-b9a7f0bd1404 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 204 len: 0 microversion: 2.1 time: 0.454298 Sep 01 05:38:33.659541 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3230/6504] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:33 2022] DELETE /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:33.673818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:33.674713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:33.698131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.698624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.699101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.699842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.700298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.700720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.937434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:33.963301 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2d4b76f-fdf4-442c-a47d-6113b54a7508 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1579 microversion: 2.1 time: 0.294147 Sep 01 05:38:33.964736 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3275/6505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:33 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1579 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:34.985612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:34.986423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:34.994102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.994743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.995376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.996162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.996927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.997573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.389321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:35.403934 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52ec001f-7cac-4435-8ecb-b6fbc95ebfc0 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1579 microversion: 2.1 time: 0.417075 Sep 01 05:38:35.405002 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3231/6506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:34 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1579 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:36.430421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:36.432555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:36.445412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.446735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.447465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.449535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.450236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.450946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.557058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.572252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4e984f88-d727-4cac-808b-c1fddfc7a825 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1511 microversion: 2.1 time: 0.149770 Sep 01 05:38:36.573136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3276/6507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:36 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:37.117846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cd3e2b9e-a3b0-4148-8ac8-3ba05fea5d87 req-7bef8717-2f9c-48d0-867d-25192b1cba41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9eb5cf-8232-420c-ac87-fcf78ddd66ab", "name": "network-vif-deleted", "tag": "3c4a5984-b3ea-4f98-8575-29bcefb858a4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:37.141953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd3e2b9e-a3b0-4148-8ac8-3ba05fea5d87 req-7bef8717-2f9c-48d0-867d-25192b1cba41 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.143740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd3e2b9e-a3b0-4148-8ac8-3ba05fea5d87 req-7bef8717-2f9c-48d0-867d-25192b1cba41 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.144619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd3e2b9e-a3b0-4148-8ac8-3ba05fea5d87 req-7bef8717-2f9c-48d0-867d-25192b1cba41 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.173047 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cd3e2b9e-a3b0-4148-8ac8-3ba05fea5d87 req-7bef8717-2f9c-48d0-867d-25192b1cba41 service nova] Creating event network-vif-deleted:3c4a5984-b3ea-4f98-8575-29bcefb858a4 for instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab on n-h1-820368-37 Sep 01 05:38:37.180492 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cd3e2b9e-a3b0-4148-8ac8-3ba05fea5d87 req-7bef8717-2f9c-48d0-867d-25192b1cba41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377319 Sep 01 05:38:37.181924 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3232/6508] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:37.603217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:37.604742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:37.618067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.623559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.626471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.627561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.629018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.631718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.755871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.772005 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a4f6d476-744c-4a7c-bc46-b693ebffd3fd tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1226 microversion: 2.1 time: 0.174098 Sep 01 05:38:37.774629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3277/6509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:37 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:38.818213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.819359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.827472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.828097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.828659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.829572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.830255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.830766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.914468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.923675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8bfb893a-b8a4-4f68-93f4-3a0bb275f26d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1226 microversion: 2.1 time: 0.109435 Sep 01 05:38:38.924288 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3233/6510] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:39.951158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:39.952251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:39.960699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.961349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.961907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.962968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.963524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.964042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.049260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:40.059620 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4f03a6b4-6e1c-4e86-9f41-f16ce1b3eb89 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1226 microversion: 2.1 time: 0.112844 Sep 01 05:38:40.070993 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3278/6511] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:39 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:41.081990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:41.082689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:41.090066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.090568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.091049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.091778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.092255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.092699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.170930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.179856 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6df64c54-aa6b-49eb-845f-a898a571df98 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1226 microversion: 2.1 time: 0.101935 Sep 01 05:38:41.180487 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3234/6512] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:41 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:42.205199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:42.206699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:42.226451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.227002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.227500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.228124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.228577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.229094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.263992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.264524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.265025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.265548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lazy-loading 'fault' on Instance uuid 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:38:42.310280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:42.317827 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2d370f8-247c-4e94-beed-491cbdb34f07 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 200 len: 1185 microversion: 2.1 time: 0.119608 Sep 01 05:38:42.318497 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3279/6513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:42 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 1185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:43.339134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:43.339822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:43.347270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.347793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.348239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.348950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.349413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.349851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.363784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab HTTP/1.1 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7b9eb5cf-8232-420c-ac87-fcf78ddd66ab'} Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:43.365484 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b46161a6-8f8b-4bbe-99dd-d9dc3814888e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 404 len: 111 microversion: 2.1 time: 0.031837 Sep 01 05:38:43.371440 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3235/6514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:43 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:43.473523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-55364012", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1047361265", "security_groups": [{"name": "tempest-secgroup-smoke-1085971855"}], "block_device_mapping_v2": [{"uuid": "b60ba5dc-44e2-4bd4-ac56-5b053c5c187a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:43.601782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:38:44.290310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:38:44.291090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:38:44.291571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:38:44.291980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:38:44.292388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:38:44.301539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.302023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.302460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.303209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.303666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.304116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.321398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:44.326602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:44.385879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:38:44.388067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b60ba5dc-44e2-4bd4-ac56-5b053c5c187a',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:38:44.521152 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [317dfc35-a0f0-4bf1-9cc8-0f1454bc9706] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:38:45.530169 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [317dfc35-a0f0-4bf1-9cc8-0f1454bc9706] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48458. Sep 01 05:38:45.535374 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cb8cfdb1-cb19-4800-98ec-6ea126e67452 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.066069 Sep 01 05:38:45.536266 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3280/6515] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:38:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:38:45.547381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91c66ce6-1c59-4e1c-b94c-a2c6ea5146cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:45.547965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91c66ce6-1c59-4e1c-b94c-a2c6ea5146cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:45.612494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91c66ce6-1c59-4e1c-b94c-a2c6ea5146cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:45.621537 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91c66ce6-1c59-4e1c-b94c-a2c6ea5146cc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1093 microversion: 2.1 time: 0.077978 Sep 01 05:38:45.622125 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3236/6516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:45 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:46.643147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:46.643838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:46.651523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:46.652018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:46.652782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:46.653690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:46.654322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:46.654757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:46.764338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:46.776799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-296a8d0c-a029-45b5-924e-a81e2f6a4c5a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1199 microversion: 2.1 time: 0.138727 Sep 01 05:38:46.778439 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3281/6517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:46 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1199 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:47.798230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:47.799543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:47.817768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.818579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.819246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:47.820160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:47.820809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:47.821424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:48.043469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:48.056365 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a799291-f92a-4026-8a05-9dc1cb225ac7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1277 microversion: 2.1 time: 0.262113 Sep 01 05:38:48.057863 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3237/6518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:47 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:48.320250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aab43e12-e57b-4bc1-b1f4-8d0a6d942319 req-1c91adbc-21b7-4e0c-8c25-8d806c1e1d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87114634-97b0-4781-8f8f-5e6cff8619e6", "tag": "7b6a57a1-9bde-47a1-821d-905276a0f6fe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:48.341900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aab43e12-e57b-4bc1-b1f4-8d0a6d942319 req-1c91adbc-21b7-4e0c-8c25-8d806c1e1d89 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:48.342380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aab43e12-e57b-4bc1-b1f4-8d0a6d942319 req-1c91adbc-21b7-4e0c-8c25-8d806c1e1d89 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:48.342807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aab43e12-e57b-4bc1-b1f4-8d0a6d942319 req-1c91adbc-21b7-4e0c-8c25-8d806c1e1d89 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:48.356716 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aab43e12-e57b-4bc1-b1f4-8d0a6d942319 req-1c91adbc-21b7-4e0c-8c25-8d806c1e1d89 service nova] Creating event network-changed:7b6a57a1-9bde-47a1-821d-905276a0f6fe for instance 87114634-97b0-4781-8f8f-5e6cff8619e6 on n-h2-820368-37 Sep 01 05:38:48.363645 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aab43e12-e57b-4bc1-b1f4-8d0a6d942319 req-1c91adbc-21b7-4e0c-8c25-8d806c1e1d89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054636 Sep 01 05:38:48.364958 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3282/6519] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:49.078518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:49.091746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:49.106463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:49.107307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:49.108261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:49.109231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:49.109871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:49.110475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:49.379598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:49.390487 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f53805f-1e1f-418f-94ab-c7f4b6b49b3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1277 microversion: 2.1 time: 0.315977 Sep 01 05:38:49.391585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3238/6520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:49 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1277 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:50.413534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:50.414393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:50.422589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.423151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.423684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.424487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:50.425059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:50.425718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:50.574473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:50.583251 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-916ed55e-723c-40ef-b822-ccd4e6dce695 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1277 microversion: 2.1 time: 0.174455 Sep 01 05:38:50.583847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3283/6521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:50 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:51.604915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:51.605509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:51.613032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:51.613587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:51.614064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:51.614791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:51.615305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:51.615747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:51.753110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:51.763198 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7573ddf6-98b4-4bd1-8c30-3e75b1e5b1d2 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1277 microversion: 2.1 time: 0.162477 Sep 01 05:38:51.764313 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3239/6522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:51 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:52.784970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:52.785567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:52.793209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:52.793688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:52.794152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:52.794819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:52.795347 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:52.795777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:52.946873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:52.949271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:52.959611 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0138c544-46b6-4a47-9dee-46277f58347c tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.178298 Sep 01 05:38:52.960618 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3284/6523] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:52 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:53.982089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:53.982812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:53.985783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:53.992223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:53.992763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:53.993220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:53.994480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:53.994480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:53.994841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:53.998600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:54.134758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:54.143305 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5aa8afd6-698d-4aad-8d4a-046d006e2462 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.165129 Sep 01 05:38:54.143872 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3240/6524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:53 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:55.164735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:55.165366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:55.168345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:55.168989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:55.169907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:55.177214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:55.177709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:55.178150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:55.178852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:55.179332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:55.179759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:55.326382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:55.335331 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d07d3717-5803-4e09-88db-f5a48e091797 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.174599 Sep 01 05:38:55.335933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3285/6525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:55 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:56.355175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:56.359491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:56.360112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:56.366593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:56.367120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:56.367562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:56.368273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:56.368737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:56.369158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:56.505475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:56.513589 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61201c32-7737-48cc-adef-05ecfc1a4e8d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.160513 Sep 01 05:38:56.514162 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3241/6526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:56 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:57.534573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:57.535206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:57.542692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:57.543200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:57.543631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:57.544343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:57.544783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:57.545217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:57.685774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:57.694322 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d44911f5-a411-4dfb-ae4d-fb77038e0bdf tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.163913 Sep 01 05:38:57.695301 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3286/6527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:57 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:58.715968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:58.716585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:58.724248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:58.724815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:58.725288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:58.726018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:58.726460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:58.726915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:58.874406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:58.882644 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53e94134-4598-4071-859f-644960aa64e1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.170792 Sep 01 05:38:58.883383 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3242/6528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:58 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:59.904352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:59.905073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:59.912665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:59.913144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:59.913716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:59.914257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:59.914704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:59.915155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:00.050288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:00.058536 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebcebb4b-1a56-4671-a352-b8638001d0da tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.158558 Sep 01 05:39:00.059226 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3287/6529] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:59 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:01.080619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:01.081208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:01.088454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:01.088955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:01.089457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:01.090168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:01.090637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:01.091098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:01.244582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:01.252530 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-507a1a93-bc7d-488f-888d-4a2f3d401edb tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.176018 Sep 01 05:39:01.253117 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3243/6530] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:01 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:39:02.273903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:02.274468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:02.282082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:02.282583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:02.283049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:02.283802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:02.284256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:02.284685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:02.421685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:02.429962 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7e39b668-fdf2-4857-a9ad-2898960da313 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.160232 Sep 01 05:39:02.430763 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3288/6531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:02 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:02.845118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-72feb150-9097-47b2-b546-038439c214d3 req-c113d6d6-f5cf-4ef7-899d-09426ff92d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114634-97b0-4781-8f8f-5e6cff8619e6", "name": "network-vif-plugged", "status": "completed", "tag": "7b6a57a1-9bde-47a1-821d-905276a0f6fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:02.855918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-72feb150-9097-47b2-b546-038439c214d3 req-c113d6d6-f5cf-4ef7-899d-09426ff92d1d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:02.856867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-72feb150-9097-47b2-b546-038439c214d3 req-c113d6d6-f5cf-4ef7-899d-09426ff92d1d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:02.857102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-72feb150-9097-47b2-b546-038439c214d3 req-c113d6d6-f5cf-4ef7-899d-09426ff92d1d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:02.873410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-72feb150-9097-47b2-b546-038439c214d3 req-c113d6d6-f5cf-4ef7-899d-09426ff92d1d service nova] Creating event network-vif-plugged:7b6a57a1-9bde-47a1-821d-905276a0f6fe for instance 87114634-97b0-4781-8f8f-5e6cff8619e6 on n-h2-820368-37 Sep 01 05:39:02.878782 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-72feb150-9097-47b2-b546-038439c214d3 req-c113d6d6-f5cf-4ef7-899d-09426ff92d1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037447 Sep 01 05:39:02.879490 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3244/6532] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:39:03.453542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:03.454187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:03.463487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:03.463979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:03.464411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:03.465174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:03.465678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:03.466139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:03.611371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:03.619852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9729cac-a35e-463d-936d-e8a02bdaf604 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1265 microversion: 2.1 time: 0.172555 Sep 01 05:39:03.620401 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3289/6533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:03 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:04.641103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:04.641813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:04.649198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:04.649708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:04.650157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:04.650916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:04.651376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:04.651819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:04.795876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:04.804575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28ec2d4d-78ed-4800-ba37-4a1e27087cdc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1453 microversion: 2.1 time: 0.167959 Sep 01 05:39:04.805145 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3245/6534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:04 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:04.824887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:04.825508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:04.834309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:04.834827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:04.835308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:04.836019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:04.836472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:04.836899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:04.975967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:04.984138 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4b4adbab-fbf0-45a4-9041-064bb505fd80 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1453 microversion: 2.1 time: 0.163208 Sep 01 05:39:04.984727 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3290/6535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:04 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:07.402950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b4223801-90e4-459c-a2aa-d6c0e8317c49 req-757d2ca5-ba3e-4c65-835b-f849fdcbdc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87114634-97b0-4781-8f8f-5e6cff8619e6", "tag": "7b6a57a1-9bde-47a1-821d-905276a0f6fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:07.412704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4223801-90e4-459c-a2aa-d6c0e8317c49 req-757d2ca5-ba3e-4c65-835b-f849fdcbdc6f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:07.413528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4223801-90e4-459c-a2aa-d6c0e8317c49 req-757d2ca5-ba3e-4c65-835b-f849fdcbdc6f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:07.413968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4223801-90e4-459c-a2aa-d6c0e8317c49 req-757d2ca5-ba3e-4c65-835b-f849fdcbdc6f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:07.426088 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b4223801-90e4-459c-a2aa-d6c0e8317c49 req-757d2ca5-ba3e-4c65-835b-f849fdcbdc6f service nova] Creating event network-changed:7b6a57a1-9bde-47a1-821d-905276a0f6fe for instance 87114634-97b0-4781-8f8f-5e6cff8619e6 on n-h2-820368-37 Sep 01 05:39:07.431675 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b4223801-90e4-459c-a2aa-d6c0e8317c49 req-757d2ca5-ba3e-4c65-835b-f849fdcbdc6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163996 Sep 01 05:39:07.432660 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3246/6536] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:46.488742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84a855d1-d781-4083-9596-0b5671aed8b6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Action: 'create', calling method: .version_select at 0x7fa760782280>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-895663301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOd+QYo2by2B9HoBc12UB6qvGs8yXJ9qTEJ3dgEMghNTIilc0GcxwodDi2bRJQU4x8v9aEvWMnbrJFSIrL2hI9p5ljnNvOTdjq3KNNB6QvIO3aHqrI9lwubglnb74ggEw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:46.496307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=11 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:46.496938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=37 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:46.509389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-84a855d1-d781-4083-9596-0b5671aed8b6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Getting quotas for project c4478d72820c4cd9bdb1edb9cb1f7c61. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:39:46.514663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-84a855d1-d781-4083-9596-0b5671aed8b6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Getting quotas for user dfe4a0380acb4d52b499b920e899e981 and project c4478d72820c4cd9bdb1edb9cb1f7c61. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:39:46.542263 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84a855d1-d781-4083-9596-0b5671aed8b6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.060002 Sep 01 05:39:46.542832 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3291/6537] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:39:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:47.614255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=13 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:47.615049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=33 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:47.619401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-676475941", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bd3798a4-a038-42ec-9f0a-44709dd5a2f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-895663301", "security_groups": [{"name": "tempest-secgroup-smoke-373110550"}], "networks": [{"uuid": "f74e9804-0b5c-4d2a-b4ee-bac36cbf1516"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:47.745149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] validate_networks() for [('f74e9804-0b5c-4d2a-b4ee-bac36cbf1516', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:39:48.206085 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:39:48.206557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:39:48.207093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:39:48.207514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:39:48.207936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:39:48.217876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.218377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.218821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.219587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.220022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.220486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.238304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Getting quotas for project c4478d72820c4cd9bdb1edb9cb1f7c61. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:39:48.243973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Getting quotas for user dfe4a0380acb4d52b499b920e899e981 and project c4478d72820c4cd9bdb1edb9cb1f7c61. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:39:48.305605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:39:48.308095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd3798a4-a038-42ec-9f0a-44709dd5a2f1',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:39:48.464873 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f4f3855-a88e-4fcb-821a-6a318eb19ed8 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.852735 Sep 01 05:39:48.465509 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3247/6538] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:39:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:39:48.477752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ffe7e9d-320f-43bd-b827-a826acc65024 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:48.478358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ffe7e9d-320f-43bd-b827-a826acc65024 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:48.534679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ffe7e9d-320f-43bd-b827-a826acc65024 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:48.544443 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ffe7e9d-320f-43bd-b827-a826acc65024 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1097 microversion: 2.1 time: 0.071895 Sep 01 05:39:48.545094 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3292/6539] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:48 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1097 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:49.567473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:49.568841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:49.581087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.581713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.582227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.583684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.583684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.584072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.675097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:49.686630 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77967647-4641-4a37-9666-255f5964c117 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1213 microversion: 2.1 time: 0.123933 Sep 01 05:39:49.687542 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3248/6540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:49 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:50.708181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:50.708995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:50.716072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:50.717012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:50.717954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:50.718969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:50.719780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:50.720429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:51.004334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:51.022748 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c6e8526-1e57-4bfc-bc43-e6740060c0a1 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1280 microversion: 2.1 time: 0.318941 Sep 01 05:39:51.023679 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3293/6541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:50 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:51.358346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b90b1657-31a7-4fbf-bcee-f7bb6ac3c17b req-7515c8f1-4348-4f6a-9251-d458810445b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:51.375915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b90b1657-31a7-4fbf-bcee-f7bb6ac3c17b req-7515c8f1-4348-4f6a-9251-d458810445b4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:51.376749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b90b1657-31a7-4fbf-bcee-f7bb6ac3c17b req-7515c8f1-4348-4f6a-9251-d458810445b4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:51.377676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b90b1657-31a7-4fbf-bcee-f7bb6ac3c17b req-7515c8f1-4348-4f6a-9251-d458810445b4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:51.407224 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b90b1657-31a7-4fbf-bcee-f7bb6ac3c17b req-7515c8f1-4348-4f6a-9251-d458810445b4 service nova] Creating event network-changed:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:39:51.413634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b90b1657-31a7-4fbf-bcee-f7bb6ac3c17b req-7515c8f1-4348-4f6a-9251-d458810445b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060073 Sep 01 05:39:51.415282 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3249/6542] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:52.046064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:52.046822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:52.054329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:52.054936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:52.055424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:52.056220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:52.056754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:52.057295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:52.288737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:52.298316 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-14e8c0e7-6064-4526-bb77-32a28da0959e tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1280 microversion: 2.1 time: 0.256362 Sep 01 05:39:52.310287 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3294/6543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:52 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:53.327544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:53.328220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:53.335735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:53.336233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:53.336682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:53.337402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:53.337847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:53.338532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:53.474497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:53.483537 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e468d155-db9e-4459-870c-15b66c326976 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1280 microversion: 2.1 time: 0.160279 Sep 01 05:39:53.484098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3250/6544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:53 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1280 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:54.505522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:54.506297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:54.513043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.513519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.513982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.514686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.515174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.515587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.664128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:54.675334 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d727887e-a4bd-44d7-ae27-3b3bba594586 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1280 microversion: 2.1 time: 0.173605 Sep 01 05:39:54.676218 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3295/6545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:54 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1280 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:55.702476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:55.703129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:55.710320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:55.710857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:55.711332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:55.712076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:55.712546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:55.712986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:55.867989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:55.876458 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b236f54b-b58d-4701-9688-299781826ca7 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.178345 Sep 01 05:39:55.877032 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3251/6546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:55 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:56.900167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:56.900848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:56.909321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:56.909933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:56.910397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:56.911313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:56.911750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:56.912178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:57.059350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:57.068591 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f18ae847-c3e2-4c7b-9321-0b3ed80a8328 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.172624 Sep 01 05:39:57.069578 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3296/6547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:56 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:58.091126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:58.091815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:58.099546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:58.100038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:58.100482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:58.101181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:58.101641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:58.102073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:58.228333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:58.244070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:58.250548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:58.253008 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fdbfaba-3308-4dab-b502-ad27cf4824fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.165907 Sep 01 05:39:58.253614 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3252/6548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:58 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:59.278923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:59.279537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:59.282231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:59.288066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:59.288556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:59.288981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:59.289676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:59.290121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:59.290532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:59.436348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:59.448599 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-41047d64-c564-49b0-bfe9-0d8729c95111 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.173433 Sep 01 05:39:59.449588 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3297/6549] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:59 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:00.474573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:00.475182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:00.482872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:00.483412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:00.483851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:00.484554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:00.485013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:00.485456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:00.643229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:00.651568 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-173d3149-17cb-4c67-87a4-1d1e99c3c525 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.184035 Sep 01 05:40:00.652509 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3253/6550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:00 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:01.674067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:01.674675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:01.682387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:01.682878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:01.683343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:01.684038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:01.684488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:01.684912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:01.838152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:01.847794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2ef6794-0622-4d9d-8a8b-800a7c6bc51b tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.177765 Sep 01 05:40:01.848376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3298/6551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:01 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:02.870002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:02.870647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:02.878119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:02.878627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:02.879104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:02.879819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:02.880289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:02.880730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:03.034568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:03.046221 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70d62cc9-5676-4013-9d39-3a592f48ae43 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.181672 Sep 01 05:40:03.047018 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3254/6552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:02 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:04.068440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:04.069071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:04.078359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:04.078858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:04.079322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:04.080036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:04.080484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:04.080909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:04.223311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:04.231851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d03fe14b-2d30-4aff-8e9c-25f7f9025802 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.167739 Sep 01 05:40:04.236039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3299/6553] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:04 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:05.254299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:05.254913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:05.257280 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:40:05.257448 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 (ip 10.222.0.26) !!! Sep 01 05:40:05.267159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:05.268080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:05.268806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:05.270042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:05.270768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:05.271474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:05.419332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:05.428242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd84a748-9610-4eec-b5cf-d5f5d1065945 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.178176 Sep 01 05:40:05.428846 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3255/6554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:05 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:06.201047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1f7cef97-ca0a-49e8-9869-c2724e33fc2e req-873ac840-0e51-4ec0-a705-c0990065567b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "name": "network-vif-plugged", "status": "completed", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:06.213515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1f7cef97-ca0a-49e8-9869-c2724e33fc2e req-873ac840-0e51-4ec0-a705-c0990065567b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.214238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1f7cef97-ca0a-49e8-9869-c2724e33fc2e req-873ac840-0e51-4ec0-a705-c0990065567b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.214742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1f7cef97-ca0a-49e8-9869-c2724e33fc2e req-873ac840-0e51-4ec0-a705-c0990065567b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.232831 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1f7cef97-ca0a-49e8-9869-c2724e33fc2e req-873ac840-0e51-4ec0-a705-c0990065567b service nova] Creating event network-vif-plugged:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:40:06.239205 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1f7cef97-ca0a-49e8-9869-c2724e33fc2e req-873ac840-0e51-4ec0-a705-c0990065567b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129190 Sep 01 05:40:06.239881 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3300/6555] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:06.450048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:06.450812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:06.458260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.458765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.459223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.461033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:06.461518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:06.461964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:06.614605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:06.622766 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-531e064e-e511-478b-ac7f-74cfdfa6f690 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1268 microversion: 2.1 time: 0.176709 Sep 01 05:40:06.623443 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3256/6556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:06 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:07.645996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:07.646851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:07.654429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:07.654951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:07.655489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:07.656102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:07.656760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:07.657255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:07.810314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:07.818511 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0c7cb6a5-566f-4936-8159-6e6d62ec384d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1456 microversion: 2.1 time: 0.177854 Sep 01 05:40:07.819150 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3301/6557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:07 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1456 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:07.840974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:07.841622 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:07.849470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:07.850159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:07.850913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:07.851701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:07.852199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:07.852880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:08.016477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:08.025199 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb3f399b-4e15-4725-ab50-7b83a825ce61 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1456 microversion: 2.1 time: 0.188154 Sep 01 05:40:08.025792 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3257/6558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:07 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1456 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:10.684205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f5938c9c-228b-48f0-a589-dd6de917fcf2 req-28a4d3d8-5b58-4d7d-9e25-bb4c6985ac49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:10.694632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5938c9c-228b-48f0-a589-dd6de917fcf2 req-28a4d3d8-5b58-4d7d-9e25-bb4c6985ac49 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:10.695308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5938c9c-228b-48f0-a589-dd6de917fcf2 req-28a4d3d8-5b58-4d7d-9e25-bb4c6985ac49 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:10.695840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f5938c9c-228b-48f0-a589-dd6de917fcf2 req-28a4d3d8-5b58-4d7d-9e25-bb4c6985ac49 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:10.709252 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f5938c9c-228b-48f0-a589-dd6de917fcf2 req-28a4d3d8-5b58-4d7d-9e25-bb4c6985ac49 service nova] Creating event network-changed:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:40:10.715420 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f5938c9c-228b-48f0-a589-dd6de917fcf2 req-28a4d3d8-5b58-4d7d-9e25-bb4c6985ac49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035220 Sep 01 05:40:10.716202 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3302/6559] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:11.666149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-10db56d0-4b45-44c2-a083-03ceb3812dc2 req-88d8f4de-42d9-4d9c-8577-463bc1207fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:11.677623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10db56d0-4b45-44c2-a083-03ceb3812dc2 req-88d8f4de-42d9-4d9c-8577-463bc1207fa4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:11.678450 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10db56d0-4b45-44c2-a083-03ceb3812dc2 req-88d8f4de-42d9-4d9c-8577-463bc1207fa4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:11.678914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10db56d0-4b45-44c2-a083-03ceb3812dc2 req-88d8f4de-42d9-4d9c-8577-463bc1207fa4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:11.691830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-10db56d0-4b45-44c2-a083-03ceb3812dc2 req-88d8f4de-42d9-4d9c-8577-463bc1207fa4 service nova] Creating event network-changed:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:40:11.698633 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-10db56d0-4b45-44c2-a083-03ceb3812dc2 req-88d8f4de-42d9-4d9c-8577-463bc1207fa4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036280 Sep 01 05:40:11.699985 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3258/6560] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:13.716189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-577526cf-8b0e-4eea-8df6-d1626869759f req-95599a0a-0edf-43a3-98ae-81e5286d6d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:13.727593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-577526cf-8b0e-4eea-8df6-d1626869759f req-95599a0a-0edf-43a3-98ae-81e5286d6d3c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:13.728052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-577526cf-8b0e-4eea-8df6-d1626869759f req-95599a0a-0edf-43a3-98ae-81e5286d6d3c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:13.728502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-577526cf-8b0e-4eea-8df6-d1626869759f req-95599a0a-0edf-43a3-98ae-81e5286d6d3c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:13.743989 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-577526cf-8b0e-4eea-8df6-d1626869759f req-95599a0a-0edf-43a3-98ae-81e5286d6d3c service nova] Creating event network-changed:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:40:13.749593 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-577526cf-8b0e-4eea-8df6-d1626869759f req-95599a0a-0edf-43a3-98ae-81e5286d6d3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038470 Sep 01 05:40:13.750202 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3303/6561] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:45.720618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:45.722436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:45.723142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=60 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:45.723615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=54 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:45.727728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:45.728318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:45.728462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3f09f76c-18f1-4532-9868-d1d24d42d092 req-4241255e-14bd-4aa5-966c-b517a8e34132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:45.736199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.736715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.737117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.737809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.738401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f09f76c-18f1-4532-9868-d1d24d42d092 req-4241255e-14bd-4aa5-966c-b517a8e34132 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.738552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.738876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f09f76c-18f1-4532-9868-d1d24d42d092 req-4241255e-14bd-4aa5-966c-b517a8e34132 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.739039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.739321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3f09f76c-18f1-4532-9868-d1d24d42d092 req-4241255e-14bd-4aa5-966c-b517a8e34132 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.753654 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3f09f76c-18f1-4532-9868-d1d24d42d092 req-4241255e-14bd-4aa5-966c-b517a8e34132 service nova] Creating event network-changed:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:40:45.759721 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3f09f76c-18f1-4532-9868-d1d24d42d092 req-4241255e-14bd-4aa5-966c-b517a8e34132 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038392 Sep 01 05:40:45.760325 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3304/6562] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:40:45.767947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:40:45.862166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13ad788c-e646-46e8-ba55-64f87c98dbd2 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 204 len: 0 microversion: 2.1 time: 0.143607 Sep 01 05:40:45.863454 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3259/6563] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:40:45 2022] DELETE /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:40:45.873480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:45.874518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:45.883562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.884332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.884947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.886047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.886734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.887215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:46.075955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:46.087991 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d1a185c0-ec1b-47f6-ad80-bfbf546e96fc tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1581 microversion: 2.1 time: 0.219003 Sep 01 05:40:46.089377 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3305/6564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:45 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1581 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:47.113533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:47.114918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:47.122447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.123304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.123747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.124453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.124919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.125349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.280142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:47.288444 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfc7ce76-7236-48d9-a4ff-9a3e62ae228d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1581 microversion: 2.1 time: 0.179147 Sep 01 05:40:47.289036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3260/6565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:47 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1581 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:47.892031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2f0a9107-7705-468a-be35-728478a8f051 req-bc4dd598-ac57-4a4d-b2d9-4fb5a98663f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46230797-ca8a-4d53-9ce8-d4f4b6347d01", "name": "network-vif-deleted", "tag": "e6663cbe-70ce-4aff-a886-9ba73e6fa3b8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:47.903626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2f0a9107-7705-468a-be35-728478a8f051 req-bc4dd598-ac57-4a4d-b2d9-4fb5a98663f6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.904253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2f0a9107-7705-468a-be35-728478a8f051 req-bc4dd598-ac57-4a4d-b2d9-4fb5a98663f6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.904890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2f0a9107-7705-468a-be35-728478a8f051 req-bc4dd598-ac57-4a4d-b2d9-4fb5a98663f6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.916772 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2f0a9107-7705-468a-be35-728478a8f051 req-bc4dd598-ac57-4a4d-b2d9-4fb5a98663f6 service nova] Creating event network-vif-deleted:e6663cbe-70ce-4aff-a886-9ba73e6fa3b8 for instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 on n-h1-820368-37 Sep 01 05:40:47.922216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2f0a9107-7705-468a-be35-728478a8f051 req-bc4dd598-ac57-4a4d-b2d9-4fb5a98663f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Sep 01 05:40:47.922824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3306/6566] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:40:48.313716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:48.314426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:48.322606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.323294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.323981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.324930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.325626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.326282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.395099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:48.403487 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae487761-c41b-4092-ad7a-7e5d549cf62d tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1228 microversion: 2.1 time: 0.093941 Sep 01 05:40:48.404586 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3261/6567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:48 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:49.426908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:49.427624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:49.440051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:49.440833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:49.441453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.442331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:49.443363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:49.443787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.524670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:49.534927 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-59065a25-c3be-408a-84ef-fdb2f1b07ad5 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1228 microversion: 2.1 time: 0.112290 Sep 01 05:40:49.535713 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3307/6568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:49 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:50.556969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:50.557559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:50.566300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.566827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.567600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.568343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.569418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.571186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.661193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:50.670552 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-603f46ba-719d-4ac0-8c84-90ef2d28abed tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1228 microversion: 2.1 time: 0.117432 Sep 01 05:40:50.671112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3262/6569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:50 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:51.692203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:51.692867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:51.700589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.701183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.701687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.702454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.703010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.704088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.786052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:51.794824 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62f1766a-b2cd-4dc1-a391-3d16c832f6da tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1228 microversion: 2.1 time: 0.106558 Sep 01 05:40:51.807565 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3308/6570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:51 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:52.818836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:52.820564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:52.833042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.833471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.834368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.835875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.836627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.838927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.910467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.911257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.911909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.912960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lazy-loading 'fault' on Instance uuid 46230797-ca8a-4d53-9ce8-d4f4b6347d01 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:40:52.966172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe4a0380acb4d52b499b920e899e981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4478d72820c4cd9bdb1edb9cb1f7c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:52.976632 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b13e9023-e4bb-4a52-b769-7a4957326bf6 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 200 len: 1233 microversion: 2.1 time: 0.162419 Sep 01 05:40:52.977316 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3263/6571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:52 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 1233 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:54.000578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:54.001180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] [instance: 46230797-ca8a-4d53-9ce8-d4f4b6347d01] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:54.010353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:54.011373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:54.012129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:54.013129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:54.013883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:54.014537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:54.033865 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] HTTP exception thrown: Instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 could not be found. Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Request method failure captured: Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 HTTP/1.1 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEUpf1na1tQIbzmL7wCqTXJA2p-KywrYPXgSU0jetWPgi2AlcR9jND8-QMRAUv-WDDfWYNBllVH6xiyc9IXPq5UzqYgx3uhhxXl8_UcvjppmkOUN77k60DsTnQzj-dDP4BGkSpzKQwxuIcI7LHX4CsD6QH2Le77lzXaHjQZe_YZUNZ8 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: c4478d72820c4cd9bdb1edb9cb1f7c61 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBackupRestore-102855675 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4478d72820c4cd9bdb1edb9cb1f7c61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4478d72820c4cd9bdb1edb9cb1f7c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4478d72820c4cd9bdb1edb9cb1f7c61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4478d72820c4cd9bdb1edb9cb1f7c61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBackupRestore-102855675 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: c4478d72820c4cd9bdb1edb9cb1f7c61 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBackupRestore-102855675 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBackupRestore-102855675-project Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: dfe4a0380acb4d52b499b920e899e981 Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBackupRestore-102855675-project Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 could not be found. Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '46230797-ca8a-4d53-9ce8-d4f4b6347d01'} Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 could not be found. Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 could not be found. Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:40:54.035931 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 could not be found. Sep 01 05:40:54.042160 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:40:54.043675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Returning 404 to user: Instance 46230797-ca8a-4d53-9ce8-d4f4b6347d01 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:40:54.044578 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94e31416-adc5-475c-814d-15d4dd4c2d2c tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01" status: 404 len: 111 microversion: 2.1 time: 0.048268 Sep 01 05:40:54.045161 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3309/6572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:53 2022] GET /compute/v2.1/servers/46230797-ca8a-4d53-9ce8-d4f4b6347d01 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:54.291704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03636904-9924-4dec-aa75-2b61964af543 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] Calling method '.version_select at 0x7fa75bcceaf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:54.352981 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03636904-9924-4dec-aa75-2b61964af543 tempest-TestVolumeBackupRestore-102855675 tempest-TestVolumeBackupRestore-102855675-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-895663301" status: 202 len: 0 microversion: 2.1 time: 0.065546 Sep 01 05:40:54.353585 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3264/6573] 10.222.0.26 () {58 vars in 1266 bytes} [Thu Sep 1 05:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-895663301 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:40:58.479951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1635808582", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1047361265", "security_groups": [{"name": "tempest-secgroup-smoke-1085971855"}], "block_device_mapping_v2": [{"uuid": "84f4306f-2dab-45d1-b52e-f35f0267a95c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7e84ff6-fd32-4f17-803a-3da2fa01773a"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:58.617566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] validate_networks() for [('e7e84ff6-fd32-4f17-803a-3da2fa01773a', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:40:59.157724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:40:59.158872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:40:59.159556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:40:59.160309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:40:59.160950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:40:59.173613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.174389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.175019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.175994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.176610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.177228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.206509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:40:59.214987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Getting quotas for user 2cda858cabf9422baaea18b04db279e9 and project 0564d7024b7e4e928dd3d3d100b01c93. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:40:59.287909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:40:59.291972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84f4306f-2dab-45d1-b52e-f35f0267a95c',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:40:59.436068 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-505455a4-7729-4e7c-9a05-84b59ce64f19 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.961240 Sep 01 05:40:59.437059 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3310/6574] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:40:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:40:59.448006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-18654df1-4d2e-46fa-90fc-2da6c98e7c66 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:59.448651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-18654df1-4d2e-46fa-90fc-2da6c98e7c66 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:59.534413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18654df1-4d2e-46fa-90fc-2da6c98e7c66 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:59.543822 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-18654df1-4d2e-46fa-90fc-2da6c98e7c66 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1095 microversion: 2.1 time: 0.100055 Sep 01 05:40:59.544977 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3265/6575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:59 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:00.566568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:00.568036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:00.578838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:00.579681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:00.580461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:00.581396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:00.582043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:00.582469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:00.654605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:00.662750 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9e73397e-1c0c-48cf-8050-8b7c304e3043 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1193 microversion: 2.1 time: 0.101237 Sep 01 05:41:00.663676 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3311/6576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:00 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:01.686386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:01.687816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:01.699885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.704561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.705150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.706058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.706639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.707249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.796213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:01.815765 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5229821-59ab-41d7-8af7-0e093b18dc8a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1211 microversion: 2.1 time: 0.135310 Sep 01 05:41:01.817549 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3266/6577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:01 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1211 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:02.838280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:02.839542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:02.850454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:02.852860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:02.855774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:02.856709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:02.860902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:02.861764 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.199595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:03.220948 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-149cbc9f-824b-4a03-9b7d-0318d1c2dc81 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1279 microversion: 2.1 time: 0.386827 Sep 01 05:41:03.222731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cb19cdf3-f194-4445-974f-c1da1d71a50c req-a328f500-b70b-4c08-9a72-0af2e78dec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a710d62-87fd-4e0d-b214-af49263848a1", "tag": "b1dec396-0d82-43d0-af79-d44cae3d9978"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:03.228968 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3312/6578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:02 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1279 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:03.245250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb19cdf3-f194-4445-974f-c1da1d71a50c req-a328f500-b70b-4c08-9a72-0af2e78dec90 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.245966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb19cdf3-f194-4445-974f-c1da1d71a50c req-a328f500-b70b-4c08-9a72-0af2e78dec90 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.246583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb19cdf3-f194-4445-974f-c1da1d71a50c req-a328f500-b70b-4c08-9a72-0af2e78dec90 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.270755 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cb19cdf3-f194-4445-974f-c1da1d71a50c req-a328f500-b70b-4c08-9a72-0af2e78dec90 service nova] Creating event network-changed:b1dec396-0d82-43d0-af79-d44cae3d9978 for instance 4a710d62-87fd-4e0d-b214-af49263848a1 on n-h1-820368-37 Sep 01 05:41:03.288388 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cb19cdf3-f194-4445-974f-c1da1d71a50c req-a328f500-b70b-4c08-9a72-0af2e78dec90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068640 Sep 01 05:41:03.289626 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3267/6579] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:41:04.242575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:04.244265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:04.252100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.252661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.253107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.254016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.254463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.255115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.436338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:04.446733 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-920f11cb-ef23-48ea-9a85-688c002809b7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1279 microversion: 2.1 time: 0.208410 Sep 01 05:41:04.448164 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3313/6580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:04 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:05.470364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:05.472655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:05.479691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.480493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.481346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.482247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.482920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.483681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.644253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:05.655467 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0252dbb3-d037-4426-b6cb-6f4b4073d1f7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1279 microversion: 2.1 time: 0.190037 Sep 01 05:41:05.656071 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3268/6581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:05 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:06.677020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:06.677623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:06.685300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:06.685815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:06.686299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:06.686997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:06.687637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:06.688056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:07.201915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:07.215232 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c4f7524-fa6c-4fa9-9ad6-4508548541b1 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.542500 Sep 01 05:41:07.215824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3314/6582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:06 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:08.238633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:08.239287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:08.246414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.246975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.247443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.248158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.248623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.249062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.409318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:08.418857 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-647d03d7-46e6-4963-b68f-70f9a5721b85 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.183971 Sep 01 05:41:08.420016 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3269/6583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:08 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:09.442499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:09.444007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:09.447413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:09.448137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:09.455248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:09.455916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:09.456592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.457465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:09.458011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:09.458455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.650623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:09.662429 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6cee569-7c35-4f8a-9070-076ccdfe490d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.225034 Sep 01 05:41:09.663121 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3315/6584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:09 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:10.691640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:10.692488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:10.696582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:10.702303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.702800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.703479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.703983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.704445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.704875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.859486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:10.868453 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0731c52e-dc44-4b14-9594-08e164d9d094 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.183581 Sep 01 05:41:10.869036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3270/6585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:10 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:41:11.902165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:11.902831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:11.910272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.910740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.911259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:11.911995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.912447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.912868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:12.078068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:12.086629 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fa0d6021-10b7-45a9-b581-044e632832b5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.192269 Sep 01 05:41:12.087328 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3316/6586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:11 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:13.114668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:13.115474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:13.123350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.123852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.124298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.125009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.125606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.126015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.282872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:13.294713 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edd500bc-76e2-4c25-ba16-98ae6bb545aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.183868 Sep 01 05:41:13.295617 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3271/6587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:13 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:14.320065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:14.320680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:14.327983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:14.328481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:14.328918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.329807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:14.330069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:14.330492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.472586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:14.484138 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6ed44f8-222a-4ae6-85c0-5c9a827071e7 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.167966 Sep 01 05:41:14.484783 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3317/6588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:14 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:15.507754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:15.508407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:15.518099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.518788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.519435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.520368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.521007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.521512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.662555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:15.671108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc33f811-29ab-46ee-bbe4-1ec1c1c536bc tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.169347 Sep 01 05:41:15.671698 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3272/6589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:15 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:16.403758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bf4e4fe3-c88f-40ff-8ed8-ec9cb1be7b63 req-7e57061c-4e54-42af-aa08-f6502f884bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a710d62-87fd-4e0d-b214-af49263848a1", "name": "network-vif-plugged", "status": "completed", "tag": "b1dec396-0d82-43d0-af79-d44cae3d9978"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:16.410925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:16.415138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf4e4fe3-c88f-40ff-8ed8-ec9cb1be7b63 req-7e57061c-4e54-42af-aa08-f6502f884bdb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.415624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf4e4fe3-c88f-40ff-8ed8-ec9cb1be7b63 req-7e57061c-4e54-42af-aa08-f6502f884bdb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.416081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bf4e4fe3-c88f-40ff-8ed8-ec9cb1be7b63 req-7e57061c-4e54-42af-aa08-f6502f884bdb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.420949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=69 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:16.432210 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bf4e4fe3-c88f-40ff-8ed8-ec9cb1be7b63 req-7e57061c-4e54-42af-aa08-f6502f884bdb service nova] Creating event network-vif-plugged:b1dec396-0d82-43d0-af79-d44cae3d9978 for instance 4a710d62-87fd-4e0d-b214-af49263848a1 on n-h1-820368-37 Sep 01 05:41:16.438748 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bf4e4fe3-c88f-40ff-8ed8-ec9cb1be7b63 req-7e57061c-4e54-42af-aa08-f6502f884bdb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039283 Sep 01 05:41:16.439424 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3318/6590] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:16.695889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:16.696538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:16.699345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:16.704997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.705491 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.705937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.706636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:16.707136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:16.707569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.711107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:16.852262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:16.860418 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f35c5b0-9bb3-46e8-ac09-d8f810847539 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1267 microversion: 2.1 time: 0.168516 Sep 01 05:41:16.860995 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3273/6591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:16 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:17.883221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:17.883902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:17.891569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:17.892068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:17.892516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:17.893242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:17.893699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:17.894127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.042123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:18.050538 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-681cad20-da0f-411b-a9cd-387d92266a69 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1455 microversion: 2.1 time: 0.172698 Sep 01 05:41:18.051194 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3319/6592] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:17 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:18.071369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:18.071968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:18.079896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:18.080399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:18.080851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.081599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:18.082076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:18.082517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:18.229152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:18.237918 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58c494ff-177a-4f44-a9bb-d86155d31706 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1455 microversion: 2.1 time: 0.170493 Sep 01 05:41:18.238423 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3274/6593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:18 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:19.931352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fb701a67-23c9-43f6-8a4e-b86319bd816d req-bf1ac4af-5750-4585-b986-8e8a93d1043b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a710d62-87fd-4e0d-b214-af49263848a1", "tag": "b1dec396-0d82-43d0-af79-d44cae3d9978"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:19.941901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb701a67-23c9-43f6-8a4e-b86319bd816d req-bf1ac4af-5750-4585-b986-8e8a93d1043b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:19.942369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb701a67-23c9-43f6-8a4e-b86319bd816d req-bf1ac4af-5750-4585-b986-8e8a93d1043b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:19.942792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fb701a67-23c9-43f6-8a4e-b86319bd816d req-bf1ac4af-5750-4585-b986-8e8a93d1043b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:19.955001 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fb701a67-23c9-43f6-8a4e-b86319bd816d req-bf1ac4af-5750-4585-b986-8e8a93d1043b service nova] Creating event network-changed:b1dec396-0d82-43d0-af79-d44cae3d9978 for instance 4a710d62-87fd-4e0d-b214-af49263848a1 on n-h1-820368-37 Sep 01 05:41:19.960903 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fb701a67-23c9-43f6-8a4e-b86319bd816d req-bf1ac4af-5750-4585-b986-8e8a93d1043b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032751 Sep 01 05:41:19.961285 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3320/6594] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:57.482916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:57.484027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:57.485130 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:42:57.485467 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:42:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 (ip 10.222.0.26) !!! Sep 01 05:42:57.485696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:57.486443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:57.488359 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:42:57.488750 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:42:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 01 05:42:57.493704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:57.494177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4e62e4fb-f77d-4f40-ba40-a6a907cb6c32 req-32762299-9a45-417f-ac55-980545c605f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a710d62-87fd-4e0d-b214-af49263848a1", "tag": "b1dec396-0d82-43d0-af79-d44cae3d9978"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:57.494673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:57.503438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.504052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.504572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.505342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.506023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.506671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.509083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e62e4fb-f77d-4f40-ba40-a6a907cb6c32 req-32762299-9a45-417f-ac55-980545c605f8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.509590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e62e4fb-f77d-4f40-ba40-a6a907cb6c32 req-32762299-9a45-417f-ac55-980545c605f8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.510159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4e62e4fb-f77d-4f40-ba40-a6a907cb6c32 req-32762299-9a45-417f-ac55-980545c605f8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.522631 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4e62e4fb-f77d-4f40-ba40-a6a907cb6c32 req-32762299-9a45-417f-ac55-980545c605f8 service nova] Creating event network-changed:b1dec396-0d82-43d0-af79-d44cae3d9978 for instance 4a710d62-87fd-4e0d-b214-af49263848a1 on n-h1-820368-37 Sep 01 05:42:57.528432 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4e62e4fb-f77d-4f40-ba40-a6a907cb6c32 req-32762299-9a45-417f-ac55-980545c605f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045158 Sep 01 05:42:57.529179 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3321/6595] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:57.536921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:42:57.639557 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c017b4e-c2ca-4cd7-8991-045910d655ca tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 204 len: 0 microversion: 2.1 time: 0.158727 Sep 01 05:42:57.643999 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3275/6596] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:42:57 2022] DELETE /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:42:57.650028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:57.651299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:57.660244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.660880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.661543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.662364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:57.662946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:57.664318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:57.810450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:57.819525 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-983f7289-b7f3-4f95-9e1f-53ca0afac49e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1580 microversion: 2.1 time: 0.173983 Sep 01 05:42:57.821093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3322/6597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:57 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1580 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:42:58.840584 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:42:58.844319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:58.845243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:58.852341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:58.852854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:58.853306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:58.854034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:58.854504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:58.855044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:59.004253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:59.012703 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e61e8166-464d-4ca5-bfda-f50fb91b8fd3 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1580 microversion: 2.1 time: 0.174115 Sep 01 05:42:59.013290 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3276/6598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:58 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1580 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:59.598155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-32a9b68d-3624-46b2-962d-7c0eb22eff13 req-6adc54d9-c0db-45a4-b642-75ef7be9ef1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a710d62-87fd-4e0d-b214-af49263848a1", "name": "network-vif-deleted", "tag": "b1dec396-0d82-43d0-af79-d44cae3d9978"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:59.609881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32a9b68d-3624-46b2-962d-7c0eb22eff13 req-6adc54d9-c0db-45a4-b642-75ef7be9ef1e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:59.610363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32a9b68d-3624-46b2-962d-7c0eb22eff13 req-6adc54d9-c0db-45a4-b642-75ef7be9ef1e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:59.610791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-32a9b68d-3624-46b2-962d-7c0eb22eff13 req-6adc54d9-c0db-45a4-b642-75ef7be9ef1e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:59.623456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-32a9b68d-3624-46b2-962d-7c0eb22eff13 req-6adc54d9-c0db-45a4-b642-75ef7be9ef1e service nova] Creating event network-vif-deleted:b1dec396-0d82-43d0-af79-d44cae3d9978 for instance 4a710d62-87fd-4e0d-b214-af49263848a1 on n-h1-820368-37 Sep 01 05:42:59.628292 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-32a9b68d-3624-46b2-962d-7c0eb22eff13 req-6adc54d9-c0db-45a4-b642-75ef7be9ef1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033870 Sep 01 05:42:59.628912 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3323/6599] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:00.034819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:00.035600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:00.045251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:00.045764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:00.046230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:00.047018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:00.047495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:00.047942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:00.051659 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49944. Sep 01 05:43:00.116298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:00.124854 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90190631-ed56-4edf-8b37-4d3f4288da9e tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1226 microversion: 2.1 time: 0.093987 Sep 01 05:43:00.125445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3277/6600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:00 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:01.147516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:01.148253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:01.156433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:01.156918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:01.157346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:01.158252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:01.158587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:01.158997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:01.227927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:01.237721 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2776432b-7f17-4413-886c-a3afb6838014 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1226 microversion: 2.1 time: 0.095452 Sep 01 05:43:01.238544 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3324/6601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:01 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:02.259394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:02.259961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:02.267167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:02.267676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:02.268098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:02.268823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:02.269289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:02.269706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:02.337759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:02.346252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b16b46c7-cb47-4ebc-81b7-afd4e28161ea tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1226 microversion: 2.1 time: 0.090944 Sep 01 05:43:02.346947 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3278/6602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:02 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:03.368482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:03.369111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:03.376537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:03.377022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:03.377457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:03.378157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:03.378608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:03.379034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:03.447096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:03.455389 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-308bb852-fb50-4c68-af6e-c7dfd3e55c6f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 200 len: 1226 microversion: 2.1 time: 0.090925 Sep 01 05:43:03.456018 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3325/6603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:03 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:04.478207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:04.478808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 4a710d62-87fd-4e0d-b214-af49263848a1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:04.486553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:04.487089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:04.487519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:04.488242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:04.488708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:04.489143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:04.503266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 4a710d62-87fd-4e0d-b214-af49263848a1 could not be found. Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 HTTP/1.1 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 4a710d62-87fd-4e0d-b214-af49263848a1 could not be found. Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '4a710d62-87fd-4e0d-b214-af49263848a1'} Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a710d62-87fd-4e0d-b214-af49263848a1 could not be found. Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a710d62-87fd-4e0d-b214-af49263848a1 could not be found. Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:04.504964 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a710d62-87fd-4e0d-b214-af49263848a1 could not be found. Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 4a710d62-87fd-4e0d-b214-af49263848a1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d050bb07-5d35-4901-948a-b59ca522581a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1" status: 404 len: 111 microversion: 2.1 time: 0.032775 Sep 01 05:43:04.508893 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3279/6604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:04 2022] GET /compute/v2.1/servers/4a710d62-87fd-4e0d-b214-af49263848a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:43:10.829651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d422880f-f76c-4418-b661-057e0d684fb1 req-0fea94f2-64ca-41ca-932b-f744fecadfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87114634-97b0-4781-8f8f-5e6cff8619e6", "tag": "7b6a57a1-9bde-47a1-821d-905276a0f6fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:10.830725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:10.836500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:10.843642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:10.844902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:10.852052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:10.852820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:10.853319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:10.853734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:10.854830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d422880f-f76c-4418-b661-057e0d684fb1 req-0fea94f2-64ca-41ca-932b-f744fecadfd6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:10.855376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d422880f-f76c-4418-b661-057e0d684fb1 req-0fea94f2-64ca-41ca-932b-f744fecadfd6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:10.855907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d422880f-f76c-4418-b661-057e0d684fb1 req-0fea94f2-64ca-41ca-932b-f744fecadfd6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:10.877447 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d422880f-f76c-4418-b661-057e0d684fb1 req-0fea94f2-64ca-41ca-932b-f744fecadfd6 service nova] Creating event network-changed:7b6a57a1-9bde-47a1-821d-905276a0f6fe for instance 87114634-97b0-4781-8f8f-5e6cff8619e6 on n-h2-820368-37 Sep 01 05:43:10.885309 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d422880f-f76c-4418-b661-057e0d684fb1 req-0fea94f2-64ca-41ca-932b-f744fecadfd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059734 Sep 01 05:43:10.886176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3280/6605] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:10.896069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:43:10.990335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8b74635-e546-4656-87a9-eb40a2d0742d tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 204 len: 0 microversion: 2.1 time: 0.170829 Sep 01 05:43:10.991333 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3326/6606] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:43:10 2022] DELETE /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:43:11.007261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:11.008205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:11.022345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:11.023052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:11.023508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:11.024235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:11.024702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:11.025214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:11.192421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:11.200635 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72ee2ca2-75da-4ea1-94ee-5e7d370432fa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1578 microversion: 2.1 time: 0.204901 Sep 01 05:43:11.201404 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3281/6607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:10 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:12.222971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:12.223723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:12.232624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:12.233222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:12.233660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:12.234844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:12.235333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:12.235759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:12.451173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:12.460168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91cc90af-dedf-4b3c-886f-589fe5769e1a tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1578 microversion: 2.1 time: 0.241645 Sep 01 05:43:12.461051 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3327/6608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:12 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:13.485672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:13.486420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:13.493824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:13.495091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:13.495091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:13.495723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:13.496181 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:13.496635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:13.810550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:13.820016 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33c4aebf-0e47-4169-b72e-f694e26911c5 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1459 microversion: 2.1 time: 0.338796 Sep 01 05:43:13.825185 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3282/6609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:13 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1459 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:13.825357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5efb60aa-1ce4-4adb-b926-86bfffd47002 req-92855970-c8e1-4c6b-8a35-a67a13e99741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114634-97b0-4781-8f8f-5e6cff8619e6", "name": "network-vif-deleted", "tag": "7b6a57a1-9bde-47a1-821d-905276a0f6fe"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:13.836298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5efb60aa-1ce4-4adb-b926-86bfffd47002 req-92855970-c8e1-4c6b-8a35-a67a13e99741 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:13.836801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5efb60aa-1ce4-4adb-b926-86bfffd47002 req-92855970-c8e1-4c6b-8a35-a67a13e99741 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:13.837234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5efb60aa-1ce4-4adb-b926-86bfffd47002 req-92855970-c8e1-4c6b-8a35-a67a13e99741 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:13.850615 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5efb60aa-1ce4-4adb-b926-86bfffd47002 req-92855970-c8e1-4c6b-8a35-a67a13e99741 service nova] Creating event network-vif-deleted:7b6a57a1-9bde-47a1-821d-905276a0f6fe for instance 87114634-97b0-4781-8f8f-5e6cff8619e6 on n-h2-820368-37 Sep 01 05:43:13.856422 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5efb60aa-1ce4-4adb-b926-86bfffd47002 req-92855970-c8e1-4c6b-8a35-a67a13e99741 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037894 Sep 01 05:43:13.857075 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3328/6610] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:43:14.844823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:14.849898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:14.860380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:14.861345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:14.862110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:14.863146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:14.863906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:14.864694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:14.944618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:14.957385 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-947b9d98-f6af-4a90-8a8c-69cb24c066c8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1224 microversion: 2.1 time: 0.115368 Sep 01 05:43:14.957385 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3283/6611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:14 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:15.976111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:15.976905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:15.983804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:15.984269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:15.984964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:15.985642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:15.986099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:15.986522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:16.051419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:16.060682 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab1abc56-3e52-43f2-8a84-ff00175571f8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1224 microversion: 2.1 time: 0.090035 Sep 01 05:43:16.061293 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3329/6612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:15 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:17.084737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:17.085668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:17.098152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.099079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.099867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.101062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.101517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.101960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.174694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:17.183364 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db4c17c0-ff9f-4b3a-8c30-21dbb8857dfe tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1224 microversion: 2.1 time: 0.104337 Sep 01 05:43:17.183951 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3284/6613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:17 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:18.207501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:18.208093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:18.215395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.215893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.216325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.217038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.217456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.218089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.289779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cda858cabf9422baaea18b04db279e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0564d7024b7e4e928dd3d3d100b01c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:18.298219 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f59c0c6a-3703-4320-9fbd-f5e841e65cab tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 200 len: 1224 microversion: 2.1 time: 0.095117 Sep 01 05:43:18.299220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3330/6614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:18 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:19.322735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:19.323300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 87114634-97b0-4781-8f8f-5e6cff8619e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:19.332747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.333252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.333711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.334436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.334943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.335440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.349698 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 87114634-97b0-4781-8f8f-5e6cff8619e6 could not be found. Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 HTTP/1.1 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 87114634-97b0-4781-8f8f-5e6cff8619e6 could not be found. Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '87114634-97b0-4781-8f8f-5e6cff8619e6'} Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87114634-97b0-4781-8f8f-5e6cff8619e6 could not be found. Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87114634-97b0-4781-8f8f-5e6cff8619e6 could not be found. Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:19.351469 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87114634-97b0-4781-8f8f-5e6cff8619e6 could not be found. Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 87114634-97b0-4781-8f8f-5e6cff8619e6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca9bcc5a-616d-4080-b11d-738ae6de8f2f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6" status: 404 len: 111 microversion: 2.1 time: 0.036134 Sep 01 05:43:19.355089 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3285/6615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:19 2022] GET /compute/v2.1/servers/87114634-97b0-4781-8f8f-5e6cff8619e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:43:19.820097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:19.820606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:19.827911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.828397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.828829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.829523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.829974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.830396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.844348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab HTTP/1.1 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7b9eb5cf-8232-420c-ac87-fcf78ddd66ab'} Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:43:19.846297 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-79920328-472e-4705-9024-66b0127a6e3f tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 404 len: 111 microversion: 2.1 time: 0.031731 Sep 01 05:43:19.850118 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3331/6616] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:43:19 2022] DELETE /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:43:19.856706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:19.857333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] [instance: 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:19.863649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.864147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.864597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.865355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.865821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.866257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.880235 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] HTTP exception thrown: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Request method failure captured: Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab HTTP/1.1 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEO-OK5qhyt88ylctWRwAC8Goszepb3o23hwIW2KtCWKlFWuLGeuo-fQFSx6JoIgzO1fzPCZQQfwKgKtL80p3vIZQ6tXJj7l4jrUSmQO3CdpczQXP1gxvtI8jf14emxHg3M4i0FvH9NpG1u3FwIY_nzXkE0MCnzWH9O4QJK7_HPP-i8 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0564d7024b7e4e928dd3d3d100b01c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 0564d7024b7e4e928dd3d3d100b01c93 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-740200795 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2cda858cabf9422baaea18b04db279e9 Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-740200795-project Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7b9eb5cf-8232-420c-ac87-fcf78ddd66ab'} Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:19.881826 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Returning 404 to user: Instance 7b9eb5cf-8232-420c-ac87-fcf78ddd66ab could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b516384e-82ff-4834-a149-ee0cca9a23aa tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab" status: 404 len: 111 microversion: 2.1 time: 0.030436 Sep 01 05:43:19.885831 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3286/6617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:19 2022] GET /compute/v2.1/servers/7b9eb5cf-8232-420c-ac87-fcf78ddd66ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:43:23.326379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46b72d4f-8c1f-415a-a163-9ea58278d5d8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] Calling method '.version_select at 0x7fa75b069dc0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:23.360460 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46b72d4f-8c1f-415a-a163-9ea58278d5d8 tempest-TestVolumeBootPattern-740200795 tempest-TestVolumeBootPattern-740200795-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1047361265" status: 202 len: 0 microversion: 2.1 time: 0.039543 Sep 01 05:43:23.361483 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3332/6618] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 1 05:43:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1047361265 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:43:42.774321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:42.775126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:42.894673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-394149066", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:43.078779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:43:43.280363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:43:43.280810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:43:43.281302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:43:43.281726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:43:43.282150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:43:43.292483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.292983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.293439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.294177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:43.294647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:43.295120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:43.314722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Getting quotas for project ccc4f69c3007460ca61ad8d98ec2a3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:43.320758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Getting quotas for user 049962413ca84090a38803ec44f23388 and project ccc4f69c3007460ca61ad8d98ec2a3d1. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:43.334542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:43:43.337110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:43:43.386172 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36077f4d-bc9c-4ea0-808c-23f77187bdd1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617039 Sep 01 05:43:43.386815 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3287/6619] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:43:43.399390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:43.400996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:43.405150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d228e10-9566-4c07-b751-2f26366848d6 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:43.406854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d228e10-9566-4c07-b751-2f26366848d6 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:43.579807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d228e10-9566-4c07-b751-2f26366848d6 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:43.587221 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d228e10-9566-4c07-b751-2f26366848d6 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1221 microversion: 2.1 time: 0.191580 Sep 01 05:43:43.587965 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3333/6620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:43 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:44.609536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:44.610157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:44.617282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:44.617827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:44.618257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:44.619078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:44.619574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:44.620018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:44.701956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:44.711095 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfc5e7ae-812f-4d47-a58e-616caeeb647c tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1273 microversion: 2.1 time: 0.106235 Sep 01 05:43:44.711725 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3288/6621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:44 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:45.733497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:45.734301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:45.742538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:45.743189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:45.743698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:45.744409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:45.744862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:45.745287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:45.991351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:45.999841 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c1d8780-9e91-44f7-99ee-37ab0d7bcbdb tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.270697 Sep 01 05:43:46.000412 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3334/6622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:45 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:46.405785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-56d2af78-9926-4d86-8162-21d4ae906c63 req-df73830f-66e0-4e26-8f4a-931c24e36b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9479c1fb-12ed-425d-8924-86bb7e95e16a", "tag": "62a87ca8-6fff-4e70-93ad-0e3c7a431fb2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:46.416974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56d2af78-9926-4d86-8162-21d4ae906c63 req-df73830f-66e0-4e26-8f4a-931c24e36b3e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:46.417786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56d2af78-9926-4d86-8162-21d4ae906c63 req-df73830f-66e0-4e26-8f4a-931c24e36b3e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:46.418335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56d2af78-9926-4d86-8162-21d4ae906c63 req-df73830f-66e0-4e26-8f4a-931c24e36b3e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:46.430225 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-56d2af78-9926-4d86-8162-21d4ae906c63 req-df73830f-66e0-4e26-8f4a-931c24e36b3e service nova] Creating event network-changed:62a87ca8-6fff-4e70-93ad-0e3c7a431fb2 for instance 9479c1fb-12ed-425d-8924-86bb7e95e16a on n-h2-820368-37 Sep 01 05:43:46.435750 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-56d2af78-9926-4d86-8162-21d4ae906c63 req-df73830f-66e0-4e26-8f4a-931c24e36b3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120261 Sep 01 05:43:46.436372 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3289/6623] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:47.022652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:47.023397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:47.031409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:47.031914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:47.032346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:47.033055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:47.033518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:47.033950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:47.175012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:47.183717 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2ee8cfbb-9cac-46af-a3a9-c0df72d976f1 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.165781 Sep 01 05:43:47.184317 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3335/6624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:47 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:48.208892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:48.209685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:48.220392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:48.221079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:48.221634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:48.222605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:48.223232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:48.223818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:48.376446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:48.386353 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a585cc98-c249-4cea-a171-e0caa302e409 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.184050 Sep 01 05:43:48.386992 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3290/6625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:48 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:49.408059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:49.408639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:49.416691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:49.417196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:49.417627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:49.418383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:49.418842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:49.419304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:49.577001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:49.588135 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea4947d8-3853-4b96-bc84-8abd1f21a9da tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.183988 Sep 01 05:43:49.588693 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3336/6626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:49 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:50.609458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:50.609999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:50.617721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:50.618244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:50.618689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:50.619460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:50.619925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:50.620362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:50.754388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:50.762695 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a564d5a-4033-4cd3-b82b-7d8637d8578e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.157401 Sep 01 05:43:50.763278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3291/6627] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:50 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:51.784655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:51.785442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:51.792753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:51.793233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:51.793662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:51.794356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:51.794802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:51.795268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:51.968857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:51.977723 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5721d702-2177-42e1-8c3e-49bc8d706914 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.197212 Sep 01 05:43:51.978304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3337/6628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:51 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:53.000514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:53.001212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:53.011911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:53.012757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:53.013528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:53.014343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:53.015040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:53.015784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:53.166874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:53.175162 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-834c8be1-a470-4bb7-a97a-7c8d5b39b178 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.178721 Sep 01 05:43:53.175757 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3292/6629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:52 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:54.197161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:54.197756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:54.200724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:54.206469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:54.207024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:54.207511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:54.208189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:54.208642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:54.209072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:54.298958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-01a2b2d7-0ef1-42fb-a56a-749035cacc43 req-195a52ca-2ac0-4530-a7c5-ae5f65edaafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9479c1fb-12ed-425d-8924-86bb7e95e16a", "name": "network-vif-plugged", "status": "completed", "tag": "62a87ca8-6fff-4e70-93ad-0e3c7a431fb2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:54.305076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:54.306376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:54.317372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-01a2b2d7-0ef1-42fb-a56a-749035cacc43 req-195a52ca-2ac0-4530-a7c5-ae5f65edaafe service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:54.317993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-01a2b2d7-0ef1-42fb-a56a-749035cacc43 req-195a52ca-2ac0-4530-a7c5-ae5f65edaafe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:54.318401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-01a2b2d7-0ef1-42fb-a56a-749035cacc43 req-195a52ca-2ac0-4530-a7c5-ae5f65edaafe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:54.332279 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-01a2b2d7-0ef1-42fb-a56a-749035cacc43 req-195a52ca-2ac0-4530-a7c5-ae5f65edaafe service nova] Creating event network-vif-plugged:62a87ca8-6fff-4e70-93ad-0e3c7a431fb2 for instance 9479c1fb-12ed-425d-8924-86bb7e95e16a on n-h2-820368-37 Sep 01 05:43:54.338065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-01a2b2d7-0ef1-42fb-a56a-749035cacc43 req-195a52ca-2ac0-4530-a7c5-ae5f65edaafe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043755 Sep 01 05:43:54.339159 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3293/6630] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:54.371061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:54.380601 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d26c86dc-3252-4108-97c4-fc619857abfa tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.187136 Sep 01 05:43:54.381054 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3338/6631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:54 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:55.403229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:55.403813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:55.413317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:55.414146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:55.414612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:55.415361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:55.415852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:55.416390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:55.557356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:55.565510 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0297632a-af26-4c94-9c91-62b8877b7e69 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1321 microversion: 2.1 time: 0.167159 Sep 01 05:43:55.566080 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3294/6632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:55 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:56.588899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:56.589562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:56.597684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:56.598200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:56.598714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:56.599586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:56.600136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:56.600642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:56.747723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:56.758371 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27fe4428-56c1-495a-8f5d-51260875682b tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1471 microversion: 2.1 time: 0.174336 Sep 01 05:43:56.759084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3339/6633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:56 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:56.840796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77929c16-e666-404f-9f95-df7640cc00f6 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Calling method '.version_select at 0x7fa75b32bee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:56.914834 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77929c16-e666-404f-9f95-df7640cc00f6 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/407272cb0f564be5a4df773af5282299" status: 200 len: 371 microversion: 2.1 time: 0.136326 Sep 01 05:43:56.915454 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3295/6634] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 05:43:56 2022] GET /compute/v2.1/os-quota-sets/407272cb0f564be5a4df773af5282299 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:56.927147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-381498d1-bf4d-4f9a-9b3c-c03ced798c92 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1451423444", "id": 1074452477, "os-flavor-access:is_public": "True"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:56.949323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-381498d1-bf4d-4f9a-9b3c-c03ced798c92 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025985 Sep 01 05:43:56.949937 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3340/6635] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:43:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:56.965727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1074452477"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:56.968378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:56.974896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:56.975403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:56.975834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:56.977039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:56.977585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:56.978020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.071447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '68d12ac4a64e41c99e0507b5b4bb94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407272cb0f564be5a4df773af5282299', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:57.078621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1451423444 {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:43:57.086258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.087314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.087766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.088539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.089008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.089441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.112619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Getting quotas for project ccc4f69c3007460ca61ad8d98ec2a3d1. Resources: {'ram', 'cores'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:57.118394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Getting quotas for user 049962413ca84090a38803ec44f23388 and project ccc4f69c3007460ca61ad8d98ec2a3d1. Resources: {'ram', 'cores'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:57.130718 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.compute.api [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] ram quota exceeded for 407272cb0f564be5a4df773af5282299, tried to resize instance. Sep 01 05:43:57.131309 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Request method failure captured: Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a/action HTTP/1.1 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 39 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEaOjDr57QKp8ZnG-WVQ5LRpPww2EZAOeBdzWO6otMHydogk3ve0shdFD2jYn73-PjiFLIZHCYaLBpQ7DLcq5eQzBOL223AilfhAcVgElRNi0xkh0DDh79rgCxUJIUeiTCD3N-jKNK0DFvQGN4826JUHGvFCyvy8lfce_8Nqqg2eKzQ Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 407272cb0f564be5a4df773af5282299 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-451250511 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,admin,member Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,admin,member Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/407272cb0f564be5a4df773af5282299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/407272cb0f564be5a4df773af5282299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_407272cb0f564be5a4df773af5282299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/407272cb0f564be5a4df773af5282299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-451250511 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 407272cb0f564be5a4df773af5282299 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-451250511 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-451250511-project-admin Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 68d12ac4a64e41c99e0507b5b4bb94f8 Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-451250511-project-admin Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: {"resize": {"flavorRef": "1074452477"}} Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '9479c1fb-12ed-425d-8924-86bb7e95e16a', 'body': {'resize': {'flavorRef': '1074452477'}}} Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:43:57.135634 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0cd656f4-25bc-4021-8834-91ad6edabc88 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a/action" status: 403 len: 118 microversion: 2.1 time: 0.178390 Sep 01 05:43:57.139875 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3296/6636] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:43:56 2022] POST /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a/action => generated 118 bytes in 180 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:43:57.146274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf7569ff-f702-431e-b60a-f1f805627796 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.170101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf7569ff-f702-431e-b60a-f1f805627796 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1074452477" status: 202 len: 0 microversion: 2.1 time: 0.027512 Sep 01 05:43:57.170696 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3341/6637] 10.222.0.26 () {58 vars in 1161 bytes} [Thu Sep 1 05:43:57 2022] DELETE /compute/v2.1/flavors/1074452477 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:43:57.179959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c540f92-2672-42fd-a8f2-b93b4c47cd80 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.200465 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c540f92-2672-42fd-a8f2-b93b4c47cd80 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024957 Sep 01 05:43:57.201049 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3297/6638] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:43:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:57.220681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a0e6bb25-c915-4374-b02e-46cc796a6baa tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Calling method '.version_select at 0x7fa75b1ab790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.297061 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a0e6bb25-c915-4374-b02e-46cc796a6baa tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/407272cb0f564be5a4df773af5282299" status: 200 len: 371 microversion: 2.1 time: 0.080133 Sep 01 05:43:57.297646 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3342/6639] 10.222.0.26 () {58 vars in 1242 bytes} [Thu Sep 1 05:43:57 2022] GET /compute/v2.1/os-quota-sets/407272cb0f564be5a4df773af5282299 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:57.309059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52c5c7fe-ea6c-4348-888d-6dd99e8208dc tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-325819714", "id": 156336805, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:57.329266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52c5c7fe-ea6c-4348-888d-6dd99e8208dc tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023848 Sep 01 05:43:57.329910 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3298/6640] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:43:57 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:57.342300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "156336805"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:57.344785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:57.351386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.351874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.352301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.352991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.353436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.353859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.511166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '68d12ac4a64e41c99e0507b5b4bb94f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '407272cb0f564be5a4df773af5282299', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:57.520106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-325819714 {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:43:57.528695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.529186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.529617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.530340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.530792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.531234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.552940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Getting quotas for project ccc4f69c3007460ca61ad8d98ec2a3d1. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:57.558481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Getting quotas for user 049962413ca84090a38803ec44f23388 and project ccc4f69c3007460ca61ad8d98ec2a3d1. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:57.571489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] cores quota exceeded for 407272cb0f564be5a4df773af5282299, tried to resize instance. Sep 01 05:43:57.572027 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Request method failure captured: Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a/action HTTP/1.1 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 38 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEaOjDr57QKp8ZnG-WVQ5LRpPww2EZAOeBdzWO6otMHydogk3ve0shdFD2jYn73-PjiFLIZHCYaLBpQ7DLcq5eQzBOL223AilfhAcVgElRNi0xkh0DDh79rgCxUJIUeiTCD3N-jKNK0DFvQGN4826JUHGvFCyvy8lfce_8Nqqg2eKzQ Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 407272cb0f564be5a4df773af5282299 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-451250511 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,admin,member Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,admin,member Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/407272cb0f564be5a4df773af5282299"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/407272cb0f564be5a4df773af5282299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_407272cb0f564be5a4df773af5282299"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/407272cb0f564be5a4df773af5282299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-451250511 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 407272cb0f564be5a4df773af5282299 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-451250511 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-451250511-project-admin Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 68d12ac4a64e41c99e0507b5b4bb94f8 Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-451250511-project-admin Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: {"resize": {"flavorRef": "156336805"}} Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9479c1fb-12ed-425d-8924-86bb7e95e16a', 'body': {'resize': {'flavorRef': '156336805'}}} Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:43:57.573990 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91fd1d98-6c73-4787-b7ae-469f5d8369b9 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a/action" status: 403 len: 113 microversion: 2.1 time: 0.237110 Sep 01 05:43:57.577567 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3343/6641] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:43:57 2022] POST /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a/action => generated 113 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:43:57.584407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bf548cc-31f1-4efa-b4e8-0d6a4d07bca3 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.604385 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8bf548cc-31f1-4efa-b4e8-0d6a4d07bca3 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/156336805" status: 202 len: 0 microversion: 2.1 time: 0.023708 Sep 01 05:43:57.604972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3299/6642] 10.222.0.26 () {58 vars in 1158 bytes} [Thu Sep 1 05:43:57 2022] DELETE /compute/v2.1/flavors/156336805 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:43:57.613134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f3979bb-4b4a-4c21-9a1c-5c80b2a39d46 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.635687 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f3979bb-4b4a-4c21-9a1c-5c80b2a39d46 tempest-ServersAdminNegativeTestJSON-451250511 tempest-ServersAdminNegativeTestJSON-451250511-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026253 Sep 01 05:43:57.636301 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3344/6643] 10.222.0.26 () {58 vars in 1146 bytes} [Thu Sep 1 05:43:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:57.658341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.659123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:57.669054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.669805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.670405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.671482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.672186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.672777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.704623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:43:57.791867 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc83113e-17a9-40c3-ac64-8c9d7398bdd0 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 204 len: 0 microversion: 2.1 time: 0.138590 Sep 01 05:43:57.792673 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3300/6644] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:43:57 2022] DELETE /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:43:57.801439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:57.802062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:57.808498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.808984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.809448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.810146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:57.810603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:57.811054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:57.945386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:57.953956 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1f075bd8-3fc8-46a4-9cdb-ff6cfb2aa4d8 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1477 microversion: 2.1 time: 0.156701 Sep 01 05:43:57.954541 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3345/6645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:57 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:58.979550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:58.980247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:58.987794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:58.988293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:58.988736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:58.989520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:58.989994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:58.990426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:59.146415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:59.156652 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba4cb24d-4f2d-4421-ab5d-aff0c382d323 tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1477 microversion: 2.1 time: 0.184328 Sep 01 05:43:59.157231 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3301/6646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:58 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:59.809730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dcc0d1dd-fe76-4243-83d4-c0bc5932d1e3 req-cf13034b-9192-4e5e-88ec-f66abcefea2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9479c1fb-12ed-425d-8924-86bb7e95e16a", "name": "network-vif-deleted", "tag": "62a87ca8-6fff-4e70-93ad-0e3c7a431fb2"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:59.821784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dcc0d1dd-fe76-4243-83d4-c0bc5932d1e3 req-cf13034b-9192-4e5e-88ec-f66abcefea2d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:59.822269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dcc0d1dd-fe76-4243-83d4-c0bc5932d1e3 req-cf13034b-9192-4e5e-88ec-f66abcefea2d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:59.822699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dcc0d1dd-fe76-4243-83d4-c0bc5932d1e3 req-cf13034b-9192-4e5e-88ec-f66abcefea2d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:59.841736 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dcc0d1dd-fe76-4243-83d4-c0bc5932d1e3 req-cf13034b-9192-4e5e-88ec-f66abcefea2d service nova] Creating event network-vif-deleted:62a87ca8-6fff-4e70-93ad-0e3c7a431fb2 for instance 9479c1fb-12ed-425d-8924-86bb7e95e16a on n-h2-820368-37 Sep 01 05:43:59.848560 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dcc0d1dd-fe76-4243-83d4-c0bc5932d1e3 req-cf13034b-9192-4e5e-88ec-f66abcefea2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042662 Sep 01 05:43:59.849574 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3346/6647] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:00.178348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:00.179053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:00.186067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:00.186584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:00.187066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:00.187777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:00.188245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:00.188688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:00.221306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:00.221806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:00.222259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:00.222706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lazy-loading 'fault' on Instance uuid 9479c1fb-12ed-425d-8924-86bb7e95e16a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:44:00.268476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049962413ca84090a38803ec44f23388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc4f69c3007460ca61ad8d98ec2a3d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:00.277311 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65da075c-aa06-4865-871e-3730ac6e727e tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 200 len: 1311 microversion: 2.1 time: 0.103174 Sep 01 05:44:00.277896 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3302/6648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:00 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:01.301990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:01.302770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] [instance: 9479c1fb-12ed-425d-8924-86bb7e95e16a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:01.311688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:01.312171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:01.312601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:01.313289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:01.313737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:01.314152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:01.328616 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] HTTP exception thrown: Instance 9479c1fb-12ed-425d-8924-86bb7e95e16a could not be found. Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Request method failure captured: Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a HTTP/1.1 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEaOUk2MTsCAoDIvvA5Sm6F2MkI_x_iIkSgfCN9KQXnKb4-tVHO1iItXl1OaSag93VfEoWHmrpaIAG2IxmfCd8NXDmf9sQaTou7w7vAkH9iZZfwMk0kQ4AGQuI5NsEwwDDHFVr8wubtXty7h5yIPDlamLVIB9H_K2gVKzNJ7s0z8IKg Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: ccc4f69c3007460ca61ad8d98ec2a3d1 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1183601357 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccc4f69c3007460ca61ad8d98ec2a3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccc4f69c3007460ca61ad8d98ec2a3d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccc4f69c3007460ca61ad8d98ec2a3d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccc4f69c3007460ca61ad8d98ec2a3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1183601357 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: ccc4f69c3007460ca61ad8d98ec2a3d1 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1183601357 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersAdminNegativeTestJSON-1183601357-project Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 049962413ca84090a38803ec44f23388 Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1183601357-project Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9479c1fb-12ed-425d-8924-86bb7e95e16a could not be found. Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9479c1fb-12ed-425d-8924-86bb7e95e16a'} Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9479c1fb-12ed-425d-8924-86bb7e95e16a could not be found. Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9479c1fb-12ed-425d-8924-86bb7e95e16a could not be found. Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:01.330295 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9479c1fb-12ed-425d-8924-86bb7e95e16a could not be found. Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] Returning 404 to user: Instance 9479c1fb-12ed-425d-8924-86bb7e95e16a could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-351d32e9-4f88-416b-a433-d8172a7f7bce tempest-ServersAdminNegativeTestJSON-1183601357 tempest-ServersAdminNegativeTestJSON-1183601357-project] 10.222.0.26 "GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a" status: 404 len: 111 microversion: 2.1 time: 0.036567 Sep 01 05:44:01.334315 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3347/6649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:01 2022] GET /compute/v2.1/servers/9479c1fb-12ed-425d-8924-86bb7e95e16a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:44:07.781032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:07.782062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:07.932123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-85265338", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "7d0a5dde-c0ba-47ef-848a-8ef977410d78"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:07.988738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] validate_networks() for [('7d0a5dde-c0ba-47ef-848a-8ef977410d78', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:44:08.423596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:44:08.424367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:44:08.425420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:44:08.425851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:44:08.426279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:44:08.436192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:08.436961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:08.437407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:08.438145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:08.438607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:08.439147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:08.460090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Getting quotas for project 68b65169a84c4ad88031f75a098f8b2a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:44:08.466367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Getting quotas for user b10a7b54f6664907b0f6d381870569b7 and project 68b65169a84c4ad88031f75a098f8b2a. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:44:08.481595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:44:08.484161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:44:08.536296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f066a2c4-d216-4196-928f-94cc47f953f4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761484 Sep 01 05:44:08.537216 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3303/6650] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:44:08.549139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d070e8a0-9ad0-4b2a-8bf4-0a515afe60d3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:08.550404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d070e8a0-9ad0-4b2a-8bf4-0a515afe60d3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:08.557129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:08.558496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:08.634534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d070e8a0-9ad0-4b2a-8bf4-0a515afe60d3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:08.645098 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d070e8a0-9ad0-4b2a-8bf4-0a515afe60d3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1213 microversion: 2.1 time: 0.101003 Sep 01 05:44:08.646062 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3348/6651] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:08 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:09.672168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:09.672168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:09.676414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:09.676853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:09.677368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:09.678150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:09.678685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:09.679446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:09.783935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:09.792137 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c530f23-8276-4864-9b24-00d2dc35c434 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1273 microversion: 2.1 time: 0.129394 Sep 01 05:44:09.801109 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3304/6652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:09 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:10.816326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:10.823401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:10.842661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:10.843321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:10.844373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:10.845281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:10.855725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:10.856289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:11.091579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:11.100218 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-687883a6-ca76-464c-b4fd-83081925b0a8 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.288176 Sep 01 05:44:11.114717 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3349/6653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:10 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:11.332949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-63ab9d66-1edd-4ac9-8d03-5ad421eb3293 req-cf074649-c56d-4aff-b602-e4cec2309039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5d24c6-19ed-4151-99e1-82ba98d740ca", "tag": "0001e575-8bda-4c6b-9b1c-e91733004365"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:11.346949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63ab9d66-1edd-4ac9-8d03-5ad421eb3293 req-cf074649-c56d-4aff-b602-e4cec2309039 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:11.347751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63ab9d66-1edd-4ac9-8d03-5ad421eb3293 req-cf074649-c56d-4aff-b602-e4cec2309039 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:11.348403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63ab9d66-1edd-4ac9-8d03-5ad421eb3293 req-cf074649-c56d-4aff-b602-e4cec2309039 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:11.361067 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-63ab9d66-1edd-4ac9-8d03-5ad421eb3293 req-cf074649-c56d-4aff-b602-e4cec2309039 service nova] Creating event network-changed:0001e575-8bda-4c6b-9b1c-e91733004365 for instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca on n-h2-820368-37 Sep 01 05:44:11.366181 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-63ab9d66-1edd-4ac9-8d03-5ad421eb3293 req-cf074649-c56d-4aff-b602-e4cec2309039 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037225 Sep 01 05:44:11.366792 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3305/6654] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:12.122999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:12.123616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:12.130944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:12.131438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:12.131876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:12.132576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:12.133036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:12.133629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:12.276205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:12.284346 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bbe6dad-236f-42e4-b785-0c38ccfb7e09 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.166199 Sep 01 05:44:12.284931 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3350/6655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:12 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:44:13.309585 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:13.310301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:13.312458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:13.318958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:13.319515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:13.320007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:13.320728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:13.321261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:13.321639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:13.324917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:13.489142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:13.497788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15f57a8c-be39-4bf0-9c24-5ccf89ea6ce4 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.193736 Sep 01 05:44:13.498372 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3306/6656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:13 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:14.519330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:14.520317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:14.523072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:14.529301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:14.529920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:14.530578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:14.531298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:14.531902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:14.532317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:14.537699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=72 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:14.705913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:14.714077 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b13aa1d-0a5e-42ce-8ef4-e3756db4d823 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.198753 Sep 01 05:44:14.714754 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3351/6657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:14 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:15.736223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:15.736863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:15.748967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:15.749503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:15.749959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:15.750693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:15.751195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:15.751625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:15.922499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:15.935221 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13dd5f4a-c9b8-4ca9-b751-48e861314a52 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.201666 Sep 01 05:44:15.935797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3307/6658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:15 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:16.960303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:16.960967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:16.968629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:16.969113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:16.969550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:16.970249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:16.970704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:16.971167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:17.129659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:17.141518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb09fe59-f2dd-4e9c-a6cb-d7e39e4766c7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.185066 Sep 01 05:44:17.142249 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3352/6659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:16 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:18.170550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:18.171393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:18.180115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:18.180615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:18.181058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:18.181793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:18.182312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:18.182743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:18.322319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:18.330797 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-daa2444d-0137-446d-9459-4c5dd15574f7 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.167456 Sep 01 05:44:18.331424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3308/6660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:18 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:18.392514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-fc28ca07-0f99-4ac0-97c2-967bf900da5f req-09296aa0-8c71-4934-a7c2-e2230b508d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5d24c6-19ed-4151-99e1-82ba98d740ca", "name": "network-vif-plugged", "status": "completed", "tag": "0001e575-8bda-4c6b-9b1c-e91733004365"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:18.404212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fc28ca07-0f99-4ac0-97c2-967bf900da5f req-09296aa0-8c71-4934-a7c2-e2230b508d4b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:18.404689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fc28ca07-0f99-4ac0-97c2-967bf900da5f req-09296aa0-8c71-4934-a7c2-e2230b508d4b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:18.405294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-fc28ca07-0f99-4ac0-97c2-967bf900da5f req-09296aa0-8c71-4934-a7c2-e2230b508d4b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:18.417138 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-fc28ca07-0f99-4ac0-97c2-967bf900da5f req-09296aa0-8c71-4934-a7c2-e2230b508d4b service nova] Creating event network-vif-plugged:0001e575-8bda-4c6b-9b1c-e91733004365 for instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca on n-h2-820368-37 Sep 01 05:44:18.423070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-fc28ca07-0f99-4ac0-97c2-967bf900da5f req-09296aa0-8c71-4934-a7c2-e2230b508d4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034385 Sep 01 05:44:18.423895 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3353/6661] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:19.352945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:19.353565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:19.355507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:19.356247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:19.364193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:19.364776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:19.365337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:19.366135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:19.366721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:19.367174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:19.576671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:19.588338 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70a05d7b-1795-42a0-9053-6ebbb00875c1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1313 microversion: 2.1 time: 0.239201 Sep 01 05:44:19.588973 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3309/6662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:19 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:20.613568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:20.618766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:20.619545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:20.627223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:20.627623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:20.628052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:20.628797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:20.629353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:20.629774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:20.818168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:20.827223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa853078-3c80-48b0-af0c-457682972052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1500 microversion: 2.1 time: 0.214543 Sep 01 05:44:20.828043 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3354/6663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:20 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1500 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:20.848270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:20.850593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:20.857934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:20.858421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:20.858904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:20.859683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:20.860099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:20.860538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:20.934863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:20.941433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:44:20.948562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:44:20.948970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:44:20.949454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:44:20.949875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:44:20.950453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:44:21.077715 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea95c30b-e565-4c12-a121-7c649e2a1d04 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "POST /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca/action" status: 202 len: 0 microversion: 2.1 time: 0.233345 Sep 01 05:44:21.078384 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3310/6664] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:44:20 2022] POST /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:44:21.086750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:21.087419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:21.093675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:21.094346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:21.094586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:21.095308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:21.095743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:21.096156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:21.273752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:21.283812 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-67dca226-c105-4f59-813e-7f2ee00937c9 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1509 microversion: 2.1 time: 0.200736 Sep 01 05:44:21.284850 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3355/6665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:21 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:22.309929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:22.311351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:22.319712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:22.320201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:22.320825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:22.321679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:22.322293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:22.322914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:22.552591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:22.561714 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-badfa5f6-9cf1-4c32-b446-1916cabb1f79 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1509 microversion: 2.1 time: 0.257877 Sep 01 05:44:22.562302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3311/6666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:22 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:23.583452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:23.584043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:23.591483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:23.591963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:23.592395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:23.593091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:23.593544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:23.593964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:23.830957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:23.842909 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36ebe2c0-56b3-496d-b727-1001f1662ea3 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.263439 Sep 01 05:44:23.843447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3356/6667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:23 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:24.867530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:24.868368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:24.879765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:24.880556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:24.881168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:24.882251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:24.882876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:24.883629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:25.039962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:25.048962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c5b8661-0bbe-4098-9db7-3a02c49d0ef1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.187485 Sep 01 05:44:25.049544 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3312/6668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:24 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:26.072713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:26.073485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:26.083690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:26.084370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:26.084973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:26.085932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:26.086557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:26.087142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:26.228899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:26.238195 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-34897b2b-d2c8-4dd1-93eb-3bbb7d65412d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.171057 Sep 01 05:44:26.238789 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3357/6669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:26 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:27.260158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:27.260694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:27.269058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:27.269568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:27.270043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:27.270759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:27.271269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:27.271712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:27.411366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:27.419617 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c0ab467-9bcb-4a30-a702-a80c3173a2c5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.163559 Sep 01 05:44:27.420272 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3313/6670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:27 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:28.440372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:28.440947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:28.448432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:28.448919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:28.449350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:28.450047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:28.450496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:28.451169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:28.587762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:28.601438 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44b69f4f-9881-43d5-8164-e5c95cbd52d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.164797 Sep 01 05:44:28.602353 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3358/6671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:28 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:29.626387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:29.627062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:29.634443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:29.634981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:29.635440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:29.636183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:29.636651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:29.637090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:29.780031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:29.788647 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2c08c00-8b29-436f-9f49-058f397a8aaf tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.166489 Sep 01 05:44:29.789242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3314/6672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:29 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:30.810805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:30.811458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:30.819163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:30.819665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:30.820092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:30.820809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:30.821262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:30.821679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:30.969344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:30.980700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a3b2e16-01f9-49b0-b4b6-2491ee0b3ba1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.173913 Sep 01 05:44:30.981475 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3359/6673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:30 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:32.004365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:32.005002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:32.012108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:32.012620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:32.013072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:32.014090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:32.014560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:32.015025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:32.151610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:32.160049 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7a2812d-9489-4384-9764-10e15f33a052 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.159898 Sep 01 05:44:32.160668 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3315/6674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:31 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:33.186977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:33.187716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:33.198936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:33.199660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:33.200087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:33.200785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:33.201229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:33.201649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:33.348276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:33.361304 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b48fb4f4-7ea4-4c02-811e-021cb768004e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.181388 Sep 01 05:44:33.362183 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3360/6675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:33 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:34.388462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:34.389117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:34.396548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:34.397056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:34.397503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:34.398229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:34.398699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:34.399208 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:34.536786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:34.545375 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-316ec2c5-dd44-4248-97ea-79114b525404 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.160799 Sep 01 05:44:34.546186 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3316/6676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:34 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:35.568693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:35.569315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:35.576825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:35.577321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:35.577762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:35.578467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:35.578981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:35.579412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:35.724783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:35.737394 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8fe8ba85-78f9-482f-995a-22565a3697f6 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.172331 Sep 01 05:44:35.738214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3361/6677] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:35 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:36.766905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:36.768411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:36.776416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:36.776924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:36.777378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:36.778089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:36.778556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:36.779031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:36.932141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:36.940502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3268f59f-8910-418a-9586-5ead475b3b0b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.179887 Sep 01 05:44:36.941095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3317/6678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:36 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:37.963178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:37.963750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:37.968151 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:44:37.968302 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:44:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca (ip 10.222.0.26) !!! Sep 01 05:44:37.980024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:37.980540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:37.980975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:37.981680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:37.982135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:37.982556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:38.121234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:38.131361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff8ee934-23ca-452e-b2ef-ec9fe7ce9878 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.173222 Sep 01 05:44:38.131950 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3362/6679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:37 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:39.152672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:39.153263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:39.155549 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:44:39.155702 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca (ip 10.222.0.26) !!! Sep 01 05:44:39.163090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:39.163587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:39.164038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:39.164742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:39.165213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:39.165656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:39.320828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:39.328992 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de6bec38-c248-4690-93ea-a102e9bd327b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.180664 Sep 01 05:44:39.329550 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3318/6680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:39 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:40.354224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:40.354795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:40.364940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:40.365430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:40.365873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:40.366553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:40.367078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:40.367507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:40.508300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:40.520003 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-efc4dfd4-86d7-466e-8ec2-238bda29b732 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.172578 Sep 01 05:44:40.520577 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3363/6681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:40 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:41.541857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:41.542432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:41.550287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:41.550785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:41.551276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:41.551972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:41.552452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:41.552884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:41.700766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:41.711947 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4b8a2ea-0d5f-4f85-baf4-8d76d1d67f0e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.173760 Sep 01 05:44:41.712765 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3319/6682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:41 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:42.736924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:42.737516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:42.745154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:42.745642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:42.746079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:42.746775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:42.747269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:42.747694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:42.880958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:42.891629 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52839388-8661-48f3-910e-8f7b62a2a909 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.158348 Sep 01 05:44:42.892497 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3364/6683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:42 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:43.915835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:43.916441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:43.919244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=32 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:43.925228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:43.925727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:43.926180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:43.927260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:43.927811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:43.928255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:43.930959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:44.079920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:44.089642 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-258275fa-e462-4c35-b154-f149fc94a09a tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.178188 Sep 01 05:44:44.090264 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3320/6684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:43 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:45.114973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:45.115927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:45.119963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=28 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:45.126054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:45.126538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:45.126968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:45.127680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:45.128136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:45.128561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:45.132427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=80 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:45.290338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:45.304288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f7b99fa8-51a1-4185-9a09-178cc9469934 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.195497 Sep 01 05:44:45.305107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3365/6685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:45 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:46.326334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:46.326966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:46.334321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:46.334811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:46.335290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:46.336001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:46.336470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:46.336907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:46.486007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:46.495894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9880a637-2f21-4164-b9e5-5b670780df54 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.173615 Sep 01 05:44:46.496499 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3321/6686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:46 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:47.520870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:47.522276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:47.534245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:47.535162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:47.535817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:47.537076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:47.538044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:47.538469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:47.679658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:47.692632 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-82fa15ba-538e-4978-8d3d-a508f118aa26 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.177962 Sep 01 05:44:47.693415 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3366/6687] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:47 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:48.714148 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:48.714707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:48.722057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:48.722558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:48.723041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:48.723752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:48.724282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:48.724708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:48.862951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:48.874169 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-354bd533-5fd5-4c34-8470-7d64ed3fba44 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.163975 Sep 01 05:44:48.874768 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3322/6688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:48 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:49.900006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:49.900969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:49.908423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:49.908944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:49.909386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:49.910077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:49.910531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:49.910978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:50.051206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:50.063883 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce391ee5-95bb-47be-9699-e899f8661372 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1514 microversion: 2.1 time: 0.167704 Sep 01 05:44:50.064618 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3367/6689] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:49 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:51.086959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:51.087744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:51.094956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:51.095459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:51.095911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:51.096626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:51.097093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:51.097531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:51.251806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5d24c6-19ed-4151-99e1-82ba98d740ca", "name": "network-vif-unplugged", "status": "completed", "tag": "0001e575-8bda-4c6b-9b1c-e91733004365"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:51.262369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:51.262844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:51.263302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:51.276456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] Creating event network-vif-unplugged:0001e575-8bda-4c6b-9b1c-e91733004365 for instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca on n-h1-820368-37 Sep 01 05:44:51.282228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:44:51.293631 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4a41b3f7-b2fd-4cc3-ac2c-4ed562d3c1fe req-ae9c3c69-2e25-4f2f-9a28-03d092fc2c7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108978 Sep 01 05:44:51.294261 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3368/6690] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:44:51.342312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:51.350559 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ec522c6-ea11-4538-8d83-c2355c2d5015 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1513 microversion: 2.1 time: 0.268235 Sep 01 05:44:51.351407 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3323/6691] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:51 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:52.377947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:52.378635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:52.386236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:52.386707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:52.387171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:52.387870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:52.388323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:52.388742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:52.529134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:52.541748 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e307d3d-6ff3-464a-a385-8451c4bfeafb tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1511 microversion: 2.1 time: 0.171726 Sep 01 05:44:52.542356 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3369/6692] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:52 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:53.310222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5d24c6-19ed-4151-99e1-82ba98d740ca", "tag": "0001e575-8bda-4c6b-9b1c-e91733004365"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:53.322253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:53.322915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.323373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.335709 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] Creating event network-changed:0001e575-8bda-4c6b-9b1c-e91733004365 for instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca on n-h1-820368-37 Sep 01 05:44:53.341877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:44:53.353196 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d330afe6-86c9-4833-b08e-f7cd7020c87c req-37414c26-eeda-4cf3-84ca-538bb2b4cca9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046845 Sep 01 05:44:53.353865 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3324/6693] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:53.571131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:53.571959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:53.579350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:53.579933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.580444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.581387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:53.581910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.582404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.868874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:53.878096 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f1ed85e2-2c04-4257-8888-95f34d7ea9d1 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1508 microversion: 2.1 time: 0.312280 Sep 01 05:44:53.878949 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3370/6694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:53 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:53.899812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:53.900816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:53.907682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:53.908183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.908648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.909356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:53.909825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:53.910255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:53.937053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:44:53.993891 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.compute.api [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Found an unconfirmed migration during delete, id: 16, status: finished Sep 01 05:44:56.118756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccecdb36-041f-43ef-a57b-a90c9ad3e794 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 204 len: 0 microversion: 2.1 time: 2.223031 Sep 01 05:44:56.119583 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3325/6695] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:44:53 2022] DELETE /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 0 bytes in 2225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:44:56.128144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:56.128758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:56.135876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:56.136486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:56.136928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:56.137635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:56.138096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:56.138521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:56.278783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:56.290713 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-275f67cd-6f7c-40d7-b330-62edbadbf980 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1500 microversion: 2.1 time: 0.166522 Sep 01 05:44:56.291573 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3371/6696] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:56 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:44:57.314297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:57.315015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:57.322342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:57.323170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:57.323929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:57.325173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:57.325668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:57.326240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:57.561322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10a7b54f6664907b0f6d381870569b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b65169a84c4ad88031f75a098f8b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:44:57.571443 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d528e720-cadb-478c-82b3-2046711ff61d tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 200 len: 1500 microversion: 2.1 time: 0.261343 Sep 01 05:44:57.572545 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3326/6697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:57 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:44:57.618806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d922be30-69a3-44de-ad0b-42145d01b8da req-c6abe056-ccd7-45bb-b10d-c3224f8c4e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5d24c6-19ed-4151-99e1-82ba98d740ca", "name": "network-vif-plugged", "status": "completed", "tag": "0001e575-8bda-4c6b-9b1c-e91733004365"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:57.629993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d922be30-69a3-44de-ad0b-42145d01b8da req-c6abe056-ccd7-45bb-b10d-c3224f8c4e0a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:57.630566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d922be30-69a3-44de-ad0b-42145d01b8da req-c6abe056-ccd7-45bb-b10d-c3224f8c4e0a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:57.631086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d922be30-69a3-44de-ad0b-42145d01b8da req-c6abe056-ccd7-45bb-b10d-c3224f8c4e0a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:57.643843 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d922be30-69a3-44de-ad0b-42145d01b8da req-c6abe056-ccd7-45bb-b10d-c3224f8c4e0a service nova] Creating event network-vif-plugged:0001e575-8bda-4c6b-9b1c-e91733004365 for instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca on n-h1-820368-37 Sep 01 05:44:57.649902 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d922be30-69a3-44de-ad0b-42145d01b8da req-c6abe056-ccd7-45bb-b10d-c3224f8c4e0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115577 Sep 01 05:44:57.653738 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3372/6698] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:44:58.043132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4cc76cb2-6c3d-4636-8b09-830a5108702d req-9ea3b8d4-a5eb-4bf0-983a-def3b4ddc69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5d24c6-19ed-4151-99e1-82ba98d740ca", "name": "network-vif-deleted", "tag": "0001e575-8bda-4c6b-9b1c-e91733004365"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:44:58.054312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cc76cb2-6c3d-4636-8b09-830a5108702d req-9ea3b8d4-a5eb-4bf0-983a-def3b4ddc69b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.055096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cc76cb2-6c3d-4636-8b09-830a5108702d req-9ea3b8d4-a5eb-4bf0-983a-def3b4ddc69b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.055623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cc76cb2-6c3d-4636-8b09-830a5108702d req-9ea3b8d4-a5eb-4bf0-983a-def3b4ddc69b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.071739 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4cc76cb2-6c3d-4636-8b09-830a5108702d req-9ea3b8d4-a5eb-4bf0-983a-def3b4ddc69b service nova] Creating event network-vif-deleted:0001e575-8bda-4c6b-9b1c-e91733004365 for instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca on n-h1-820368-37 Sep 01 05:44:58.078615 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4cc76cb2-6c3d-4636-8b09-830a5108702d req-9ea3b8d4-a5eb-4bf0-983a-def3b4ddc69b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096497 Sep 01 05:44:58.079793 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3327/6699] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:44:58.598727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:58.599814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:58.608933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.609418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.609849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.610540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.611019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.611438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.625751 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] HTTP exception thrown: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Request method failure captured: Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca HTTP/1.1 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEanNyoYtX8ORod7gkZnwUPtxDULl7_H5g9XbvGfyR6k2Ia07quWsvkDjilF5qI6NzOJZHqnYE893AJwNoHGOPsKcFzVR6QNfUEwPIe1JC88QhmiZspSl6nZTUCnbzgX3MRmwKKsj8o5LHGRO9Jud2KWdV6syCRgNp819CF-O9M2BOg Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 68b65169a84c4ad88031f75a098f8b2a Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 68b65169a84c4ad88031f75a098f8b2a Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-12746003-project Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b10a7b54f6664907b0f6d381870569b7 Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-12746003-project Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2f5d24c6-19ed-4151-99e1-82ba98d740ca'} Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:58.627428 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Returning 404 to user: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71be1534-bd84-4605-a0b4-05ce5932773b tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 404 len: 111 microversion: 2.1 time: 0.038203 Sep 01 05:44:58.631718 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3373/6700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:58 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:44:58.644698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:58.645187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:58.652979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.653474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.653920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.654630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.655126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.655560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.669659 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] HTTP exception thrown: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Request method failure captured: Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca HTTP/1.1 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEanNyoYtX8ORod7gkZnwUPtxDULl7_H5g9XbvGfyR6k2Ia07quWsvkDjilF5qI6NzOJZHqnYE893AJwNoHGOPsKcFzVR6QNfUEwPIe1JC88QhmiZspSl6nZTUCnbzgX3MRmwKKsj8o5LHGRO9Jud2KWdV6syCRgNp819CF-O9M2BOg Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 68b65169a84c4ad88031f75a098f8b2a Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 68b65169a84c4ad88031f75a098f8b2a Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-12746003-project Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: b10a7b54f6664907b0f6d381870569b7 Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-12746003-project Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '2f5d24c6-19ed-4151-99e1-82ba98d740ca'} Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:44:58.671383 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Returning 404 to user: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1fcc26e-477e-4476-8b59-70c42aaf35b5 tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 404 len: 111 microversion: 2.1 time: 0.032836 Sep 01 05:44:58.674740 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3328/6701] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:44:58 2022] DELETE /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:44:58.681638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:44:58.682246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] [instance: 2f5d24c6-19ed-4151-99e1-82ba98d740ca] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:44:58.689240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.689707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.690138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.690831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:44:58.691390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:44:58.691805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:44:58.706453 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] HTTP exception thrown: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Request method failure captured: Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca HTTP/1.1 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEanNyoYtX8ORod7gkZnwUPtxDULl7_H5g9XbvGfyR6k2Ia07quWsvkDjilF5qI6NzOJZHqnYE893AJwNoHGOPsKcFzVR6QNfUEwPIe1JC88QhmiZspSl6nZTUCnbzgX3MRmwKKsj8o5LHGRO9Jud2KWdV6syCRgNp819CF-O9M2BOg Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 68b65169a84c4ad88031f75a098f8b2a Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68b65169a84c4ad88031f75a098f8b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 68b65169a84c4ad88031f75a098f8b2a Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-DeleteServersTestJSON-12746003 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-DeleteServersTestJSON-12746003-project Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: b10a7b54f6664907b0f6d381870569b7 Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-DeleteServersTestJSON-12746003-project Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '2f5d24c6-19ed-4151-99e1-82ba98d740ca'} Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:44:58.708075 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] Returning 404 to user: Instance 2f5d24c6-19ed-4151-99e1-82ba98d740ca could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-00a26a29-7d61-4cfe-9b18-7edb31e95d4e tempest-DeleteServersTestJSON-12746003 tempest-DeleteServersTestJSON-12746003-project] 10.222.0.26 "GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca" status: 404 len: 111 microversion: 2.1 time: 0.031957 Sep 01 05:44:58.712503 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3374/6702] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:44:58 2022] GET /compute/v2.1/servers/2f5d24c6-19ed-4151-99e1-82ba98d740ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:45:07.561855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-490788901", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "bfe3fe26-bb29-4ea8-97d8-f9a68b0f23e0"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:07.616722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] validate_networks() for [('bfe3fe26-bb29-4ea8-97d8-f9a68b0f23e0', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:45:08.081364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:45:08.085748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:45:08.086281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:45:08.086715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:45:08.087215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:45:08.098036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:08.098531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:08.099002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:08.099736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:08.100193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:08.100625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:08.118483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Getting quotas for project 62f070df70b04c31ae969516ac252808. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:45:08.124406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Getting quotas for user db61bc44589948e9aaa9c42c15c3c3f4 and project 62f070df70b04c31ae969516ac252808. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:45:08.137442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:45:08.139947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:45:08.191347 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd124cac-6b1a-4dc4-9f14-7febea132512 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751502 Sep 01 05:45:08.192008 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3329/6703] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:45:08.204728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b9b99d6-f500-436b-9a04-f473262dd67a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:08.205457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b9b99d6-f500-436b-9a04-f473262dd67a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:08.262918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b9b99d6-f500-436b-9a04-f473262dd67a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:08.270521 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b9b99d6-f500-436b-9a04-f473262dd67a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1217 microversion: 2.1 time: 0.070874 Sep 01 05:45:08.271250 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3375/6704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:08 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:45:09.293537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:09.295014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:09.303301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:09.303806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:09.304469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:09.305288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:09.305765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:09.306225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:09.372515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:09.381549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44bb3031-8556-4e2a-b74a-90d1d6b96423 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1277 microversion: 2.1 time: 0.093142 Sep 01 05:45:09.382117 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3330/6705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:09 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:10.407726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:10.410496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:10.412923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=45 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:10.430926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:10.432861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:10.433303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:10.434329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:10.434910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:10.435340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:10.654505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:10.664468 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80242849-5c08-458c-b068-ba94d7d07d7f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.260386 Sep 01 05:45:10.665937 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3376/6706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:10 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:11.192261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-212d270c-5cea-4d29-a703-5bb4012ea635 req-1da2e985-2a7e-43bc-8941-e40188918b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f1c650-bd1a-461c-991f-d245fb775105", "tag": "4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:11.207226 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-212d270c-5cea-4d29-a703-5bb4012ea635 req-1da2e985-2a7e-43bc-8941-e40188918b05 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:11.208075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-212d270c-5cea-4d29-a703-5bb4012ea635 req-1da2e985-2a7e-43bc-8941-e40188918b05 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:11.208627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-212d270c-5cea-4d29-a703-5bb4012ea635 req-1da2e985-2a7e-43bc-8941-e40188918b05 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:11.221560 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-212d270c-5cea-4d29-a703-5bb4012ea635 req-1da2e985-2a7e-43bc-8941-e40188918b05 service nova] Creating event network-changed:4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9 for instance 71f1c650-bd1a-461c-991f-d245fb775105 on n-h1-820368-37 Sep 01 05:45:11.229519 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-212d270c-5cea-4d29-a703-5bb4012ea635 req-1da2e985-2a7e-43bc-8941-e40188918b05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042394 Sep 01 05:45:11.231070 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3331/6707] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:11.689690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:11.690220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:11.697395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:11.697873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:11.698303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:11.699022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:11.699643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:11.700091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:11.850492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:11.858823 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84870b4e-89e9-4350-bcf7-7388d8cf0fcf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.173291 Sep 01 05:45:11.859457 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3377/6708] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:11 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:12.881731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:12.882449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:12.889589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:12.890110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:12.890567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:12.891337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:12.891811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:12.892239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:13.034503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:13.042659 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57fb7704-0fa4-4fac-8a12-dfd9f1655f20 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.166135 Sep 01 05:45:13.043377 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3332/6709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:12 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:14.064265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:14.064782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:14.072098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:14.072587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:14.073021 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:14.073715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:14.074148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:14.074592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:14.210439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:14.218788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-daa85f6f-9fa2-470a-bd1b-4966fe21c89c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.158629 Sep 01 05:45:14.219397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3378/6710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:14 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:15.243942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:15.244859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:15.248040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:15.253633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:15.254063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:15.254509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:15.255262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:15.255732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:15.256162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:15.259469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:15.401480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:15.410204 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4cd3172-b122-4210-9c81-ee223b792331 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.173021 Sep 01 05:45:15.410801 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3333/6711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:15 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:16.433081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:16.433879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:16.436671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=30 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:16.442274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:16.442763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:16.443225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:16.443929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:16.444385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:16.444814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:16.593675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:16.605946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-911a24a6-10a7-4600-9b97-00a805512ce8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.177830 Sep 01 05:45:16.606496 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3379/6712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:16 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:17.461172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7f1ed1a6-3e8f-4196-bbcd-313553ca97b3 req-d8334c3b-00db-4838-810f-077b3bc8c16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f1c650-bd1a-461c-991f-d245fb775105", "name": "network-vif-plugged", "status": "completed", "tag": "4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:17.473607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7f1ed1a6-3e8f-4196-bbcd-313553ca97b3 req-d8334c3b-00db-4838-810f-077b3bc8c16e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.474093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7f1ed1a6-3e8f-4196-bbcd-313553ca97b3 req-d8334c3b-00db-4838-810f-077b3bc8c16e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.475081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7f1ed1a6-3e8f-4196-bbcd-313553ca97b3 req-d8334c3b-00db-4838-810f-077b3bc8c16e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:17.488292 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7f1ed1a6-3e8f-4196-bbcd-313553ca97b3 req-d8334c3b-00db-4838-810f-077b3bc8c16e service nova] Creating event network-vif-plugged:4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9 for instance 71f1c650-bd1a-461c-991f-d245fb775105 on n-h1-820368-37 Sep 01 05:45:17.493463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7f1ed1a6-3e8f-4196-bbcd-313553ca97b3 req-d8334c3b-00db-4838-810f-077b3bc8c16e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036117 Sep 01 05:45:17.494095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3334/6713] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:17.627258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:17.627832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:17.635299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.635792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.636238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:17.636939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:17.637402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:17.637832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:17.786178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:17.799506 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f684c9de-a3f0-4474-82b1-cffb4853163d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1317 microversion: 2.1 time: 0.175386 Sep 01 05:45:17.800788 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3380/6714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:17 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:18.823269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:18.824132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:18.829246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:18.829962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:18.837401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:18.837902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:18.838351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:18.839096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:18.839577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:18.840004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:18.983493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:18.991472 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd13f510-c8a0-46cb-b6f9-80429310705d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1506 microversion: 2.1 time: 0.169256 Sep 01 05:45:18.992078 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3335/6715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:18 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:19.014071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:19.014686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.016640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:19.022986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.023463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.023911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.024609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.025057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.025811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.162622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.171153 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f702bd67-8890-432c-a4fb-3771812b49c0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1506 microversion: 2.1 time: 0.162184 Sep 01 05:45:19.171716 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3381/6716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:19 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:19.191494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:19.193836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.200568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.201072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.201526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.202236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.202711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.203186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.271907 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53bd7b34-ff62-4c91-9024-748315e090db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "PUT /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1078 microversion: 2.1 time: 0.084430 Sep 01 05:45:19.272528 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3336/6717] 10.222.0.26 () {60 vars in 1256 bytes} [Thu Sep 1 05:45:19 2022] PUT /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1078 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:19.290127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:19.290743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.297403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.297870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.298507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.299214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.299676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.300088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.456455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.467810 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4d4956f3-822c-4231-8772-e34b90c1841f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1504 microversion: 2.1 time: 0.181747 Sep 01 05:45:19.468421 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3382/6718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:19 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:19.491133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:19.492154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.501578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.502395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.503198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.504353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.505120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.505844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.646917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.659237 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9254484-1a68-42f9-a5bc-32b094ca3cfb tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1504 microversion: 2.1 time: 0.174260 Sep 01 05:45:19.660064 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3337/6719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:19 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:45:19.679947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:19.682301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.689082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.689566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.689993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.690792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.691311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.691726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.721154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.727180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:45:19.734227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:45:19.734648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:45:19.735163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:45:19.735565 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:45:19.735987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:45:19.805550 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d97a31c-bedc-4a53-a076-bc4f3876e448 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105/action" status: 202 len: 0 microversion: 2.1 time: 0.129723 Sep 01 05:45:19.806218 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3383/6720] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:45:19 2022] POST /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:45:19.814486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:19.815138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:19.821060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.821552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.821960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.822687 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:19.823180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:19.823612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:19.985611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:19.993818 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-743fad04-8b69-4c79-9a8f-7917f4053e73 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1515 microversion: 2.1 time: 0.183255 Sep 01 05:45:19.994436 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3338/6721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:19 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:21.016506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:21.017145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:21.023742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:21.024223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:21.024648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:21.025705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:21.026151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:21.026568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:21.162062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:21.170837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11c4132a-a48a-4d33-9809-dba90188826e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1515 microversion: 2.1 time: 0.159478 Sep 01 05:45:21.171447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3384/6722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:21 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:22.192861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:22.193392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:22.201429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:22.201915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:22.202366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:22.203105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:22.203587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:22.204026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:22.346857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:22.355138 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c53a2853-a6c0-4095-bd0c-6bfab16f972a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.166245 Sep 01 05:45:22.355759 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3339/6723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:22 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:23.380917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:23.381847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:23.391560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:23.392045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:23.392473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:23.393158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:23.393601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:23.394015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:23.535075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:23.543070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d436cd5b-44f0-4f40-8ffd-0eee09360cc8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.168861 Sep 01 05:45:23.543644 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3385/6724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:23 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:24.568484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:24.569575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:24.581077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:24.581914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:24.582661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:24.583887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:24.584662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:24.585404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:24.737579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:24.745567 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c245999-0901-4aef-a9c8-70bdc802cfaf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.183866 Sep 01 05:45:24.746153 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3340/6725] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:24 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:25.771838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:25.772846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:25.784810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:25.785620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:25.786399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:25.787536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:25.788285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:25.788991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:25.931325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:25.940869 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-866dfa2e-094c-4c20-b4e4-e1b5c14e9bb7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.176088 Sep 01 05:45:25.941457 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3386/6726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:25 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:26.971376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:26.972968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:26.987187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:26.987933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:26.988610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:26.989703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:26.990427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:26.991142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:27.133194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:27.143063 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66833a72-5f8d-476e-b637-647f528b3344 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.182373 Sep 01 05:45:27.143741 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3341/6727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:26 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:28.176542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:28.177468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:28.187711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:28.188188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:28.188617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:28.189303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:28.189757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:28.190175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:28.332191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:28.344622 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6915d7c8-484e-4ae5-bb8b-7025e79bc8f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.173946 Sep 01 05:45:28.345212 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3387/6728] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:28 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:29.366218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:29.366791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:29.373922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:29.374418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:29.374863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:29.375586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:29.376042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:29.376480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:29.515873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:29.524036 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-187b99a8-7f90-464f-adc0-ef2b2b2d72ca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.161856 Sep 01 05:45:29.524608 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3342/6729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:29 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:30.546037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:30.546652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:30.554343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:30.554852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:30.555310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:30.555986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:30.556432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:30.556858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:30.703618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:30.712335 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8bb5d8ea-b988-4e7f-b900-0946e1dcb011 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.170435 Sep 01 05:45:30.712918 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3388/6730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:30 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:31.739527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:31.740131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:31.747316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:31.747754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:31.748206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:31.748909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:31.749379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:31.749824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:31.895105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:31.903391 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ebce8f0-9186-4d7a-9370-75c0e31193e8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.167868 Sep 01 05:45:31.903975 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3343/6731] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:31 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:32.928392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:32.928997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:32.936414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.936894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.937318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:32.937992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.938532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.938982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:33.079267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:33.087595 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-36dfa27d-4c49-408f-bd56-6fff6533eb34 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.165229 Sep 01 05:45:33.088166 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3389/6732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:32 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:34.112870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:34.113722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:34.125324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.126146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.126925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.128080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.128855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.129580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.268633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:34.278280 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cef1bb5-a534-49b0-b231-840e468fcdd6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.172046 Sep 01 05:45:34.278839 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3344/6733] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:34 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:35.306086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:35.306613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:35.313973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:35.314460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:35.314903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:35.315605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:35.316063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:35.316485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:35.450114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:35.458424 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9357c13f-9a27-4b10-9bf3-afbf6b6e5ddc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.156714 Sep 01 05:45:35.459020 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3390/6734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:35 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:36.483121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:36.484144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:36.496222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:36.497100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:36.497803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.498966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:36.499800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:36.500536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:36.640505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:36.648704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb740d09-68d2-4d48-8a2a-e98bae9c2195 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.172172 Sep 01 05:45:36.649293 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3345/6735] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:36 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:37.676325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:37.677379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:37.693476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:37.693964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:37.694394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:37.695135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:37.695579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:37.696000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:37.702857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:37.851308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:37.859817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f14139d2-7484-44ed-bb60-94f9eadb6886 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.190187 Sep 01 05:45:37.860452 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3391/6736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:37 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:38.881008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:38.881612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:38.891657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:38.892153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:38.892594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:38.893299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:38.893762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:38.894201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:39.040421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:39.048906 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-022bed7e-1efe-4463-b1c2-54ff9c08cbfc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.171978 Sep 01 05:45:39.049484 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3346/6737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:38 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:40.072320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:40.072902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:40.081063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:40.081625 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:40.082131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:40.082959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:40.083476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:40.083956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:40.230542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:40.243303 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8cf4ac1-4f8d-4505-81e3-d526833662f3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.175962 Sep 01 05:45:40.244014 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3392/6738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:40 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:41.269318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:41.270224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:41.278265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:41.278766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:41.279255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:41.279965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:41.280435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:41.280874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:41.413918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:41.421881 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99cce8de-41d8-411c-965c-7e2443d24ed2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.159454 Sep 01 05:45:41.422464 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3347/6739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:41 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:42.445514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:42.446158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:42.453672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:42.454158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:42.454584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:42.455309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:42.455753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:42.456167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:42.596132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:42.604780 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c6287cee-186e-47fc-a6d7-3b7b34ff24db tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.164256 Sep 01 05:45:42.605375 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3393/6740] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:42 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:43.630170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:43.630876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:43.638046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:43.638537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:43.638989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:43.639734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:43.640186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:43.640619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:43.772359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:43.781181 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e59685cd-df64-45ee-863d-e562b18e237e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.157595 Sep 01 05:45:43.781754 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3348/6741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:43 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:44.804771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:44.805367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:44.813188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.813696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.814147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.814869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.815370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.815809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.962905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:44.974770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08a9ebc1-009b-48a8-9de9-2765f0ca0653 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.175102 Sep 01 05:45:44.975515 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3394/6742] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:44 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:46.005095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:46.005673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:46.008498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=32 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:46.014132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:46.014672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:46.015152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:46.015874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:46.016353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:46.016797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:46.019727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:46.148349 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:46.157215 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26484830-41b9-4389-83b9-a9ac3cffb933 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.158707 Sep 01 05:45:46.157770 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3349/6743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:45 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:47.183892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:47.184895 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:47.189234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:47.198789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:47.199638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:47.200355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:47.201503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:47.202264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:47.202996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:47.344184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:47.354770 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf1f5e07-dabe-4af9-8939-6175e0eff38c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.178133 Sep 01 05:45:47.355403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3395/6744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:47 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:48.381825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:48.382430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:48.392774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:48.393332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:48.393830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:48.394605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:48.395164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:48.395885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:48.531127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:48.539389 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea3e00d9-4cbd-42ad-a70d-cce72869465e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1520 microversion: 2.1 time: 0.164034 Sep 01 05:45:48.539962 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3350/6745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:48 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:49.561410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:49.562112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:49.569432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:49.569909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:49.570339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:49.571068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:49.571521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:49.571942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:49.611576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f1c650-bd1a-461c-991f-d245fb775105", "name": "network-vif-unplugged", "status": "completed", "tag": "4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:49.622823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:49.623355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:49.623827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:49.639591 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] Creating event network-vif-unplugged:4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9 for instance 71f1c650-bd1a-461c-991f-d245fb775105 on n-h2-820368-37 Sep 01 05:45:49.649633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] Instance 71f1c650-bd1a-461c-991f-d245fb775105 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:45:49.663061 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-121c39d7-ca3d-415a-95e4-cdb4d61d44d3 req-133ae494-9802-4e84-9be0-9cb8166399a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055229 Sep 01 05:45:49.663902 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3351/6746] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:49.810053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:49.818636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69dd12e7-c91d-45c1-84e7-60c6bc5ed7da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1519 microversion: 2.1 time: 0.261022 Sep 01 05:45:49.819322 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3396/6747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:49 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:50.842139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:50.842852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:50.849925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:50.850458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:50.850914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:50.851623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:50.852092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:50.852531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:50.987055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:50.995212 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-489a8a90-bae0-4ffe-8ec8-f1d2b17abb33 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1517 microversion: 2.1 time: 0.158301 Sep 01 05:45:50.995831 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3352/6748] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:50 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:51.701319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f1c650-bd1a-461c-991f-d245fb775105", "tag": "4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:51.714931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:51.715440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:51.715873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:51.728230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] Creating event network-changed:4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9 for instance 71f1c650-bd1a-461c-991f-d245fb775105 on n-h2-820368-37 Sep 01 05:45:51.734083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] Instance 71f1c650-bd1a-461c-991f-d245fb775105 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:45:51.745126 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-95a8e9d5-1243-4755-a788-2ce52e0ac86f req-6243dd7b-9e56-466a-a048-a3ffc403c5b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050163 Sep 01 05:45:51.745913 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3397/6749] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:52.024514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:52.025504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:52.032962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:52.033470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:52.033951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:52.034696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:52.035207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:52.035644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:52.171524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:52.179841 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43aeb893-ad63-4227-8fd9-64ebcae8276f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1517 microversion: 2.1 time: 0.160140 Sep 01 05:45:52.180508 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3353/6750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:52 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:53.203250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:53.204098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:53.210905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:53.211416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:53.211854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:53.212578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:53.213032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:53.213480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:53.352837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:53.361055 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-471488b0-f7a3-46e1-ac0a-cf6d231435b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1517 microversion: 2.1 time: 0.163384 Sep 01 05:45:53.361910 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3398/6751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:53 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:54.387845 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:54.388831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:54.401298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.402179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.402967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.404220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.405037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.405784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.549652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:54.558381 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a186adf-81aa-457d-a6d4-f42e41936ae0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1514 microversion: 2.1 time: 0.177414 Sep 01 05:45:54.558992 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3354/6752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:54 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:54.579063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:54.579588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:54.586510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.587040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.587477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.588176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.588635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.589059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.652788 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a705dd1-d4e3-4004-b5bc-5ec610cf6194 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105/action" status: 204 len: 0 microversion: 2.1 time: 0.077466 Sep 01 05:45:54.653347 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3399/6753] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:45:54 2022] POST /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:45:54.662244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:54.662852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:54.669300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.670062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.670508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.671257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.671705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.672154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.815108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:54.823171 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5f12d67-0900-4945-a024-77c60ccee9ab tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1514 microversion: 2.1 time: 0.165385 Sep 01 05:45:54.823962 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3355/6754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:54 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:55.845702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:55.846247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:55.852996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:55.853568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:55.854060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:55.854831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:55.855315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:55.855750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:55.989286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:55.997851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a8b161c-afa4-42e5-a525-2d6bb61983df tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1514 microversion: 2.1 time: 0.157371 Sep 01 05:45:55.998704 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3400/6755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:55 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:45:56.788089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e3b89981-8f72-443c-b066-267e470b9975 req-de28b108-8a2e-4209-b3ce-6d48f98273c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f1c650-bd1a-461c-991f-d245fb775105", "name": "network-vif-plugged", "status": "completed", "tag": "4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:56.799715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3b89981-8f72-443c-b066-267e470b9975 req-de28b108-8a2e-4209-b3ce-6d48f98273c4 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:56.800239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3b89981-8f72-443c-b066-267e470b9975 req-de28b108-8a2e-4209-b3ce-6d48f98273c4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:56.800680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3b89981-8f72-443c-b066-267e470b9975 req-de28b108-8a2e-4209-b3ce-6d48f98273c4 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:56.813322 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e3b89981-8f72-443c-b066-267e470b9975 req-de28b108-8a2e-4209-b3ce-6d48f98273c4 service nova] Creating event network-vif-plugged:4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9 for instance 71f1c650-bd1a-461c-991f-d245fb775105 on n-h2-820368-37 Sep 01 05:45:56.818563 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e3b89981-8f72-443c-b066-267e470b9975 req-de28b108-8a2e-4209-b3ce-6d48f98273c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034246 Sep 01 05:45:56.819297 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3356/6756] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:45:57.023868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:57.024586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:57.032601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.033098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.033541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.034246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.034706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.035176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.187627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.195918 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d12793f4-d8ed-4367-ac99-746fcb9a23a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1506 microversion: 2.1 time: 0.178406 Sep 01 05:45:57.196535 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3401/6757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:57 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:57.226435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:57.227205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:57.233821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.234313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.234758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.235516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.235980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.236411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.372995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.381652 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91317bb1-296f-42bf-81c5-c2e6647abfef tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1506 microversion: 2.1 time: 0.160693 Sep 01 05:45:57.382242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3357/6758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:57 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:57.405487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d8426d56-24a4-4f8a-b3c6-48949aa43cc1 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'create', calling method: .version_select at 0x7fa75bd8d430>, body: {"keypair": {"name": "tempest-keypair-1901842600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo3Y8houmQ2GrPkDfocEj9HhBaHeZT9dsRZr5q5qpKX+ges7BD8Dn+E1C6xXhet0kdL8nHq7Y0VFvPDUqTDiHaWB+JrwtDngXa2I182I1s5sZSLIBOf3hpH3vehCAVm+Q=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:57.424656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d8426d56-24a4-4f8a-b3c6-48949aa43cc1 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Getting quotas for project 62f070df70b04c31ae969516ac252808. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:45:57.430223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-d8426d56-24a4-4f8a-b3c6-48949aa43cc1 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Getting quotas for user db61bc44589948e9aaa9c42c15c3c3f4 and project 62f070df70b04c31ae969516ac252808. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:45:57.460044 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d8426d56-24a4-4f8a-b3c6-48949aa43cc1 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058581 Sep 01 05:45:57.460755 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3402/6759] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:45:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:45:58.685578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:58.686202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:58.693160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.693654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.694094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.694791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.695285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.695715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.845834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:58.855529 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49030601-de6f-4bd2-882f-c90b2edddaf8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 200 len: 1506 microversion: 2.1 time: 0.174017 Sep 01 05:45:58.856122 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3358/6760] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:58 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:58.876386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:58.876945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:58.884252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.884736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.885142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.885872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:58.886389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:58.887071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:58.913153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:45:58.999393 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a92a7bd-37a4-414f-acd9-f3329cd57b44 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 204 len: 0 microversion: 2.1 time: 0.127672 Sep 01 05:45:59.003162 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3403/6761] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:45:58 2022] DELETE /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:45:59.056180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2119141552", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "bfe3fe26-bb29-4ea8-97d8-f9a68b0f23e0"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:59.110219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] validate_networks() for [('bfe3fe26-bb29-4ea8-97d8-f9a68b0f23e0', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:45:59.584343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:45:59.584954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:45:59.585694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:45:59.586307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:45:59.586924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:45:59.602690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:59.603144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:59.603553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:59.604432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:59.604881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:59.605311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:59.625097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Getting quotas for project 62f070df70b04c31ae969516ac252808. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:45:59.631012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Getting quotas for user db61bc44589948e9aaa9c42c15c3c3f4 and project 62f070df70b04c31ae969516ac252808. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:45:59.644425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:45:59.646803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:45:59.692885 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39cddc86-36b7-4516-b4bc-ae21f7ff363c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641147 Sep 01 05:45:59.693560 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3359/6762] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:45:59.705308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-645bcb34-90a9-4fa1-b3d3-8ce0d242ca2a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:59.706007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-645bcb34-90a9-4fa1-b3d3-8ce0d242ca2a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:59.759885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-645bcb34-90a9-4fa1-b3d3-8ce0d242ca2a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:59.767294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-645bcb34-90a9-4fa1-b3d3-8ce0d242ca2a tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1218 microversion: 2.1 time: 0.066375 Sep 01 05:45:59.767898 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3404/6763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:59 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:00.790336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:00.791882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:00.799531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:00.800037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:00.800496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:00.801177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:00.801711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:00.802189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:00.878004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:00.886730 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdeb45dd-1783-4287-981f-992a1e59b407 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1270 microversion: 2.1 time: 0.101646 Sep 01 05:46:00.887333 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3360/6764] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:00 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:01.222719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ee459d1a-d377-4c14-b7e7-62e45daf55dc req-3454a672-a0c2-4a82-9955-b25ec3ef047d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f1c650-bd1a-461c-991f-d245fb775105", "name": "network-vif-deleted", "tag": "4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:01.236146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ee459d1a-d377-4c14-b7e7-62e45daf55dc req-3454a672-a0c2-4a82-9955-b25ec3ef047d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:01.236851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ee459d1a-d377-4c14-b7e7-62e45daf55dc req-3454a672-a0c2-4a82-9955-b25ec3ef047d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:01.237546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ee459d1a-d377-4c14-b7e7-62e45daf55dc req-3454a672-a0c2-4a82-9955-b25ec3ef047d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:01.254453 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ee459d1a-d377-4c14-b7e7-62e45daf55dc req-3454a672-a0c2-4a82-9955-b25ec3ef047d service nova] Creating event network-vif-deleted:4ac5d2d0-658d-4ce0-8d7d-d3ef47f8b1f9 for instance 71f1c650-bd1a-461c-991f-d245fb775105 on n-h2-820368-37 Sep 01 05:46:01.262609 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ee459d1a-d377-4c14-b7e7-62e45daf55dc req-3454a672-a0c2-4a82-9955-b25ec3ef047d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043228 Sep 01 05:46:01.263447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3405/6765] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:01.909242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:01.909944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:01.918325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:01.918959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:01.919756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:01.920628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:01.921122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:01.921854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:02.130206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:02.138530 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a0abfce-2bca-41ff-a91a-af9d0128893b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.233148 Sep 01 05:46:02.139282 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3361/6766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:01 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:03.164469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:03.165046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:03.172292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:03.172773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:03.173206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:03.173900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:03.174346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:03.174772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:03.279411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2f8a378f-4db2-4d15-ac1c-d11871087ea8 req-6110ed35-50fa-4aa5-b472-81f821809de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f4809c-e920-4803-bda7-fa05bd300f5a", "tag": "5e7d65f5-d0c7-416a-9937-f7d3252c0487"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:03.290496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2f8a378f-4db2-4d15-ac1c-d11871087ea8 req-6110ed35-50fa-4aa5-b472-81f821809de6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:03.291021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2f8a378f-4db2-4d15-ac1c-d11871087ea8 req-6110ed35-50fa-4aa5-b472-81f821809de6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:03.291504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2f8a378f-4db2-4d15-ac1c-d11871087ea8 req-6110ed35-50fa-4aa5-b472-81f821809de6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:03.303276 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2f8a378f-4db2-4d15-ac1c-d11871087ea8 req-6110ed35-50fa-4aa5-b472-81f821809de6 service nova] Creating event network-changed:5e7d65f5-d0c7-416a-9937-f7d3252c0487 for instance 54f4809c-e920-4803-bda7-fa05bd300f5a on n-h2-820368-37 Sep 01 05:46:03.308669 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2f8a378f-4db2-4d15-ac1c-d11871087ea8 req-6110ed35-50fa-4aa5-b472-81f821809de6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033397 Sep 01 05:46:03.309289 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3362/6767] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:03.315351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:03.326191 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-991a5780-298e-4bcd-9363-aaa1739ab179 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.168295 Sep 01 05:46:03.327018 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3406/6768] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:03 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:04.355827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:04.356548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:04.363412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:04.363906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:04.364360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:04.365155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:04.365636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:04.366068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:04.512826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:04.520758 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a730320-778b-4261-91df-f49b234e5b41 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.170365 Sep 01 05:46:04.521380 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3363/6769] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:04 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:05.542096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:05.542720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:05.549873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:05.550364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:05.550801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:05.551530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:05.551985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:05.552475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:05.752848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:05.761167 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0ede416-dab6-486f-a661-5528f93bd7e9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.223084 Sep 01 05:46:05.761729 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3407/6770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:05 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:06.782281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:06.783196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:06.790323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:06.790814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:06.791292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:06.791999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:06.792463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:06.792894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:06.933036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:06.941398 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-013d9278-060c-4170-9375-8647ce8a4329 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.163002 Sep 01 05:46:06.941962 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3364/6771] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:06 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:07.967542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:07.968553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:07.978212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:07.978700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:07.979161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:07.979858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:07.980309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:07.980739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:07.983492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:08.124281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:08.135578 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fb12a4b-dd60-4f32-9b4c-e8de7601831d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.174776 Sep 01 05:46:08.136415 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3408/6772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:07 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:08.852530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-41d6a257-a599-4a7c-a676-8c3b8dce4ec9 req-33a3015f-d28d-4585-96f1-0e1517f19947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f4809c-e920-4803-bda7-fa05bd300f5a", "name": "network-vif-plugged", "status": "completed", "tag": "5e7d65f5-d0c7-416a-9937-f7d3252c0487"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:08.864694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41d6a257-a599-4a7c-a676-8c3b8dce4ec9 req-33a3015f-d28d-4585-96f1-0e1517f19947 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:08.865629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41d6a257-a599-4a7c-a676-8c3b8dce4ec9 req-33a3015f-d28d-4585-96f1-0e1517f19947 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:08.866330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41d6a257-a599-4a7c-a676-8c3b8dce4ec9 req-33a3015f-d28d-4585-96f1-0e1517f19947 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:08.878788 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-41d6a257-a599-4a7c-a676-8c3b8dce4ec9 req-33a3015f-d28d-4585-96f1-0e1517f19947 service nova] Creating event network-vif-plugged:5e7d65f5-d0c7-416a-9937-f7d3252c0487 for instance 54f4809c-e920-4803-bda7-fa05bd300f5a on n-h2-820368-37 Sep 01 05:46:08.883933 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-41d6a257-a599-4a7c-a676-8c3b8dce4ec9 req-33a3015f-d28d-4585-96f1-0e1517f19947 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035537 Sep 01 05:46:08.884826 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3365/6773] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:09.169742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:09.170714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:09.182677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:09.183513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:09.184257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:09.185521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:09.186294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:09.187093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:09.338525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:09.350181 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d4e8fcf-a498-49c0-8de4-908918677eb0 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.188327 Sep 01 05:46:09.350798 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3409/6774] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:09 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:10.369371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:10.371276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:10.379145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:10.380287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:10.390745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:10.391344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:10.391894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:10.392955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:10.393692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:10.394287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:10.530157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:10.538619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a07a6f4-2c48-4f66-8fdc-e1e935373034 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1318 microversion: 2.1 time: 0.170329 Sep 01 05:46:10.539240 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3366/6775] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:10 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:11.562984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:11.563684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:11.566401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:11.574140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:11.574611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:11.575069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:11.575757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:11.576204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:11.576622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:11.740773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:11.749038 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6f04c518-a615-414f-864f-b290d03e52cf tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1507 microversion: 2.1 time: 0.191860 Sep 01 05:46:11.749595 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3410/6776] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:11 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:11.770072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:11.770706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:11.778331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:11.778843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:11.779392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:11.780115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:11.780623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:11.781072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:11.989363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:11.997738 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f56cb7c-97a0-48c8-9d1d-b452d54a6d12 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1507 microversion: 2.1 time: 0.231539 Sep 01 05:46:11.998548 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3367/6777] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:11 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:12.020280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:12.022780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:12.029992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:12.030475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:12.030918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:12.031637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:12.032081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:12.032500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:12.061681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:12.068240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:46:12.075641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:46:12.076066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:46:12.076576 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:46:12.076956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:46:12.077366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:46:12.144716 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0faf8bb5-1bff-4894-b0b8-a72d24f4dc10 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a/action" status: 202 len: 0 microversion: 2.1 time: 0.128467 Sep 01 05:46:12.145784 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3411/6778] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:46:12 2022] POST /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:46:12.154311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:12.155032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:12.161682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:12.162310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:12.163060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:12.164045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:12.164713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:12.165223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:12.422668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:12.425270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:12.433503 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2755cd1b-0db6-40eb-b4d8-300cbda074f8 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1514 microversion: 2.1 time: 0.283526 Sep 01 05:46:12.434234 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3368/6779] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:12 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:13.461634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:13.462770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:13.469899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:13.470382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:13.470986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:13.471666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:13.472137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:13.472562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:13.685168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:13.693528 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd7b5750-27cf-4002-8185-6015da22f4a3 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1514 microversion: 2.1 time: 0.240976 Sep 01 05:46:13.694082 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3412/6780] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:13 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:14.717195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:14.717865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:14.727314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:14.727971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:14.728546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:14.729570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:14.730155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:14.730697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:14.872801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:14.885077 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f513a19b-99e4-4dce-8f1a-288b8698a178 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.173378 Sep 01 05:46:14.885873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3369/6781] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:14 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:15.911443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:15.912483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:15.921194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:15.921705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:15.922103 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:15.922814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:15.923300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:15.923716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:16.055694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:16.063652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a109410-e9ce-4468-b41c-93dc06e7d0cc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.158901 Sep 01 05:46:16.064211 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3413/6782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:15 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:17.089342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:17.090020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:17.093093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:17.099382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:17.099992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:17.100583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:17.101549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:17.102198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:17.102746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:17.247886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:17.256603 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b36cd883-06d0-4b8c-9ed4-9023a8439313 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.173754 Sep 01 05:46:17.257113 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3370/6783] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:17 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:18.280344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:18.280925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:18.287361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:18.292324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:18.293077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:18.293517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:18.294216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:18.294848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:18.295171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:18.446005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:18.455890 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c3407ec-a883-4b3f-aaa7-e6e330f3270b tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.180076 Sep 01 05:46:18.456494 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3414/6784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:18 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:19.481725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:19.482345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:19.489837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:19.490326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:19.490768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:19.491488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:19.491950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:19.492385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:19.633979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:19.642488 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19e1ae37-a06e-48e7-a260-e03027563c94 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.166627 Sep 01 05:46:19.643118 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3371/6785] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:19 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:20.668016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:20.668997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:20.678584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:20.679277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:20.679841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:20.680745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:20.681376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:20.681935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:20.830439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:20.839197 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2939587-4e97-4f21-b6ff-d9f6731febfe tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.177721 Sep 01 05:46:20.839899 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3415/6786] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:20 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:21.864262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:21.865256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:21.877496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:21.878315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:21.879159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:21.880354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:21.881128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:21.881848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:22.027860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:22.036107 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89c02853-d9e2-430b-83ec-6276a8abd544 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.178475 Sep 01 05:46:22.036696 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3372/6787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:21 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:23.059890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:23.060628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:23.070699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.071222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.071660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.072362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:23.072817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:23.073245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:23.209502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:23.217937 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0de679b9-d306-401d-a211-9dd7d8e1f546 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.162351 Sep 01 05:46:23.218529 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3416/6788] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:23 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:24.244159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:24.245230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:24.261552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:24.262409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:24.262877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:24.263609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:24.264071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:24.264506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:24.403708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:24.412135 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c902deac-4eb3-4ed4-9f2d-2b38822224a7 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.174645 Sep 01 05:46:24.412710 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3373/6789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:24 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:25.444727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:25.445395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:25.453447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:25.453940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:25.454368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:25.455069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:25.455515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:25.455935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:25.591583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:25.603569 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-086afad7-3afe-4056-ab21-c77656702972 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.163933 Sep 01 05:46:25.604281 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3417/6790] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:25 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:26.629647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:26.630705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:26.642767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:26.643359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:26.644032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:26.645207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:26.646316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:26.647172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:26.804572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:26.814449 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa4eee4e-6d2e-40a3-b5e1-fd1ae3f9e8ed tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.191378 Sep 01 05:46:26.815066 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3374/6791] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:26 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:27.839082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:27.840126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:27.852068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:27.852907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:27.853629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:27.854703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:27.855414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:27.856175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:28.000446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:28.011476 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d2c62cf4-f63d-438f-a8b0-1e09af63f14e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.179264 Sep 01 05:46:28.012053 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3418/6792] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:27 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:29.034137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:29.034779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:29.042176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.042683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.043162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.043865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:29.044387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:29.044763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:29.195962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:29.205009 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7bcab856-cf52-44fc-9540-7b628631ab17 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.174881 Sep 01 05:46:29.205592 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3375/6793] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:29 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:30.227949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:30.228657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:30.236649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.237138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.237571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.238275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:30.238785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:30.239243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:30.376214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:30.384285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c4ff646f-3a05-4eb6-b614-ddd57720d3a6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.161338 Sep 01 05:46:30.384861 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3419/6794] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:30 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:31.406578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:31.407241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:31.414739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:31.415279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:31.415725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:31.416429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:31.416891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:31.417333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:31.554233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:31.563050 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c35a0935-dda9-4a37-b954-bdb3827e4d56 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.160645 Sep 01 05:46:31.563697 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3376/6795] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:31 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:32.594495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:32.595123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:32.603701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:32.604215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:32.604643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:32.605363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:32.605806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:32.606226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:32.754413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:32.766946 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-815f8dbb-c8c3-4512-be7d-e8e0e74792c2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.178385 Sep 01 05:46:32.767691 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3420/6796] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:32 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:33.796097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:33.796705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:33.804248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.804751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.805204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:33.805909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:33.806379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:33.806822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:33.942648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:33.951463 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-333aec9a-6e1c-4635-ac1c-17a3e74f7199 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.161391 Sep 01 05:46:33.952268 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3377/6797] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:33 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:34.974141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:34.974727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:34.982640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:34.983155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:34.983591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:34.984300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:34.984752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:34.985175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:35.132998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:35.141703 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e3b0b326-ac84-4224-a402-977e3ea23755 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.171596 Sep 01 05:46:35.142300 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3421/6798] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:34 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:36.168149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:36.169170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:36.177591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:36.178090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:36.178530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:36.179267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:36.179769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:36.180206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:36.328928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:36.341104 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-820b5f82-0eaf-4871-864b-806dacc5a9fc tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.179562 Sep 01 05:46:36.341933 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3378/6799] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:36 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:37.365186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:37.365881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:37.373657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:37.374147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:37.374602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:37.375388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:37.376015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:37.376655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:37.513499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:37.522494 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63ad7c9d-46e7-478f-aee5-dc1612bb068d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.162056 Sep 01 05:46:37.523123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3422/6800] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:37 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:38.549739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:38.550746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:38.562370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:38.563264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:38.563995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:38.564692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:38.565161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:38.565596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:38.708665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:38.720658 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4173778c-d49e-4cac-ae19-b25b61e8eac5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.177628 Sep 01 05:46:38.721242 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3379/6801] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:38 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:39.745129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:39.745972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:39.756795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:39.757552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:39.758275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:39.759416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:39.760114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:39.760831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:39.764972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:39.915891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:39.928643 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fb2d7f8-0d11-4adc-984c-dd127867281e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.189787 Sep 01 05:46:39.929491 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3423/6802] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:39 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:40.958872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:40.959877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:40.970773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:40.971579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:40.972267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:40.973210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:40.973675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:40.974108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:41.127126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:41.135386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb1e6c5c-404d-4738-9887-ccf663faa6d6 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1519 microversion: 2.1 time: 0.182598 Sep 01 05:46:41.136001 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3380/6803] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:40 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:41.712368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f4809c-e920-4803-bda7-fa05bd300f5a", "name": "network-vif-unplugged", "status": "completed", "tag": "5e7d65f5-d0c7-416a-9937-f7d3252c0487"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:41.723360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:41.723839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:41.724286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:41.737201 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] Creating event network-vif-unplugged:5e7d65f5-d0c7-416a-9937-f7d3252c0487 for instance 54f4809c-e920-4803-bda7-fa05bd300f5a on n-h1-820368-37 Sep 01 05:46:41.743147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] Instance 54f4809c-e920-4803-bda7-fa05bd300f5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:46:41.754511 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d80fd848-432c-41fd-9601-3ec6a913d78c req-bacdc99e-5911-4b3c-9f1d-b16fa82e516c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045621 Sep 01 05:46:41.755172 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3424/6804] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:42.157227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:42.158065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:42.165337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:42.165836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:42.166281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:42.167012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:42.167478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:42.167912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:42.304319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:42.312367 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28f1a781-e112-4576-8ea4-fa4954c0523e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1518 microversion: 2.1 time: 0.159097 Sep 01 05:46:42.312928 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3381/6805] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:42 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:43.337434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:43.338129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:43.346108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:43.346599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:43.347101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:43.347778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:43.348450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:43.349111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:43.485856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:43.494424 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea9bcd33-b2b9-4a3f-a22f-adfa369b6b16 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1516 microversion: 2.1 time: 0.162684 Sep 01 05:46:43.495040 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3425/6806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:43 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:43.785701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f4809c-e920-4803-bda7-fa05bd300f5a", "tag": "5e7d65f5-d0c7-416a-9937-f7d3252c0487"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:43.797144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:43.797780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:43.798274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:43.811500 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] Creating event network-changed:5e7d65f5-d0c7-416a-9937-f7d3252c0487 for instance 54f4809c-e920-4803-bda7-fa05bd300f5a on n-h1-820368-37 Sep 01 05:46:43.818715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] Instance 54f4809c-e920-4803-bda7-fa05bd300f5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:46:43.829614 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d5eafefb-c1d6-489f-ae57-2ca8f4d047a0 req-753aa77f-31b4-4840-830e-0362ecce5a35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047892 Sep 01 05:46:43.830206 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3382/6807] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:44.521214 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:44.522140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:44.534351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.535414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.536153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:44.537035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.537494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.537944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:44.680474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:44.688886 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7d939294-bf38-4b7c-a7dd-3d53c1b190de tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1513 microversion: 2.1 time: 0.174565 Sep 01 05:46:44.689466 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3426/6808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:44 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:44.720197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:44.721048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:44.728543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.729043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.729497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:44.730203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.730676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.731156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:44.733834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=84 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:44.803009 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9890c61e-2f2c-4ed1-bbb1-ef2209f508b5 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "POST /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a/action" status: 204 len: 0 microversion: 2.1 time: 0.089183 Sep 01 05:46:44.803675 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3383/6809] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:46:44 2022] POST /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:46:44.812032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:44.812646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:44.819325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.819765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.820201 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:44.820899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:44.821358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:44.821794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:45.038896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:45.047082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6cd1541c-363c-4fde-a9c4-5bd89a8a99da tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1513 microversion: 2.1 time: 0.238928 Sep 01 05:46:45.047680 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3427/6810] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:44 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:46:46.070787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:46.071555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:46.078747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:46.080359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:46.081025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:46.082050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:46.082768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:46.083440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:46.230662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:46.238487 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f988f2d-4cd4-41f2-8b23-c5188a69efca tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1513 microversion: 2.1 time: 0.173300 Sep 01 05:46:46.239124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3384/6811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:46 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:47.260792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:47.261335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:47.270790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.271703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.272221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.272949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.273428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.273850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.411830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:47.419885 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4977b863-14be-4e03-ad0b-1e0ddceee7a9 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1505 microversion: 2.1 time: 0.163205 Sep 01 05:46:47.420478 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3428/6812] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:47 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:47.439874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:47.440507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:47.443351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=30 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:47.449239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.449731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.450176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.450874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.451395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.451829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.593960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:47.603097 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26d783ad-df95-4107-838a-0fe1db38df93 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1505 microversion: 2.1 time: 0.167039 Sep 01 05:46:47.603708 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3385/6813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:47 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:46:47.623094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:47.623710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:47.630089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.630575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.631079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.631867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.632319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.632744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.774668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:47.783110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee7f72cd-c3ca-41a0-aff0-474bafe59aa2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1505 microversion: 2.1 time: 0.163967 Sep 01 05:46:47.783637 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3429/6814] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:47 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:47.803768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:47.804507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:47.810844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.811373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.811883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.812583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.813046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.813478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.840883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:46:47.930444 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68c90d7e-19b4-43c7-ac6d-2475a1cc678d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 204 len: 0 microversion: 2.1 time: 0.130500 Sep 01 05:46:47.938574 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3386/6815] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:46:47 2022] DELETE /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:46:47.947468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:47.947969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:47.954337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.954821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.955352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.956081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:47.956527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:47.956943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:47.982706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:46:48.031891 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.compute.api [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Instance is already in deleting state, ignoring this request Sep 01 05:46:48.032723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f57b579b-e6f1-4b54-a7f8-b601732e2c83 req-69e09092-78df-4f9f-9417-49d6039387b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f4809c-e920-4803-bda7-fa05bd300f5a", "name": "network-vif-plugged", "status": "completed", "tag": "5e7d65f5-d0c7-416a-9937-f7d3252c0487"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:48.032851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-62291014-6c61-4a34-a4c0-04632972edd2 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 204 len: 0 microversion: 2.1 time: 0.090047 Sep 01 05:46:48.033369 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3430/6816] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:46:47 2022] DELETE /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:46:48.043191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:48.043738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f57b579b-e6f1-4b54-a7f8-b601732e2c83 req-69e09092-78df-4f9f-9417-49d6039387b3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:48.044600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f57b579b-e6f1-4b54-a7f8-b601732e2c83 req-69e09092-78df-4f9f-9417-49d6039387b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:48.044955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:48.045129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f57b579b-e6f1-4b54-a7f8-b601732e2c83 req-69e09092-78df-4f9f-9417-49d6039387b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:48.053786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:48.054466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:48.054921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:48.055728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:48.056263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:48.056686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:48.057626 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f57b579b-e6f1-4b54-a7f8-b601732e2c83 req-69e09092-78df-4f9f-9417-49d6039387b3 service nova] Creating event network-vif-plugged:5e7d65f5-d0c7-416a-9937-f7d3252c0487 for instance 54f4809c-e920-4803-bda7-fa05bd300f5a on n-h1-820368-37 Sep 01 05:46:48.062720 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f57b579b-e6f1-4b54-a7f8-b601732e2c83 req-69e09092-78df-4f9f-9417-49d6039387b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034503 Sep 01 05:46:48.063720 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3387/6817] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:46:48.197725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:48.205684 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de575050-9a55-40d5-9bb6-03807b126b7d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1511 microversion: 2.1 time: 0.167395 Sep 01 05:46:48.206262 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3431/6818] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:48 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:49.228836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:49.229545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:49.236129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:49.236624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:49.237078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:49.237775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:49.238241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:49.238675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:49.377000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db61bc44589948e9aaa9c42c15c3c3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f070df70b04c31ae969516ac252808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:46:49.385575 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ecc4169-a0fa-43f3-9c70-64c151af1728 tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 200 len: 1511 microversion: 2.1 time: 0.162204 Sep 01 05:46:49.386164 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3388/6819] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:49 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:46:49.732023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-afc684fb-4c45-431f-8478-af904a1d521a req-a305ba75-d406-488a-9628-2067cb16ccca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f4809c-e920-4803-bda7-fa05bd300f5a", "name": "network-vif-deleted", "tag": "5e7d65f5-d0c7-416a-9937-f7d3252c0487"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:46:49.738060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:49.744837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afc684fb-4c45-431f-8478-af904a1d521a req-a305ba75-d406-488a-9628-2067cb16ccca service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:49.745322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afc684fb-4c45-431f-8478-af904a1d521a req-a305ba75-d406-488a-9628-2067cb16ccca service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:49.745754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afc684fb-4c45-431f-8478-af904a1d521a req-a305ba75-d406-488a-9628-2067cb16ccca service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:49.758293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-afc684fb-4c45-431f-8478-af904a1d521a req-a305ba75-d406-488a-9628-2067cb16ccca service nova] Creating event network-vif-deleted:5e7d65f5-d0c7-416a-9937-f7d3252c0487 for instance 54f4809c-e920-4803-bda7-fa05bd300f5a on n-h1-820368-37 Sep 01 05:46:49.764674 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-afc684fb-4c45-431f-8478-af904a1d521a req-a305ba75-d406-488a-9628-2067cb16ccca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036246 Sep 01 05:46:49.765089 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3432/6820] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:46:50.407486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:50.408088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 54f4809c-e920-4803-bda7-fa05bd300f5a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:50.415385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:50.415878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:50.416434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:50.417187 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:50.417659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:50.418083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:50.432500 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] HTTP exception thrown: Instance 54f4809c-e920-4803-bda7-fa05bd300f5a could not be found. Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Request method failure captured: Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a HTTP/1.1 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEbjxMXTZxvX8tw4R1Lr_yU5umxVje59uCTjpyc6e49N695MbsV57q3AFkaVa_HJd3s4Gld8v8ZCewMyiEyAjwtLTO3Qo9csuT6pRcCgJVQJoFCR2_zJql1pfFQ3JO1Ml7bBxmlZ-mMQ6csfxeEmWOqR2BJEXlSCmneeAS5yw3YVFHQ Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 62f070df70b04c31ae969516ac252808 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/62f070df70b04c31ae969516ac252808"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/62f070df70b04c31ae969516ac252808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_62f070df70b04c31ae969516ac252808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/62f070df70b04c31ae969516ac252808"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 62f070df70b04c31ae969516ac252808 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-952155092-project Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: db61bc44589948e9aaa9c42c15c3c3f4 Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-952155092-project Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 54f4809c-e920-4803-bda7-fa05bd300f5a could not be found. Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '54f4809c-e920-4803-bda7-fa05bd300f5a'} Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54f4809c-e920-4803-bda7-fa05bd300f5a could not be found. Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54f4809c-e920-4803-bda7-fa05bd300f5a could not be found. Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:50.434180 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54f4809c-e920-4803-bda7-fa05bd300f5a could not be found. Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Returning 404 to user: Instance 54f4809c-e920-4803-bda7-fa05bd300f5a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-413b36d4-dcc6-4275-955c-ec7c7ffa873c tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a" status: 404 len: 111 microversion: 2.1 time: 0.032288 Sep 01 05:46:50.439116 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3389/6821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:50 2022] GET /compute/v2.1/servers/54f4809c-e920-4803-bda7-fa05bd300f5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:50.448753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72e7bb7a-8730-4b1e-ad8d-d47fe81d128e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '.version_select at 0x7fa75bd6fb80>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:50.471878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72e7bb7a-8730-4b1e-ad8d-d47fe81d128e tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901842600" status: 202 len: 0 microversion: 2.1 time: 0.029387 Sep 01 05:46:50.472469 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3433/6822] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:46:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901842600 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:46:51.110727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:51.111269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:51.117641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:51.118164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:51.118616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:51.119363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:51.119878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:51.120323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:51.133957 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] HTTP exception thrown: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Request method failure captured: Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 HTTP/1.1 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEbjxMXTZxvX8tw4R1Lr_yU5umxVje59uCTjpyc6e49N695MbsV57q3AFkaVa_HJd3s4Gld8v8ZCewMyiEyAjwtLTO3Qo9csuT6pRcCgJVQJoFCR2_zJql1pfFQ3JO1Ml7bBxmlZ-mMQ6csfxeEmWOqR2BJEXlSCmneeAS5yw3YVFHQ Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 62f070df70b04c31ae969516ac252808 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/62f070df70b04c31ae969516ac252808"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/62f070df70b04c31ae969516ac252808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_62f070df70b04c31ae969516ac252808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/62f070df70b04c31ae969516ac252808"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 62f070df70b04c31ae969516ac252808 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-952155092-project Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: db61bc44589948e9aaa9c42c15c3c3f4 Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-952155092-project Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '71f1c650-bd1a-461c-991f-d245fb775105'} Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:46:51.135725 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Returning 404 to user: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72143ca4-8976-4fd1-9a45-92fecab6a16d tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 404 len: 111 microversion: 2.1 time: 0.030457 Sep 01 05:46:51.139801 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3390/6823] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:46:51 2022] DELETE /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:51.146762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:46:51.147541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] [instance: 71f1c650-bd1a-461c-991f-d245fb775105] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:46:51.154949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:51.155416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:51.155845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:51.156536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:46:51.156984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:46:51.157407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:46:51.171109 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] HTTP exception thrown: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Request method failure captured: Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 HTTP/1.1 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEbjxMXTZxvX8tw4R1Lr_yU5umxVje59uCTjpyc6e49N695MbsV57q3AFkaVa_HJd3s4Gld8v8ZCewMyiEyAjwtLTO3Qo9csuT6pRcCgJVQJoFCR2_zJql1pfFQ3JO1Ml7bBxmlZ-mMQ6csfxeEmWOqR2BJEXlSCmneeAS5yw3YVFHQ Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 62f070df70b04c31ae969516ac252808 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/62f070df70b04c31ae969516ac252808"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/62f070df70b04c31ae969516ac252808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_62f070df70b04c31ae969516ac252808"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/62f070df70b04c31ae969516ac252808"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 62f070df70b04c31ae969516ac252808 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-952155092 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerDiskConfigTestJSON-952155092-project Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: db61bc44589948e9aaa9c42c15c3c3f4 Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerDiskConfigTestJSON-952155092-project Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '71f1c650-bd1a-461c-991f-d245fb775105'} Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:46:51.172772 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] Returning 404 to user: Instance 71f1c650-bd1a-461c-991f-d245fb775105 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa040615-9b2d-403c-bb23-dc9895141e6f tempest-ServerDiskConfigTestJSON-952155092 tempest-ServerDiskConfigTestJSON-952155092-project] 10.222.0.26 "GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105" status: 404 len: 111 microversion: 2.1 time: 0.032290 Sep 01 05:46:51.176936 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3434/6824] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:46:51 2022] GET /compute/v2.1/servers/71f1c650-bd1a-461c-991f-d245fb775105 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:47:00.336918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-193fd73f-f319-41a4-baf9-b6988c91d7e1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'create', calling method: .version_select at 0x7fa7582e2550>, body: {"keypair": {"name": "tempest-keypair-1415424487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpyQTpqs7QG/Bw3dYXBfASPM7CpI0FQKGtXG0TIIe//QCP9O3WdMNZ5GWe2QAe/VLL7E28URelaQwEMDSUmsZV2dhsO06NbNx9j/sMh+aLZa9VTFC4bIkew9F9qynnRKQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:00.353972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-193fd73f-f319-41a4-baf9-b6988c91d7e1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:47:00.360953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-193fd73f-f319-41a4-baf9-b6988c91d7e1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:47:00.396704 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-193fd73f-f319-41a4-baf9-b6988c91d7e1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182125 Sep 01 05:47:00.397424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3391/6825] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:47:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:01.724337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2107178300", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ec1c841-61f0-4e5a-9acf-9b82e4e6a455"}], "security_groups": [{"name": "tempest-securitygroup--1988176895"}], "key_name": "tempest-keypair-1415424487", "user_data": "}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:01.734134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:01.735073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:01.837824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] validate_networks() for [('8ec1c841-61f0-4e5a-9acf-9b82e4e6a455', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:47:02.306945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:47:02.307431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:47:02.307913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:47:02.308323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:47:02.308757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:47:02.318054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:02.318522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:02.318989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:02.319838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:02.320298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:02.320721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:02.340958 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:47:02.346481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:47:02.359398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:47:02.361847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:47:02.410112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a43f321d-d0ec-4c74-8b2a-b8797b94eeb1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.690233 Sep 01 05:47:02.416815 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3435/6826] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:47:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:47:02.419233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:02.425544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77380a43-1f7e-4da0-a2cc-a561fe3a8f78 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:02.426167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77380a43-1f7e-4da0-a2cc-a561fe3a8f78 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:02.501130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77380a43-1f7e-4da0-a2cc-a561fe3a8f78 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:02.510078 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77380a43-1f7e-4da0-a2cc-a561fe3a8f78 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1239 microversion: 2.1 time: 0.091740 Sep 01 05:47:02.511353 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3392/6827] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:02 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:03.532924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:03.533442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:03.543641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:03.544143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:03.544585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:03.545307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:03.545763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:03.546393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:03.615300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:03.625158 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb89f7ce-fc88-4f6a-b52f-4e4d1837932f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1299 microversion: 2.1 time: 0.097130 Sep 01 05:47:03.626274 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3436/6828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:03 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:04.648180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:04.649776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:04.660645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:04.661489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:04.662149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:04.662997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:04.663695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:04.664364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:04.829022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:04.846786 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8405670-c17b-4ed9-830c-4d3a4385e9d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1365 microversion: 2.1 time: 0.202719 Sep 01 05:47:04.847510 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3393/6829] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:04 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:05.027812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dca209f6-d2ff-4cb5-af9c-8c0a7f46ec84 req-b174796e-e262-495b-be81-60dd9fbde84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:05.039960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dca209f6-d2ff-4cb5-af9c-8c0a7f46ec84 req-b174796e-e262-495b-be81-60dd9fbde84b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:05.040744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dca209f6-d2ff-4cb5-af9c-8c0a7f46ec84 req-b174796e-e262-495b-be81-60dd9fbde84b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:05.041262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dca209f6-d2ff-4cb5-af9c-8c0a7f46ec84 req-b174796e-e262-495b-be81-60dd9fbde84b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:05.054202 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dca209f6-d2ff-4cb5-af9c-8c0a7f46ec84 req-b174796e-e262-495b-be81-60dd9fbde84b service nova] Creating event network-changed:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h1-820368-37 Sep 01 05:47:05.059338 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dca209f6-d2ff-4cb5-af9c-8c0a7f46ec84 req-b174796e-e262-495b-be81-60dd9fbde84b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037879 Sep 01 05:47:05.059993 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3437/6830] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:05.873792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:05.874359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:05.883752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:05.884540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:05.885177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:05.886275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:05.887330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:05.887961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:06.034476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:06.043183 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e625cfc-3631-4a14-a5a5-c372a29b8413 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1365 microversion: 2.1 time: 0.174447 Sep 01 05:47:06.044035 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3394/6831] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:05 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:07.065891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:07.066592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:07.073444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:07.073932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:07.074361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:07.075085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:07.075558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:07.075955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:07.219915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:07.231406 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d6c81455-9fb0-463d-9ea1-02bc4187b17d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1365 microversion: 2.1 time: 0.170514 Sep 01 05:47:07.232198 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3438/6832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:07 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:08.258550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:08.259231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:08.266970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:08.267476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:08.268005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:08.268749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:08.269225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:08.269667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:08.426707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:08.435183 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41959ee9-a200-4fe7-af40-3d92d3c2fbb4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1365 microversion: 2.1 time: 0.180517 Sep 01 05:47:08.435823 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3395/6833] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:08 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:09.456752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:09.457285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:09.464298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:09.464780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:09.465208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:09.465897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:09.466344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:09.466761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:09.605595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:09.613851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80a64223-a8c0-4eda-b9a0-2d527286276d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1365 microversion: 2.1 time: 0.161200 Sep 01 05:47:09.614447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3439/6834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:09 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:10.141167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-84f81254-97f4-4ed1-a3b2-dc265dd5ff8c req-dc2e08fb-6d8a-4524-a9ac-1bfde917e186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "name": "network-vif-plugged", "status": "completed", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:10.152830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-84f81254-97f4-4ed1-a3b2-dc265dd5ff8c req-dc2e08fb-6d8a-4524-a9ac-1bfde917e186 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:10.153332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-84f81254-97f4-4ed1-a3b2-dc265dd5ff8c req-dc2e08fb-6d8a-4524-a9ac-1bfde917e186 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:10.153822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-84f81254-97f4-4ed1-a3b2-dc265dd5ff8c req-dc2e08fb-6d8a-4524-a9ac-1bfde917e186 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:10.165536 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-84f81254-97f4-4ed1-a3b2-dc265dd5ff8c req-dc2e08fb-6d8a-4524-a9ac-1bfde917e186 service nova] Creating event network-vif-plugged:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h1-820368-37 Sep 01 05:47:10.170636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-84f81254-97f4-4ed1-a3b2-dc265dd5ff8c req-dc2e08fb-6d8a-4524-a9ac-1bfde917e186 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Sep 01 05:47:10.171320 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3396/6835] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:10.644369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:10.644933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:10.652648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:10.653327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:10.653892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:10.654670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:10.655247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:10.655757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:10.801999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:10.810407 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-030219a8-1f15-4155-8a67-a626cccc3797 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1365 microversion: 2.1 time: 0.171756 Sep 01 05:47:10.811013 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3440/6836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:10 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:11.835761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:11.836474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:11.842844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:11.843413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:11.843837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:11.844539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:11.845008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:11.845448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:11.996910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:12.005395 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e921ed8-0f75-4ac4-b9ec-648358f00e49 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1552 microversion: 2.1 time: 0.176197 Sep 01 05:47:12.005981 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3397/6837] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:11 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:12.031377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:12.032133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:12.042690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:12.043980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:12.044689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:12.045883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:12.046944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:12.047624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:12.136684 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-23f01404-b7df-4513-ab69-970d6753e8aa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112417 Sep 01 05:47:12.137502 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3441/6838] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:47:12 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:13.398490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e446c2ed-af7d-4817-9e21-bc6b32301c20 req-ecd54777-8296-45fc-839d-3bc4dc8b6575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:13.403889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:13.411254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e446c2ed-af7d-4817-9e21-bc6b32301c20 req-ecd54777-8296-45fc-839d-3bc4dc8b6575 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:13.411975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e446c2ed-af7d-4817-9e21-bc6b32301c20 req-ecd54777-8296-45fc-839d-3bc4dc8b6575 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:13.412663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e446c2ed-af7d-4817-9e21-bc6b32301c20 req-ecd54777-8296-45fc-839d-3bc4dc8b6575 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:13.424507 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e446c2ed-af7d-4817-9e21-bc6b32301c20 req-ecd54777-8296-45fc-839d-3bc4dc8b6575 service nova] Creating event network-changed:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h1-820368-37 Sep 01 05:47:13.429830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e446c2ed-af7d-4817-9e21-bc6b32301c20 req-ecd54777-8296-45fc-839d-3bc4dc8b6575 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035366 Sep 01 05:47:13.430454 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3398/6839] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:42.958050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:42.958832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:42.960940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:42.961593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=32 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:42.966169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:42.966822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:42.974955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:42.975449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:42.975901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:42.976599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:42.977056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:42.977481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.115679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:43.124488 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e1dea2a5-5fb9-4444-b393-d93df0421498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1671 microversion: 2.1 time: 0.167343 Sep 01 05:47:43.125087 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3442/6840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:42 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:43.155325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:43.156072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:43.160230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:43.160952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:43.168315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.168817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.169261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.170318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.170846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.171304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.313142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:43.325572 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3920328-fc62-4536-a177-6da06f6fe126 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1671 microversion: 2.1 time: 0.173357 Sep 01 05:47:43.326941 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3399/6841] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:43 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:43.357164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:43.357803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:43.364070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.364544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.364970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.365676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.366117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.366532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.504896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:43.512852 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f0e636df-a06a-4133-8c68-c4bf0e74ebde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1671 microversion: 2.1 time: 0.161986 Sep 01 05:47:43.513465 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3443/6842] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:43 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:47:43.536862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:43.539982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:43.548235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.548741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.549188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.549893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.550363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.550798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.581063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:43.587236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:47:43.594104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:47:43.594538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:47:43.595054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:47:43.595472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:47:43.595887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:47:43.665849 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26ceed0c-72f8-4c0d-bbc6-789d20cf4c4e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96/action" status: 202 len: 0 microversion: 2.1 time: 0.135396 Sep 01 05:47:43.666480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3400/6843] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:47:43 2022] POST /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:47:43.674879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:43.675527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:43.681726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.682208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.682670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.683893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.683893 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.684263 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.844148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:43.852456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-133d8d60-0a45-4833-8c45-1bbf3d9245ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1680 microversion: 2.1 time: 0.181451 Sep 01 05:47:43.853063 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3444/6844] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:43 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:44.879359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:44.880306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:44.890588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:44.891130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:44.891574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:44.892272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:44.892737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:44.893172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:45.031421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:45.039509 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0250db0-242f-47ed-82da-59431e8323b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1680 microversion: 2.1 time: 0.168230 Sep 01 05:47:45.040088 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3401/6845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:44 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:46.062480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:46.063114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:46.070947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:46.071461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:46.071897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:46.072587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:46.073040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:46.073461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:46.221607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:46.229833 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c6d4053-8db6-4f0b-9430-1b2fef317be8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.172156 Sep 01 05:47:46.230420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3445/6846] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:46 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:47.256173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:47.257250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:47.267378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:47.267821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:47.268296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:47.268978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:47.269446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:47.269887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:47.416837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:47.424923 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6abc9950-ddd8-47e7-acf9-cf008d49acad tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.175444 Sep 01 05:47:47.425506 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3402/6847] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:47 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:48.458361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:48.459261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:48.469993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:48.470476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:48.470915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:48.471616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:48.472185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:48.472610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:48.606732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:48.615997 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27de68f8-fc51-444b-a33f-39f42aea6ba5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.164719 Sep 01 05:47:48.616546 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3446/6848] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:48 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:49.641520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:49.642563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:49.654481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:49.655384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:49.655830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:49.656534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:49.656995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:49.657618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:49.794734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:49.803408 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0a533f5-e779-4eb8-8deb-3c6f7bf3bc0f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.168504 Sep 01 05:47:49.803981 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3403/6849] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:49 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:50.828470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:50.829136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:50.837375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:50.837956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:50.838422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:50.839306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:50.839834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:50.840327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:50.979478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:50.992274 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-69a0bcf4-6bd4-4ca6-8daf-6e6357b14b33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.169810 Sep 01 05:47:50.993067 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3447/6850] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:50 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:52.017240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:52.017862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:52.025723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:52.026214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:52.026660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:52.027390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:52.027858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:52.028282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:52.165093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:52.175783 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1d75188-9311-4c42-92e7-733ebf6c91a6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.163298 Sep 01 05:47:52.176370 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3404/6851] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:52 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:53.204830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:53.205426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:53.212781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:53.213264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:53.213691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:53.214377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:53.214824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:53.215261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:53.353202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:53.366357 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-af0884b3-8954-4e90-9768-ce12c0fa15fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.165462 Sep 01 05:47:53.367290 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3448/6852] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:53 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:54.390870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:54.391539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:54.399042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:54.399539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:54.400341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:54.401031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:54.401494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:54.401923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:54.550064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:54.562424 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64f85166-6ecd-4707-ab60-8f26cfb3cef5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.175600 Sep 01 05:47:54.563286 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3405/6853] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:54 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:55.589341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:55.589948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:55.597771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:55.598256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:55.598691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:55.599390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:55.599873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:55.600273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:55.745243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:55.753739 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9acb98cd-e6b7-4056-8410-716b751944de tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.168421 Sep 01 05:47:55.754327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3449/6854] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:55 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:56.776156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:56.776880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:56.784219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:56.784718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:56.785168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:56.786056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:56.786526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:56.786996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:56.921271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:56.929785 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c876d580-cd39-4371-a333-c31f11440a91 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1685 microversion: 2.1 time: 0.158071 Sep 01 05:47:56.930352 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3406/6855] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:56 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:57.954210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:57.954983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:57.962027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:57.962510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:57.962977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:57.963669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:57.964118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:57.964534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:58.213381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:58.221994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0de6a992-0919-4cd0-92a5-583039622c96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1684 microversion: 2.1 time: 0.271909 Sep 01 05:47:58.222546 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3450/6856] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:57 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1684 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:58.390823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "name": "network-vif-unplugged", "status": "completed", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:58.401781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:58.402270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:58.402710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:58.415249 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] Creating event network-vif-unplugged:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h2-820368-37 Sep 01 05:47:58.420646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:47:58.431654 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6623c573-7110-4345-8e88-658dbf56dce2 req-a5337690-8c44-49b3-8ee5-8b1ba95ca7e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044708 Sep 01 05:47:58.432454 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3407/6857] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:59.245190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:59.245780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:59.254039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:59.254501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:59.254964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:59.255668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:59.256178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:59.256665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:59.458914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:59.468804 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dcfa0488-8328-4c6e-9915-afa469b72b4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1684 microversion: 2.1 time: 0.227869 Sep 01 05:47:59.469664 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3451/6858] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:59 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1684 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:00.465338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:00.479554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:00.480213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:00.480816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:00.490285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:00.490869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:00.493333 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] Creating event network-changed:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h2-820368-37 Sep 01 05:48:00.498117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:00.498602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:00.498992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:48:00.499153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:00.499731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:00.500168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:00.500601 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:00.509837 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-06ddd568-fa74-4a50-9f1e-8f73e766dca3 req-f1dd09b4-6cb8-42e4-8c46-9ea7986dea48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051878 Sep 01 05:48:00.510831 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3408/6859] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:00.642663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:00.651614 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ddde751c-ab3f-42d2-969b-0c219b18fece tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1682 microversion: 2.1 time: 0.165207 Sep 01 05:48:00.652245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3452/6860] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:00 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:01.678946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:01.680105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:01.689690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:01.690188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:01.690633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:01.691370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:01.691839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:01.692266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:01.837432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:01.849784 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3558e501-c446-4f8b-a2e0-fd2f923013a1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1682 microversion: 2.1 time: 0.179073 Sep 01 05:48:01.850535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3409/6861] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:01 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:02.873841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:02.874519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:02.882655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:02.883163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:02.883631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:02.884319 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:02.884766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:02.885185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:03.031667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:03.040994 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb251c48-e748-4f5e-8f35-4db4707f1228 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1679 microversion: 2.1 time: 0.172376 Sep 01 05:48:03.041923 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3453/6862] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:02 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:03.063286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:03.064486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:03.072303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:03.072721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:03.073277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:03.074128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:03.074608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:03.075192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:03.136587 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2c4428b-18b7-4aca-9f72-a826ae7d1744 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96/action" status: 204 len: 0 microversion: 2.1 time: 0.077260 Sep 01 05:48:03.137252 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3410/6863] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:48:03 2022] POST /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:48:03.145817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:03.146570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:03.153567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:03.154167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:03.154670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:03.155412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:03.155989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:03.156392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:03.305202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:03.313331 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f276a52-2555-4479-8248-82f02bae71ab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1679 microversion: 2.1 time: 0.171687 Sep 01 05:48:03.313947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3454/6864] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:03 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:48:04.335997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:04.336662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:04.343140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:04.343644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:04.344097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:04.345145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:04.345686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:04.346141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:04.489251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:04.500076 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37355b09-ecb5-41d7-89f3-508384f4cf33 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1679 microversion: 2.1 time: 0.169440 Sep 01 05:48:04.500766 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3411/6865] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:04 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:05.344314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-dbf4399f-add7-4941-bb92-e011d5e7ff3a req-fa90160d-f942-4660-b29d-444c8241f4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "name": "network-vif-plugged", "status": "completed", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:05.355798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dbf4399f-add7-4941-bb92-e011d5e7ff3a req-fa90160d-f942-4660-b29d-444c8241f4c1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.356274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dbf4399f-add7-4941-bb92-e011d5e7ff3a req-fa90160d-f942-4660-b29d-444c8241f4c1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.356802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-dbf4399f-add7-4941-bb92-e011d5e7ff3a req-fa90160d-f942-4660-b29d-444c8241f4c1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:05.371118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-dbf4399f-add7-4941-bb92-e011d5e7ff3a req-fa90160d-f942-4660-b29d-444c8241f4c1 service nova] Creating event network-vif-plugged:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h2-820368-37 Sep 01 05:48:05.376440 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-dbf4399f-add7-4941-bb92-e011d5e7ff3a req-fa90160d-f942-4660-b29d-444c8241f4c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037642 Sep 01 05:48:05.377107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3455/6866] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:05.520954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:05.521531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:05.529511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.530024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.530480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:05.531230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.531709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.532164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:05.669558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:05.677761 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef042412-8ca4-4d8e-96ee-abac0b2667b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1671 microversion: 2.1 time: 0.161135 Sep 01 05:48:05.678350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3412/6867] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:05 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:05.699507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:05.700204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:05.709585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.710249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.710813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:05.711912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.712546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.713180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:05.854481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:05.867476 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebfd02c0-7e81-4829-b26c-ed0de8899332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1671 microversion: 2.1 time: 0.171956 Sep 01 05:48:05.868307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3456/6868] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:05 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:05.891201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:05.891848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:05.898391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.898916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.899375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:05.900436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:05.900916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:05.901358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:06.048220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:06.050617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:06.057712 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c8dae20-d680-4352-ab5b-25007534f03a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1671 microversion: 2.1 time: 0.170511 Sep 01 05:48:06.058300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3413/6869] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:05 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:06.078425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:06.078934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:06.085432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:06.085916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:06.086354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:06.087090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:06.087542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:06.087963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:06.116784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:48:06.170089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:06.209301 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bc043920-1d5f-4969-8b99-419e59b2997f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 204 len: 0 microversion: 2.1 time: 0.134554 Sep 01 05:48:06.210031 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3457/6870] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:48:06 2022] DELETE /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:48:06.219287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:06.219939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:06.226640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:06.227131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:06.227576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:06.228296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:06.228754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:06.229184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:06.369730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:06.381253 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5032f395-6dd2-4675-a5be-a63db13d7515 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1677 microversion: 2.1 time: 0.166202 Sep 01 05:48:06.382071 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3414/6871] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:06 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:07.408915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:07.409502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:07.417159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:07.417646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:07.418082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:07.418775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:07.419257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:07.419703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:07.565187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:07.574310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b492c7d5-822e-43d8-992e-90f1d4ecbbb0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1677 microversion: 2.1 time: 0.172514 Sep 01 05:48:07.575120 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3458/6872] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:07 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:08.596518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:08.597253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:08.604996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:08.605518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:08.605973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:08.606740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:08.607233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:08.607688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:08.772650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:08.781753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61879655-00e6-430c-8f88-904691106084 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 200 len: 1609 microversion: 2.1 time: 0.189453 Sep 01 05:48:08.782307 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3415/6873] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:08 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 1609 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:09.001876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5658a5e3-171c-4ea5-b8ed-5d28d0b8b617 req-5dded87d-bfe0-4486-9850-292c98e16565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed78b01-7cc7-4e0a-bce1-636a999b9d96", "name": "network-vif-deleted", "tag": "d01abe27-54dd-4b7b-90de-7931eb3fa46b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:09.014944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5658a5e3-171c-4ea5-b8ed-5d28d0b8b617 req-5dded87d-bfe0-4486-9850-292c98e16565 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:09.015418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5658a5e3-171c-4ea5-b8ed-5d28d0b8b617 req-5dded87d-bfe0-4486-9850-292c98e16565 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:09.016053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5658a5e3-171c-4ea5-b8ed-5d28d0b8b617 req-5dded87d-bfe0-4486-9850-292c98e16565 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:09.030389 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5658a5e3-171c-4ea5-b8ed-5d28d0b8b617 req-5dded87d-bfe0-4486-9850-292c98e16565 service nova] Creating event network-vif-deleted:d01abe27-54dd-4b7b-90de-7931eb3fa46b for instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 on n-h2-820368-37 Sep 01 05:48:09.036365 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5658a5e3-171c-4ea5-b8ed-5d28d0b8b617 req-5dded87d-bfe0-4486-9850-292c98e16565 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039491 Sep 01 05:48:09.038278 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3459/6874] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:09.804916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:09.805551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:09.812961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:09.813489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:09.813982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:09.814730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:09.815229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:09.815667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:09.836118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 HTTP/1.1 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7ed78b01-7cc7-4e0a-bce1-636a999b9d96'} Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:09.838915 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e65a9245-243d-4883-8f44-0fbf7faf5e96 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 404 len: 111 microversion: 2.1 time: 0.040846 Sep 01 05:48:09.842776 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3416/6875] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:09 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:48:09.857100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:09.857800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:09.866644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:09.867096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:09.867527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:09.868224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:09.868679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:09.869104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:09.884950 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 HTTP/1.1 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7ed78b01-7cc7-4e0a-bce1-636a999b9d96'} Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:48:09.886627 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:48:09.890872 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6473979-a2ad-47cf-85f6-42492592c260 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 404 len: 111 microversion: 2.1 time: 0.035513 Sep 01 05:48:09.891925 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3460/6876] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:09 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:48:09.941627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2063935650", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "8ec1c841-61f0-4e5a-9acf-9b82e4e6a455"}], "security_groups": [{"name": "tempest-securitygroup--1988176895"}], "key_name": "tempest-keypair-1415424487", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:10.057841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] validate_networks() for [('8ec1c841-61f0-4e5a-9acf-9b82e4e6a455', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:48:10.460773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:48:10.461210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:48:10.461696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:48:10.462114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:48:10.462535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:48:10.472389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:10.472888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:10.473340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:10.474049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:10.474513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:10.474980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:10.494009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:48:10.499590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:48:10.515778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:48:10.519647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:48:10.574343 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12bb756b-b140-4412-8dcf-9a5816e4f3a8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.637550 Sep 01 05:48:10.575244 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3417/6877] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:48:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:48:10.586740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-866466cb-aa1b-48eb-b707-359c13296927 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:10.587390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-866466cb-aa1b-48eb-b707-359c13296927 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:10.643488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-866466cb-aa1b-48eb-b707-359c13296927 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:10.651858 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-866466cb-aa1b-48eb-b707-359c13296927 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1239 microversion: 2.1 time: 0.069151 Sep 01 05:48:10.652473 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3461/6878] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:10 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:11.674329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:11.675561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:11.682684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:11.683241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:11.683668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:11.684373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:11.684839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:11.685277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:11.783667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:11.792873 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a438195-ad9f-4827-a88a-765d906f6dde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1299 microversion: 2.1 time: 0.122767 Sep 01 05:48:11.803286 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3418/6879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:11 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:12.815809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:12.817013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:12.824282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:12.824797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:12.825231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:12.825896 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:12.826346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:12.826765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:13.033993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:13.043211 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-622485b4-13ec-48c8-81c2-61127b7abc7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.231733 Sep 01 05:48:13.043996 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3462/6880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:12 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:13.278706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-36675705-19fe-4b1d-8409-d99a5b1a0d9d req-fb0b5776-3d22-400b-9cbb-d2a869b598bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:13.284942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:13.291003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-36675705-19fe-4b1d-8409-d99a5b1a0d9d req-fb0b5776-3d22-400b-9cbb-d2a869b598bb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:13.291499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-36675705-19fe-4b1d-8409-d99a5b1a0d9d req-fb0b5776-3d22-400b-9cbb-d2a869b598bb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:13.291943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-36675705-19fe-4b1d-8409-d99a5b1a0d9d req-fb0b5776-3d22-400b-9cbb-d2a869b598bb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:13.304093 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-36675705-19fe-4b1d-8409-d99a5b1a0d9d req-fb0b5776-3d22-400b-9cbb-d2a869b598bb service nova] Creating event network-changed:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h2-820368-37 Sep 01 05:48:13.309300 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-36675705-19fe-4b1d-8409-d99a5b1a0d9d req-fb0b5776-3d22-400b-9cbb-d2a869b598bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034640 Sep 01 05:48:13.310300 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3419/6881] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:14.065782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:14.066396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:14.069338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:14.074913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:14.075406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:14.075843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:14.076538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:14.076996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:14.077424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:14.215529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:14.224215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f3727544-5f85-4568-814b-59c4cd73c87e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.162530 Sep 01 05:48:14.224801 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3463/6882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:14 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:15.251566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:15.252683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:15.263444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:15.264161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:15.265633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:15.266908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:15.267864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:15.268681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:15.406693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:15.418619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d1d5af3-3233-459c-a526-2d2cb40d4ba0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.175293 Sep 01 05:48:15.419488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3420/6883] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:15 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:16.445359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:16.446301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:16.457484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:16.458252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:16.458939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:16.460084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:16.460792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:16.461390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:16.604052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:16.612704 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d72c9f3d-e561-4043-a0db-130fb748fc85 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.174544 Sep 01 05:48:16.613690 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3464/6884] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:16 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:17.642557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:17.643251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:17.650868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:17.651414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:17.651869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:17.652617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:17.653096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:17.653549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:17.792747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:17.801084 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c629cb11-3f1e-4b3d-888c-4a624a5ee93b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.164627 Sep 01 05:48:17.801665 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3421/6885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:17 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:18.822705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:18.823309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:18.830794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:18.831425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:18.831861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:18.832555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:18.833007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:18.833430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:18.970724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:18.979381 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f608863-3fb9-43c4-933b-bfa08b2e877a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.160853 Sep 01 05:48:18.979962 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3465/6886] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:18 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:19.404324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a79716f8-92ac-423d-a025-82f2f641223f req-6150fd4f-50ad-45b3-9ca2-29e0608c122a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "name": "network-vif-plugged", "status": "completed", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:19.415012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a79716f8-92ac-423d-a025-82f2f641223f req-6150fd4f-50ad-45b3-9ca2-29e0608c122a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:19.415554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a79716f8-92ac-423d-a025-82f2f641223f req-6150fd4f-50ad-45b3-9ca2-29e0608c122a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:19.417006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a79716f8-92ac-423d-a025-82f2f641223f req-6150fd4f-50ad-45b3-9ca2-29e0608c122a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:19.429320 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a79716f8-92ac-423d-a025-82f2f641223f req-6150fd4f-50ad-45b3-9ca2-29e0608c122a service nova] Creating event network-vif-plugged:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h2-820368-37 Sep 01 05:48:19.435637 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a79716f8-92ac-423d-a025-82f2f641223f req-6150fd4f-50ad-45b3-9ca2-29e0608c122a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035452 Sep 01 05:48:19.436215 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3422/6887] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:20.003223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:20.003879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:20.014298 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:20.014808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:20.015301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:20.016029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:20.016670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:20.017131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:20.167940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:20.177392 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cf35b92a-f6f4-4f16-a223-e2e73a4f4ea6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1365 microversion: 2.1 time: 0.180092 Sep 01 05:48:20.178215 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3466/6888] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:19 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:21.210651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:21.211329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:21.214149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:21.214823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:21.220759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:21.221248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:21.221689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:21.222427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:21.222911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:21.223348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:21.357750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:48:21.366227 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6565c92-fad5-4c6e-a8f1-2a2043721447 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1553 microversion: 2.1 time: 0.160338 Sep 01 05:48:21.367017 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3423/6889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:48:21 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:48:21.387476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:48:21.388009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:48:21.389901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:21.396723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:21.397211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:21.397648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:21.398382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:21.398835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:21.399278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:21.476144 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f70017e-2b9a-4d0f-a559-584b9e87ce88 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092569 Sep 01 05:48:21.476783 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3467/6890] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:48:21 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:48:22.756312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ac5e3e08-c71a-427b-9ea9-1d50b3639cc0 req-c49b190e-047a-4fb4-8da2-518fb67a2de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:48:22.766598 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ac5e3e08-c71a-427b-9ea9-1d50b3639cc0 req-c49b190e-047a-4fb4-8da2-518fb67a2de0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:48:22.767360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ac5e3e08-c71a-427b-9ea9-1d50b3639cc0 req-c49b190e-047a-4fb4-8da2-518fb67a2de0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:48:22.768124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ac5e3e08-c71a-427b-9ea9-1d50b3639cc0 req-c49b190e-047a-4fb4-8da2-518fb67a2de0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:48:22.783514 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ac5e3e08-c71a-427b-9ea9-1d50b3639cc0 req-c49b190e-047a-4fb4-8da2-518fb67a2de0 service nova] Creating event network-changed:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h2-820368-37 Sep 01 05:48:22.788478 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ac5e3e08-c71a-427b-9ea9-1d50b3639cc0 req-c49b190e-047a-4fb4-8da2-518fb67a2de0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036136 Sep 01 05:48:22.789093 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3424/6891] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:49:35.156194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:35.157662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:35.162917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d625cab7-3637-44ff-8f0b-950f78487734 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:35.170247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d625cab7-3637-44ff-8f0b-950f78487734 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:35.170731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d625cab7-3637-44ff-8f0b-950f78487734 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:35.171188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d625cab7-3637-44ff-8f0b-950f78487734 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:35.194742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d625cab7-3637-44ff-8f0b-950f78487734 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Going to try to stop instance {{(pid=128862) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:49:35.239969 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d625cab7-3637-44ff-8f0b-950f78487734 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action" status: 202 len: 0 microversion: 2.1 time: 0.086163 Sep 01 05:49:35.240645 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3468/6892] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:49:35 2022] POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:49:35.248200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:35.249513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=47 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:35.255485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:35.256624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:35.264035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:35.264526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:35.265156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:35.265867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:35.266332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:35.266767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:35.492871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:35.500827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b8390d7-98bc-41ee-ab42-7982d45a0dd4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.255518 Sep 01 05:49:35.501413 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3425/6893] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:35 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:36.529108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:36.530328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:36.540052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:36.540543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:36.540980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:36.541681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:36.542142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:36.542566 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:36.732205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:36.740808 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2feccdb9-0e61-4527-97ce-0887e609b824 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.219473 Sep 01 05:49:36.741394 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3469/6894] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:36 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:37.766747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:37.767748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:37.776424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:37.776923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:37.777367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:37.778105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:37.778568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:37.779040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:37.911879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:37.921144 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba7aa4ed-feb2-4327-83bc-93450fabab42 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.160696 Sep 01 05:49:37.921984 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3426/6895] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:37 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:38.948275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:38.949129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:38.960294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:38.961114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:38.961851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:38.963048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:38.963815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:38.964531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:39.105998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:39.116984 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a6d09f98-9066-4bd5-9457-165a35d828f1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.176132 Sep 01 05:49:39.117578 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3470/6896] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:38 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:40.141825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:40.142480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:40.153250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:40.153925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:40.154535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:40.155576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:40.156123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:40.156739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:40.300681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:40.308948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80d69496-9cfe-4a1f-b46b-5f28c46c9ff2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.173696 Sep 01 05:49:40.309530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3427/6897] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:40 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:41.336887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:41.337632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:41.340607 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:49:41.340813 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 (ip 10.222.0.26) !!! Sep 01 05:49:41.343142 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:49:41.343357 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 (ip 10.222.0.26) !!! Sep 01 05:49:41.362598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:41.363292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:41.363870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:41.364734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:41.365162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:41.365578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:41.501062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:41.508990 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4c0a60e-aa3a-4911-8f82-9e9c9497053d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.178451 Sep 01 05:49:41.509620 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3471/6898] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:41 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:42.535043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:42.536080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:42.539102 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:49:42.539241 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:49:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 (ip 10.222.0.26) !!! Sep 01 05:49:42.547724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:42.548235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:42.548671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:42.549379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:42.549849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:42.550266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:42.684344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:42.692579 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-127d30ee-10a9-4346-b90c-cce649f9ca55 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.164212 Sep 01 05:49:42.693209 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3428/6899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:42 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:43.718741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:43.719854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:43.731643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:43.732500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:43.733216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:43.734342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:43.735161 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:43.735858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:43.875944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:43.884592 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fdef586-1fdc-413c-b72d-744c04dbce7f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.172566 Sep 01 05:49:43.885145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3472/6900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:43 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:44.910705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:44.911601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:44.919778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:44.920276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:44.920752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:44.921483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:44.921958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:44.922423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:45.064933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:45.077421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7407f7cb-b2bf-42f1-8276-d97d6e54748b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.173341 Sep 01 05:49:45.078201 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3429/6901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:44 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:46.102940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:46.103469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:46.111011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.111469 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.111931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.112615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.113098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.113516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.250220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:46.258754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-582577f2-ddc8-42e2-8c7e-9b368a1128e8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1659 microversion: 2.1 time: 0.161338 Sep 01 05:49:46.259367 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3473/6902] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:46 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1659 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:46.279931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:46.282170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:46.289655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.290150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.290590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.291324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.291787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.292219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.323679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:46.329988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:49:46.337036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:49:46.337453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:49:46.337941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:49:46.338365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:49:46.338787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:49:46.415183 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f30ac22-383e-4ca5-8a03-2a629e54c382 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action" status: 202 len: 0 microversion: 2.1 time: 0.139176 Sep 01 05:49:46.416268 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3430/6903] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:49:46 2022] POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:49:46.424700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:46.425371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:46.432076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.432569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.432994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.433692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:46.434165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:46.434595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:46.592856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:46.601585 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6470b126-3907-4850-ae0e-5a1717bc61dc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.180661 Sep 01 05:49:46.602193 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3474/6904] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:46 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:47.626294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:47.626915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:47.636234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:47.636733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:47.637182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:47.637904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:47.638378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:47.638809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:47.785972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:47.794530 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7967637d-d871-4710-ae65-97960b1875b0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1682 microversion: 2.1 time: 0.175934 Sep 01 05:49:47.795122 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3431/6905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:47 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:48.818076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:48.818832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:48.829040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:48.829725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:48.830308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:48.831240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:48.831835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:48.832437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:48.976664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:48.985094 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5cb31398-360c-4884-9770-e6b87edfa607 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1687 microversion: 2.1 time: 0.172313 Sep 01 05:49:48.985649 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3475/6906] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:48 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:50.010048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:50.010652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:50.018248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.018751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.019237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:50.019953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.020421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.020860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:50.154279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:50.162669 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eac930bb-2aab-4ead-a625-1bf4b6855790 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1687 microversion: 2.1 time: 0.158169 Sep 01 05:49:50.163491 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3432/6907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:50 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:50.975793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "name": "network-vif-unplugged", "status": "completed", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:50.986965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:50.987561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:50.988092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.008563 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] Creating event network-vif-unplugged:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h1-820368-37 Sep 01 05:49:51.016843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:49:51.029122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9702d8b6-228b-4378-aa7b-a33df482f2d9 req-1a22ed3e-1b04-421f-8be0-e5f51e9397e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057153 Sep 01 05:49:51.029750 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3476/6908] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:51.183636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:51.184397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:51.191753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:51.192256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:51.192693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.193432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:51.193922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:51.194363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:51.327923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:51.335858 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49638879-a235-4748-99f2-64b16e6a2d86 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1686 microversion: 2.1 time: 0.156278 Sep 01 05:49:51.336514 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3433/6909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:51 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:52.363606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:52.364165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:52.372381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.372857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.373290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.373984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:52.374427 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:52.374852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:52.521031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:52.533332 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ee55917-4d20-4fb7-9e69-a2e26d3a7c2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1684 microversion: 2.1 time: 0.177910 Sep 01 05:49:52.534107 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3477/6910] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:52 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:53.046505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:53.057769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.058297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.058746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.070625 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] Creating event network-changed:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h1-820368-37 Sep 01 05:49:53.076981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:49:53.088519 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cd34f84b-e793-4cae-80e0-3688157eaf36 req-2ad5ee49-991f-4418-82ad-2d4bba18df24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045720 Sep 01 05:49:53.089108 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3434/6911] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:53.557245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:53.557926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:53.565083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.565575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.566008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.566770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.567300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.567725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.730312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:53.738367 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-118888c5-1285-4b65-9cad-66e512d984cb tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1680 microversion: 2.1 time: 0.185083 Sep 01 05:49:53.738987 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3478/6912] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:53 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:53.761276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:53.761908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:53.768311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.768814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.769267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.769980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.770488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.770948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.834273 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e02b2163-b06d-484d-bb25-9d1c80128a9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action" status: 204 len: 0 microversion: 2.1 time: 0.077157 Sep 01 05:49:53.834824 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3435/6913] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:49:53 2022] POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:49:53.843471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:53.844073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:53.850197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.850678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.851136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:53.851830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:53.852276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:53.852693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:54.066811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:54.075694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f78d93d2-7754-4ade-9fdd-364d4642435e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1680 microversion: 2.1 time: 0.236212 Sep 01 05:49:54.076265 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3479/6914] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:53 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:49:55.098682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:55.099526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:55.106484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.107091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.107798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.108625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:55.109167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:55.109708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:55.260632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:55.268714 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fbc17d3-6944-49a3-a22b-004723cadd0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1680 microversion: 2.1 time: 0.175442 Sep 01 05:49:55.269303 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3436/6915] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:55 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:56.293868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:56.294484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:56.301521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.302003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.302419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.303146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.303594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.304011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.447919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:56.456571 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ceb08e09-c08c-4b0f-a319-4694d801d9e4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1659 microversion: 2.1 time: 0.168192 Sep 01 05:49:56.457132 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3480/6916] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:56 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1659 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:56.479531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:56.480186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:56.487855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.488352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.488804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.489509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.489976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.490414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.623212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:56.631192 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3354722-fa7e-4855-b5d5-49caab989510 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1659 microversion: 2.1 time: 0.157164 Sep 01 05:49:56.631771 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3437/6917] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:56 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1659 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:56.658926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f718e14-4b20-494b-be17-5a25ef539ff5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:56.665580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f718e14-4b20-494b-be17-5a25ef539ff5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.666114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f718e14-4b20-494b-be17-5a25ef539ff5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.666553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f718e14-4b20-494b-be17-5a25ef539ff5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.691330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f718e14-4b20-494b-be17-5a25ef539ff5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Going to try to start instance {{(pid=128862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:49:56.736111 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f718e14-4b20-494b-be17-5a25ef539ff5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action" status: 202 len: 0 microversion: 2.1 time: 0.081041 Sep 01 05:49:56.736723 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3481/6918] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:49:56 2022] POST /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:49:56.745321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:56.745947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:56.752105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.752663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.753176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.753874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:56.754386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:56.754866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:56.894246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:56.903886 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9e9c1db-3b9e-41f4-b468-6378bd93e86a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1668 microversion: 2.1 time: 0.162391 Sep 01 05:49:56.904479 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3438/6919] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:56 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:57.151698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-580ff205-7c11-4ffd-999b-1b6cbc4a79ed req-18a3a161-ea0f-497e-b1f6-5cb21a8f2119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "name": "network-vif-plugged", "status": "completed", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:57.162377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-580ff205-7c11-4ffd-999b-1b6cbc4a79ed req-18a3a161-ea0f-497e-b1f6-5cb21a8f2119 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:57.163164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-580ff205-7c11-4ffd-999b-1b6cbc4a79ed req-18a3a161-ea0f-497e-b1f6-5cb21a8f2119 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:57.163594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-580ff205-7c11-4ffd-999b-1b6cbc4a79ed req-18a3a161-ea0f-497e-b1f6-5cb21a8f2119 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:57.175493 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-580ff205-7c11-4ffd-999b-1b6cbc4a79ed req-18a3a161-ea0f-497e-b1f6-5cb21a8f2119 service nova] Creating event network-vif-plugged:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h1-820368-37 Sep 01 05:49:57.180621 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-580ff205-7c11-4ffd-999b-1b6cbc4a79ed req-18a3a161-ea0f-497e-b1f6-5cb21a8f2119 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Sep 01 05:49:57.181363 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3482/6920] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:57.929914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:57.930706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:57.942712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:57.943576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:57.944300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:57.945464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:57.946393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:57.947142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:57.962760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:58.081945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:58.090219 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b05d7cc-4f78-48ba-99c3-4ff0658207fc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1672 microversion: 2.1 time: 0.167063 Sep 01 05:49:58.090831 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3439/6921] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:57 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:58.116068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:58.116626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:58.124307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:58.124800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:58.125245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:58.125939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:58.126397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:58.126823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:58.146211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:58.155823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:49:58.235875 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d64a3cea-5e47-4a5c-9aca-81411888b502 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 204 len: 0 microversion: 2.1 time: 0.127980 Sep 01 05:49:58.236441 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3483/6922] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:58 2022] DELETE /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:49:58.244898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:58.245614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:58.251759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:58.252250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:58.252694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:58.253390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:58.253851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:58.254279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:58.393081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:58.406989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3672e60b-68e8-4aaf-86a6-9d47a7a5b323 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1678 microversion: 2.1 time: 0.165585 Sep 01 05:49:58.407805 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3440/6923] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:58 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:59.437029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:59.437710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:59.446509 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:59.447073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:59.447543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:59.448247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:59.448824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:59.449253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:59.597061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:59.605363 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b77dcf6-8b88-4741-a1f6-dc56df5a5f00 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1678 microversion: 2.1 time: 0.175815 Sep 01 05:49:59.605872 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3484/6924] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:59 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:00.627463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:00.628105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:00.634613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:00.635153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:00.635609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:00.636387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:00.636928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:00.637371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:00.716143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:00.724646 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a43cbf8a-0863-480b-8f58-0fb3bf0e6525 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 200 len: 1610 microversion: 2.1 time: 0.101260 Sep 01 05:50:00.725726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3441/6925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:00 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 1610 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:00.771010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-33f3b5dc-64a2-4873-b20b-93cd48e7c45a req-77170f53-d5e0-4c00-a91e-2564764cade6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aba5165-782c-49f5-84d6-f47ef9f9c567", "name": "network-vif-deleted", "tag": "d6be5e73-609f-4cd7-8a61-04ab4943e508"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:00.781959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-33f3b5dc-64a2-4873-b20b-93cd48e7c45a req-77170f53-d5e0-4c00-a91e-2564764cade6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:00.782400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-33f3b5dc-64a2-4873-b20b-93cd48e7c45a req-77170f53-d5e0-4c00-a91e-2564764cade6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:00.782921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-33f3b5dc-64a2-4873-b20b-93cd48e7c45a req-77170f53-d5e0-4c00-a91e-2564764cade6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:00.795557 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-33f3b5dc-64a2-4873-b20b-93cd48e7c45a req-77170f53-d5e0-4c00-a91e-2564764cade6 service nova] Creating event network-vif-deleted:d6be5e73-609f-4cd7-8a61-04ab4943e508 for instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 on n-h1-820368-37 Sep 01 05:50:00.800919 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-33f3b5dc-64a2-4873-b20b-93cd48e7c45a req-77170f53-d5e0-4c00-a91e-2564764cade6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100589 Sep 01 05:50:00.801636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3485/6926] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:50:01.746057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:01.746673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:01.753963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.754415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.754942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.755641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.756107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.756538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.772552 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 HTTP/1.1 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '3aba5165-782c-49f5-84d6-f47ef9f9c567'} Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:01.774230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb745812-fab7-4c7f-9d6f-13024b80a417 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 404 len: 111 microversion: 2.1 time: 0.034024 Sep 01 05:50:01.778998 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3442/6927] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:01 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:01.790737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:01.791996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:01.799113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.799589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.800018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.800700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:01.801150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:01.801562 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:01.815480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 HTTP/1.1 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3aba5165-782c-49f5-84d6-f47ef9f9c567'} Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:50:01.817416 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49ec6000-0660-4e9c-a3bb-44c4dfd12fd5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 404 len: 111 microversion: 2.1 time: 0.032538 Sep 01 05:50:01.821223 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3486/6928] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:01 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:50:01.869189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2094977965", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "8ec1c841-61f0-4e5a-9acf-9b82e4e6a455"}], "security_groups": [{"name": "tempest-securitygroup--1988176895"}], "key_name": "tempest-keypair-1415424487", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:01.976158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] validate_networks() for [('8ec1c841-61f0-4e5a-9acf-9b82e4e6a455', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:50:02.364296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:50:02.364757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:50:02.365242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:50:02.365658 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:50:02.366078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:50:02.375939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:02.376430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:02.376873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:02.377608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:02.378070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:02.378499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:02.396590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:50:02.402468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:50:02.417669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:50:02.420185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:50:02.469851 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0434b255-280e-45e5-8bba-e3c6b7216e16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.604541 Sep 01 05:50:02.470711 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3443/6929] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:50:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:50:02.484668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5c47ab45-976e-43bd-a1ca-53d3838541e0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:02.485474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5c47ab45-976e-43bd-a1ca-53d3838541e0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:02.549401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5c47ab45-976e-43bd-a1ca-53d3838541e0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:02.557414 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5c47ab45-976e-43bd-a1ca-53d3838541e0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1239 microversion: 2.1 time: 0.076814 Sep 01 05:50:02.558125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3487/6930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:02 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:03.580254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:03.580968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:03.588347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:03.588842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:03.589405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:03.590446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:03.590914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:03.591506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:03.661414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:03.669847 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14d2fb63-09bb-4891-a448-fc1303a57005 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1299 microversion: 2.1 time: 0.094635 Sep 01 05:50:03.670834 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3444/6931] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:03 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:04.692728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:04.693516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:04.701672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:04.702159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:04.702588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:04.703318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:04.703736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:04.704361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.206766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:05.215765 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6381104d-3491-41fb-9c46-7d3e201d5eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.526927 Sep 01 05:50:05.216350 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3488/6932] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:04 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:05.460159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-75f8367e-0e49-4084-bb8b-07346b360061 req-38d4adc5-3c72-4265-9f0b-de48cfe6ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:05.465083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:05.471055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-75f8367e-0e49-4084-bb8b-07346b360061 req-38d4adc5-3c72-4265-9f0b-de48cfe6ade6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:05.471557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-75f8367e-0e49-4084-bb8b-07346b360061 req-38d4adc5-3c72-4265-9f0b-de48cfe6ade6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:05.471997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-75f8367e-0e49-4084-bb8b-07346b360061 req-38d4adc5-3c72-4265-9f0b-de48cfe6ade6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:05.484261 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-75f8367e-0e49-4084-bb8b-07346b360061 req-38d4adc5-3c72-4265-9f0b-de48cfe6ade6 service nova] Creating event network-changed:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:50:05.489242 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-75f8367e-0e49-4084-bb8b-07346b360061 req-38d4adc5-3c72-4265-9f0b-de48cfe6ade6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094399 Sep 01 05:50:05.489846 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3445/6933] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:06.241821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:06.243008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:06.247650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:06.257105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:06.257809 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:06.258548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:06.259742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:06.260503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:06.261495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:06.404571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:06.412945 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09d76163-71fc-4d50-8842-b995f1bda49a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.177791 Sep 01 05:50:06.413520 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3489/6934] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:06 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:07.448122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:07.449129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:07.456520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:07.457020 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:07.457463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:07.458168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:07.458634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:07.459112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:07.597710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:07.605581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa6ffb4b-fc5e-4f49-a6ca-d901fc031bea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.166309 Sep 01 05:50:07.606163 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3446/6935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:07 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:08.630942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:08.631949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:08.642508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:08.643304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:08.643974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:08.645027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:08.645726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:08.646382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:08.786033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:08.794275 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71534f1d-e0b3-4465-817d-236e43a12e7c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.169751 Sep 01 05:50:08.794850 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3490/6936] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:08 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:09.815606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:09.816200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:09.823670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:09.824182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:09.824629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:09.825347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:09.825901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:09.826345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:09.967275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:09.975031 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dda108ff-d067-4eb3-a3fe-9d5796f1e08e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.163375 Sep 01 05:50:09.975609 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3447/6937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:09 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:10.999803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:11.000512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:11.007887 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:11.008269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:11.008701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:11.009403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:11.009856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:11.010273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:11.157757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:11.165663 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ff14df9-154f-4a4a-b9d3-74790e14c09a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.172192 Sep 01 05:50:11.166231 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3491/6938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:10 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:11.960120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d28ff58e-e599-4545-9757-b4cf32635cbe req-d382e631-9c04-4cfc-8c2e-423281cdb1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "name": "network-vif-plugged", "status": "completed", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:11.969754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d28ff58e-e599-4545-9757-b4cf32635cbe req-d382e631-9c04-4cfc-8c2e-423281cdb1d0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:11.970836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d28ff58e-e599-4545-9757-b4cf32635cbe req-d382e631-9c04-4cfc-8c2e-423281cdb1d0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:11.970836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d28ff58e-e599-4545-9757-b4cf32635cbe req-d382e631-9c04-4cfc-8c2e-423281cdb1d0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:11.981844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d28ff58e-e599-4545-9757-b4cf32635cbe req-d382e631-9c04-4cfc-8c2e-423281cdb1d0 service nova] Creating event network-vif-plugged:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:50:11.987113 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d28ff58e-e599-4545-9757-b4cf32635cbe req-d382e631-9c04-4cfc-8c2e-423281cdb1d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090151 Sep 01 05:50:11.987697 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3448/6939] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:12.189304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:12.189914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:12.197157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:12.197639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:12.198065 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:12.198752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:12.199234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:12.199652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:12.338645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:12.346925 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6416e2df-7a72-4056-8cd3-66146a615d75 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.162814 Sep 01 05:50:12.347500 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3492/6940] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:12 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:13.366605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:13.367432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:13.372235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:13.372949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:13.380046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:13.380533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:13.380975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:13.381670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:13.382127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:13.382560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:13.553447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:13.561471 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5489d9d1-3788-41be-b987-57d32f6ab1b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1365 microversion: 2.1 time: 0.195870 Sep 01 05:50:13.562058 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3449/6941] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:13 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:14.588623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:14.589213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:14.591976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:50:14.599904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:14.600400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:14.600835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.601550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:14.602005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:14.602433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.763054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:50:14.771875 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2394272c-ec8a-4716-b742-298dc68abd17 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1553 microversion: 2.1 time: 0.190551 Sep 01 05:50:14.772463 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3493/6942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:50:14 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:50:14.793417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:50:14.793922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:50:14.801319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:14.801828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:14.802278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.803027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:14.803498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:14.803938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:14.921222 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6c0c279-8615-49ff-8f9a-06a593f20ba2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131676 Sep 01 05:50:14.921824 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3450/6943] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:50:14 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:50:16.140328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8244847c-f2f3-4aa0-b208-787fb2ae38b7 req-3f7149ec-39b3-4e40-b6f0-a874383f7908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:50:16.151442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8244847c-f2f3-4aa0-b208-787fb2ae38b7 req-3f7149ec-39b3-4e40-b6f0-a874383f7908 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:50:16.151918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8244847c-f2f3-4aa0-b208-787fb2ae38b7 req-3f7149ec-39b3-4e40-b6f0-a874383f7908 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:50:16.152342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8244847c-f2f3-4aa0-b208-787fb2ae38b7 req-3f7149ec-39b3-4e40-b6f0-a874383f7908 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:50:16.163957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8244847c-f2f3-4aa0-b208-787fb2ae38b7 req-3f7149ec-39b3-4e40-b6f0-a874383f7908 service nova] Creating event network-changed:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:50:16.169031 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8244847c-f2f3-4aa0-b208-787fb2ae38b7 req-3f7149ec-39b3-4e40-b6f0-a874383f7908 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032512 Sep 01 05:50:16.169642 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3494/6944] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:28.453735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:28.455027 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=51 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:28.463396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:28.467313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:28.475068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:28.475575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:28.476024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:28.476732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:28.477236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:28.477673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:28.508591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:28.514840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:51:28.521972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:51:28.522408 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:51:28.522913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:51:28.523362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:51:28.523824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:51:28.857045 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35af25b1-fe2b-4dcb-90cf-1095362c01ca tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464/action" status: 202 len: 0 microversion: 2.1 time: 0.408129 Sep 01 05:51:28.857977 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3451/6945] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:51:28 2022] POST /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:51:28.865573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=11 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:28.866312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:28.871728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:28.872579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:28.880501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:28.880945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:28.881380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:28.882080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:28.882547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:28.882976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:29.062369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:29.070952 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25e9f5f1-edba-4746-8aa6-0466a0adb66e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1681 microversion: 2.1 time: 0.208259 Sep 01 05:51:29.071676 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3495/6946] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:28 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:30.094813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:30.095476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:30.102631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:30.103189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:30.103641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:30.104359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:30.104824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:30.105263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:30.321041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:30.329552 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39501de4-be47-4658-b7d2-7f878987154e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1681 microversion: 2.1 time: 0.239695 Sep 01 05:51:30.330358 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3452/6947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:30 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:31.352737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:31.353369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:31.361019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:31.361505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:31.361933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:31.362621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:31.363110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:31.363554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:31.498422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:31.506834 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad7871bb-dfaa-417f-a1a8-59bd7f201898 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.158128 Sep 01 05:51:31.507446 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3496/6948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:31 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:32.533835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:32.534858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:32.546516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:32.547122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:32.547576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:32.548279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:32.548743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:32.549183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:32.684233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:32.696971 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b71c6ec6-2169-4193-852d-f41e58acd307 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.169995 Sep 01 05:51:32.697827 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3453/6949] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:32 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:33.720940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:33.721550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:33.729950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:33.730532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:33.731220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:33.732083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:33.732537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:33.732960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:33.879172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:33.887765 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ea755848-6219-4250-9fe0-f96ef8572332 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.171015 Sep 01 05:51:33.888364 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3497/6950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:33 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:34.910952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:34.911488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:34.919908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:34.920426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:34.920872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:34.921570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:34.922037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:34.922440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:35.060594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:35.068757 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-485bc8cf-fe28-42a2-9f77-5c51b65add4d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.162682 Sep 01 05:51:35.069348 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3454/6951] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:34 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:36.093623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:36.094226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:36.102043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:36.102547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:36.103039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:36.103793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:36.104273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:36.104711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:36.247361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:36.255957 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-279b87db-9c85-4aca-9704-ea400603c43a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.168151 Sep 01 05:51:36.256541 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3498/6952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:36 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:37.282449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:37.283401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:37.294906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:37.295414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:37.295857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:37.297170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:37.297642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:37.298079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:37.430679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:37.439172 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bb1c9d2-b890-4fd6-99e0-b9fe77c211c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.163534 Sep 01 05:51:37.439733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3455/6953] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:37 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:38.468848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:38.469834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:38.481437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:38.482236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:38.482793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:38.483882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:38.484342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:38.484767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:38.628378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:38.637285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6377a939-b437-483f-8bb7-59d45965ba90 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.174467 Sep 01 05:51:38.637285 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3499/6954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:38 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:39.659013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:39.659800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:39.667160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:39.667665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:39.668138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:39.668833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:39.669304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:39.669736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:39.804175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:39.812414 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-056da916-20dd-4f3d-a516-6bc5f9ed0202 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.157442 Sep 01 05:51:39.812978 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3456/6955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:39 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:40.837876 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:40.838959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:40.851168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:40.851966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:40.852686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:40.853818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:40.854575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:40.855424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:41.000186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:41.008268 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6a441238-6485-46a8-85b5-f726c93660c9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.177150 Sep 01 05:51:41.008844 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3500/6956] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:40 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:42.033258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:42.033912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:42.041240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:42.041741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:42.042185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:42.043004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:42.043464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:42.043900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:42.183916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:42.191930 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef72daf6-dbb8-4e6a-ba41-8a4b077baf2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.164432 Sep 01 05:51:42.192508 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3457/6957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:42 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:43.218713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:43.219861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:43.232266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:43.233075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:43.233820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:43.234827 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:43.235316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:43.235746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:43.381725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:43.394323 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-debbe1d1-d805-41ea-8fa7-1d1dd9adf98d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.182012 Sep 01 05:51:43.395271 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3501/6958] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:43 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:44.425507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:44.426189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:44.435133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:44.435763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:44.436324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:44.437250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:44.438436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:44.439028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:44.579457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:44.587410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-339c323e-bebe-45d2-9d69-8042707e369b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.168674 Sep 01 05:51:44.587989 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3458/6959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:44 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:45.613645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:45.614579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:45.626015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:45.626504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:45.626944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:45.627659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:45.628115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:45.628541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:45.770075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:45.783128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ab956025-8e88-4191-8c34-0324d78ffb82 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.176553 Sep 01 05:51:45.783708 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3502/6960] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:45 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:46.806229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:46.806985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:46.815975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:46.816593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:46.817147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:46.818019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:46.818599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:46.819180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:46.960903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:46.969386 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a99242d0-7941-46e8-9c52-51b285a78b1a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1686 microversion: 2.1 time: 0.168137 Sep 01 05:51:46.970262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3459/6961] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:46 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:47.991909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:47.992675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:48.001189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:48.001963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:48.002412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:48.003159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:48.003821 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:48.004326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:48.144377 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:48.152782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dff11e74-d5d5-4bd0-bca5-c824dc458cde tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1685 microversion: 2.1 time: 0.165237 Sep 01 05:51:48.153346 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3503/6962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:47 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:48.496024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "name": "network-vif-unplugged", "status": "completed", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:48.507342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:48.507837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:48.508338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:48.521175 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] Creating event network-vif-unplugged:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h1-820368-37 Sep 01 05:51:48.527174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] Instance e58030a2-ecb9-4e87-8d22-6212040e6464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:51:48.539208 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e248de2c-d589-43bb-b7c4-0b43b8339b9c req-d97dfe4d-b600-4420-9b29-1a58c2650dd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047041 Sep 01 05:51:48.539818 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3460/6963] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:49.175901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:49.176534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:49.183856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:49.184331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:49.184761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:49.185458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:49.185907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:49.186313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:49.336698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:49.348585 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b907ae1e-5158-41a1-a93f-52b39e497c52 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1685 microversion: 2.1 time: 0.176730 Sep 01 05:51:49.349179 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3504/6964] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:49 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:50.377485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:50.378311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:50.385470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:50.385994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:50.386465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:50.387231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:50.387724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:50.388179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:50.531577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:50.540450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aa0aeb8-777a-4f86-9be7-2311f2eea936 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1683 microversion: 2.1 time: 0.172009 Sep 01 05:51:50.541021 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3461/6965] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:50 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:50.571741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:50.582453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:50.583200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:50.583633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:50.595635 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] Creating event network-changed:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h1-820368-37 Sep 01 05:51:50.601444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] Instance e58030a2-ecb9-4e87-8d22-6212040e6464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:51:50.612554 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a4d60092-bf27-4d35-ab2f-ea9f9058871e req-61368692-feae-41a4-b54b-3be9ae45dae7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 Sep 01 05:51:50.613121 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3505/6966] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:51.562175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:51.562812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:51.570425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.570917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.571421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.572130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.572597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.573064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.717789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:51.727310 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c906eebe-676e-477a-ab2e-b6e1718cf5d6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1680 microversion: 2.1 time: 0.169115 Sep 01 05:51:51.727878 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3462/6967] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:51 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:51.749962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:51.750567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:51.757635 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.758124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.758554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.759290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.759742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.760159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.803110 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.803597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.804029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.804780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.805227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.805647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.827230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:51:51.832713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:51:51.947150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-824a92b1-8910-439c-90e7-9b72f5fccbab tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464/action" status: 202 len: 0 microversion: 2.1 time: 0.202325 Sep 01 05:51:51.948086 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3506/6968] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:51:51 2022] POST /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:51:51.956803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:51.957542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:51.963866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.964449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.964900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:51.965741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:51.966231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:51.966673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:52.106414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:52.115146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3735946-dc78-485c-a424-3cbcab629eea tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.162767 Sep 01 05:51:52.115777 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3463/6969] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:51 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:53.141633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:53.142686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:53.150931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:53.151420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:53.151847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:53.152544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:53.152989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:53.153407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:53.295859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:53.304319 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce72cd35-6553-4d3b-80de-8124c47bf6c4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.169884 Sep 01 05:51:53.305029 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3507/6970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:53 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:53.686424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "name": "network-vif-plugged", "status": "completed", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:53.697614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:53.698199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:53.698651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:53.711581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] Creating event network-vif-plugged:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h1-820368-37 Sep 01 05:51:53.717478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] Instance e58030a2-ecb9-4e87-8d22-6212040e6464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:51:53.728385 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9c7f9af1-fe96-446c-8476-2ab8a1dc3187 req-c728b91e-9b5f-4d9e-9a88-cb7cc5a45c1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045860 Sep 01 05:51:53.729001 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3464/6971] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:54.326636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:54.327186 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:54.334181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:54.334658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:54.335122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:54.335826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:54.337142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:54.337587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:54.480047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:54.483739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:54.491642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4fe42d55-602d-4a46-a3e9-551b7878be1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.169414 Sep 01 05:51:54.492245 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3508/6972] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:54 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:55.088346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "name": "network-vif-unplugged", "status": "completed", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:55.098533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.099155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.099652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.112176 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] Creating event network-vif-unplugged:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:51:55.118243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] Instance e58030a2-ecb9-4e87-8d22-6212040e6464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:51:55.129896 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4dbdcfa3-82e1-4e19-8c65-ebc03c37903a req-43a60dab-1d33-4ad8-b09f-06ec925a3dc6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047402 Sep 01 05:51:55.130706 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3465/6973] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:55.514168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:55.514773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:55.522930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.523488 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.523948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.525249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:55.525793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:55.526222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:55.757810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:55.766095 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2d4a9927-024e-4f04-b0b3-c498d2bf0119 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.256177 Sep 01 05:51:55.766688 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3509/6974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:55 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:56.793545 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:56.794728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:56.804498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.804976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.805434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.806149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:56.806620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:56.807108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:56.951979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:56.960104 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69fac6f9-5261-4eaf-b9d2-e34bf4b1a324 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.174349 Sep 01 05:51:56.960683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3466/6975] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:56 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:57.181016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:51:57.195194 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:57.195671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:57.196097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:57.209475 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] Creating event network-changed:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:51:57.215102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] Instance e58030a2-ecb9-4e87-8d22-6212040e6464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:51:57.227485 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4455927f-9c4a-4dbc-927a-a91ec821592d req-01be1cfa-c4f7-401a-bd7e-f3f7091922d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052994 Sep 01 05:51:57.228145 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3510/6976] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:51:57.982540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:57.983390 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:57.993813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:57.994319 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:57.994761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:57.995497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:57.995966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:57.996398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:58.001133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:58.136647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:58.148685 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aea8b0a-91f0-4c3a-991a-98e8c3799b2b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.169887 Sep 01 05:51:58.149887 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3467/6977] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:57 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:51:59.175558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:51:59.176643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:51:59.180626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:59.186047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:59.186806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:59.187281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:59.188001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:51:59.188458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:51:59.188897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:51:59.409865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:51:59.417982 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f0bd0a4-c5a5-4412-bebb-2cc03b289258 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1679 microversion: 2.1 time: 0.247765 Sep 01 05:51:59.418491 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3511/6978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:51:59 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:00.496970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:00.497600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:00.499496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=39 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:00.505434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.505930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.506378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.507128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.507593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.508034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.643320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:00.652139 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1674fd69-5ac4-4845-b3e1-1d9854b20fd8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1672 microversion: 2.1 time: 0.215181 Sep 01 05:52:00.652942 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3468/6979] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:00 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:00.674288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:00.674992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:00.682395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.682911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.683368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.684117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.684745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.685266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.829884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:00.838226 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6572edde-c2df-4e6f-8bd4-5af2f6c9ded4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1672 microversion: 2.1 time: 0.167950 Sep 01 05:52:00.839108 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3512/6980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:00 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:00.860591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:00.861230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:00.867669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.868175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.868629 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.869343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:00.869821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:00.870261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:00.999975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2fa9da57-7184-4ad6-bddb-903a7a26e7e4 req-69ebf2f3-67bf-46b4-8e97-4e7793919d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "name": "network-vif-plugged", "status": "completed", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:01.016379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:01.016728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2fa9da57-7184-4ad6-bddb-903a7a26e7e4 req-69ebf2f3-67bf-46b4-8e97-4e7793919d65 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:01.016728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2fa9da57-7184-4ad6-bddb-903a7a26e7e4 req-69ebf2f3-67bf-46b4-8e97-4e7793919d65 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:01.016728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2fa9da57-7184-4ad6-bddb-903a7a26e7e4 req-69ebf2f3-67bf-46b4-8e97-4e7793919d65 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:01.022476 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e416edf4-c77f-4992-adee-e5eab55b4f0e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1672 microversion: 2.1 time: 0.166036 Sep 01 05:52:01.023348 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3469/6981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:00 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:01.042178 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2fa9da57-7184-4ad6-bddb-903a7a26e7e4 req-69ebf2f3-67bf-46b4-8e97-4e7793919d65 service nova] Creating event network-vif-plugged:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:52:01.043877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:01.044822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:01.047410 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2fa9da57-7184-4ad6-bddb-903a7a26e7e4 req-69ebf2f3-67bf-46b4-8e97-4e7793919d65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052072 Sep 01 05:52:01.048023 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3513/6982] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:01.051567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:01.052078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:01.052529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:01.053246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:01.053735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:01.054188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:01.079638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:52:01.168244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70cf34c3-677d-429f-a1ed-a5aaa5cb6959 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 204 len: 0 microversion: 2.1 time: 0.127268 Sep 01 05:52:01.168855 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3470/6983] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:52:01 2022] DELETE /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:52:01.178503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:01.179222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:01.185900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:01.186381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:01.186810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:01.187553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:01.187989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:01.188484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:01.325250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:01.333708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-204807cd-df70-4581-9d91-384f0eeb53d9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1678 microversion: 2.1 time: 0.159533 Sep 01 05:52:01.334286 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3514/6984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:01 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:02.356503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:02.357065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:02.364753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:02.365250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:02.365709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:02.366534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:02.367036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:02.367448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:02.841178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:02.849878 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cd6ef14-5230-465b-aea8-247aeb31c76f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1678 microversion: 2.1 time: 0.497844 Sep 01 05:52:02.850468 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3471/6985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:02 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:03.652520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d834d6da-2eaa-4c22-9da8-7d832fadeec9 req-f119d26a-df15-4d4b-89c5-865258c65fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58030a2-ecb9-4e87-8d22-6212040e6464", "name": "network-vif-deleted", "tag": "db23f555-d1eb-4130-aab8-5054196ab4b6"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:03.659412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:03.665796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d834d6da-2eaa-4c22-9da8-7d832fadeec9 req-f119d26a-df15-4d4b-89c5-865258c65fbe service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:03.666282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d834d6da-2eaa-4c22-9da8-7d832fadeec9 req-f119d26a-df15-4d4b-89c5-865258c65fbe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:03.666706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d834d6da-2eaa-4c22-9da8-7d832fadeec9 req-f119d26a-df15-4d4b-89c5-865258c65fbe service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:03.678779 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d834d6da-2eaa-4c22-9da8-7d832fadeec9 req-f119d26a-df15-4d4b-89c5-865258c65fbe service nova] Creating event network-vif-deleted:db23f555-d1eb-4130-aab8-5054196ab4b6 for instance e58030a2-ecb9-4e87-8d22-6212040e6464 on n-h2-820368-37 Sep 01 05:52:03.684699 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d834d6da-2eaa-4c22-9da8-7d832fadeec9 req-f119d26a-df15-4d4b-89c5-865258c65fbe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036495 Sep 01 05:52:03.685600 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3515/6986] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:03.873432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:03.874792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:03.883128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:03.883808 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:03.884651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:03.885420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:03.885895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:03.886514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:03.920451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:03.920944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:03.921387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:03.921841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lazy-loading 'fault' on Instance uuid e58030a2-ecb9-4e87-8d22-6212040e6464 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:52:03.963497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:03.971923 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b9835cb-0a7d-454b-a228-3bf8985e7e18 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 200 len: 1329 microversion: 2.1 time: 0.103543 Sep 01 05:52:03.972575 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3472/6987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:03 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:04.999914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:05.000965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:05.011801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.012569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.013232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.014282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.014977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.015647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.031973 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 HTTP/1.1 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e58030a2-ecb9-4e87-8d22-6212040e6464'} Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:05.033629 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08196ece-c28b-43d4-81e6-19d69c1ee033 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 404 len: 111 microversion: 2.1 time: 0.043385 Sep 01 05:52:05.038215 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3516/6988] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:04 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:52:05.049825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:05.050443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:05.057871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.058372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.058817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.059530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.059998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.060434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.074106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 HTTP/1.1 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e58030a2-ecb9-4e87-8d22-6212040e6464'} Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:52:05.075886 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-972c942d-87e5-4113-8b6d-8d65d3ac35b9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 404 len: 111 microversion: 2.1 time: 0.031479 Sep 01 05:52:05.080044 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3473/6989] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:05 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:52:05.128755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1633318889", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "8ec1c841-61f0-4e5a-9acf-9b82e4e6a455"}], "security_groups": [{"name": "tempest-securitygroup--1988176895"}], "key_name": "tempest-keypair-1415424487", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:05.238579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] validate_networks() for [('8ec1c841-61f0-4e5a-9acf-9b82e4e6a455', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:52:05.686150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:52:05.686580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:52:05.687100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:52:05.687510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:52:05.687923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:52:05.697644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.698131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.698588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.699348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:05.699817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:05.700236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:05.717530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:52:05.722824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:52:05.740545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:52:05.742963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:52:05.798293 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db858e9d-7180-4883-849f-45bbd6d791c8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673459 Sep 01 05:52:05.798971 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3517/6990] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:52:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:52:05.810335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f065fd53-989e-443b-8ffe-f18e5d8a029a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:05.811026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f065fd53-989e-443b-8ffe-f18e5d8a029a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:05.865858 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f065fd53-989e-443b-8ffe-f18e5d8a029a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:05.872830 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f065fd53-989e-443b-8ffe-f18e5d8a029a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1239 microversion: 2.1 time: 0.066484 Sep 01 05:52:05.873396 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3474/6991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:05 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:06.895665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:06.896275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:06.904106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:06.904598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:06.905032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:06.905733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:06.906181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:06.906600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:07.016792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:07.027415 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-885bd06e-6978-4eeb-99cc-b75fa2e2162b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1299 microversion: 2.1 time: 0.137499 Sep 01 05:52:07.027999 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3518/6992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:06 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:08.050035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:08.050644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:08.059520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:08.060045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:08.060496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:08.061225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:08.061696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:08.062121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:08.294632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:08.303303 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-921a347c-a2bf-4eb2-b6de-28ee7706b78d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.257324 Sep 01 05:52:08.303861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3475/6993] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:08 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:08.451712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-13fa1edd-5b8e-4ae9-954f-54ed7a0b97ee req-59490a27-fa3b-49cf-a5fa-eb3e04768b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:08.463209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-13fa1edd-5b8e-4ae9-954f-54ed7a0b97ee req-59490a27-fa3b-49cf-a5fa-eb3e04768b69 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:08.464451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-13fa1edd-5b8e-4ae9-954f-54ed7a0b97ee req-59490a27-fa3b-49cf-a5fa-eb3e04768b69 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:08.464883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-13fa1edd-5b8e-4ae9-954f-54ed7a0b97ee req-59490a27-fa3b-49cf-a5fa-eb3e04768b69 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:08.477636 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-13fa1edd-5b8e-4ae9-954f-54ed7a0b97ee req-59490a27-fa3b-49cf-a5fa-eb3e04768b69 service nova] Creating event network-changed:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:52:08.482738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-13fa1edd-5b8e-4ae9-954f-54ed7a0b97ee req-59490a27-fa3b-49cf-a5fa-eb3e04768b69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036035 Sep 01 05:52:08.483378 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3519/6994] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:09.325595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:09.326198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:09.333771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:09.334267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:09.334718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:09.335459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:09.335926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:09.336369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:09.466105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:09.476819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5513f85a-af8c-473a-bd55-d2c900daf114 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.154938 Sep 01 05:52:09.477600 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3476/6995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:09 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:10.504749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:10.505609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:10.515171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:10.515769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:10.516310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:10.517159 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:10.517710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:10.518274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:10.669832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:10.678110 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0222461b-b03b-4827-a2b4-44512cf34b4a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.178786 Sep 01 05:52:10.678659 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3520/6996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:10 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:11.700894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:11.701729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:11.710144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:11.710650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:11.711163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:11.711876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:11.712350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:11.712807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:11.853284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:11.861348 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a1e5abf-6b39-46bb-96f2-3c36e2e34a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.165312 Sep 01 05:52:11.861929 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3477/6997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:11 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:12.884124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:12.884732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:12.892013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:12.892498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:12.892924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:12.893615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:12.894060 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:12.894478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:13.041513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:13.049527 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3d668fc5-8b9f-487b-a414-9f930801377c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.169379 Sep 01 05:52:13.059495 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3521/6998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:12 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:14.075949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:14.077034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:14.086708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:14.087232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:14.087686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:14.088393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:14.088861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:14.089299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:14.235523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:14.244417 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cea8f1a-da43-4b3e-9564-4cd5a9ddfb46 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.175182 Sep 01 05:52:14.244972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3478/6999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:14 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:15.060282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-aaaf82c1-d341-4d39-8197-80c2bc13f136 req-c3e289e5-b601-47ac-9c55-59fb8eb59524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "name": "network-vif-plugged", "status": "completed", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:15.074572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aaaf82c1-d341-4d39-8197-80c2bc13f136 req-c3e289e5-b601-47ac-9c55-59fb8eb59524 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:15.075108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aaaf82c1-d341-4d39-8197-80c2bc13f136 req-c3e289e5-b601-47ac-9c55-59fb8eb59524 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:15.075582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-aaaf82c1-d341-4d39-8197-80c2bc13f136 req-c3e289e5-b601-47ac-9c55-59fb8eb59524 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:15.087832 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-aaaf82c1-d341-4d39-8197-80c2bc13f136 req-c3e289e5-b601-47ac-9c55-59fb8eb59524 service nova] Creating event network-vif-plugged:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:52:15.093837 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-aaaf82c1-d341-4d39-8197-80c2bc13f136 req-c3e289e5-b601-47ac-9c55-59fb8eb59524 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040936 Sep 01 05:52:15.094785 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3522/7000] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:15.265931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:15.266554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:15.273711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:15.274549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:15.275035 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:15.275738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:15.276200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:15.276634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:15.420006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:15.428620 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63e03e56-3212-411e-acc1-70951023d458 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.166688 Sep 01 05:52:15.429189 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3479/7001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:15 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:16.448078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:16.448780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:16.453825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:16.454561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:16.465468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:16.466155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:16.466781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:16.467715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:16.468322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:16.468871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:16.615390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:16.624934 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-45174889-7ea6-4eba-9aae-87358bdc0812 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1365 microversion: 2.1 time: 0.177885 Sep 01 05:52:16.625515 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3523/7002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:16 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:17.645628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:17.650855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:17.651508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:17.658205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:17.658704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:17.659191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:17.659893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:17.660529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:17.660969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:17.802635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:52:17.811054 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a1cab5f-4867-48fb-8731-3615e45fdf32 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1553 microversion: 2.1 time: 0.166895 Sep 01 05:52:17.811641 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3480/7003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:52:17 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:52:17.832608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:52:17.833141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:52:17.840206 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:17.840691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:17.841125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:17.841786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:17.842244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:17.842663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:17.929223 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44820e47-ea92-4e12-92b4-6db733d1171b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100295 Sep 01 05:52:17.930093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3524/7004] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:52:17 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:52:19.239371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2a62e54c-e440-4cd2-b1b5-0e3e39d4cd16 req-cbfa2b4a-7340-480d-8cb7-8905f5e18429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:52:19.250604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2a62e54c-e440-4cd2-b1b5-0e3e39d4cd16 req-cbfa2b4a-7340-480d-8cb7-8905f5e18429 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:52:19.251145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2a62e54c-e440-4cd2-b1b5-0e3e39d4cd16 req-cbfa2b4a-7340-480d-8cb7-8905f5e18429 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:52:19.252152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2a62e54c-e440-4cd2-b1b5-0e3e39d4cd16 req-cbfa2b4a-7340-480d-8cb7-8905f5e18429 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:52:19.263962 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2a62e54c-e440-4cd2-b1b5-0e3e39d4cd16 req-cbfa2b4a-7340-480d-8cb7-8905f5e18429 service nova] Creating event network-changed:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:52:19.269752 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2a62e54c-e440-4cd2-b1b5-0e3e39d4cd16 req-cbfa2b4a-7340-480d-8cb7-8905f5e18429 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034202 Sep 01 05:52:19.270972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3481/7005] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:53:33.772278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:33.773028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=68 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:33.774776 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:53:33.775001 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 05:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f (ip 10.222.0.26) !!! Sep 01 05:53:33.783041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:33.783653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:33.793313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:33.793788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:33.794219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:33.794975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:33.795369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:33.795785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:33.936889 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:33.950069 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bae43313-e997-4688-ad33-509c82edb080 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1672 microversion: 2.1 time: 0.180414 Sep 01 05:53:33.950946 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3525/7006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:33 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:33.969939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:33.970691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:33.972080 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:53:33.972244 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:53:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-volume_attachments (ip 10.222.0.26) !!! Sep 01 05:53:33.977882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa62a799-0117-4cc9-8a78-6e9e4a2af71e"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:53:33.980387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:33.990277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:33.990846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:33.991321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:33.992026 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:33.992492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:33.992905 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:34.275349 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aabd1c81-e52e-47c4-a96d-432a5377ffc7 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307841 Sep 01 05:53:34.275972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3482/7007] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:53:33 2022] POST /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:53:45.046168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:53:45.048474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:45.050966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:45.051626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:45.057104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:45.057590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:45.058025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:45.058718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:45.059245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:45.059672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:45.101342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:45.109225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128862) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 05:53:45.117398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:53:45.118036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:53:45.118758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:53:45.119417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:53:45.120033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:53:45.204188 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-52b928b8-1199-44ec-ac1c-56e51cf01427 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.162209 Sep 01 05:53:45.204799 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3526/7008] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:53:45 2022] POST /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:53:45.211355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:45.212509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:53:45.216699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:45.217344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:45.224848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:45.225376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:45.225885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:45.226535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:45.227025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:45.227487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:45.393123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:45.401987 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aada22ef-16a2-42eb-b169-baa73f23c710 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1727 microversion: 2.1 time: 0.192477 Sep 01 05:53:45.402561 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3483/7009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:45 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:46.428365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:46.429203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:46.442328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:46.442817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:46.443281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:46.443972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:46.444420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:46.444837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:46.611532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:46.620754 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d4964a91-2310-4f48-8465-2b71e0589481 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1727 microversion: 2.1 time: 0.200462 Sep 01 05:53:46.621354 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3527/7010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:46 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:47.646272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:47.647340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:47.659694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:47.660515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:47.661259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:47.662430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:47.663270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:47.663995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:47.801252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:47.813098 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6618093-f1bf-4203-842c-5c8f6dc6d17a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.173440 Sep 01 05:53:47.813691 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3484/7011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:47 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:48.834365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:48.835003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:48.843016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:48.843801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:48.844457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:48.845584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:48.846043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:48.846479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:48.987234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:48.995906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ff213e2f-25b3-4aa5-b1e1-ffc7e195c63f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.165562 Sep 01 05:53:48.996500 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3528/7012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:48 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:50.017162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:50.017876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:50.025663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:50.026252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:50.026768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:50.027556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:50.028059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:50.028502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:50.162866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:50.171540 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab87c10-6695-4d18-bffa-16d7e78611d5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.158389 Sep 01 05:53:50.172123 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3485/7013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:50 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:51.194012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:51.194588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:51.202500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:51.203044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:51.203499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:51.204273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:51.204905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:51.205351 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:51.345489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:51.354533 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44272c4f-c635-4eb7-ae53-94c92d92a8c5 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.164986 Sep 01 05:53:51.355235 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3529/7014] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:51 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:52.381289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:52.381937 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:52.390592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:52.391220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:52.391749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:52.392783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:52.393528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:52.394055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:52.549987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:52.562472 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c38edd2-f800-495c-ba34-9b7ad845e78a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.186385 Sep 01 05:53:52.563094 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3486/7015] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:52 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:53.586438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:53.587120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:53.596055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:53.596729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:53.597433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:53.598572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:53.599057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:53.599465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:53.746459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:53.757089 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bcc9553-1934-4686-80c4-36b049fe73ed tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.175481 Sep 01 05:53:53.757651 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3530/7016] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:53 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:54.780667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:54.781472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:54.789183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:54.789681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:54.790127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:54.790828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:54.791330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:54.791766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:54.935192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:54.946912 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6098ad1b-c436-45a5-9405-2b728c0a2f93 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.171205 Sep 01 05:53:54.947503 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3487/7017] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:54 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:55.972334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:55.972946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:55.979952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:55.980432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:55.980870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:55.981557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:55.982006 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:55.982425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:56.114623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:56.123415 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0ea92222-9f6b-4577-9ae7-9882c3b20ffc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.157350 Sep 01 05:53:56.124032 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3531/7018] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:55 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:57.148680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:57.149964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:57.160223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:57.160878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:57.161479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:57.162446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:57.163114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:57.163721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:57.317323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:57.331277 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43242037-0017-4dda-8cf4-a3ef82113af8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.188209 Sep 01 05:53:57.331904 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3488/7019] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:57 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:58.356888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:58.357812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:58.369366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:58.370171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:58.371036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:58.372092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:58.372857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:58.373548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:58.510146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:58.519425 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ee223cbb-40b0-4b16-94be-d2452064a205 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.168910 Sep 01 05:53:58.520017 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3532/7020] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:58 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:53:59.545750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:53:59.546631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:53:59.555714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:59.556229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:59.556691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:59.557420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:53:59.558176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:53:59.558609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:53:59.698255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:53:59.711089 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43284f64-83b5-46f0-948c-a7fc284df08f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.171694 Sep 01 05:53:59.712055 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3489/7021] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:53:59 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:00.739504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:00.740355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:00.750442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:00.751126 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:00.751705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:00.752619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:00.753219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:00.753899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:00.889533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:00.898799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68b2f9c1-0896-4f43-b3ee-0e0c6f12e1df tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.164640 Sep 01 05:54:00.899758 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3533/7022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:00 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:01.924791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:01.925633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:01.937973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:01.938772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:01.939567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:01.940727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:01.941760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:01.942169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:02.083968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:02.092687 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7acf7fc-b424-405d-951a-a14f016da7cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.174755 Sep 01 05:54:02.093278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3490/7023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:01 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:03.116669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:03.117335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:03.124626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:03.125109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:03.125540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:03.126226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:03.126681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:03.127139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:03.271698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:03.280787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15a6a6a2-49ab-4e6c-ac89-d546466201e6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.169611 Sep 01 05:54:03.281370 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3534/7024] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:03 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:04.304642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:04.305420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:04.314595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:04.315296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:04.315898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:04.317021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:04.317675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:04.318254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:04.455435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:04.465118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0a0f204-1686-4b8d-af1a-d481a3133b4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.166486 Sep 01 05:54:04.465715 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3491/7025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:04 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:05.495851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:05.497720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:05.508464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:05.508946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:05.509383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:05.510081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:05.510533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:05.510997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:05.655791 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:05.664815 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21f96439-d957-43cb-8385-a4d25b9a3d35 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.181158 Sep 01 05:54:05.665373 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3535/7026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:05 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:06.689809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:06.690463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:06.699162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:06.699823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:06.700205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:06.701104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:06.701784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:06.702467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:06.840089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:06.851846 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e98467c9-2dcc-4e49-92f8-ef4a81b911f9 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.168669 Sep 01 05:54:06.852433 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3492/7027] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:06 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:07.873542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:07.874173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:07.881995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:07.882481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:07.882928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:07.883650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:07.884109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:07.884535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:08.033823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:08.042517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a0c4097-1e81-41f1-8192-236e4b91c3b6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.173085 Sep 01 05:54:08.043164 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3536/7028] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:07 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:09.064361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:09.064985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:09.072862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:09.073383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:09.073834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:09.074539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:09.075073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:09.075514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:09.215210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:09.227396 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acf317b6-f571-49c7-8f7e-39dc2cdba3c3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.167044 Sep 01 05:54:09.227978 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3493/7029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:09 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:54:10.249668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:10.250328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:10.257438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:10.257848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:10.258278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:10.258998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:10.259451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:10.259865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:10.401884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:10.411185 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fffae08-290c-475e-95ea-3c0bb2046263 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1732 microversion: 2.1 time: 0.166121 Sep 01 05:54:10.411824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3537/7030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:10 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:11.432532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:11.433131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:11.440807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:11.441259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:11.441712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:11.442461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:11.443116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:11.443568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:11.584002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:11.592638 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6dc2537a-20e3-4f46-90fc-ccf34da8593c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1731 microversion: 2.1 time: 0.164099 Sep 01 05:54:11.593261 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3494/7031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:11 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:11.944598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "name": "network-vif-unplugged", "status": "completed", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:11.958292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:11.958833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:11.959481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:11.972113 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] Creating event network-vif-unplugged:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h1-820368-37 Sep 01 05:54:11.977766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:54:11.990257 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-755d804d-5a44-42d6-a292-77a50f43c60d req-852ff937-58f6-4472-9cc3-7c1e21db1150 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050432 Sep 01 05:54:11.991198 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3538/7032] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:12.615292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:12.615902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:12.623678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:12.624185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:12.624642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:12.625361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:12.625835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:12.626298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:12.766902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:12.776887 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7caffbf-1f7f-4b0e-878f-6e739bdb5eb3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1731 microversion: 2.1 time: 0.165697 Sep 01 05:54:12.777480 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3495/7033] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:12 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:13.799863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:13.800563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:13.807408 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:13.807899 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:13.808332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:13.809067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:13.809522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:13.809946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:13.949041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:13.958150 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c9bfced-890e-420b-90ff-675804620498 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.163613 Sep 01 05:54:13.958837 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3539/7034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:13 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:14.028112 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:14.038916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:14.039424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:14.039869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:14.055134 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] Creating event network-changed:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h1-820368-37 Sep 01 05:54:14.061105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:54:14.072332 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b9fc1815-ebc6-4839-80f9-aaf4870a6c00 req-44f7b52d-a268-4913-b431-544450413bb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048298 Sep 01 05:54:14.072949 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3496/7035] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:14.980642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:14.981266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:14.988732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:14.989224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:14.989670 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:14.990479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:14.990920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:14.991375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:15.126081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:15.128486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:15.136265 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc2a01c4-3bb9-4849-a21f-f11f06506a9d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.159612 Sep 01 05:54:15.136829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3540/7036] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:14 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:16.159563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:16.160380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:16.162498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:16.168530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:16.169034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:16.169481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:16.170193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:16.170667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:16.171135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:16.173823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=83 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:16.309962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:16.318756 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1dbb8dd7-8466-4164-bb4a-c12e1872fbe1 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.164517 Sep 01 05:54:16.319343 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3497/7037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:16 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:17.340959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:17.341532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:17.344163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=35 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:17.350101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:17.350582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:17.351039 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:17.351732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:17.352187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:17.352602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:17.488435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:17.497361 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-616f359d-f087-46d8-98ad-3a92885d1b3e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.161072 Sep 01 05:54:17.497961 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3541/7038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:17 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:18.523317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:18.523976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:18.532060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:18.532572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:18.533038 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:18.533777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:18.534267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:18.534719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:18.672903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:18.681545 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2eca7a0b-92e7-462d-afd2-1123d09be192 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.164134 Sep 01 05:54:18.682096 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3498/7039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:18 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:19.705446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:19.706146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:19.717423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:19.718250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:19.719277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:19.720439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:19.721213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:19.721935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:19.859341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:19.868144 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91b02add-5dc9-4f24-90c3-7629575acbd6 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.168062 Sep 01 05:54:19.868734 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3542/7040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:19 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:20.893364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:20.893986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:20.902908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:20.903444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:20.903892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:20.904594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:20.905070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:20.905509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:21.042083 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:21.055455 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6a590b9-6e42-4a6b-b6e2-bc3f79f35829 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.168258 Sep 01 05:54:21.056269 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3499/7041] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:20 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:22.084719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:22.085702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:22.096910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:22.097616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:22.098288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:22.099484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:22.099948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:22.100378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:22.238143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:22.248155 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1370ec15-c904-40da-8c4c-e44915b425da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.169709 Sep 01 05:54:22.248766 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3543/7042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:22 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:23.271113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:23.271790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:23.280261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:23.280819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:23.281325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:23.282114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:23.282635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:23.283161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:23.420847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:23.429715 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b555fab3-9464-48e2-8a52-af43b13169bd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.163186 Sep 01 05:54:23.430334 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3500/7043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:23 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:24.457399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:24.457969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:24.465412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:24.465900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:24.466302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:24.467063 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:24.467495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:24.467916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:24.616829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:24.625829 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3400431-92df-43da-b493-de82b11bf25d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1729 microversion: 2.1 time: 0.173282 Sep 01 05:54:24.626403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3544/7044] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:24 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:25.650322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:25.650976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:25.661869 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:25.662735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:25.663221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:25.663925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:25.664396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:25.664835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:25.820668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:25.829356 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7bfce8e8-bcc8-4eeb-9bb8-a7456c1534a4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1726 microversion: 2.1 time: 0.185688 Sep 01 05:54:25.829944 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3501/7045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:25 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:25.852001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:25.852544 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:25.860158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:25.860651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:25.861093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:25.861792 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:25.862254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:25.862684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:25.904641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:25.905044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:25.905476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:25.906203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:25.906655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:25.907122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:25.928322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:54:25.934017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Getting quotas for user 6c95f8442f8e4b0abf1126495f5302d4 and project 757ad4b9aede4f4ba49859e4ca063939. Resources: {'ram', 'cores'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:54:26.047528 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c670c07-57f6-49d7-9c1c-ca5ddf95885d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "POST /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/action" status: 202 len: 0 microversion: 2.1 time: 0.200875 Sep 01 05:54:26.048155 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3545/7046] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:54:25 2022] POST /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:54:26.057172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:26.057920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:26.064170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:26.064688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:26.065134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:26.065841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:26.066310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:26.066727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:26.203200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:26.216583 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7dbc193-2a0d-43e9-b654-3f33d11edb9a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.162969 Sep 01 05:54:26.217350 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3502/7047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:26 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:27.244075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:27.245812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:27.257807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:27.258228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:27.258656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:27.259388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:27.259839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:27.260256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:27.417338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:27.429552 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5d182c4-e457-48d9-a5fc-4363f48c65fa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.193544 Sep 01 05:54:27.430152 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3546/7048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:27 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:28.398330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "name": "network-vif-plugged", "status": "completed", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:28.411805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:28.412679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:28.413320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:28.435625 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] Creating event network-vif-plugged:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h1-820368-37 Sep 01 05:54:28.441859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:54:28.453309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:28.453999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:28.463459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:28.464275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:28.465153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:28.465715 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8f03cb3f-413f-43a4-b86a-ad3c08796aee req-cf794c76-403e-40fe-816b-f3cea6b0d482 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071937 Sep 01 05:54:28.466293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:28.467000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:28.467617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:28.468686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3503/7049] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:28.605290 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:28.614062 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d11dab4-a4d5-4b58-8a87-ec7527f9cf76 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.165556 Sep 01 05:54:28.614645 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3547/7050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:28 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:54:29.637997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:29.638586 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:29.645457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:29.645952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:29.646399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:29.647216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:29.647663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:29.648120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:29.787246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:29.795956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9e42356-f408-4ffd-ae6b-17c03cb35d2e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.163211 Sep 01 05:54:29.796516 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3504/7051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:29 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:30.819892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:30.821414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:30.829578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:30.830068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:30.830498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:30.831231 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:30.831678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:30.832097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:31.023755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:31.032826 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6b85bae7-1192-44ae-b2dc-44da75fa4286 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.218705 Sep 01 05:54:31.033397 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3548/7052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:30 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:31.319982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "name": "network-vif-unplugged", "status": "completed", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:31.330550 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:31.330965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:31.331529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:31.344593 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] Creating event network-vif-unplugged:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:54:31.350251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:54:31.361648 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dc315e1f-2f3d-444e-8782-38722e26371f req-04cc306d-8f4c-4e4e-8b2e-538cc4532f77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046028 Sep 01 05:54:31.362262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3505/7053] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:32.055311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:32.055930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:32.063181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:32.063693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:32.064129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:32.064830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:32.065284 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:32.065715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:32.280448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:32.289565 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aeb56bbc-6c04-4a08-a7bc-12c613d9046b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.238327 Sep 01 05:54:32.290411 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3549/7054] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:32 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:33.312938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:33.313669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:33.320173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:33.320730 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:33.321244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:33.322012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:33.322553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:33.323088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:33.699002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:33.710962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:33.711663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:33.712087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:33.724747 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] Creating event network-changed:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:54:33.730777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 05:54:33.749966 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-da89e942-b783-4585-a279-e3eea3120570 req-1935f271-3b4b-4f59-87f5-2033dac45708 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054915 Sep 01 05:54:33.750933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3550/7055] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:33.769735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:33.785829 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-170321d3-353e-4b44-a8a6-b4e4133eec16 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.477940 Sep 01 05:54:33.801112 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3506/7056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:33 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:34.808768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:34.809734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:34.817606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:34.818142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:34.818581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:34.819660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:34.820157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:34.820584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:34.969825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:34.979372 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de63abb0-3d09-4462-8d9a-41fb6a21241d tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.175042 Sep 01 05:54:34.980002 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3551/7057] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:34 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:36.001475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:36.002130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:36.009400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:36.009909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:36.010357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:36.011097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:36.011599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:36.012041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:36.196872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:36.205699 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c356cab7-c79c-466e-8282-2c259121349a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.208416 Sep 01 05:54:36.206299 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3507/7058] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:35 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:37.228102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:37.228735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:37.231902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:37.238453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:37.239011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:37.239489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:37.240236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:37.240759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:37.241420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:37.435747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:37.444425 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c1f633df-734e-4a3c-9eaf-143456115bfa tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.220970 Sep 01 05:54:37.445112 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3552/7059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:37 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:38.465656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:38.466245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:38.473870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:38.474370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:38.474824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:38.475768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:38.476488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:38.476935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:38.624831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:38.633821 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d50ef96-83e2-47ad-b2d8-27a1f206618f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.172383 Sep 01 05:54:38.634413 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3508/7060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:38 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:54:39.661014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:39.662067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:39.673308 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:39.674109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:39.674919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:39.676051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:39.676795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:39.677494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:39.826016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:39.837512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5e5c48a6-5c33-4a28-8e48-2f439d800d1f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.183285 Sep 01 05:54:39.838109 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3553/7061] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:39 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:40.859795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:40.860438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:40.867601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:40.868098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:40.868542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:40.869241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:40.869709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:40.870141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:41.020769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:41.030167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9e14663-7966-473f-b5d4-bc97697b616f tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.174705 Sep 01 05:54:41.030915 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3509/7062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:40 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:42.052312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:42.052805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:42.060434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:42.060922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:42.061361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:42.062056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:42.062518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:42.062949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:42.210512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:42.213794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:42.224200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-61226756-345c-42f1-8e80-36ba5ed4efc0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.175718 Sep 01 05:54:42.225001 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3554/7063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:42 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:43.250160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:43.251237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:43.263030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:43.263815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:43.264556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:43.265746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:43.266514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:43.267928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:43.408572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:43.417606 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8d87af8-8596-4bc4-94cf-00f92d4826cc tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.174117 Sep 01 05:54:43.418191 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3510/7064] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:43 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:44.445492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:44.446077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:44.453860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:44.454350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:44.454810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:44.455528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:44.455976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:44.456396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:44.599477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:44.608857 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3e219b10-ab7b-4012-b349-27f1038462d0 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.171587 Sep 01 05:54:44.609447 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3555/7065] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:44 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:45.630099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:45.630721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:45.638964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:45.639516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:45.640242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:45.640680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:45.641203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:45.641677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:45.785864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:45.795892 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c31e84b-f8cd-4576-abd9-95c1ff7d41cd tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1725 microversion: 2.1 time: 0.169857 Sep 01 05:54:45.796900 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3511/7066] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:45 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:46.817145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:46.817717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:46.825253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:46.825740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:46.826185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:46.826894 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:46.827365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:46.827788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:46.963951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:46.972479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae6aa145-e00b-42c9-b067-c640e9f42f4c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1718 microversion: 2.1 time: 0.159536 Sep 01 05:54:46.973062 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3556/7067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:46 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:46.994785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:46.995425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:46.998372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=30 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:47.005246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.005996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.006662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.008669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.009305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.009891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.013217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=86 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:47.151168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:47.159745 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93f8b28a-77c5-46a0-89a6-13f3b4b8aa2a tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1718 microversion: 2.1 time: 0.169972 Sep 01 05:54:47.160319 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3512/7068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:46 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:47.240925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:47.242210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:47.252723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.253387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.254037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.255058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.255637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.256310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.402627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:47.411413 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f41728e3-6f39-4e7e-b2f2-517613fbf504 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1718 microversion: 2.1 time: 0.177187 Sep 01 05:54:47.411998 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3557/7069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:47 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:47.432460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:47.432966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:47.439163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.439701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.440147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.440848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.441318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.441752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.468118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:54:47.556819 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44b3c531-1342-4f73-92b2-90da761d6974 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 204 len: 0 microversion: 2.1 time: 0.128072 Sep 01 05:54:47.557443 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3513/7070] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:54:47 2022] DELETE /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:54:47.565855 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:47.566465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:47.568426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:54:47.574199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.574682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.575177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.575869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.576325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.576745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.716224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:47.724729 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-689a0722-7732-4c9d-b86a-a2719088024c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1724 microversion: 2.1 time: 0.162812 Sep 01 05:54:47.725315 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3558/7071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:47 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:47.815656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4e591339-0fd9-4ea9-8acd-37fe9ceec14a req-b42ead20-a2d8-4753-95eb-ead1333d9373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "name": "network-vif-plugged", "status": "completed", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:47.825899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e591339-0fd9-4ea9-8acd-37fe9ceec14a req-b42ead20-a2d8-4753-95eb-ead1333d9373 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:47.826589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e591339-0fd9-4ea9-8acd-37fe9ceec14a req-b42ead20-a2d8-4753-95eb-ead1333d9373 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:47.827003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e591339-0fd9-4ea9-8acd-37fe9ceec14a req-b42ead20-a2d8-4753-95eb-ead1333d9373 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:47.839148 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4e591339-0fd9-4ea9-8acd-37fe9ceec14a req-b42ead20-a2d8-4753-95eb-ead1333d9373 service nova] Creating event network-vif-plugged:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:54:47.844092 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4e591339-0fd9-4ea9-8acd-37fe9ceec14a req-b42ead20-a2d8-4753-95eb-ead1333d9373 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Sep 01 05:54:47.844695 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3514/7072] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:48.749917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:48.750967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:48.760913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:48.761399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:48.761831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:48.762517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:48.762991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:48.763397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:48.903734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:48.916574 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10a0f25c-5698-44cb-a9e1-2fe12f96663b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1724 microversion: 2.1 time: 0.173259 Sep 01 05:54:48.917138 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3559/7073] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:48 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:49.939401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:49.940113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:49.947254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:49.947759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:49.948210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:49.948925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:49.949394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:49.949830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:50.047940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:50.057271 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0617120-81ea-4c09-9547-6804a484d4b2 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1656 microversion: 2.1 time: 0.122769 Sep 01 05:54:50.058017 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3515/7074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:49 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1656 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:50.325029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a6a8067b-5ea9-4d95-82f3-0f0a6ac5a41a req-76101073-72a0-4b4f-ad46-97097cdb866f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f35426-29e6-4769-8e88-8a0a7e35b46f", "name": "network-vif-deleted", "tag": "50eadf87-6ad9-4a17-be7a-58cb5524aa56"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:54:50.337365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a6a8067b-5ea9-4d95-82f3-0f0a6ac5a41a req-76101073-72a0-4b4f-ad46-97097cdb866f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:50.337849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a6a8067b-5ea9-4d95-82f3-0f0a6ac5a41a req-76101073-72a0-4b4f-ad46-97097cdb866f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:50.338267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a6a8067b-5ea9-4d95-82f3-0f0a6ac5a41a req-76101073-72a0-4b4f-ad46-97097cdb866f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:50.350147 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a6a8067b-5ea9-4d95-82f3-0f0a6ac5a41a req-76101073-72a0-4b4f-ad46-97097cdb866f service nova] Creating event network-vif-deleted:50eadf87-6ad9-4a17-be7a-58cb5524aa56 for instance d2f35426-29e6-4769-8e88-8a0a7e35b46f on n-h2-820368-37 Sep 01 05:54:50.355751 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a6a8067b-5ea9-4d95-82f3-0f0a6ac5a41a req-76101073-72a0-4b4f-ad46-97097cdb866f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 Sep 01 05:54:50.359071 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3560/7075] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:54:51.079919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:51.080506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:51.087912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:51.088416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:51.089084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:51.089810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:51.090280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:51.090745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:51.167669 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:51.177353 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aebe5e2c-f943-4e5b-85a4-1790e0511913 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1370 microversion: 2.1 time: 0.101616 Sep 01 05:54:51.178166 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3516/7076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:51 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:52.201140 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:52.201844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:52.208734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:52.209220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:52.209628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:52.210353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:52.210879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:52.211339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:52.277089 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:52.286634 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-dd29bda1-1f30-49e4-bb49-a854be595a5b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1370 microversion: 2.1 time: 0.090803 Sep 01 05:54:52.287420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3561/7077] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:52 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:53.308479 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:53.309264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:53.318057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:53.318531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:53.319003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:53.319712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:53.320264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:53.320727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:53.386699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:53.395743 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca5dd6b4-8582-4b80-b9ba-de98682221b8 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1370 microversion: 2.1 time: 0.091586 Sep 01 05:54:53.396324 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3517/7078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:53 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:54.417490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:54.418053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:54.428636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:54.429124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:54.429714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:54.430418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:54.431120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:54.431564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:54.494493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c95f8442f8e4b0abf1126495f5302d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757ad4b9aede4f4ba49859e4ca063939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:54:54.503216 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-94e1961d-a568-4539-814d-8dd45834a3bf tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 200 len: 1370 microversion: 2.1 time: 0.089962 Sep 01 05:54:54.503759 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3562/7079] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:54 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 1370 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:54:55.529903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:55.530921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:55.541537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:55.542058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:55.542516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:55.543270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:55.543745 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:55.544190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:55.558713 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f HTTP/1.1 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'd2f35426-29e6-4769-8e88-8a0a7e35b46f'} Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:55.560432 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d1764ee-c08b-4b43-ad80-c69b70d199f3 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 404 len: 111 microversion: 2.1 time: 0.039186 Sep 01 05:54:55.564894 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3518/7080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:55 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:55.633124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:55.635365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:55.642504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:55.643040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:55.643479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:55.644212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:55.644668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:55.645096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:55.658773 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-volume_attachments HTTP/1.1 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': 'd2f35426-29e6-4769-8e88-8a0a7e35b46f'} Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:55.660508 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8d56cc93-f904-4932-8026-016d362f1a8b tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033049 Sep 01 05:54:55.664928 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3563/7081] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:54:55 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:58.999704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.000317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.007526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.007982 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.008445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.009171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.009755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.010212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.026810 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f HTTP/1.1 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'd2f35426-29e6-4769-8e88-8a0a7e35b46f'} Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.028431 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad232e71-5c98-4077-874b-506cf297116e tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 404 len: 111 microversion: 2.1 time: 0.034307 Sep 01 05:54:59.032173 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3519/7082] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:54:58 2022] DELETE /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.038495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.039168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: d2f35426-29e6-4769-8e88-8a0a7e35b46f] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.046451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.046954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.047384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.048067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.048519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.048938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.062708 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f HTTP/1.1 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd2f35426-29e6-4769-8e88-8a0a7e35b46f'} Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.064316 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance d2f35426-29e6-4769-8e88-8a0a7e35b46f could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c68292e2-c94b-41fc-9f8b-2c737f8934ba tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f" status: 404 len: 111 microversion: 2.1 time: 0.031093 Sep 01 05:54:59.068813 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3564/7083] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:59 2022] GET /compute/v2.1/servers/d2f35426-29e6-4769-8e88-8a0a7e35b46f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:54:59.074565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.075138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.081813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.082313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.082764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.083519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.083977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.084579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.100512 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 HTTP/1.1 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'e58030a2-ecb9-4e87-8d22-6212040e6464'} Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.102212 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee8235f4-c500-404b-bfcc-18972141c722 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 404 len: 111 microversion: 2.1 time: 0.033417 Sep 01 05:54:59.109532 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3520/7084] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:54:59 2022] DELETE /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.115716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.116336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: e58030a2-ecb9-4e87-8d22-6212040e6464] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.122954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.123449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.123885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.124591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.125055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.125471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.140204 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 HTTP/1.1 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'e58030a2-ecb9-4e87-8d22-6212040e6464'} Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.141754 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance e58030a2-ecb9-4e87-8d22-6212040e6464 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-043a04fb-4efb-4791-b076-38531a8923ac tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464" status: 404 len: 111 microversion: 2.1 time: 0.031464 Sep 01 05:54:59.145943 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3565/7085] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:59 2022] GET /compute/v2.1/servers/e58030a2-ecb9-4e87-8d22-6212040e6464 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.152885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.153367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.159795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.160295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.160741 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.161452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.162058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.162846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.176536 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 HTTP/1.1 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '3aba5165-782c-49f5-84d6-f47ef9f9c567'} Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.178142 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d1dba5c-c352-49f8-806c-22815bd3325c tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 404 len: 111 microversion: 2.1 time: 0.031170 Sep 01 05:54:59.182121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3521/7086] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:54:59 2022] DELETE /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.188839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.189555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 3aba5165-782c-49f5-84d6-f47ef9f9c567] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.196208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.196771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.197276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.198079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.198534 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.198951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.215883 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 HTTP/1.1 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '3aba5165-782c-49f5-84d6-f47ef9f9c567'} Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.217436 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 3aba5165-782c-49f5-84d6-f47ef9f9c567 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de5a7479-d8e6-42ca-bf8b-2f1657363064 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567" status: 404 len: 111 microversion: 2.1 time: 0.034006 Sep 01 05:54:59.221310 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3566/7087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:59 2022] GET /compute/v2.1/servers/3aba5165-782c-49f5-84d6-f47ef9f9c567 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.227779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.228321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.234802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.235333 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.235787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.236493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.236959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.237394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.251613 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 HTTP/1.1 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '7ed78b01-7cc7-4e0a-bce1-636a999b9d96'} Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.253230 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4d5c19a-56dc-4b42-b316-20f85583be14 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 404 len: 111 microversion: 2.1 time: 0.030911 Sep 01 05:54:59.257318 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3522/7088] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:54:59 2022] DELETE /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.263416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.263966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] [instance: 7ed78b01-7cc7-4e0a-bce1-636a999b9d96] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:54:59.270735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.271268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.271708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.272398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:54:59.272820 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:54:59.273686 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:54:59.288348 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] HTTP exception thrown: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Request method failure captured: Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 HTTP/1.1 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEdUBy6ilB-6BMNSCJFU0_AsgFjMnX7_odsWHYCvPtpKA1ZCC3jEtELxzmK4adSYiF5_GelRKpS9_WAwm0pzdWSS5AfcjABdvgErXW2g-J-nFTtcE35zojI7f6ps36BBNIQW-oezzD3UmHt5cvot2sKDkoLvCSU0keHKZ8pPa2J1Kjw Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/757ad4b9aede4f4ba49859e4ca063939"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 757ad4b9aede4f4ba49859e4ca063939 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServerActionsTestJSON-1545588609 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 6c95f8442f8e4b0abf1126495f5302d4 Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServerActionsTestJSON-1545588609-project Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '7ed78b01-7cc7-4e0a-bce1-636a999b9d96'} Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:54:59.290057 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Returning 404 to user: Instance 7ed78b01-7cc7-4e0a-bce1-636a999b9d96 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04be0654-ed6c-416e-980d-1af448dc08f4 tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96" status: 404 len: 111 microversion: 2.1 time: 0.032169 Sep 01 05:54:59.297016 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3567/7089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:54:59 2022] GET /compute/v2.1/servers/7ed78b01-7cc7-4e0a-bce1-636a999b9d96 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:54:59.305782 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-414a9d63-876e-407b-a0a8-8fd8e10650da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] Calling method '.version_select at 0x7fa75b0a9280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:54:59.332165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-414a9d63-876e-407b-a0a8-8fd8e10650da tempest-ServerActionsTestJSON-1545588609 tempest-ServerActionsTestJSON-1545588609-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415424487" status: 202 len: 0 microversion: 2.1 time: 0.031127 Sep 01 05:54:59.332750 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3523/7090] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 1 05:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415424487 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:55:09.267523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=19 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:09.279245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=55 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:09.376755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-404899011", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "0889a210-3b07-44fe-bc1b-1c9aa22da490"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:09.432742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] validate_networks() for [('0889a210-3b07-44fe-bc1b-1c9aa22da490', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:55:09.816332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:55:09.816913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:55:09.817514 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:55:09.817987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:55:09.818482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:55:09.828130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:09.828700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:09.829288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:09.830017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:09.830537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:09.831061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:09.849515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Getting quotas for project f9ba5c7f3ea84a05b96b4288fbfe0b1d. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:55:09.855441 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Getting quotas for user ef9c87f9ca604675bbab0b511b60e5b1 and project f9ba5c7f3ea84a05b96b4288fbfe0b1d. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:55:09.869333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:55:09.871920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:55:09.922929 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e45920df-57b3-4089-b9c9-a0fa249d3e1e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690327 Sep 01 05:55:09.923824 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3568/7091] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:55:09.935611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0689eaa8-2b64-4179-bbe3-ec6ba71183ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:09.936234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0689eaa8-2b64-4179-bbe3-ec6ba71183ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:09.940716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:09.941834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:10.013897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0689eaa8-2b64-4179-bbe3-ec6ba71183ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:10.025913 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0689eaa8-2b64-4179-bbe3-ec6ba71183ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1216 microversion: 2.1 time: 0.093820 Sep 01 05:55:10.027219 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3524/7092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:09 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:11.050744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:11.052253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:11.065222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:11.066183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:11.066897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:11.068574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:11.069273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:11.070926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:11.174278 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:11.183517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b986a8e-6e63-4225-a72d-dac09b370724 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1286 microversion: 2.1 time: 0.138275 Sep 01 05:55:11.184264 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3569/7093] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:11 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:12.205958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:12.206590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:12.213851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.214357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.214810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:12.215660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.216134 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.216574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:12.363789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:12.371826 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d8b9da5-3b19-4140-9cd0-4c9cee0e6387 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1316 microversion: 2.1 time: 0.169939 Sep 01 05:55:12.372411 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3525/7094] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:12 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:12.483356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-d229b69f-7269-4015-a569-6355851c182c req-fb2062db-08e1-4b8c-8009-a6d6d5212a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e1da80-57c5-484b-a8a3-9dbad25acdc8", "tag": "6b0bd80e-b938-4be6-8f43-0e6377daa6ee"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:12.495202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d229b69f-7269-4015-a569-6355851c182c req-fb2062db-08e1-4b8c-8009-a6d6d5212a1f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:12.496104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d229b69f-7269-4015-a569-6355851c182c req-fb2062db-08e1-4b8c-8009-a6d6d5212a1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:12.496246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-d229b69f-7269-4015-a569-6355851c182c req-fb2062db-08e1-4b8c-8009-a6d6d5212a1f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:12.509118 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-d229b69f-7269-4015-a569-6355851c182c req-fb2062db-08e1-4b8c-8009-a6d6d5212a1f service nova] Creating event network-changed:6b0bd80e-b938-4be6-8f43-0e6377daa6ee for instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 on n-h1-820368-37 Sep 01 05:55:12.514139 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-d229b69f-7269-4015-a569-6355851c182c req-fb2062db-08e1-4b8c-8009-a6d6d5212a1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093337 Sep 01 05:55:12.514748 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3570/7095] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:55:13.396089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:13.396692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:13.405784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:13.406272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:13.406718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:13.407459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:13.407930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:13.408368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:13.549838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:13.561864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a2d51b2-6b4a-4a6f-aecd-4ff43e08fec9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1316 microversion: 2.1 time: 0.171392 Sep 01 05:55:13.562536 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3526/7096] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:13 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:14.585016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:14.585743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:14.592822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:14.593305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:14.593778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:14.594477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:14.594917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:14.595364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:14.734375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:14.742683 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb9f5fc4-8843-4416-9eae-29781940d1d2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1316 microversion: 2.1 time: 0.163906 Sep 01 05:55:14.743351 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3571/7097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:14 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:15.765037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:15.765767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:15.768208 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:55:15.768383 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 05:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 (ip 10.222.0.26) !!! Sep 01 05:55:15.776962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:15.777517 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:15.778023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:15.778810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:15.779364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:15.779852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:15.914521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:15.923448 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e9dd8c4-7f55-429e-9ff7-41630a81a458 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1316 microversion: 2.1 time: 0.162934 Sep 01 05:55:15.924036 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3527/7098] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:15 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:16.607226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-e3bc94a7-8bcb-4ec0-908b-69b4f56d7423 req-df9a2fbf-7853-456e-86b4-c43481cfa349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e1da80-57c5-484b-a8a3-9dbad25acdc8", "name": "network-vif-plugged", "status": "completed", "tag": "6b0bd80e-b938-4be6-8f43-0e6377daa6ee"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:16.616929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3bc94a7-8bcb-4ec0-908b-69b4f56d7423 req-df9a2fbf-7853-456e-86b4-c43481cfa349 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:16.617403 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3bc94a7-8bcb-4ec0-908b-69b4f56d7423 req-df9a2fbf-7853-456e-86b4-c43481cfa349 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:16.617884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-e3bc94a7-8bcb-4ec0-908b-69b4f56d7423 req-df9a2fbf-7853-456e-86b4-c43481cfa349 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:16.629380 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-e3bc94a7-8bcb-4ec0-908b-69b4f56d7423 req-df9a2fbf-7853-456e-86b4-c43481cfa349 service nova] Creating event network-vif-plugged:6b0bd80e-b938-4be6-8f43-0e6377daa6ee for instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 on n-h1-820368-37 Sep 01 05:55:16.634310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-e3bc94a7-8bcb-4ec0-908b-69b4f56d7423 req-df9a2fbf-7853-456e-86b4-c43481cfa349 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089617 Sep 01 05:55:16.634935 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3572/7099] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:55:16.944899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:16.945513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:16.953174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:16.953700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:16.954172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:16.954921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:16.955430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:16.955915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:17.092649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:17.101105 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2dd8779-b0b4-484f-856a-24a0a110d225 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1316 microversion: 2.1 time: 0.160634 Sep 01 05:55:17.101686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3528/7100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:16 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:18.128460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:18.129458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:18.137865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:18.138338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:18.138765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:18.139481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:18.139927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:18.140346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:18.292160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:18.304416 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cf8838f-08e5-4b0c-a80e-3fb679ce27b5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.184320 Sep 01 05:55:18.305279 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3573/7101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:18 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:18.367482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2115895851", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "0889a210-3b07-44fe-bc1b-1c9aa22da490"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:18.432204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] validate_networks() for [('0889a210-3b07-44fe-bc1b-1c9aa22da490', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:55:18.871140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:55:18.871605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:55:18.872099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:55:18.872544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:55:18.872967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:55:18.883090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:18.883588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:18.884129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:18.884897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:18.885362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:18.885797 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:18.903723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Getting quotas for project f9ba5c7f3ea84a05b96b4288fbfe0b1d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:55:18.909130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Getting quotas for user ef9c87f9ca604675bbab0b511b60e5b1 and project f9ba5c7f3ea84a05b96b4288fbfe0b1d. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:55:18.923509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:55:18.925850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:55:18.977608 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91a529eb-bc7d-40d2-b7d6-a06bb5e126bf tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614031 Sep 01 05:55:18.984535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3529/7102] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:55:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:55:18.989860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecd3df27-30d5-4e5f-afff-1de20eef5337 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:18.990473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecd3df27-30d5-4e5f-afff-1de20eef5337 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:19.056630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecd3df27-30d5-4e5f-afff-1de20eef5337 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:19.063184 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecd3df27-30d5-4e5f-afff-1de20eef5337 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1217 microversion: 2.1 time: 0.077256 Sep 01 05:55:19.063760 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3574/7103] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:18 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:20.085290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:20.085947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:20.093485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:20.093991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:20.094446 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:20.095197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:20.095679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:20.096130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:20.163577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:20.171849 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1000a390-db63-4eb2-9621-66a9f300f08c tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1269 microversion: 2.1 time: 0.091706 Sep 01 05:55:20.172435 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3530/7104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:20 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:21.193356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:21.193964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:21.196871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:21.203336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:21.203870 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:21.204283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:21.204976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:21.205421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:21.205835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:21.397080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:21.406192 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-73eec05c-618c-4359-9639-2e89b183fc79 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.216724 Sep 01 05:55:21.406814 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3575/7105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:21 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:21.681961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2ad65228-9b47-46f9-b3fc-c289455946a0 req-1c0d357f-6867-4868-9b10-4be7908d64ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb476dbd-2ee4-4fa6-9164-efb997c1664e", "tag": "5c3004d4-34bf-40df-990b-038846502467"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:21.691401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ad65228-9b47-46f9-b3fc-c289455946a0 req-1c0d357f-6867-4868-9b10-4be7908d64ad service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:21.691890 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ad65228-9b47-46f9-b3fc-c289455946a0 req-1c0d357f-6867-4868-9b10-4be7908d64ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:21.692329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ad65228-9b47-46f9-b3fc-c289455946a0 req-1c0d357f-6867-4868-9b10-4be7908d64ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:21.703516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2ad65228-9b47-46f9-b3fc-c289455946a0 req-1c0d357f-6867-4868-9b10-4be7908d64ad service nova] Creating event network-changed:5c3004d4-34bf-40df-990b-038846502467 for instance eb476dbd-2ee4-4fa6-9164-efb997c1664e on n-h2-820368-37 Sep 01 05:55:21.708980 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2ad65228-9b47-46f9-b3fc-c289455946a0 req-1c0d357f-6867-4868-9b10-4be7908d64ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097128 Sep 01 05:55:21.709606 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3531/7106] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:55:22.427749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:22.428398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:22.436123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:22.436603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:22.437028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:22.437708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:22.438160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:22.438558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:22.578158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:22.589243 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1734ca02-7aea-463d-9d27-4b2b3734a6b8 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.165183 Sep 01 05:55:22.590044 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3576/7107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:22 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:23.617993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:23.619380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:23.625953 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:23.626448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:23.626933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:23.627631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:23.628099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:23.628534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:23.766094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:23.774432 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07cf9f2c-cf07-4925-ac40-9fedc234bf7d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.164909 Sep 01 05:55:23.775182 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3532/7108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:23 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:24.799854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:24.800502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:24.810651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:24.811406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:24.812004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:24.813036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:24.813654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:24.814302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:24.956552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:24.973865 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e8f8f70-d54b-42cc-8d95-b8c9ebbd2b46 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.180139 Sep 01 05:55:24.974683 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3577/7109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:24 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:26.002077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:26.002862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:26.010805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:26.011394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:26.011859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:26.012634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:26.013280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:26.013882 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:26.160824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:26.169844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5df3cf89-f5cd-4d71-982a-c9b3485ce0a5 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.176881 Sep 01 05:55:26.170387 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3533/7110] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:25 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:27.195845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:27.197056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:27.204606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:27.205094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:27.205530 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:27.206219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:27.206696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:27.207155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:27.354299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:27.362470 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ac9bdfda-b9d2-4b5b-9b66-028b40749306 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.173194 Sep 01 05:55:27.363086 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3578/7111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:27 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:28.108476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3171dab4-50e7-4a57-8bc6-b6c7a6495e68 req-90aab82e-29ff-4218-a5e0-b3a9f3061fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb476dbd-2ee4-4fa6-9164-efb997c1664e", "name": "network-vif-plugged", "status": "completed", "tag": "5c3004d4-34bf-40df-990b-038846502467"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:28.119378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3171dab4-50e7-4a57-8bc6-b6c7a6495e68 req-90aab82e-29ff-4218-a5e0-b3a9f3061fb0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:28.119853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3171dab4-50e7-4a57-8bc6-b6c7a6495e68 req-90aab82e-29ff-4218-a5e0-b3a9f3061fb0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:28.120397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3171dab4-50e7-4a57-8bc6-b6c7a6495e68 req-90aab82e-29ff-4218-a5e0-b3a9f3061fb0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:28.133364 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3171dab4-50e7-4a57-8bc6-b6c7a6495e68 req-90aab82e-29ff-4218-a5e0-b3a9f3061fb0 service nova] Creating event network-vif-plugged:5c3004d4-34bf-40df-990b-038846502467 for instance eb476dbd-2ee4-4fa6-9164-efb997c1664e on n-h2-820368-37 Sep 01 05:55:28.138700 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3171dab4-50e7-4a57-8bc6-b6c7a6495e68 req-90aab82e-29ff-4218-a5e0-b3a9f3061fb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Sep 01 05:55:28.139318 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3534/7112] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:55:28.385995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:28.386606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:28.394029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:28.394520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:28.394985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:28.395693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:28.396145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:28.396570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:28.539903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:28.548577 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c5f41589-aa99-4cec-86a7-c4c451f5229e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.168334 Sep 01 05:55:28.549133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3579/7113] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:28 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:29.572760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:29.573473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:29.575522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:29.576205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:29.583315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:29.583893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:29.584370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:29.585154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:29.585676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:29.586145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:29.727400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:29.735931 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95798b4d-af97-44c2-9f08-da85c6615827 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1317 microversion: 2.1 time: 0.167574 Sep 01 05:55:29.736443 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3535/7114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:29 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:30.759770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:30.761068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:30.763027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:30.771023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:30.771575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:30.772156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:30.772866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:30.773320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:30.773761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:30.913247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:30.921933 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2384fa6d-3e8b-4287-896f-45b2e9fe806a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1506 microversion: 2.1 time: 0.167610 Sep 01 05:55:30.922479 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3580/7115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:30 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:30.942269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:30.942787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:30.949758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:30.950310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:30.950780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:30.951539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:30.952007 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:30.952525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:30.979444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:55:31.067912 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6280ff70-7e50-4773-8d80-c151e0540179 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 204 len: 0 microversion: 2.1 time: 0.128992 Sep 01 05:55:31.071643 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3536/7116] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:55:30 2022] DELETE /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:55:31.077101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:31.077721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:31.083938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:31.084429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:31.084861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:31.085560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:31.086017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:31.086462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:31.219019 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:31.227102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf5629e3-b920-403a-b591-dac3fb1bb57b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1512 microversion: 2.1 time: 0.154086 Sep 01 05:55:31.227692 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3581/7117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:31 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:32.253952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:32.255091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:32.265385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:32.265803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:32.266263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:32.267001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:32.267468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:32.267904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:32.416951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:32.425299 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e43edc3b-ae05-44a3-98f7-fb5f5ad4c76a tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1512 microversion: 2.1 time: 0.179194 Sep 01 05:55:32.425873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3537/7118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:32 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:33.447196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:33.447916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:33.455259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:33.455868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:33.456404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:33.457178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:33.457877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:33.458266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:33.716940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c1036174-5c3a-4f2a-a4c9-d58115388a0c req-fea7f0b9-fe75-4762-97fe-99cd9eea77a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb476dbd-2ee4-4fa6-9164-efb997c1664e", "name": "network-vif-deleted", "tag": "5c3004d4-34bf-40df-990b-038846502467"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:33.724331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:33.735848 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c2f4e81-0237-414e-bdd4-def59250f65e tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 200 len: 1512 microversion: 2.1 time: 0.292765 Sep 01 05:55:33.738647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1036174-5c3a-4f2a-a4c9-d58115388a0c req-fea7f0b9-fe75-4762-97fe-99cd9eea77a7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:33.739382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1036174-5c3a-4f2a-a4c9-d58115388a0c req-fea7f0b9-fe75-4762-97fe-99cd9eea77a7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:33.740004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c1036174-5c3a-4f2a-a4c9-d58115388a0c req-fea7f0b9-fe75-4762-97fe-99cd9eea77a7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:33.752514 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c1036174-5c3a-4f2a-a4c9-d58115388a0c req-fea7f0b9-fe75-4762-97fe-99cd9eea77a7 service nova] Creating event network-vif-deleted:5c3004d4-34bf-40df-990b-038846502467 for instance eb476dbd-2ee4-4fa6-9164-efb997c1664e on n-h2-820368-37 Sep 01 05:55:33.755187 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3582/7119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:33 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:33.759452 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c1036174-5c3a-4f2a-a4c9-d58115388a0c req-fea7f0b9-fe75-4762-97fe-99cd9eea77a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044882 Sep 01 05:55:33.760410 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3538/7120] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:55:34.757992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:34.758584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:34.766028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:34.766517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:34.766945 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:34.767659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:34.768105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:34.768561 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:34.783264 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] HTTP exception thrown: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e HTTP/1.1 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'eb476dbd-2ee4-4fa6-9164-efb997c1664e'} Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:34.784943 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 404 to user: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fbf9b565-26f1-4779-acb9-26e98fd00b7b tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 404 len: 111 microversion: 2.1 time: 0.032370 Sep 01 05:55:34.788803 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3583/7121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:34 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:55:34.798756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:34.799507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:34.806330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:34.806830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:34.807322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:34.808073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:34.808546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:34.808994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:34.952631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:34.961844 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcdc84fc-0bd0-4313-a134-66b095340291 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.169289 Sep 01 05:55:34.962429 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3539/7122] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:34 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:34.982780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aacd31df-3a52-4225-8806-51c2d83d9670 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:34.985397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aacd31df-3a52-4225-8806-51c2d83d9670 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: d1ce64f8-c127-44ce-a563-2c186a46bc5b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:34.991435 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-aacd31df-3a52-4225-8806-51c2d83d9670 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] HTTP exception thrown: Instance d1ce64f8-c127-44ce-a563-2c186a46bc5b could not be found. Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aacd31df-3a52-4225-8806-51c2d83d9670 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/d1ce64f8-c127-44ce-a563-2c186a46bc5b/action HTTP/1.1 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 32 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: {"resize": {"flavorRef": "452"}} Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d1ce64f8-c127-44ce-a563-2c186a46bc5b could not be found. Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd1ce64f8-c127-44ce-a563-2c186a46bc5b', 'body': {'resize': {'flavorRef': '452'}}} Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ce64f8-c127-44ce-a563-2c186a46bc5b could not be found. Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:55:34.993028 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ce64f8-c127-44ce-a563-2c186a46bc5b could not be found. Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ce64f8-c127-44ce-a563-2c186a46bc5b could not be found. Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aacd31df-3a52-4225-8806-51c2d83d9670 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 404 to user: Instance d1ce64f8-c127-44ce-a563-2c186a46bc5b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aacd31df-3a52-4225-8806-51c2d83d9670 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "POST /compute/v2.1/servers/d1ce64f8-c127-44ce-a563-2c186a46bc5b/action" status: 404 len: 111 microversion: 2.1 time: 0.016053 Sep 01 05:55:34.997500 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3584/7123] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:55:34 2022] POST /compute/v2.1/servers/d1ce64f8-c127-44ce-a563-2c186a46bc5b/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:55:35.005052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:35.005691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:35.012458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.012884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.013337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.014059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.014628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.015105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.152001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:35.160609 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0a84c1f-87fe-4981-9a82-121567fb0eab tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.159765 Sep 01 05:55:35.161188 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3540/7124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:34 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:35.182147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:35.182746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:35.189952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.190429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.190856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.191598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.192049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.192468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.323993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:35.332436 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0261bd40-0497-4097-b359-be1c8189f318 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.154231 Sep 01 05:55:35.332980 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3585/7125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:35 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:35.353423 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7b8edf15-c73f-45c8-95f0-d4810916f1cc"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:35.355843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:35.362862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.363400 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.363850 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.364577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.365041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.365480 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.409929 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:35.416119 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] HTTP exception thrown: Flavor 7b8edf15-c73f-45c8-95f0-d4810916f1cc could not be found. Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8/action HTTP/1.1 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 65 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: {"resize": {"flavorRef": "7b8edf15-c73f-45c8-95f0-d4810916f1cc"}} Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: exception: Flavor 7b8edf15-c73f-45c8-95f0-d4810916f1cc could not be found. Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '58e1da80-57c5-484b-a8a3-9dbad25acdc8', 'body': {'resize': {'flavorRef': '7b8edf15-c73f-45c8-95f0-d4810916f1cc'}}} Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:35.418171 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7b8edf15-c73f-45c8-95f0-d4810916f1cc could not be found. Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7b8edf15-c73f-45c8-95f0-d4810916f1cc could not be found. Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7b8edf15-c73f-45c8-95f0-d4810916f1cc could not be found. Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 400 to user: Flavor 7b8edf15-c73f-45c8-95f0-d4810916f1cc could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:35.422420 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb9c693f-76d6-4052-8965-b9af5bc8fbca tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "POST /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8/action" status: 400 len: 107 microversion: 2.1 time: 0.070437 Sep 01 05:55:35.424908 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3541/7126] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:55:35 2022] POST /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8/action => generated 107 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:55:35.429179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:35.429797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:35.436047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.436797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.437385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.438080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.438529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.438974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.595559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:35.604112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e57bdf07-7f50-4f56-bb4a-5611db6796ff tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.178806 Sep 01 05:55:35.604802 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3586/7127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:35 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:35.626330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:35.626990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:35.633518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.634109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.634560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.635340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.638608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.638720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.777064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:35.781399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:35.788320 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7051ff9-6f02-4211-b70d-91fbfba8f440 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.166441 Sep 01 05:55:35.788898 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3542/7128] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:35 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:35.811064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a0bff4c-155e-4424-ad47-2a545fd44384 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a0bff4c-155e-4424-ad47-2a545fd44384 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: request: POST /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8/action HTTP/1.1 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 29 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: {"resize": {"flavorRef": ""}} Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '58e1da80-57c5-484b-a8a3-9dbad25acdc8', 'body': {'resize': {'flavorRef': ''}}} Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi '' Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.814985 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a0bff4c-155e-4424-ad47-2a545fd44384 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a0bff4c-155e-4424-ad47-2a545fd44384 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "POST /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8/action" status: 400 len: 113 microversion: 2.1 time: 0.009418 Sep 01 05:55:35.819840 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3587/7129] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:55:35 2022] POST /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:55:35.825041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:35.825671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:35.834325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.834827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.835314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.836028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:35.836504 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:35.836942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:35.981434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:35.989785 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f0e4027-d991-4eb8-8e54-c5421934a0b9 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1504 microversion: 2.1 time: 0.168605 Sep 01 05:55:35.990412 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3543/7130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:35 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:36.016082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:36.016574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:36.024703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.025114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.025546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.026237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.026682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.027136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.040855 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] HTTP exception thrown: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e HTTP/1.1 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'eb476dbd-2ee4-4fa6-9164-efb997c1664e'} Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:55:36.042449 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 404 to user: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4601c34c-3f40-4327-9b0d-e03c5631b590 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 404 len: 111 microversion: 2.1 time: 0.034328 Sep 01 05:55:36.047817 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3588/7131] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:55:36 2022] DELETE /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:55:36.053056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:36.053689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: eb476dbd-2ee4-4fa6-9164-efb997c1664e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:36.060044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.060547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.061005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.062233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.062709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.063209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.077827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] HTTP exception thrown: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e HTTP/1.1 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'eb476dbd-2ee4-4fa6-9164-efb997c1664e'} Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:36.079471 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 404 to user: Instance eb476dbd-2ee4-4fa6-9164-efb997c1664e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dac5fd66-7128-4560-a794-c255403065e2 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e" status: 404 len: 111 microversion: 2.1 time: 0.031903 Sep 01 05:55:36.085274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3544/7132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:36 2022] GET /compute/v2.1/servers/eb476dbd-2ee4-4fa6-9164-efb997c1664e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:55:36.092592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:36.093075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:36.103571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.104320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.104748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.105429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.105875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.106288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.133962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:55:36.169112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:55:36.219489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb4f61a3-41fb-428e-8ab9-783db94c354f tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 204 len: 0 microversion: 2.1 time: 0.133112 Sep 01 05:55:36.220045 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3589/7133] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:55:36 2022] DELETE /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:55:36.228677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:36.229307 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:36.235805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.236308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.236763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.237465 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:36.237912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:36.238339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:36.379392 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:36.392543 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69321662-36a4-49f1-a7a6-d0f65633aa00 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1510 microversion: 2.1 time: 0.167510 Sep 01 05:55:36.393542 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3545/7134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:36 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:37.423689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:37.424425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:37.431740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:37.432225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:37.432657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:37.433348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:37.433800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:37.434221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:37.577057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9c87f9ca604675bbab0b511b60e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ba5c7f3ea84a05b96b4288fbfe0b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:55:37.585895 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6fcf7a22-c062-4dca-a366-6a924964122d tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 200 len: 1510 microversion: 2.1 time: 0.169222 Sep 01 05:55:37.586453 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3590/7135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:37 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:55:38.008824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d82d5a42-2e8a-49cc-9b91-251497b8ad57 req-991c9d11-ad64-4898-9b8d-9b65ce7b9b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e1da80-57c5-484b-a8a3-9dbad25acdc8", "name": "network-vif-deleted", "tag": "6b0bd80e-b938-4be6-8f43-0e6377daa6ee"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:55:38.020636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d82d5a42-2e8a-49cc-9b91-251497b8ad57 req-991c9d11-ad64-4898-9b8d-9b65ce7b9b86 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:38.021147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d82d5a42-2e8a-49cc-9b91-251497b8ad57 req-991c9d11-ad64-4898-9b8d-9b65ce7b9b86 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:38.021590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d82d5a42-2e8a-49cc-9b91-251497b8ad57 req-991c9d11-ad64-4898-9b8d-9b65ce7b9b86 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:38.035277 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d82d5a42-2e8a-49cc-9b91-251497b8ad57 req-991c9d11-ad64-4898-9b8d-9b65ce7b9b86 service nova] Creating event network-vif-deleted:6b0bd80e-b938-4be6-8f43-0e6377daa6ee for instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 on n-h1-820368-37 Sep 01 05:55:38.041268 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d82d5a42-2e8a-49cc-9b91-251497b8ad57 req-991c9d11-ad64-4898-9b8d-9b65ce7b9b86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Sep 01 05:55:38.041943 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3546/7136] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:55:38.607512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:55:38.608113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] [instance: 58e1da80-57c5-484b-a8a3-9dbad25acdc8] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:55:38.615209 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:38.615750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:38.616166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:38.616857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:55:38.617320 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:55:38.617743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:55:38.632910 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] HTTP exception thrown: Instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 could not be found. Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Request method failure captured: Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 HTTP/1.1 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEk9C8FYW8h3yIpZJSLd4fcocdRHXM048rSLv5FpwL1S61UhYeAXiTYK2-KIP56LlHeN08kZach_-s9VF6rCxqcCK6HjK56pEa6dGefJXMPbUDt0GDZbxDTSZiJDHvZ1VJYDx7E4qNvu4tji2PwhwCLdqXESRIouO2uUBIY9bhGaRx8 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ba5c7f3ea84a05b96b4288fbfe0b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: f9ba5c7f3ea84a05b96b4288fbfe0b1d Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1618338692 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: ef9c87f9ca604675bbab0b511b60e5b1 Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-ServersNegativeTestJSON-1618338692-project Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 could not be found. Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '58e1da80-57c5-484b-a8a3-9dbad25acdc8'} Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 could not be found. Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 could not be found. Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:55:38.634560 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 could not be found. Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] Returning 404 to user: Instance 58e1da80-57c5-484b-a8a3-9dbad25acdc8 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-009707fd-0695-43c3-92ce-f129eaad0370 tempest-ServersNegativeTestJSON-1618338692 tempest-ServersNegativeTestJSON-1618338692-project] 10.222.0.26 "GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8" status: 404 len: 111 microversion: 2.1 time: 0.032731 Sep 01 05:55:38.638757 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3591/7137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:55:38 2022] GET /compute/v2.1/servers/58e1da80-57c5-484b-a8a3-9dbad25acdc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:56:09.949828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:09.950604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:10.136250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c5b330e-40cf-415a-b53e-dda2e28e0ada tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: .version_select at 0x7fa75b0a9820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-758863162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGzkQrkW1D4hUJPrsfNZOw+S/ySp36p8r82rgzSPxSTV9FDKBLORKUWP7sFmf8LakPvfzpfBV1xMw3/gzCfEMtvxYyz2I8DPa75VfS8BkC4JkD6Nnhe3kV0IW5E+bnfPQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:10.153110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3c5b330e-40cf-415a-b53e-dda2e28e0ada tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:56:10.158265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3c5b330e-40cf-415a-b53e-dda2e28e0ada tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for user 27cb25d8e13246e790fc5be736b7417f and project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:56:10.185560 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c5b330e-40cf-415a-b53e-dda2e28e0ada tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.238332 Sep 01 05:56:10.197186 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3547/7138] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:56:09 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:10.241205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1940207116", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-758863162", "networks": [{"uuid": "f6e88c34-3a37-40ae-bf08-7ca35bf8f932"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:10.250482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:10.251164 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:10.302155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] validate_networks() for [('f6e88c34-3a37-40ae-bf08-7ca35bf8f932', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:56:10.715710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:56:10.716125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:56:10.716589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:56:10.716991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:56:10.717393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:56:10.727175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:10.727685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:10.728106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:10.728825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:10.729269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:10.729682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:10.749213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:56:10.754850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for user 27cb25d8e13246e790fc5be736b7417f and project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:56:10.767817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:56:10.770197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:56:10.823166 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cbd7a0df-1c58-4bab-a8e7-761276b16479 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586087 Sep 01 05:56:10.827448 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3592/7139] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:56:10.839242 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37320d69-7aaf-4b3d-ba17-1ad10de7972f tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:10.845029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37320d69-7aaf-4b3d-ba17-1ad10de7972f tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:10.937421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37320d69-7aaf-4b3d-ba17-1ad10de7972f tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:10.951997 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37320d69-7aaf-4b3d-ba17-1ad10de7972f tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1262 microversion: 2.1 time: 0.116756 Sep 01 05:56:10.955072 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3548/7140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:10 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1262 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:11.976004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:11.976605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:11.983733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:11.984447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:11.985519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:11.986255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:11.986715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:11.987166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:12.060449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:12.068516 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e0b8cd39-5b3d-4b93-accc-35debe61b8b8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1314 microversion: 2.1 time: 0.098372 Sep 01 05:56:12.069097 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3593/7141] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:11 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1314 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:13.089906 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:13.091414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:13.099945 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:13.100570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:13.101312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:13.102010 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:13.102546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:13.103253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:13.312954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:13.321573 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a827f5fa-b28f-42b0-8ae9-e58198d2f389 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.235595 Sep 01 05:56:13.323264 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3549/7142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:13 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:13.610205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3346ffa0-7af4-4c1f-ac23-ae9638821b17 req-48cd0cc5-be15-4164-b05a-2a106e0d1279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9dfcba-6e9a-4e50-b822-e28550c30da1", "tag": "de5f1c50-a97a-4dfc-960b-087f9c86ed37"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:13.626658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3346ffa0-7af4-4c1f-ac23-ae9638821b17 req-48cd0cc5-be15-4164-b05a-2a106e0d1279 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:13.627421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3346ffa0-7af4-4c1f-ac23-ae9638821b17 req-48cd0cc5-be15-4164-b05a-2a106e0d1279 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:13.628219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3346ffa0-7af4-4c1f-ac23-ae9638821b17 req-48cd0cc5-be15-4164-b05a-2a106e0d1279 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:13.641379 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3346ffa0-7af4-4c1f-ac23-ae9638821b17 req-48cd0cc5-be15-4164-b05a-2a106e0d1279 service nova] Creating event network-changed:de5f1c50-a97a-4dfc-960b-087f9c86ed37 for instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 on n-h2-820368-37 Sep 01 05:56:13.652448 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3346ffa0-7af4-4c1f-ac23-ae9638821b17 req-48cd0cc5-be15-4164-b05a-2a106e0d1279 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047853 Sep 01 05:56:13.653403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3594/7143] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:14.346258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:14.346829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:14.354195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:14.355421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:14.355919 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:14.356628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:14.357090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:14.357544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:14.492021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:14.500410 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b56ebd7-c773-48f8-b949-347526255d09 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.160633 Sep 01 05:56:14.501095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3550/7144] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:14 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:15.528519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:15.529559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:15.540329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:15.541123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:15.541839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:15.542988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:15.543773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:15.544476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:15.685550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:15.698189 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bef4e9a9-a199-4e5d-acb6-a0cb08fbb491 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.178590 Sep 01 05:56:15.699197 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3595/7145] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:15 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:16.722495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:16.723180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:16.731169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:16.731684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:16.732139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:16.732862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:16.733342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:16.733790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:16.871756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:16.881191 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a378f08-706c-40f6-8108-9f384381f5be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.163709 Sep 01 05:56:16.881778 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3551/7146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:16 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:17.906451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:17.907560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:17.919507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.920311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.921025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:17.922157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:17.923104 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:17.923525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:18.054878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:18.062820 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-96bd402c-5d5e-43ae-bcca-fd4d1a5cc316 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.163412 Sep 01 05:56:18.063598 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3596/7147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:17 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:19.087751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:19.088587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:19.098068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:19.098583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:19.099070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:19.099781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:19.100256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:19.100696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:19.238413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:19.246908 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d47b3ce-9943-4e57-a356-eae06906ff26 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.165509 Sep 01 05:56:19.247485 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3552/7148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:19 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:20.269511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:20.269511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:20.276690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:20.277170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:20.277624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:20.278295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:20.278740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:20.279181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:20.377184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-55cc4ee6-1e05-48ce-bde9-0faeab218566 req-b64ef709-f66e-481d-9fac-edde48f99b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dfcba-6e9a-4e50-b822-e28550c30da1", "name": "network-vif-plugged", "status": "completed", "tag": "de5f1c50-a97a-4dfc-960b-087f9c86ed37"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:20.390286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-55cc4ee6-1e05-48ce-bde9-0faeab218566 req-b64ef709-f66e-481d-9fac-edde48f99b5d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:20.390949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-55cc4ee6-1e05-48ce-bde9-0faeab218566 req-b64ef709-f66e-481d-9fac-edde48f99b5d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:20.391510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-55cc4ee6-1e05-48ce-bde9-0faeab218566 req-b64ef709-f66e-481d-9fac-edde48f99b5d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:20.404109 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-55cc4ee6-1e05-48ce-bde9-0faeab218566 req-b64ef709-f66e-481d-9fac-edde48f99b5d service nova] Creating event network-vif-plugged:de5f1c50-a97a-4dfc-960b-087f9c86ed37 for instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 on n-h2-820368-37 Sep 01 05:56:20.409626 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-55cc4ee6-1e05-48ce-bde9-0faeab218566 req-b64ef709-f66e-481d-9fac-edde48f99b5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036901 Sep 01 05:56:20.410295 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3553/7149] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:20.418282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:20.426977 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-12072569-62ba-42dc-835c-1ddc4f84573c tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.162148 Sep 01 05:56:20.427851 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3597/7150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:20 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:21.447326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:21.452588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:21.453325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:21.460184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:21.460674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:21.461121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:21.461817 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:21.462281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:21.462716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:21.596002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:21.604100 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7030554-de04-465d-8006-718c2981c938 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1362 microversion: 2.1 time: 0.157783 Sep 01 05:56:21.604726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3554/7151] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:21 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:22.631927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:22.632922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:22.636058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:22.637134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:22.648280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:22.649484 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:22.650251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:22.651478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:22.652254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:22.652912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:22.794335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:22.802364 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-50e4b309-9316-4b48-aa1d-f0cf55e0ebee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1553 microversion: 2.1 time: 0.177124 Sep 01 05:56:22.803004 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3598/7152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:22 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:22.822731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:22.823457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:22.830711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:22.831252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:22.831714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:22.832436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:22.832918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:22.833366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:23.288158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:23.301370 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f33a744c-896f-4591-949f-134a7b2dff06 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1553 microversion: 2.1 time: 0.482079 Sep 01 05:56:23.302428 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3555/7153] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:22 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1553 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:25.039568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0ff45e9-f319-4e49-92a6-b99728809cbd"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:25.041988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:25.049098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:25.049583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:25.050014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:25.050695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:25.051188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:25.051598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:25.345280 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3810f163-a72c-4a18-815c-f122cc2eba96 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309610 Sep 01 05:56:25.346131 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3599/7154] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:56:25 2022] POST /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:36.112116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:36.112653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:36.116018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:36.116765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:36.125785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:36.126509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:36.127216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:36.128224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:36.128899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:36.129470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:36.220238 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lazy-loading 'services' on Instance uuid 5f9dfcba-6e9a-4e50-b822-e28550c30da1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:56:36.298915 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43b881b6-f00c-4dc3-a6fd-0afb2177d5d9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments/d0ff45e9-f319-4e49-92a6-b99728809cbd" status: 202 len: 0 microversion: 2.1 time: 0.193431 Sep 01 05:56:36.299531 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3556/7155] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:56:36 2022] DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments/d0ff45e9-f319-4e49-92a6-b99728809cbd => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:56:36.306273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:36.307652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:56:36.311860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:36.314204 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:36.322138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:36.322634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:36.323163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:36.323863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:36.324307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:36.324718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:36.358532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-537d11f5-7718-4deb-bace-e6c9aa80541d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054148 Sep 01 05:56:36.359136 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3600/7156] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:56:36 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:37.373300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:37.375740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:37.382874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:37.383397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:37.383841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:37.384543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:37.385005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:37.385432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:37.417394 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4da7467-d233-4824-9192-b3b4917870e9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049469 Sep 01 05:56:37.417973 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3557/7157] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:56:37 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:38.430267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:38.432597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:38.440057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:38.440555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:38.440987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:38.441787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:38.442245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:38.442666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:38.475835 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75f41b58-6d09-4398-add5-ecf4de07b189 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049771 Sep 01 05:56:38.476443 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3601/7158] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:56:38 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:39.488881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:39.491363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:39.498569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:39.499109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:39.499557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:39.500270 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:39.500737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:39.501175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:39.536027 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83898307-98f0-48a9-9c4f-79e51f285242 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051393 Sep 01 05:56:39.536643 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3558/7159] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:56:39 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:40.549158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:40.551445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:40.558668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:40.559182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:40.559613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:40.560303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:40.560746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:40.561167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:40.592355 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-192f5ed2-cbd9-488a-ab2f-72dd23cef95e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047186 Sep 01 05:56:40.592909 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3602/7160] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:56:40 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:41.609472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:41.613071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:41.625252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:41.626051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:41.626725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:41.627884 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:41.628576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:41.629865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:41.666492 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db934c5a-03e2-47ee-a676-928b8990242e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063922 Sep 01 05:56:41.667093 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3559/7161] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:56:41 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:56:41.678582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:41.679158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:41.686442 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:41.686927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:41.687385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:41.688068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:41.688515 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:41.688928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:41.775168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] HTTP exception thrown: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 is not attached to volume d0ff45e9-f319-4e49-92a6-b99728809cbd Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Request method failure captured: Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments/d0ff45e9-f319-4e49-92a6-b99728809cbd HTTP/1.1 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEl1CWVKilIuV-CzbGx4EmQGumpb5nGvs_M7XLowzOU7paFkhjombptmqgkrDsydJs3JEv3qTbwmOiSNTT6wIxeu_AGD1tAT5hnErnMBUZ_zaJwkX0cKy9-UU86GQnzJINOihuQXcKOabdvIAl0odWu6I_Ai4DBrOnu_1_BP4FzgXJ8 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 27cb25d8e13246e790fc5be736b7417f Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 is not attached to volume d0ff45e9-f319-4e49-92a6-b99728809cbd Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '5f9dfcba-6e9a-4e50-b822-e28550c30da1', 'id': 'd0ff45e9-f319-4e49-92a6-b99728809cbd'} Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d0ff45e9-f319-4e49-92a6-b99728809cbd. Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 is not attached to volume d0ff45e9-f319-4e49-92a6-b99728809cbd Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:56:41.795221 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 is not attached to volume d0ff45e9-f319-4e49-92a6-b99728809cbd Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Returning 404 to user: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 is not attached to volume d0ff45e9-f319-4e49-92a6-b99728809cbd {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-384ebdd8-20b5-40a7-9cf1-da495f0d1461 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments/d0ff45e9-f319-4e49-92a6-b99728809cbd" status: 404 len: 154 microversion: 2.1 time: 0.122561 Sep 01 05:56:41.799763 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3603/7162] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:56:41 2022] DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1/os-volume_attachments/d0ff45e9-f319-4e49-92a6-b99728809cbd => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:56:45.156886 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:45.157523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:45.166584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:45.167114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:45.167563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:45.168304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:45.168777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:45.169241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:45.196759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:56:45.286601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3c134d8-9c8c-4845-8864-8841fe136712 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 204 len: 0 microversion: 2.1 time: 0.135858 Sep 01 05:56:45.287548 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3560/7163] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:56:45 2022] DELETE /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:56:45.295695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:45.296297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:45.304727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:45.305208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:45.305638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:45.306363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:45.306808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:45.307252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:45.440583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:45.449279 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68a05fe2-c3e2-4464-af32-58d928affa8b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1559 microversion: 2.1 time: 0.157447 Sep 01 05:56:45.449829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3604/7164] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:45 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:46.474354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:46.475096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:46.484055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:46.484790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:46.485410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:46.486398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:46.487087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:46.487637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:46.630473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:46.638864 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a8b9ef3-3d72-486e-973b-1ec909925726 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1559 microversion: 2.1 time: 0.170665 Sep 01 05:56:46.639477 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3561/7165] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:46 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:47.516598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-bb190542-0f48-4ef5-b410-dc5d1a5b9c57 req-9f826684-3e11-4386-b37e-6e411d73ea93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9dfcba-6e9a-4e50-b822-e28550c30da1", "name": "network-vif-deleted", "tag": "de5f1c50-a97a-4dfc-960b-087f9c86ed37"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:47.527773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb190542-0f48-4ef5-b410-dc5d1a5b9c57 req-9f826684-3e11-4386-b37e-6e411d73ea93 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:47.528247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb190542-0f48-4ef5-b410-dc5d1a5b9c57 req-9f826684-3e11-4386-b37e-6e411d73ea93 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:47.528891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-bb190542-0f48-4ef5-b410-dc5d1a5b9c57 req-9f826684-3e11-4386-b37e-6e411d73ea93 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:47.541311 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-bb190542-0f48-4ef5-b410-dc5d1a5b9c57 req-9f826684-3e11-4386-b37e-6e411d73ea93 service nova] Creating event network-vif-deleted:de5f1c50-a97a-4dfc-960b-087f9c86ed37 for instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 on n-h2-820368-37 Sep 01 05:56:47.546233 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-bb190542-0f48-4ef5-b410-dc5d1a5b9c57 req-9f826684-3e11-4386-b37e-6e411d73ea93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Sep 01 05:56:47.546841 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3605/7166] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:47.667822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:47.668409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:47.675143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:47.675674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:47.676120 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:47.676822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:47.677292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:47.677722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:47.711216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:47.711721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:47.712180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:47.712680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lazy-loading 'fault' on Instance uuid 5f9dfcba-6e9a-4e50-b822-e28550c30da1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:56:47.758126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:47.766215 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34bc326a-ab59-4825-910a-3cedc35eb3af tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 200 len: 1352 microversion: 2.1 time: 0.102430 Sep 01 05:56:47.766815 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3562/7167] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:47 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:48.795094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:48.796283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: 5f9dfcba-6e9a-4e50-b822-e28550c30da1] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:48.806313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:48.806795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:48.807259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:48.807956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:48.808410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:48.808831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:48.823450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] HTTP exception thrown: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 could not be found. Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Request method failure captured: Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 HTTP/1.1 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEl1CWVKilIuV-CzbGx4EmQGumpb5nGvs_M7XLowzOU7paFkhjombptmqgkrDsydJs3JEv3qTbwmOiSNTT6wIxeu_AGD1tAT5hnErnMBUZ_zaJwkX0cKy9-UU86GQnzJINOihuQXcKOabdvIAl0odWu6I_Ai4DBrOnu_1_BP4FzgXJ8 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 27cb25d8e13246e790fc5be736b7417f Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 could not be found. Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '5f9dfcba-6e9a-4e50-b822-e28550c30da1'} Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 could not be found. Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 could not be found. Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:48.825107 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 could not be found. Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Returning 404 to user: Instance 5f9dfcba-6e9a-4e50-b822-e28550c30da1 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d3bb865a-c555-4e66-a59f-338e682c8f38 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1" status: 404 len: 111 microversion: 2.1 time: 0.040905 Sep 01 05:56:48.832718 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3606/7168] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:48 2022] GET /compute/v2.1/servers/5f9dfcba-6e9a-4e50-b822-e28550c30da1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:56:48.836340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc3bdef6-1608-4000-9c46-22ce1ea55131 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '.version_select at 0x7fa760e4aee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:48.861890 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc3bdef6-1608-4000-9c46-22ce1ea55131 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-758863162" status: 202 len: 0 microversion: 2.1 time: 0.030083 Sep 01 05:56:48.862595 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3563/7169] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 1 05:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-758863162 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:56:48.880992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64e42d11-98ec-4b0b-9286-7c989fd9cb83 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: .version_select at 0x7fa75b0a6310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1588383277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZZcX3HbD2MeC7b0dAOnOil3oF8d4r6FfDnbXvZLmNSuisAcDMt85u5EWjdgcsyTJ/uyPS8R2oC8bvDqSxpzrOShuO5Gq0mnPZ1YHq17mlG/cexKGj0SrrMrmWiCSl3zw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:48.897455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-64e42d11-98ec-4b0b-9286-7c989fd9cb83 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:56:48.903281 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-64e42d11-98ec-4b0b-9286-7c989fd9cb83 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for user 27cb25d8e13246e790fc5be736b7417f and project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:56:48.916964 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64e42d11-98ec-4b0b-9286-7c989fd9cb83 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [71619eec-194b-4380-8e03-02d6f96a168e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:56:49.929967 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-64e42d11-98ec-4b0b-9286-7c989fd9cb83 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [71619eec-194b-4380-8e03-02d6f96a168e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52522. Sep 01 05:56:49.956093 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64e42d11-98ec-4b0b-9286-7c989fd9cb83 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.078897 Sep 01 05:56:49.956717 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3607/7170] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:56:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:50.010859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-579095651", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1588383277", "networks": [{"uuid": "f6e88c34-3a37-40ae-bf08-7ca35bf8f932"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:50.066575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] validate_networks() for [('f6e88c34-3a37-40ae-bf08-7ca35bf8f932', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:56:50.456497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:56:50.456948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:56:50.457430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:56:50.457880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:56:50.458303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:56:50.467978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:50.468468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:50.468917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:50.469643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:50.470101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:50.470568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:50.488401 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:56:50.494130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for user 27cb25d8e13246e790fc5be736b7417f and project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:56:50.507650 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:56:50.509973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:56:50.560976 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca0716b6-6298-4df7-9a93-3e61252b79ce tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555137 Sep 01 05:56:50.561807 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3564/7171] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:56:50.573429 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-63a70c42-2e23-4be7-9117-eb7e3b9581ac tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:50.574048 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-63a70c42-2e23-4be7-9117-eb7e3b9581ac tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:50.628939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-63a70c42-2e23-4be7-9117-eb7e3b9581ac tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:50.636872 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-63a70c42-2e23-4be7-9117-eb7e3b9581ac tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1262 microversion: 2.1 time: 0.068302 Sep 01 05:56:50.637432 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3608/7172] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:50 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:51.658239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:51.658800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:51.666760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:51.667295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:51.667725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:51.668468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:51.668927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:51.669378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:51.766689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:51.775601 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a1255f7-0c26-4b5f-8468-45e148f19a73 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1322 microversion: 2.1 time: 0.121468 Sep 01 05:56:51.776547 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3565/7173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:51 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1322 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:52.796148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:52.797389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:52.804952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:52.805594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:52.806081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:52.807353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:52.807977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:52.808765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:53.022054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:53.030667 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccf4e61e-6463-41b1-a77c-724a83f2ee91 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.238477 Sep 01 05:56:53.031272 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3609/7174] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:52 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:53.109510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d5b19627-905a-4fdd-9567-eda4569b7264 req-23c9cfeb-0004-4ae9-92f8-cb03ea783659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed43430b-fb9c-497d-939b-c62e367d3245", "tag": "1eaf64c4-9b05-42e6-aa5c-589003c3a0b1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:53.120775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5b19627-905a-4fdd-9567-eda4569b7264 req-23c9cfeb-0004-4ae9-92f8-cb03ea783659 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:53.121279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5b19627-905a-4fdd-9567-eda4569b7264 req-23c9cfeb-0004-4ae9-92f8-cb03ea783659 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:53.121724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5b19627-905a-4fdd-9567-eda4569b7264 req-23c9cfeb-0004-4ae9-92f8-cb03ea783659 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:53.134055 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d5b19627-905a-4fdd-9567-eda4569b7264 req-23c9cfeb-0004-4ae9-92f8-cb03ea783659 service nova] Creating event network-changed:1eaf64c4-9b05-42e6-aa5c-589003c3a0b1 for instance ed43430b-fb9c-497d-939b-c62e367d3245 on n-h2-820368-37 Sep 01 05:56:53.139147 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d5b19627-905a-4fdd-9567-eda4569b7264 req-23c9cfeb-0004-4ae9-92f8-cb03ea783659 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033403 Sep 01 05:56:53.139764 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3566/7175] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:54.052299 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:54.052914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:54.060348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:54.060828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:54.061261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:54.061944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:54.062395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:54.062811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:54.195971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:54.204177 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2060301b-9713-4f4a-9b87-465e7b6a4285 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.155837 Sep 01 05:56:54.204757 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3610/7176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:54 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:55.230180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:55.230985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:55.239718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:55.240267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:55.240763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:55.241547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:55.242056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:55.242539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:55.388016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:55.399739 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c021f76-ed5e-49ff-9e00-a55f17905b37 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.176344 Sep 01 05:56:55.400318 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3567/7177] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:55 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:56.421002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:56.421623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:56.429511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:56.430004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:56.430649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:56.431609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:56.432068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:56.432520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:56.565053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:56.573281 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-83e990b1-e564-49a9-9267-3b53a7b70619 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.156357 Sep 01 05:56:56.573874 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3611/7178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:56 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:57.599318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:57.600299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:57.609001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:57.609494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:57.609941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:57.610673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:57.611175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:57.611614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:57.749025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:57.757169 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-740a582c-2d87-445d-b5ae-8663bc4701f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.164575 Sep 01 05:56:57.757770 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3568/7179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:57 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:58.581814 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-7346a88d-63dd-4a58-93ff-e9d1e36a9c92 req-893d505f-dbea-45ce-b648-5f1d394962cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed43430b-fb9c-497d-939b-c62e367d3245", "name": "network-vif-plugged", "status": "completed", "tag": "1eaf64c4-9b05-42e6-aa5c-589003c3a0b1"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:56:58.594506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7346a88d-63dd-4a58-93ff-e9d1e36a9c92 req-893d505f-dbea-45ce-b648-5f1d394962cb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:58.595080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7346a88d-63dd-4a58-93ff-e9d1e36a9c92 req-893d505f-dbea-45ce-b648-5f1d394962cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:58.595512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-7346a88d-63dd-4a58-93ff-e9d1e36a9c92 req-893d505f-dbea-45ce-b648-5f1d394962cb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:58.607482 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-7346a88d-63dd-4a58-93ff-e9d1e36a9c92 req-893d505f-dbea-45ce-b648-5f1d394962cb service nova] Creating event network-vif-plugged:1eaf64c4-9b05-42e6-aa5c-589003c3a0b1 for instance ed43430b-fb9c-497d-939b-c62e367d3245 on n-h2-820368-37 Sep 01 05:56:58.613001 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-7346a88d-63dd-4a58-93ff-e9d1e36a9c92 req-893d505f-dbea-45ce-b648-5f1d394962cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035228 Sep 01 05:56:58.613753 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3612/7180] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:56:58.779542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:58.780194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:58.788135 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:58.788656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:58.789107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:58.789833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:58.790798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:58.791309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:58.920865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:56:58.929158 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-849ce6db-d823-419f-b323-e12e6089b281 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.154186 Sep 01 05:56:58.929717 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3569/7181] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:58 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:56:59.954995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:56:59.956264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:56:59.966835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:59.967337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:59.967766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:56:59.968455 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:56:59.968903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:56:59.969323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:00.115197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:00.123681 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2f808ce-6abb-4e32-90d9-1d9f09bce1e5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1362 microversion: 2.1 time: 0.175928 Sep 01 05:57:00.124307 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3613/7182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:56:59 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:01.150076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:01.151144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:01.155358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:01.156489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:01.168036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:01.168865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:01.169358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:01.170076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:01.170540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:01.170999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:01.309657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:01.318208 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-879acbae-d6a6-4f66-b272-6bf8da08b61e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1554 microversion: 2.1 time: 0.175358 Sep 01 05:57:01.318823 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3570/7183] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:01 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:01.338934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:01.339550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:01.341677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:01.348003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:01.348491 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:01.348923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:01.349618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:01.350070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:01.350492 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:01.493921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:01.503276 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-edd1b19c-a9fb-426b-9324-690cb05dae87 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1554 microversion: 2.1 time: 0.168343 Sep 01 05:57:01.503990 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3614/7184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:01 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:03.021167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "373e3077-b261-48cc-ac02-9b8be831b257"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:03.025081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:03.032952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:03.033448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:03.033894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:03.034600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:03.035123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:03.035561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:03.200655 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:03.330815 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d10f9cbb-fed3-4c06-8e48-cadc97047dfa tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314437 Sep 01 05:57:03.331460 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3571/7185] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:57:03 2022] POST /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:14.101333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:14.101911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:14.104422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:14.105132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=66 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:14.112097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:14.112586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:14.113024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:14.113745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:14.114203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:14.114627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:14.200105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lazy-loading 'services' on Instance uuid ed43430b-fb9c-497d-939b-c62e367d3245 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:57:14.281884 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-303c45db-8be6-41a7-ad56-e7b7b39d8eeb tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments/373e3077-b261-48cc-ac02-9b8be831b257" status: 202 len: 0 microversion: 2.1 time: 0.184949 Sep 01 05:57:14.284141 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3615/7186] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:57:14 2022] DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments/373e3077-b261-48cc-ac02-9b8be831b257 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:57:14.289647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:14.290456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:14.294921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:14.297792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:14.306727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:14.307345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:14.307816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:14.308666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:14.309198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:14.309754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:14.347104 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c71ed35-ce24-4d08-b2e2-7fed4ecff276 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059454 Sep 01 05:57:14.347736 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3572/7187] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:14 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:15.361327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:15.363783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:15.370414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:15.370914 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:15.371362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:15.372045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:15.372489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:15.372920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:15.405871 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-def3a905-a085-4d7a-aee3-98647dd79883 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Sep 01 05:57:15.406448 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3616/7188] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:15 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:16.418363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:16.421302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:16.429005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:16.429516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:16.429970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:16.430700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:16.431215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:16.431661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:16.466901 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc709eac-8601-48c1-9c9c-c664d05cf9f8 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052486 Sep 01 05:57:16.468040 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3573/7189] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:16 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:17.480393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:17.482806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:17.490426 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:17.490910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:17.491373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:17.492130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:17.492521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:17.492942 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:17.524462 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b746d808-c3b2-411c-afb1-b3577dda9978 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047782 Sep 01 05:57:17.525039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3617/7190] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:17 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:18.536237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:18.538459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:18.546165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:18.546697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:18.547161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:18.547881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:18.548357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:18.548799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:18.581901 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77898dd8-d852-4f99-9340-f58b79acbe84 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049768 Sep 01 05:57:18.582486 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3574/7191] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:18 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:19.599024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:19.602550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:19.612167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.612655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.613087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.613776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.614243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.614703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.645082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0d89b7dd-7fe4-4324-8635-799fa922feb7 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053235 Sep 01 05:57:19.645642 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3618/7192] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:19 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:57:19.656727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:19.657264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:19.664317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.664809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.665255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.665947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:19.666413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:19.666841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:19.743926 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] HTTP exception thrown: Instance ed43430b-fb9c-497d-939b-c62e367d3245 is not attached to volume 373e3077-b261-48cc-ac02-9b8be831b257 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Request method failure captured: Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments/373e3077-b261-48cc-ac02-9b8be831b257 HTTP/1.1 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEl1CWVKilIuV-CzbGx4EmQGumpb5nGvs_M7XLowzOU7paFkhjombptmqgkrDsydJs3JEv3qTbwmOiSNTT6wIxeu_AGD1tAT5hnErnMBUZ_zaJwkX0cKy9-UU86GQnzJINOihuQXcKOabdvIAl0odWu6I_Ai4DBrOnu_1_BP4FzgXJ8 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 27cb25d8e13246e790fc5be736b7417f Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ed43430b-fb9c-497d-939b-c62e367d3245 is not attached to volume 373e3077-b261-48cc-ac02-9b8be831b257 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'server_id': 'ed43430b-fb9c-497d-939b-c62e367d3245', 'id': '373e3077-b261-48cc-ac02-9b8be831b257'} Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 373e3077-b261-48cc-ac02-9b8be831b257. Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed43430b-fb9c-497d-939b-c62e367d3245 is not attached to volume 373e3077-b261-48cc-ac02-9b8be831b257 Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:19.745904 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed43430b-fb9c-497d-939b-c62e367d3245 is not attached to volume 373e3077-b261-48cc-ac02-9b8be831b257 Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Returning 404 to user: Instance ed43430b-fb9c-497d-939b-c62e367d3245 is not attached to volume 373e3077-b261-48cc-ac02-9b8be831b257 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-005b24f4-b260-4ee0-9cfb-14aebab49970 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments/373e3077-b261-48cc-ac02-9b8be831b257" status: 404 len: 154 microversion: 2.1 time: 0.094868 Sep 01 05:57:19.749952 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3575/7193] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:57:19 2022] DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245/os-volume_attachments/373e3077-b261-48cc-ac02-9b8be831b257 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:23.116317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:23.116841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:23.123883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:23.124366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:23.124987 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:23.125688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:23.126151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:23.126578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:23.155413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:57:23.253463 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eac6908e-fa10-43b3-9b4d-371130079c27 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 204 len: 0 microversion: 2.1 time: 0.140869 Sep 01 05:57:23.254266 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3619/7194] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:57:23 2022] DELETE /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:57:23.263323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:23.264304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:23.271428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:23.271883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:23.272324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:23.273549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:23.273549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:23.274576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:23.406369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:23.414636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8596677f-ccfe-40d8-9f65-1ff917acd110 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1560 microversion: 2.1 time: 0.155400 Sep 01 05:57:23.415347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3576/7195] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:23 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:24.436596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:24.437493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:24.445311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:24.445785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:24.446211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:24.446916 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:24.447374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:24.447789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:24.584134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:24.595523 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ccbe6e07-9190-496c-a4a0-3e86519db045 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1560 microversion: 2.1 time: 0.163250 Sep 01 05:57:24.596111 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3620/7196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:24 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:57:25.525809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f64e27a1-9c75-4cf3-93c5-66c20fc7ebb7 req-3503c2fc-7c43-43db-8822-2a465c4334d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed43430b-fb9c-497d-939b-c62e367d3245", "name": "network-vif-deleted", "tag": "1eaf64c4-9b05-42e6-aa5c-589003c3a0b1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:25.537534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f64e27a1-9c75-4cf3-93c5-66c20fc7ebb7 req-3503c2fc-7c43-43db-8822-2a465c4334d1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:25.538246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f64e27a1-9c75-4cf3-93c5-66c20fc7ebb7 req-3503c2fc-7c43-43db-8822-2a465c4334d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:25.538912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f64e27a1-9c75-4cf3-93c5-66c20fc7ebb7 req-3503c2fc-7c43-43db-8822-2a465c4334d1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:25.551342 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f64e27a1-9c75-4cf3-93c5-66c20fc7ebb7 req-3503c2fc-7c43-43db-8822-2a465c4334d1 service nova] Creating event network-vif-deleted:1eaf64c4-9b05-42e6-aa5c-589003c3a0b1 for instance ed43430b-fb9c-497d-939b-c62e367d3245 on n-h2-820368-37 Sep 01 05:57:25.556465 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f64e27a1-9c75-4cf3-93c5-66c20fc7ebb7 req-3503c2fc-7c43-43db-8822-2a465c4334d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034986 Sep 01 05:57:25.557601 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3577/7197] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:25.617890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:25.619264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:25.627277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:25.628101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:25.628689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:25.629414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:25.629908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:25.630506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:25.665825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:25.666318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:25.666771 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:25.667234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lazy-loading 'fault' on Instance uuid ed43430b-fb9c-497d-939b-c62e367d3245 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:57:25.708749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:25.717482 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f5d98c91-5edc-4e94-9b16-12ac26f563f1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 200 len: 1352 microversion: 2.1 time: 0.104712 Sep 01 05:57:25.718066 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3621/7198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:25 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:26.745799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:26.746928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: ed43430b-fb9c-497d-939b-c62e367d3245] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:26.755398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:26.755899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:26.756345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:26.757062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:26.757534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:26.757984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:26.772200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] HTTP exception thrown: Instance ed43430b-fb9c-497d-939b-c62e367d3245 could not be found. Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Request method failure captured: Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 HTTP/1.1 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEl1CWVKilIuV-CzbGx4EmQGumpb5nGvs_M7XLowzOU7paFkhjombptmqgkrDsydJs3JEv3qTbwmOiSNTT6wIxeu_AGD1tAT5hnErnMBUZ_zaJwkX0cKy9-UU86GQnzJINOihuQXcKOabdvIAl0odWu6I_Ai4DBrOnu_1_BP4FzgXJ8 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 27cb25d8e13246e790fc5be736b7417f Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ed43430b-fb9c-497d-939b-c62e367d3245 could not be found. Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ed43430b-fb9c-497d-939b-c62e367d3245'} Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed43430b-fb9c-497d-939b-c62e367d3245 could not be found. Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed43430b-fb9c-497d-939b-c62e367d3245 could not be found. Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:26.773859 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed43430b-fb9c-497d-939b-c62e367d3245 could not be found. Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Returning 404 to user: Instance ed43430b-fb9c-497d-939b-c62e367d3245 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24870214-8d2b-42ce-a8c5-38ddc9e87148 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245" status: 404 len: 111 microversion: 2.1 time: 0.038769 Sep 01 05:57:26.778539 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3578/7199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:26 2022] GET /compute/v2.1/servers/ed43430b-fb9c-497d-939b-c62e367d3245 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:57:26.784747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d69cf250-609f-4610-8234-7d066bb694e2 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '.version_select at 0x7fa7602070d0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:26.807962 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d69cf250-609f-4610-8234-7d066bb694e2 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1588383277" status: 202 len: 0 microversion: 2.1 time: 0.027238 Sep 01 05:57:26.808551 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3622/7200] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Sep 1 05:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1588383277 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:57:26.826733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b9bd95d-eef7-4a8f-ab57-e96f5359c0c0 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: .version_select at 0x7fa75bd44d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2078402378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDxmkvyH8O3ruBNQqSjb5e2XYvEvUtSz0VjYdGn/CteL5FXeteQ0usKMay5EhnG/OU3oScXNXk+CMfq1oUXC5zXaRHoQ022dMQ67fFpHg6E0W+SYCA1sRv5aiJLmcf1ZA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:26.844302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5b9bd95d-eef7-4a8f-ab57-e96f5359c0c0 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:57:26.850824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5b9bd95d-eef7-4a8f-ab57-e96f5359c0c0 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for user 27cb25d8e13246e790fc5be736b7417f and project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:57:26.877197 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b9bd95d-eef7-4a8f-ab57-e96f5359c0c0 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054700 Sep 01 05:57:26.877820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3579/7201] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:57:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:26.932259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-720943581", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2078402378", "networks": [{"uuid": "f6e88c34-3a37-40ae-bf08-7ca35bf8f932"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:26.991563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] validate_networks() for [('f6e88c34-3a37-40ae-bf08-7ca35bf8f932', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:57:27.501648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:57:27.502334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:57:27.503003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:57:27.503439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:57:27.503826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:57:27.514247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:27.514729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:27.515198 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:27.515931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:27.516374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:27.516797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:27.535022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:57:27.540499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Getting quotas for user 27cb25d8e13246e790fc5be736b7417f and project 78fc6972e22046f888d2c6ba376c9b5b. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:57:27.553329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:57:27.555717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:57:27.605574 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8947242e-82d9-468e-a964-5be634aa7f78 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677284 Sep 01 05:57:27.606393 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3623/7202] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:57:27.617495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7515ffa3-7ded-4bea-973e-95780251bc63 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:27.618124 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7515ffa3-7ded-4bea-973e-95780251bc63 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:27.676689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7515ffa3-7ded-4bea-973e-95780251bc63 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:27.683868 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7515ffa3-7ded-4bea-973e-95780251bc63 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1262 microversion: 2.1 time: 0.070392 Sep 01 05:57:27.684436 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3580/7203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:27 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:28.707623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:28.709181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:28.719027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:28.719898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:28.720500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:28.721420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:28.722273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:28.723236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:28.815718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:28.826507 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bddb7269-7ef6-4b94-b25a-aa79947c9c34 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1314 microversion: 2.1 time: 0.125666 Sep 01 05:57:28.827104 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3624/7204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:28 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1314 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:29.851591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:29.852374 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:29.859947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:29.860520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:29.860973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:29.861725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:29.862202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:29.862637 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:30.090596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:30.098657 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf73b21c-a72c-40c5-87cf-63c0d00cf79e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.251501 Sep 01 05:57:30.099262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3581/7205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:29 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:30.572097 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-654b9dfb-b10d-4c2c-aa3e-9e4167cf7d1e req-2a5c1c3f-7e3c-43e1-a668-fa63f503e66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d441ffbf-7675-4640-b578-0e3f46398681", "tag": "1a0f9670-9dd7-4e8d-82c3-dc9d9c206e19"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:30.583287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-654b9dfb-b10d-4c2c-aa3e-9e4167cf7d1e req-2a5c1c3f-7e3c-43e1-a668-fa63f503e66e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:30.583840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-654b9dfb-b10d-4c2c-aa3e-9e4167cf7d1e req-2a5c1c3f-7e3c-43e1-a668-fa63f503e66e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:30.584342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-654b9dfb-b10d-4c2c-aa3e-9e4167cf7d1e req-2a5c1c3f-7e3c-43e1-a668-fa63f503e66e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:30.596255 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-654b9dfb-b10d-4c2c-aa3e-9e4167cf7d1e req-2a5c1c3f-7e3c-43e1-a668-fa63f503e66e service nova] Creating event network-changed:1a0f9670-9dd7-4e8d-82c3-dc9d9c206e19 for instance d441ffbf-7675-4640-b578-0e3f46398681 on n-h2-820368-37 Sep 01 05:57:30.601294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-654b9dfb-b10d-4c2c-aa3e-9e4167cf7d1e req-2a5c1c3f-7e3c-43e1-a668-fa63f503e66e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033116 Sep 01 05:57:30.602371 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3625/7206] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:31.124176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:31.125144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:31.135759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:31.136483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:31.137169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:31.138207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:31.139029 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:31.139679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:31.277663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:31.285634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64725b25-e972-4c2e-97af-f7ef50a9768b tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.167854 Sep 01 05:57:31.286194 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3582/7207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:31 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:32.308012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:32.308603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:32.315316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:32.315796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:32.316220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:32.316904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:32.317348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:32.317766 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:32.468572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:32.476999 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d396131-c899-4ffe-8b9e-044b4bdc49a1 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.174246 Sep 01 05:57:32.477578 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3626/7208] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:32 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:33.502236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:33.503004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:33.510540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:33.511212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:33.511755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:33.513698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:33.514192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:33.514636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:33.675944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:33.684317 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20d2f44d-245b-4ad8-a8ed-d87638b3f84d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.186058 Sep 01 05:57:33.684918 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3583/7209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:33 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:34.705588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:34.706710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:34.714615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:34.716101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:34.716639 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:34.717266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:34.717769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:34.718154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:34.860288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:34.869533 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-556e9ad6-00fa-4943-9ce2-a96e69c235db tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.167879 Sep 01 05:57:34.870147 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3627/7210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:34 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:35.894235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:35.894801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:35.902422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:35.902918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:35.903409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:35.904207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:35.904670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:35.905108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:36.040006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:36.052805 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61a81dcc-c9fc-430e-b729-3c3bf964a2f3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.164877 Sep 01 05:57:36.053565 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3584/7211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:35 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:36.732358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-06fc4287-716e-4ef2-abf5-fbf8ab82bf89 req-aaf1cb91-92e2-400a-8df4-543a176dd6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d441ffbf-7675-4640-b578-0e3f46398681", "name": "network-vif-plugged", "status": "completed", "tag": "1a0f9670-9dd7-4e8d-82c3-dc9d9c206e19"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:36.746459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06fc4287-716e-4ef2-abf5-fbf8ab82bf89 req-aaf1cb91-92e2-400a-8df4-543a176dd6ee service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:36.746707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06fc4287-716e-4ef2-abf5-fbf8ab82bf89 req-aaf1cb91-92e2-400a-8df4-543a176dd6ee service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:36.748156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-06fc4287-716e-4ef2-abf5-fbf8ab82bf89 req-aaf1cb91-92e2-400a-8df4-543a176dd6ee service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:36.760678 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-06fc4287-716e-4ef2-abf5-fbf8ab82bf89 req-aaf1cb91-92e2-400a-8df4-543a176dd6ee service nova] Creating event network-vif-plugged:1a0f9670-9dd7-4e8d-82c3-dc9d9c206e19 for instance d441ffbf-7675-4640-b578-0e3f46398681 on n-h2-820368-37 Sep 01 05:57:36.766479 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-06fc4287-716e-4ef2-abf5-fbf8ab82bf89 req-aaf1cb91-92e2-400a-8df4-543a176dd6ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037888 Sep 01 05:57:36.767314 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3628/7212] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:37.078121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:37.079201 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:37.091054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:37.091991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:37.092737 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:37.093907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:37.094688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:37.095464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:37.236641 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:37.245530 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7801fb61-af51-46ef-bba8-2f16f15f4f72 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1362 microversion: 2.1 time: 0.173975 Sep 01 05:57:37.246114 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3585/7213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:37 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:38.268752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:38.269414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:38.271496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.272160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.280539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.281116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.281553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.282245 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.282691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.283136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.421032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:38.429512 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4cafe240-9b09-41d9-9625-f309193372c3 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1553 microversion: 2.1 time: 0.165549 Sep 01 05:57:38.430088 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3629/7214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:38 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:38.450297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:38.450935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:38.453000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:38.459463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.459967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.460425 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.461132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:38.461603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:38.462042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:38.610279 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:57:38.620080 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be4ceec9-683e-42d7-8e86-524153403ac9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1553 microversion: 2.1 time: 0.173861 Sep 01 05:57:38.620628 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3586/7215] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:57:38 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:57:40.179793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea684760-e2d0-4026-adb5-28b47de3cca5"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:57:40.182253 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:40.189423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:40.189907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:40.190343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:40.191047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:40.191525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:40.191949 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:40.463382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:40.482445 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6055fec6-8402-4cef-afff-2bc63bd1763e tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "POST /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306565 Sep 01 05:57:40.483144 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3630/7216] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:57:40 2022] POST /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:51.237815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:51.238343 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:51.241304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:51.242144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=70 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:51.247663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:51.248218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:51.248674 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:51.249366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:51.249835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:51.250276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:51.334766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lazy-loading 'services' on Instance uuid d441ffbf-7675-4640-b578-0e3f46398681 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:57:51.424480 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-128c74a3-09bb-4a62-b48b-192f95f30ce5 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments/ea684760-e2d0-4026-adb5-28b47de3cca5" status: 202 len: 0 microversion: 2.1 time: 0.190643 Sep 01 05:57:51.425567 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3587/7217] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:57:51 2022] DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments/ea684760-e2d0-4026-adb5-28b47de3cca5 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:57:51.432353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:57:51.436769 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:51.439191 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:51.446920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:51.447477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:51.447883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:51.448575 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:51.449020 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:51.449438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:51.481816 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a218cee-6ac4-4025-9716-dcbf68407eee tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051571 Sep 01 05:57:51.482387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3631/7218] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:51 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:52.495552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:52.497950 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:52.505770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:52.506259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:52.506702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:52.507443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:52.507903 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:52.508334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:52.540624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbff3067-9d11-4b94-adde-26e50ffc4775 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Sep 01 05:57:52.541197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3588/7219] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:52 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:53.554911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:53.557271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:53.564522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:53.565003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:53.565431 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:53.566125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:53.566571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:53.567014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:53.598992 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-10d36b97-0d7a-49e5-8b9d-2338e94695be tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047991 Sep 01 05:57:53.599804 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3632/7220] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:53 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:54.611089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:54.613309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:54.621250 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:54.621754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:54.622205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:54.622920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:54.623406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:54.623846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:54.658705 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-837ab6b6-1159-4f6b-a735-9689b039a91a tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051698 Sep 01 05:57:54.659394 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3589/7221] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:54 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:55.671842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:55.674070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:55.681344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:55.682038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:55.682487 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:55.683246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:55.683695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:55.684112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:55.718294 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4fc3768-040d-4c61-9938-e6e6d08faee9 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050630 Sep 01 05:57:55.719125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3633/7222] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:55 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:57:56.733759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:56.736064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:56.743581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:56.744086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:56.744542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:56.746173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:56.746742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:56.747207 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:56.781692 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df89322f-a5ec-4602-97f4-3b7268c4d999 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054058 Sep 01 05:57:56.782269 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3590/7223] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 05:57:56 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:57:56.793210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:57:56.793772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:57:56.800698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:56.801205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:56.801633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:56.802316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:57:56.802759 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:57:56.803200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:57:56.881414 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] HTTP exception thrown: Instance d441ffbf-7675-4640-b578-0e3f46398681 is not attached to volume ea684760-e2d0-4026-adb5-28b47de3cca5 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Request method failure captured: Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments/ea684760-e2d0-4026-adb5-28b47de3cca5 HTTP/1.1 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEl1CWVKilIuV-CzbGx4EmQGumpb5nGvs_M7XLowzOU7paFkhjombptmqgkrDsydJs3JEv3qTbwmOiSNTT6wIxeu_AGD1tAT5hnErnMBUZ_zaJwkX0cKy9-UU86GQnzJINOihuQXcKOabdvIAl0odWu6I_Ai4DBrOnu_1_BP4FzgXJ8 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 27cb25d8e13246e790fc5be736b7417f Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d441ffbf-7675-4640-b578-0e3f46398681 is not attached to volume ea684760-e2d0-4026-adb5-28b47de3cca5 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': 'd441ffbf-7675-4640-b578-0e3f46398681', 'id': 'ea684760-e2d0-4026-adb5-28b47de3cca5'} Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea684760-e2d0-4026-adb5-28b47de3cca5. Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d441ffbf-7675-4640-b578-0e3f46398681 is not attached to volume ea684760-e2d0-4026-adb5-28b47de3cca5 Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:57:56.883120 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d441ffbf-7675-4640-b578-0e3f46398681 is not attached to volume ea684760-e2d0-4026-adb5-28b47de3cca5 Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Returning 404 to user: Instance d441ffbf-7675-4640-b578-0e3f46398681 is not attached to volume ea684760-e2d0-4026-adb5-28b47de3cca5 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1acefcfe-bc29-4dd6-8c21-7087d319bf25 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments/ea684760-e2d0-4026-adb5-28b47de3cca5" status: 404 len: 154 microversion: 2.1 time: 0.095595 Sep 01 05:57:56.888420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3634/7224] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 05:57:56 2022] DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681/os-volume_attachments/ea684760-e2d0-4026-adb5-28b47de3cca5 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:58:00.247810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:00.248414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:00.257729 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:00.258323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:00.258931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:00.259900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:00.260752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:00.261387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:00.292657 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:58:00.382502 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6107ccf-c180-46bc-befa-6cd8f2981634 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 204 len: 0 microversion: 2.1 time: 0.141706 Sep 01 05:58:00.386661 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3591/7225] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 05:58:00 2022] DELETE /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:58:00.392062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:00.392677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:00.400778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:00.401762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:00.402203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:00.402923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:00.403382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:00.403933 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:00.536900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:00.545365 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-27c88338-ad7e-4167-ae18-47c3583923fd tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1559 microversion: 2.1 time: 0.157257 Sep 01 05:58:00.545940 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3635/7226] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:00 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:01.570968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:01.572272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:01.584553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:01.585386 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:01.586141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:01.587486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:01.588265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:01.588920 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:01.738084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:01.746404 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31bd4977-555e-42b1-9a8f-f322feffa171 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1559 microversion: 2.1 time: 0.182676 Sep 01 05:58:01.747013 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3592/7227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:01 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:02.642388 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-932e88ac-63f2-486b-bb8c-bacb26879234 req-c6de1cf7-a655-4d7d-b03d-d2350b4ea317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d441ffbf-7675-4640-b578-0e3f46398681", "name": "network-vif-deleted", "tag": "1a0f9670-9dd7-4e8d-82c3-dc9d9c206e19"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:58:02.655641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-932e88ac-63f2-486b-bb8c-bacb26879234 req-c6de1cf7-a655-4d7d-b03d-d2350b4ea317 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:02.656127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-932e88ac-63f2-486b-bb8c-bacb26879234 req-c6de1cf7-a655-4d7d-b03d-d2350b4ea317 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:02.656550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-932e88ac-63f2-486b-bb8c-bacb26879234 req-c6de1cf7-a655-4d7d-b03d-d2350b4ea317 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:02.669131 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-932e88ac-63f2-486b-bb8c-bacb26879234 req-c6de1cf7-a655-4d7d-b03d-d2350b4ea317 service nova] Creating event network-vif-deleted:1a0f9670-9dd7-4e8d-82c3-dc9d9c206e19 for instance d441ffbf-7675-4640-b578-0e3f46398681 on n-h2-820368-37 Sep 01 05:58:02.674652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-932e88ac-63f2-486b-bb8c-bacb26879234 req-c6de1cf7-a655-4d7d-b03d-d2350b4ea317 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036264 Sep 01 05:58:02.675724 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3636/7228] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:58:02.767914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:02.768544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:02.776904 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:02.777419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:02.777874 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:02.778587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:02.779089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:02.779531 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:02.812284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:02.812712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:02.813164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:02.813623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lazy-loading 'fault' on Instance uuid d441ffbf-7675-4640-b578-0e3f46398681 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:58:02.859968 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cb25d8e13246e790fc5be736b7417f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fc6972e22046f888d2c6ba376c9b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:02.868228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08d38e0e-29f6-4dea-ad88-418c8523eb59 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 200 len: 1352 microversion: 2.1 time: 0.104431 Sep 01 05:58:02.875025 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3593/7229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:02 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:03.891406 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:03.892125 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] [instance: d441ffbf-7675-4640-b578-0e3f46398681] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:03.900093 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:03.900590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:03.901136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:03.902257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:03.903069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:03.903482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:03.917988 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] HTTP exception thrown: Instance d441ffbf-7675-4640-b578-0e3f46398681 could not be found. Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Request method failure captured: Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 HTTP/1.1 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEl1CWVKilIuV-CzbGx4EmQGumpb5nGvs_M7XLowzOU7paFkhjombptmqgkrDsydJs3JEv3qTbwmOiSNTT6wIxeu_AGD1tAT5hnErnMBUZ_zaJwkX0cKy9-UU86GQnzJINOihuQXcKOabdvIAl0odWu6I_Ai4DBrOnu_1_BP4FzgXJ8 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/78fc6972e22046f888d2c6ba376c9b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 78fc6972e22046f888d2c6ba376c9b5b Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1955101655 Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 27cb25d8e13246e790fc5be736b7417f Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestEncryptedCinderVolumes-1955101655-project Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d441ffbf-7675-4640-b578-0e3f46398681 could not be found. Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd441ffbf-7675-4640-b578-0e3f46398681'} Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d441ffbf-7675-4640-b578-0e3f46398681 could not be found. Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d441ffbf-7675-4640-b578-0e3f46398681 could not be found. Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:58:03.919680 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d441ffbf-7675-4640-b578-0e3f46398681 could not be found. Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Returning 404 to user: Instance d441ffbf-7675-4640-b578-0e3f46398681 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-09fe94dd-2595-4391-a48a-68e54433fe47 tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681" status: 404 len: 111 microversion: 2.1 time: 0.034933 Sep 01 05:58:03.924376 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3637/7230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:03 2022] GET /compute/v2.1/servers/d441ffbf-7675-4640-b578-0e3f46398681 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:58:03.930273 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-114b2cbe-bb0b-478b-a157-bfee442dec1d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] Calling method '.version_select at 0x7fa75b219d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:03.953435 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-114b2cbe-bb0b-478b-a157-bfee442dec1d tempest-TestEncryptedCinderVolumes-1955101655 tempest-TestEncryptedCinderVolumes-1955101655-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2078402378" status: 202 len: 0 microversion: 2.1 time: 0.027035 Sep 01 05:58:03.954026 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3594/7231] 10.222.0.26 () {58 vars in 1278 bytes} [Thu Sep 1 05:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2078402378 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:58:30.682067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-be442c97-52d6-4a17-94ad-be88c5351ffa tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'create', calling method: .version_select at 0x7fa75a847dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1496142541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsoa7Mt9LdR0gVl3YopWVeU6MYIfxTAvrrnN9qyCSRtRWVJ2EQL1OMeieCMcWxr0lMTgCyNxU2rUyry/pabRMWcrZqOV3e9kt1VcyH1YoPqnjs0eFh8akYihP1KbLq+sw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:58:30.688132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:30.688797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:30.702710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-be442c97-52d6-4a17-94ad-be88c5351ffa tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:58:30.708070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-be442c97-52d6-4a17-94ad-be88c5351ffa tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for user 0a18005274cc44f5a3c390d0f924db56 and project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:58:30.734529 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-be442c97-52d6-4a17-94ad-be88c5351ffa tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056595 Sep 01 05:58:30.735170 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3638/7232] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 05:58:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:58:30.784373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:30.785155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:30.789756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1401992592", "imageRef": "fb71c631-2a56-49cb-9677-021cbb5f9072", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1496142541", "networks": [{"uuid": "7db7da97-e623-465e-8b03-37590566fe0e"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:58:30.848829 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] validate_networks() for [('7db7da97-e623-465e-8b03-37590566fe0e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:58:31.547686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:58:31.548119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:58:31.548636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:58:31.549056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:58:31.549481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:58:31.559136 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:31.559633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:31.560081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:31.560810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:31.561280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:31.561711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:31.580009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:58:31.585592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for user 0a18005274cc44f5a3c390d0f924db56 and project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:58:31.598229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:58:31.600568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fb71c631-2a56-49cb-9677-021cbb5f9072',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:58:31.656978 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d631c2b-fa01-4e73-bea7-b4975dfa08d5 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874796 Sep 01 05:58:31.657614 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3595/7233] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 05:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:58:31.668372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-16dfb871-bf0f-42af-a0ff-d5207b6726d0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:31.668990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-16dfb871-bf0f-42af-a0ff-d5207b6726d0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:31.727853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-16dfb871-bf0f-42af-a0ff-d5207b6726d0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:31.735810 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-16dfb871-bf0f-42af-a0ff-d5207b6726d0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1259 microversion: 2.1 time: 0.071342 Sep 01 05:58:31.748661 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3639/7234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:31 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:32.756643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:32.757952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:32.769670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:32.770202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:32.770634 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:32.771394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:32.771856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:32.772289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:32.889417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:32.897506 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24915dfb-e9b0-4613-b085-2284e65142af tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1319 microversion: 2.1 time: 0.145720 Sep 01 05:58:32.898124 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3596/7235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:32 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:33.919772 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:33.920464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:33.927542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:33.928035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:33.928472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:33.929187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:33.929638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:33.930061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:34.083270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:34.091901 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b21cd1f-2220-4d3f-9d77-6a9c8979f378 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.176099 Sep 01 05:58:34.092995 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3640/7236] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:33 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:35.113973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:35.114597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:35.136151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:35.136661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:35.137113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:35.137838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:35.138305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:35.138747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:35.287230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:35.295910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-525c2100-312b-4fc8-bb72-0b55b907c7fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.186038 Sep 01 05:58:35.296488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3597/7237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:35 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:36.319023 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:36.319642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:36.328025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:36.328539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:36.329049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:36.329767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:36.330242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:36.330663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:36.473038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:36.481205 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-03c868f9-da2c-4d17-81d8-cf02d7ac023b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.168333 Sep 01 05:58:36.494909 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3641/7238] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:36 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:37.504857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:37.506753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:37.514865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:37.515788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:37.516656 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:37.517760 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:37.518404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:37.518841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:37.657448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:37.666749 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-155bb2a1-5c0d-4c74-b374-f1c7934b4474 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.166145 Sep 01 05:58:37.667378 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3598/7239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:37 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:38.693992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:38.695623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:38.707084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:38.708499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:38.709698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:38.710826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:38.712012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:38.712915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:38.861621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:38.883070 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f20e423a-84a6-4a8d-bd18-2256bc1a5236 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.184252 Sep 01 05:58:38.883907 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3642/7240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:38 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:39.905051 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:39.906338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:39.916081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:39.916865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:39.917476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:39.918540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:39.919365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:39.919804 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:40.066846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:40.075248 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a48ab40-8f12-4b82-82b5-290ee2d46b3a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.174583 Sep 01 05:58:40.075843 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3599/7241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:39 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:41.097518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:41.098144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:41.105756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:41.106247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:41.106681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:41.107434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:41.107868 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:41.108293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:41.244968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:41.253290 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-46585bd7-9695-4061-96c9-fad761e09a58 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.160058 Sep 01 05:58:41.253797 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3643/7242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:41 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:42.277142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:42.277765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:42.281406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:42.282119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:42.291133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:42.291652 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:42.292278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:42.293236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:42.293912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:42.294595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:42.438723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:42.447699 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5a26e05-ffaf-4dd1-a5d8-9e23cdacd4eb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.176969 Sep 01 05:58:42.448395 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3600/7243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:42 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:43.471934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:43.472591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:43.474449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:58:43.480834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:43.481315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:43.481748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:43.482437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:43.482909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:43.483343 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:43.619867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:43.628443 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ed5de2ca-bffc-47e6-9542-bb9c0ce65329 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.162394 Sep 01 05:58:43.629031 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3644/7244] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:43 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:44.654525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:44.655563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:44.665841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:44.666593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:44.667315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:44.668394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:44.669125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:44.669802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:44.890185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:44.898640 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9612fe19-b3fc-4d57-82e3-81876d43ab35 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.251316 Sep 01 05:58:44.899686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3601/7245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:44 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:45.406808 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3e838300-39b5-42b6-afbe-2f01c6f22714 req-87756cfb-93ea-40c0-b04c-64acc6ae4c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:58:45.417724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e838300-39b5-42b6-afbe-2f01c6f22714 req-87756cfb-93ea-40c0-b04c-64acc6ae4c5e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:45.418193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e838300-39b5-42b6-afbe-2f01c6f22714 req-87756cfb-93ea-40c0-b04c-64acc6ae4c5e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:45.418614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3e838300-39b5-42b6-afbe-2f01c6f22714 req-87756cfb-93ea-40c0-b04c-64acc6ae4c5e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:45.429864 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3e838300-39b5-42b6-afbe-2f01c6f22714 req-87756cfb-93ea-40c0-b04c-64acc6ae4c5e service nova] Creating event network-changed:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 05:58:45.436058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3e838300-39b5-42b6-afbe-2f01c6f22714 req-87756cfb-93ea-40c0-b04c-64acc6ae4c5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Sep 01 05:58:45.436671 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3645/7246] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:58:45.921045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:45.921712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:45.929546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:45.930072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:45.930529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:45.931289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:45.931765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:45.932359 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:46.158143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:46.167549 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa6b3fb3-968d-42e4-a4c5-1e662c2ef21b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.250560 Sep 01 05:58:46.168118 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3602/7247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:45 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:47.192991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:47.193714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:47.202446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:47.203043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:47.203549 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:47.204354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:47.204880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:47.205370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:47.350848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:47.359168 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eff40ed8-7b95-4d66-b74f-e06ecff75f91 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.172846 Sep 01 05:58:47.359732 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3646/7248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:47 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:48.385094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:48.386173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:48.396458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:48.396955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:48.397393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:48.398099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:48.398563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:48.399364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:48.537130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:48.545415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc647ea0-ce7d-46bb-9389-3ef5dd1e890a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.167403 Sep 01 05:58:48.546005 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3603/7249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:48 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:49.566507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:49.567179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:49.574400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:49.574906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:49.575341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:49.576027 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:49.576470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:49.576883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:49.710552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:49.718762 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-150bf13a-60e2-4938-b0b4-fc0a503a787a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.156255 Sep 01 05:58:49.719407 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3647/7250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:49 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:50.745080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:50.746048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:50.756648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:50.757149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:50.757601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:50.758309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:50.758778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:50.759239 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:50.892895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:50.901506 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54d95639-e28d-4710-86da-12e38cf6d4cf tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.163219 Sep 01 05:58:50.902118 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3604/7251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:50 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:51.093679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-25a12160-635c-47ff-bc00-843c63059d13 req-8a5d3e2f-42bd-40c6-ac9f-eb3dba61b7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "name": "network-vif-plugged", "status": "completed", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:58:51.104805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-25a12160-635c-47ff-bc00-843c63059d13 req-8a5d3e2f-42bd-40c6-ac9f-eb3dba61b7ec service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:51.105341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-25a12160-635c-47ff-bc00-843c63059d13 req-8a5d3e2f-42bd-40c6-ac9f-eb3dba61b7ec service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:51.105768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-25a12160-635c-47ff-bc00-843c63059d13 req-8a5d3e2f-42bd-40c6-ac9f-eb3dba61b7ec service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:51.117517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-25a12160-635c-47ff-bc00-843c63059d13 req-8a5d3e2f-42bd-40c6-ac9f-eb3dba61b7ec service nova] Creating event network-vif-plugged:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 05:58:51.122517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-25a12160-635c-47ff-bc00-843c63059d13 req-8a5d3e2f-42bd-40c6-ac9f-eb3dba61b7ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032636 Sep 01 05:58:51.123377 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3648/7252] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:58:51.926633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:51.927247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:51.934751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:51.935278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:51.935725 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:51.936428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:51.936895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:51.937337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:52.072582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:52.081186 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d92ba9f9-349c-42db-b559-8ea7fd592687 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1359 microversion: 2.1 time: 0.160808 Sep 01 05:58:52.081780 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3605/7253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:51 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:53.105658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:53.106581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:53.115479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.116120 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.116701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.117627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.118233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.118799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.261724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:53.269984 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-612dd4f0-47dd-4e52-b759-5bc38d8726ea tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1549 microversion: 2.1 time: 0.171234 Sep 01 05:58:53.270445 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3649/7254] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:53 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:53.291548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:53.292185 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:53.299800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.300387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.300836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.301580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.302055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.302501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.436534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:53.448632 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-814cc32a-4429-4642-969c-0ddce3b1a5cc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1549 microversion: 2.1 time: 0.160810 Sep 01 05:58:53.449424 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3606/7255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:53 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:58:53.469157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:53.474246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:53.475017 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Searching by: {'deleted': False, 'project_id': '9cee229f11cb4f26a995fd1200fcce82'} {{(pid=128862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:58:53.480939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.481416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.481846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.482555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.483035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.483449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.510212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.multi_cell_list [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:58:53.538557 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-75cc9bdc-9850-45ff-b7a2-d57b44de3206 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073413 Sep 01 05:58:53.539173 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3650/7256] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 05:58:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:58:53.550778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:58:53.551457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:53.557633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.558155 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.558601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.559332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:53.559763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:53.560364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:53.701334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:58:53.709634 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13417eee-909c-407e-87e4-40e602685b43 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1549 microversion: 2.1 time: 0.163042 Sep 01 05:58:53.710224 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3607/7257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:58:53 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:58:55.285715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f4f2e58-f375-4e39-8d73-b8e127596204"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:58:55.288116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:58:55.294983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:55.295452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:55.295882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:55.296567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:58:55.297036 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:58:55.297477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:58:55.606222 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-31330f5f-5ea1-4239-a521-779a456554a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324948 Sep 01 05:58:55.607025 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3651/7258] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 05:58:55 2022] POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:08.705985 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:08.706594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:08.709047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:08.709766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=74 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:08.715911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:08.716420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:08.716876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:08.717589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:08.718063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:08.718509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:08.857608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:08.869582 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b1f5903-8bc0-4191-906d-755e00472118 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1595 microversion: 2.1 time: 0.167742 Sep 01 05:59:08.870168 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3608/7259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:08 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:10.624906 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:10.626287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:10.627259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:59:10.631578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-943db942-7672-4a6d-982c-f5758efbf2a1 req-3e602d98-0b6a-4f84-ab13-e8284d34a181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:10.644146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-943db942-7672-4a6d-982c-f5758efbf2a1 req-3e602d98-0b6a-4f84-ab13-e8284d34a181 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:10.644892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-943db942-7672-4a6d-982c-f5758efbf2a1 req-3e602d98-0b6a-4f84-ab13-e8284d34a181 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:10.645477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-943db942-7672-4a6d-982c-f5758efbf2a1 req-3e602d98-0b6a-4f84-ab13-e8284d34a181 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:10.659584 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-943db942-7672-4a6d-982c-f5758efbf2a1 req-3e602d98-0b6a-4f84-ab13-e8284d34a181 service nova] Creating event network-changed:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 05:59:10.664880 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-943db942-7672-4a6d-982c-f5758efbf2a1 req-3e602d98-0b6a-4f84-ab13-e8284d34a181 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041909 Sep 01 05:59:10.665858 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3652/7260] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:59:11.671805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1619407581"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:11.672407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:11.679560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:11.680069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:11.680495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:11.681245 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:11.681714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:11.682157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:11.818028 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Adding security group b06c9f03-69e2-4b12-8a7c-8ea8de90ee63 to port af1961b7-ad7b-4c9b-9f74-8f135411f714 Sep 01 05:59:12.167734 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf4ad606-9132-4940-841c-697ecbc6b622 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action" status: 202 len: 0 microversion: 2.1 time: 0.499923 Sep 01 05:59:12.168368 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3609/7261] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 05:59:11 2022] POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:59:12.178180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:59:12.180465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:59:12.192891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:12.193512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:12.203413 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:12.204190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:12.204661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:12.205099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:12.682361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-697af7b0-36d3-4764-a3ce-dcad3aaf5489 req-13d12587-c0e3-4b88-8c40-58f022c01a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:59:12.692889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-697af7b0-36d3-4764-a3ce-dcad3aaf5489 req-13d12587-c0e3-4b88-8c40-58f022c01a29 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:59:12.693116 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:59:12.693356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-697af7b0-36d3-4764-a3ce-dcad3aaf5489 req-13d12587-c0e3-4b88-8c40-58f022c01a29 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:59:12.694974 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-697af7b0-36d3-4764-a3ce-dcad3aaf5489 req-13d12587-c0e3-4b88-8c40-58f022c01a29 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:59:12.702727 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43b51df5-bd89-4665-aba9-a1b698108eb1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1761 microversion: 2.1 time: 0.529691 Sep 01 05:59:12.704403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3653/7262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 05:59:12 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1761 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:59:12.710300 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-697af7b0-36d3-4764-a3ce-dcad3aaf5489 req-13d12587-c0e3-4b88-8c40-58f022c01a29 service nova] Creating event network-changed:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 05:59:12.716112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-697af7b0-36d3-4764-a3ce-dcad3aaf5489 req-13d12587-c0e3-4b88-8c40-58f022c01a29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037767 Sep 01 05:59:12.717176 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3610/7263] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 05:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:01:24.638860 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:01:24.640067 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:01:24.640593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:24.641330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:24.642598 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:01:24.642755 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action (ip 10.222.0.26) !!! Sep 01 06:01:24.643921 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:01:24.644098 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action (ip 10.222.0.26) !!! Sep 01 06:01:24.648453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:01:24.651691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:24.662434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:24.662918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:24.663383 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:24.664068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:24.665217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:24.665649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:24.751339 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-39e984c9-d018-4860-bb0f-18e0a5433f95 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action" status: 202 len: 0 microversion: 2.1 time: 0.114189 Sep 01 06:01:24.751978 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3654/7264] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:01:24 2022] POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:01:24.758677 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:01:24.759625 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:01:24.760457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:24.761206 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:01:24.762297 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:01:24.762418 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 (ip 10.222.0.26) !!! Sep 01 06:01:24.763677 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:01:24.763796 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 (ip 10.222.0.26) !!! Sep 01 06:01:24.769314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:24.770031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:24.784138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:24.784663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:24.785109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:24.785818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:24.786281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:24.786713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:25.158025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:01:25.167079 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4966709a-493a-4e5d-9541-2370d69fe212 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1763 microversion: 2.1 time: 0.410318 Sep 01 06:01:25.167654 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3611/7265] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:01:24 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1763 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:01:26.194428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:01:26.195498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:01:26.204167 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53222. Sep 01 06:01:26.205640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:26.206119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:26.206552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:26.207266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:01:26.207720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:01:26.208138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:01:26.214433 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53220. Sep 01 06:01:26.413202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:01:26.422641 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ebe56423-1999-4e2b-a78b-fb9ba2c66332 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1761 microversion: 2.1 time: 0.236730 Sep 01 06:01:26.423239 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3655/7266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:01:26 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1761 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:10.379530 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:10.380503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:10.381808 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:03:10.381997 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action (ip 10.222.0.26) !!! Sep 01 06:03:10.391792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1619407581"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:10.392557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:10.408290 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53254. Sep 01 06:03:10.410786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:10.411340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:10.411738 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:10.412462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:10.412918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:10.413346 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:10.414208 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53252. Sep 01 06:03:10.550942 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Removing security group b06c9f03-69e2-4b12-8a7c-8ea8de90ee63 from port af1961b7-ad7b-4c9b-9f74-8f135411f714 Sep 01 06:03:10.867956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91b3c898-1dbe-4056-b641-40c569f0e412 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action" status: 202 len: 0 microversion: 2.1 time: 0.493168 Sep 01 06:03:10.872745 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3612/7267] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:03:10 2022] POST /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:03:10.874836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:10.875744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:10.960326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8de827fe-d81d-4718-b1db-808923cdf3bb req-7f2104c9-003e-4953-a230-ce4b6739a06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:10.970381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8de827fe-d81d-4718-b1db-808923cdf3bb req-7f2104c9-003e-4953-a230-ce4b6739a06f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:10.970858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8de827fe-d81d-4718-b1db-808923cdf3bb req-7f2104c9-003e-4953-a230-ce4b6739a06f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:10.971312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8de827fe-d81d-4718-b1db-808923cdf3bb req-7f2104c9-003e-4953-a230-ce4b6739a06f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:10.983155 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8de827fe-d81d-4718-b1db-808923cdf3bb req-7f2104c9-003e-4953-a230-ce4b6739a06f service nova] Creating event network-changed:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 06:03:10.988340 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8de827fe-d81d-4718-b1db-808923cdf3bb req-7f2104c9-003e-4953-a230-ce4b6739a06f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115987 Sep 01 06:03:10.989375 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3656/7268] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:12.247902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:12.248535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:12.254946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:12.255448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:12.255877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:12.256569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:12.257008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:12.257437 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:12.272274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-80281035-c58a-42e8-95da-1182cf292d37 req-ab0f01f1-5dad-4749-9a8d-186d0d4657bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:12.283636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-80281035-c58a-42e8-95da-1182cf292d37 req-ab0f01f1-5dad-4749-9a8d-186d0d4657bc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:12.284266 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-80281035-c58a-42e8-95da-1182cf292d37 req-ab0f01f1-5dad-4749-9a8d-186d0d4657bc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:12.284721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-80281035-c58a-42e8-95da-1182cf292d37 req-ab0f01f1-5dad-4749-9a8d-186d0d4657bc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:12.297429 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-80281035-c58a-42e8-95da-1182cf292d37 req-ab0f01f1-5dad-4749-9a8d-186d0d4657bc service nova] Creating event network-changed:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 06:03:12.305275 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-80281035-c58a-42e8-95da-1182cf292d37 req-ab0f01f1-5dad-4749-9a8d-186d0d4657bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104245 Sep 01 06:03:12.306508 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3613/7269] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:12.346028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lazy-loading 'services' on Instance uuid 16a74c57-25dd-42c8-9e4e-aad44f4c1545 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:03:12.426101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74aa8903-33b3-4bda-a79f-32ebe6cb8254 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments/8f4f2e58-f375-4e39-8d73-b8e127596204" status: 202 len: 0 microversion: 2.1 time: 0.183892 Sep 01 06:03:12.426756 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3657/7270] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 06:03:12 2022] DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments/8f4f2e58-f375-4e39-8d73-b8e127596204 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 06:03:12.440467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:12.443200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:12.452337 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:12.452897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:12.453389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:12.454411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:12.455092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:12.455940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:12.491542 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d091ac01-a14b-43b3-9689-ad41fdc11f29 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058825 Sep 01 06:03:12.496761 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3614/7271] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:03:12 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:03:13.505822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:13.508100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:13.515844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:13.516335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:13.516773 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:13.517477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:13.517900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:13.518355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:13.549567 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba7c4de3-05f4-4625-bc8b-3926356ef90b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048375 Sep 01 06:03:13.550133 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3658/7272] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:03:13 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:14.562675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:14.565520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:14.573202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:14.573713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:14.574160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:14.575110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:14.575583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:14.575994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:14.608169 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e98520aa-2125-4638-99d0-94afd4bacb88 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049950 Sep 01 06:03:14.608776 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3615/7273] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:03:14 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:15.621679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:15.623954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:15.631632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:15.632119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:15.632543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:15.633236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:15.633684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:15.634100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:15.665586 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a1f99980-3e48-483e-a57f-fce3c52db9fd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048026 Sep 01 06:03:15.666159 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3659/7274] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:03:15 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:16.678579 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:16.680799 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:16.688335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:16.688840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:16.689287 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:16.690001 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:16.690469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:16.690914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:16.721130 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fecda3cc-7130-4d96-a18b-2b2c3514d2bd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Sep 01 06:03:16.721700 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3616/7275] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:03:16 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:17.738067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:17.741642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:17.753528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:17.754332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:17.755102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:17.756237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:17.756979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:17.757671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:17.789737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2a94ad58-5881-4e2e-83d5-dbd71642762c tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058451 Sep 01 06:03:17.790292 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3660/7276] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:03:17 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 06:03:17.801146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:17.801682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:17.809197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:17.809695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:17.810141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:17.810878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:17.811368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:17.811801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:17.901683 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] HTTP exception thrown: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 is not attached to volume 8f4f2e58-f375-4e39-8d73-b8e127596204 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Request method failure captured: Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments/8f4f2e58-f375-4e39-8d73-b8e127596204 HTTP/1.1 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEn4QHDbJ2DNRLEAasI6Zrw-z5JP6_G-MV3nV1E6TpCq-etcyNo0ko7JmkrPCK5WeczotlkxlTY7ep6rEjGwnf3Ndgrvk7PMMnjzYfQHc-q4nJAR5bmSAT3jDqLuGFvsqrku_BXfCt2XYYd8fxXqlCRdDpxF9f4YFoOiLytlICsG7is Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 0a18005274cc44f5a3c390d0f924db56 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 is not attached to volume 8f4f2e58-f375-4e39-8d73-b8e127596204 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'server_id': '16a74c57-25dd-42c8-9e4e-aad44f4c1545', 'id': '8f4f2e58-f375-4e39-8d73-b8e127596204'} Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8f4f2e58-f375-4e39-8d73-b8e127596204. Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 is not attached to volume 8f4f2e58-f375-4e39-8d73-b8e127596204 Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:03:17.903474 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 is not attached to volume 8f4f2e58-f375-4e39-8d73-b8e127596204 Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Returning 404 to user: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 is not attached to volume 8f4f2e58-f375-4e39-8d73-b8e127596204 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdd03851-0e57-4d7f-b294-278f048021cd tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments/8f4f2e58-f375-4e39-8d73-b8e127596204" status: 404 len: 154 microversion: 2.1 time: 0.108006 Sep 01 06:03:17.908000 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3617/7277] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 06:03:17 2022] DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545/os-volume_attachments/8f4f2e58-f375-4e39-8d73-b8e127596204 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:03:21.262394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:21.262941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:21.270267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:21.270745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:21.271205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:21.271884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:21.272331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:21.272748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:21.297719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:03:21.392920 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aa12841b-3f2d-4bab-ab7f-8eca400f7c73 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 204 len: 0 microversion: 2.1 time: 0.134113 Sep 01 06:03:21.393634 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3661/7278] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:03:21 2022] DELETE /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 06:03:21.402532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:21.403196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:21.411750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:21.412219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:21.412668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:21.413377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:21.413870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:21.414302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:21.552409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:21.560532 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe87c75e-acf1-4c83-90fa-fa1d43d26be9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1555 microversion: 2.1 time: 0.162406 Sep 01 06:03:21.561759 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3618/7279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:21 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:03:22.587965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:22.589000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:22.597564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:22.598054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:22.598495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:22.599233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:22.599689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:22.600117 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:22.744212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:22.753198 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8f083ccd-bc85-4e53-8e54-504125da769d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1555 microversion: 2.1 time: 0.172533 Sep 01 06:03:22.753776 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3662/7280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:22 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:23.777513 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:23.778118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:23.787253 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:23.787917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:23.788246 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:23.788987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:23.789482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:23.789923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:23.900144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:23.908963 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29d4ca15-c5c9-4963-8cc5-5f8a62407369 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 200 len: 1513 microversion: 2.1 time: 0.135771 Sep 01 06:03:23.911402 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3619/7281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:23 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:23.914748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-f2e4407c-1524-4b1d-9a9b-0d9978f13621 req-b30c653d-35b3-42c3-bcb8-136e442466e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a74c57-25dd-42c8-9e4e-aad44f4c1545", "name": "network-vif-deleted", "tag": "af1961b7-ad7b-4c9b-9f74-8f135411f714"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:23.926106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2e4407c-1524-4b1d-9a9b-0d9978f13621 req-b30c653d-35b3-42c3-bcb8-136e442466e7 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:23.926582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2e4407c-1524-4b1d-9a9b-0d9978f13621 req-b30c653d-35b3-42c3-bcb8-136e442466e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:23.927041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-f2e4407c-1524-4b1d-9a9b-0d9978f13621 req-b30c653d-35b3-42c3-bcb8-136e442466e7 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:23.938761 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-f2e4407c-1524-4b1d-9a9b-0d9978f13621 req-b30c653d-35b3-42c3-bcb8-136e442466e7 service nova] Creating event network-vif-deleted:af1961b7-ad7b-4c9b-9f74-8f135411f714 for instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 on n-h2-820368-37 Sep 01 06:03:23.943608 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-f2e4407c-1524-4b1d-9a9b-0d9978f13621 req-b30c653d-35b3-42c3-bcb8-136e442466e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 Sep 01 06:03:23.944225 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3663/7282] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:03:24.937868 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:24.938952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 16a74c57-25dd-42c8-9e4e-aad44f4c1545] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:24.950744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:24.951645 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:24.952487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:24.953196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:24.953667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:24.954109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:24.968036 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] HTTP exception thrown: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 could not be found. Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Request method failure captured: Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 HTTP/1.1 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEn4QHDbJ2DNRLEAasI6Zrw-z5JP6_G-MV3nV1E6TpCq-etcyNo0ko7JmkrPCK5WeczotlkxlTY7ep6rEjGwnf3Ndgrvk7PMMnjzYfQHc-q4nJAR5bmSAT3jDqLuGFvsqrku_BXfCt2XYYd8fxXqlCRdDpxF9f4YFoOiLytlICsG7is Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 0a18005274cc44f5a3c390d0f924db56 Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 could not be found. Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '16a74c57-25dd-42c8-9e4e-aad44f4c1545'} Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 could not be found. Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 could not be found. Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:03:24.969718 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 could not be found. Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Returning 404 to user: Instance 16a74c57-25dd-42c8-9e4e-aad44f4c1545 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dca169ea-6fd6-4258-be09-bcb5a2594024 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545" status: 404 len: 111 microversion: 2.1 time: 0.039963 Sep 01 06:03:24.974191 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3620/7283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:24 2022] GET /compute/v2.1/servers/16a74c57-25dd-42c8-9e4e-aad44f4c1545 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:03:24.981620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f15147c-eff4-42f4-b82b-e398f1a58cbb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '.version_select at 0x7fa75beecee0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:25.010081 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f15147c-eff4-42f4-b82b-e398f1a58cbb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1496142541" status: 202 len: 0 microversion: 2.1 time: 0.033456 Sep 01 06:03:25.010700 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3664/7284] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 06:03:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1496142541 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:03:33.895688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4854cad5-9459-4d81-828c-a8ceddc63092 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'create', calling method: .version_select at 0x7fa76023aca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1723172811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHzTBpNEIuw03aE8CSRmfMB70dfAhSHo2KfsxBRDYFmjN8d13Ip+bBAPl3wVBKp01HTrMXtKz9AjrkktSdKMb8Xhk0GARZPDqC8O3TRzR5J9i1vp9INbH0H7AiRoH12OQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:33.913165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4854cad5-9459-4d81-828c-a8ceddc63092 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:03:33.919471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4854cad5-9459-4d81-828c-a8ceddc63092 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for user 0a18005274cc44f5a3c390d0f924db56 and project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:03:33.949952 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4854cad5-9459-4d81-828c-a8ceddc63092 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058234 Sep 01 06:03:33.950552 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3621/7285] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:03:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:34.000353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:34.005211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-543471275", "imageRef": "8e1f9fa6-a2cd-4013-b7e9-7d91671a3cd6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1723172811", "networks": [{"uuid": "7db7da97-e623-465e-8b03-37590566fe0e"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:34.063389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] validate_networks() for [('7db7da97-e623-465e-8b03-37590566fe0e', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:03:34.811523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:03:34.811937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:03:34.812405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:03:34.812806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:03:34.813207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:03:34.822272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:34.822751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:34.823211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:34.823926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:34.824372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:34.824784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:34.841852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:03:34.847271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Getting quotas for user 0a18005274cc44f5a3c390d0f924db56 and project 9cee229f11cb4f26a995fd1200fcce82. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:03:34.861975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:03:34.864391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e1f9fa6-a2cd-4013-b7e9-7d91671a3cd6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:03:34.916290 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71c7bdf0-c3c0-4d35-9f85-87e1d4b0a4e6 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919233 Sep 01 06:03:34.916947 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3665/7286] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:03:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 06:03:34.928031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4066075-a44c-4c5e-9798-db2a812def63 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:34.928662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4066075-a44c-4c5e-9798-db2a812def63 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:34.959146 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=44 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:34.988258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4066075-a44c-4c5e-9798-db2a812def63 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:34.999643 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4066075-a44c-4c5e-9798-db2a812def63 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1258 microversion: 2.1 time: 0.074750 Sep 01 06:03:35.020257 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3622/7287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:34 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1258 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:36.032626 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:36.033196 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:36.040927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:36.041461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:36.041877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:36.042571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:36.043049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:36.043483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:36.111062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:36.120668 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b4d172c8-b599-47c3-ba06-b1b9c7937557 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1310 microversion: 2.1 time: 0.092365 Sep 01 06:03:36.121256 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3666/7288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:36 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:37.142406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:37.143093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:37.150788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:37.151314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:37.151755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:37.152460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:37.152923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:37.153402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:37.299198 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:37.307206 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd43246b-e522-4f05-b3df-9a70b4c25054 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.169005 Sep 01 06:03:37.307789 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3623/7289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:37 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:38.329883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:38.331787 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:38.340718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:38.341585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:38.342057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:38.342805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:38.343594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:38.343985 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:38.482498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:38.490579 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ba2e731-b0a6-483c-ad9e-4ca8316954a7 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.166195 Sep 01 06:03:38.491197 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3667/7290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:38 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:39.513851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:39.515560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:39.525259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:39.525924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:39.526633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:39.527921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:39.528686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:39.529376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:39.668976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:39.677307 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a34e909-f7f9-44f6-916f-9deaeadc039e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.169748 Sep 01 06:03:39.678100 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3624/7291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:39 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:40.701803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:40.702573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:40.710660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:40.711193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:40.711630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:40.712344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:40.712796 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:40.713277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:40.869152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:40.882310 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-72da063a-c791-442d-b6f2-647ba0b71d2e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.186402 Sep 01 06:03:40.882950 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3668/7292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:40 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:41.904289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:41.904984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:41.907362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:41.912962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:41.913559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:41.914081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:41.914898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:41.915452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:41.915954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:42.060677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:42.069817 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f5f15c0-0074-4da4-ac87-265d5c08c4fb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.169830 Sep 01 06:03:42.077733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3625/7293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:41 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:43.091560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:43.092175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:43.094928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:43.100800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:43.101341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:43.101726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:43.102428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:43.102911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:43.103334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:43.258643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:43.268621 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74606c5c-b77d-42ba-aad5-fd2872fae307 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.180899 Sep 01 06:03:43.270157 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3669/7294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:43 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:44.294960 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:44.296141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:44.309348 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:44.310362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:44.311625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:44.312500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:44.313143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:44.313719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:44.448216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:44.456763 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f106c4d8-6ae8-4ccc-b72d-82f31e54d61a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.168737 Sep 01 06:03:44.457342 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3626/7295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:44 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:45.481232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:45.482135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:45.486517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:45.487523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:45.497018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:45.497754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:45.498415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:45.499750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:45.500057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:45.500476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:45.640684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:45.648461 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b2581ebc-6174-4469-b4ea-f4c906e25df1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.173136 Sep 01 06:03:45.649028 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3670/7296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:45 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:46.669215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:46.669977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:46.673412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:03:46.680017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:46.680796 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:46.681744 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:46.682371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:46.682925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:46.683438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:46.810927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-afae90ca-a0f5-4dbf-b2b1-38cc12ca862b req-0b613b8b-0e08-4794-a508-171c43070852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:46.822057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afae90ca-a0f5-4dbf-b2b1-38cc12ca862b req-0b613b8b-0e08-4794-a508-171c43070852 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:46.822532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afae90ca-a0f5-4dbf-b2b1-38cc12ca862b req-0b613b8b-0e08-4794-a508-171c43070852 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:46.822978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-afae90ca-a0f5-4dbf-b2b1-38cc12ca862b req-0b613b8b-0e08-4794-a508-171c43070852 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:46.835215 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-afae90ca-a0f5-4dbf-b2b1-38cc12ca862b req-0b613b8b-0e08-4794-a508-171c43070852 service nova] Creating event network-changed:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:03:46.840891 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-afae90ca-a0f5-4dbf-b2b1-38cc12ca862b req-0b613b8b-0e08-4794-a508-171c43070852 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033764 Sep 01 06:03:46.841568 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3671/7297] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:46.897361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:46.906302 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12e8cb7b-cbb9-4b86-a49a-577a8bb3b64d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.240957 Sep 01 06:03:46.906966 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3627/7298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:46 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:47.937977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:47.938584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:47.945755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:47.946236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:47.946673 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:47.947401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:47.947854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:47.948277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:48.085415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:48.094009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-19548e1f-d63c-48a9-920d-aca94c599fa3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.164329 Sep 01 06:03:48.094590 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3672/7299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:47 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:49.119420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:49.120495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:49.132339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:49.133171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:49.133931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:49.135162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:49.135956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:49.136694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:49.287142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:49.297428 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3b19d06-1940-41f4-9018-f362454f8c93 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.184707 Sep 01 06:03:49.298012 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3628/7300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:49 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:50.323322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:50.324189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:50.336166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:50.336969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:50.337693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:50.338830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:50.339663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:50.340366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:50.487704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:50.495938 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-496b9ded-8cc3-4da7-b08e-d9d9c7a273d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.179367 Sep 01 06:03:50.496565 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3673/7301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:50 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:51.521494 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:51.522435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:51.533109 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:51.533587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:51.534057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:51.534754 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:51.535261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:51.535699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:51.670235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:51.678469 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3f3bd54-04fb-45c7-9f88-fff8e4e0e3b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.164055 Sep 01 06:03:51.679045 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3629/7302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:51 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:52.699715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:52.700468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:52.707746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:52.708324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:52.709022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:52.709824 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:52.710363 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:52.710914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:52.758578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4de02c71-05a1-47c1-b221-073dad83a67b req-5a8a56af-60c8-4c86-ada6-c6f67f0be35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "name": "network-vif-plugged", "status": "completed", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:52.768446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4de02c71-05a1-47c1-b221-073dad83a67b req-5a8a56af-60c8-4c86-ada6-c6f67f0be35d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:52.768902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4de02c71-05a1-47c1-b221-073dad83a67b req-5a8a56af-60c8-4c86-ada6-c6f67f0be35d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:52.769525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4de02c71-05a1-47c1-b221-073dad83a67b req-5a8a56af-60c8-4c86-ada6-c6f67f0be35d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:52.781524 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4de02c71-05a1-47c1-b221-073dad83a67b req-5a8a56af-60c8-4c86-ada6-c6f67f0be35d service nova] Creating event network-vif-plugged:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:03:52.787330 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4de02c71-05a1-47c1-b221-073dad83a67b req-5a8a56af-60c8-4c86-ada6-c6f67f0be35d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092226 Sep 01 06:03:52.788321 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3674/7303] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:52.853887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:52.862651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e7dc93b-0a21-4b03-8305-24d9cc21ca8d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.167321 Sep 01 06:03:52.863479 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3630/7304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:52 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:53.886207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:53.886962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:53.894507 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:53.895074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:53.895547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:53.896305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:53.896801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:53.897261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:54.034638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:54.042812 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f6629793-8c61-4024-aed1-7ab4fdea14bb tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1358 microversion: 2.1 time: 0.162349 Sep 01 06:03:54.043444 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3675/7305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:53 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:55.064511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:55.064896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:55.072128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.072632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.073061 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.073789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.074255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.074691 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.215334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:55.224712 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6b2f856-0ddb-4ff0-8fab-2d8db65972d1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1548 microversion: 2.1 time: 0.164770 Sep 01 06:03:55.225290 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3631/7306] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:55 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:55.245433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:55.246012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:55.253185 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.253657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.254080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.254762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.255235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.255647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.401789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:55.410605 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2dc012f4-c9cc-467a-82a8-575c6f113569 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1548 microversion: 2.1 time: 0.169058 Sep 01 06:03:55.411228 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3676/7307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:55 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:03:55.433455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:55.439818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:55.440500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Searching by: {'deleted': False, 'project_id': '9cee229f11cb4f26a995fd1200fcce82'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 06:03:55.446236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.446731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.447228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.447975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.448435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.448873 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.475160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 06:03:55.506684 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6148bb8f-3c17-432a-b4fb-a6e38e135178 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.079383 Sep 01 06:03:55.507562 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3632/7308] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 1 06:03:55 2022] GET /compute/v2.1/servers => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:03:55.519222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:03:55.519837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:55.526980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.527472 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.527908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.528627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:55.529069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:55.529775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:55.679951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:03:55.688423 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1b5506a6-b6df-4ad3-b8b3-5118739b9d04 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1548 microversion: 2.1 time: 0.173177 Sep 01 06:03:55.688980 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3677/7309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:03:55 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:03:57.215826 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "216d901a-fe19-499b-98de-ba41df332676"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:03:57.218296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:03:57.226211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:57.226719 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:57.227223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:57.227940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:03:57.228419 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:03:57.228861 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:03:57.521528 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a39634b6-8e52-48a5-b3fa-7e931febd0b1 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309526 Sep 01 06:03:57.522292 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3633/7310] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 1 06:03:57 2022] POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:04:08.353136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:04:08.353742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:04:08.355980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=17 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:04:08.356901 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=66 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:04:08.364184 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:08.364656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:08.365088 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:08.365812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:08.366261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:08.366659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:08.503466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:04:08.512231 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c8d57843-034f-4b21-bf58-f7727c702c94 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1594 microversion: 2.1 time: 0.163334 Sep 01 06:04:08.512744 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3678/7311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:04:08 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:04:10.175309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2c765d9f-c48c-48ab-8eaf-4bc01691b1f2 req-6d7aac62-95cd-4680-ba53-46f4ab405e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:04:10.181604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:04:10.182445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=17 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:04:10.186863 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:04:10.193584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c765d9f-c48c-48ab-8eaf-4bc01691b1f2 req-6d7aac62-95cd-4680-ba53-46f4ab405e5e service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:10.194516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c765d9f-c48c-48ab-8eaf-4bc01691b1f2 req-6d7aac62-95cd-4680-ba53-46f4ab405e5e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:10.194972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c765d9f-c48c-48ab-8eaf-4bc01691b1f2 req-6d7aac62-95cd-4680-ba53-46f4ab405e5e service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:10.208266 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2c765d9f-c48c-48ab-8eaf-4bc01691b1f2 req-6d7aac62-95cd-4680-ba53-46f4ab405e5e service nova] Creating event network-changed:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:04:10.214039 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2c765d9f-c48c-48ab-8eaf-4bc01691b1f2 req-6d7aac62-95cd-4680-ba53-46f4ab405e5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051102 Sep 01 06:04:10.214964 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3634/7312] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:04:11.668619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1395418061"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:04:11.669165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:04:11.679672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:11.680381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:11.681015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:11.682225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:11.682867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:11.683550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:11.822707 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Adding security group 490d4313-85ab-4576-b37c-ccd398ac65b9 to port d36dab76-fbf7-4af2-9eda-c4223de816e5 Sep 01 06:04:12.157845 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-77655819-3f0b-4e3b-8006-2c373f22f97a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.494699 Sep 01 06:04:12.157845 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3679/7313] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:04:11 2022] POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:04:12.167072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:04:12.167778 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:04:12.176009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:12.176901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:12.177115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:12.178053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:12.178591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:12.179300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:12.232537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b482f166-d1b5-4d1e-b893-1be3936210d7 req-24c30125-cc28-4ca3-a23b-40c20ca21d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:04:12.243086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b482f166-d1b5-4d1e-b893-1be3936210d7 req-24c30125-cc28-4ca3-a23b-40c20ca21d61 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:04:12.244760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b482f166-d1b5-4d1e-b893-1be3936210d7 req-24c30125-cc28-4ca3-a23b-40c20ca21d61 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:04:12.245378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b482f166-d1b5-4d1e-b893-1be3936210d7 req-24c30125-cc28-4ca3-a23b-40c20ca21d61 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:04:12.258384 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b482f166-d1b5-4d1e-b893-1be3936210d7 req-24c30125-cc28-4ca3-a23b-40c20ca21d61 service nova] Creating event network-changed:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:04:12.263955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b482f166-d1b5-4d1e-b893-1be3936210d7 req-24c30125-cc28-4ca3-a23b-40c20ca21d61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035146 Sep 01 06:04:12.264933 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3680/7314] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:04:12.345642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:04:12.354818 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab215528-0ca0-4a58-9bc5-1c6857f17f71 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1760 microversion: 2.1 time: 0.192358 Sep 01 06:04:12.355511 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3635/7315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:04:12 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1760 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:00.524545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:05:00.527405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:00.529999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:05:00.530790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:05:00.539432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:00.540024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:00.540568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:00.541397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:00.541957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:00.542474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:00.623358 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1cb87a2d-87d5-4f59-9b0b-b851b9bcf45a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.105850 Sep 01 06:05:00.624100 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3681/7316] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:05:00 2022] POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:05:00.632426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:00.633138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:00.635872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:05:00.636698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:05:00.637445 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:05:00.637617 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 (ip 10.222.0.26) !!! Sep 01 06:05:00.645907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:00.646414 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:00.646854 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:00.648073 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:00.648538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:00.649008 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:00.884432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:00.892804 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14c61493-51ee-48bd-acb1-8ec503ba362b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1752 microversion: 2.1 time: 0.264341 Sep 01 06:05:00.893390 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3636/7317] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:00 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1752 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:01.921964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:01.923049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:01.931230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:01.931719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:01.932155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:01.932846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:01.933303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:01.933733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:02.094607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:02.103960 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a01cd1d-2956-43fc-9d75-2ae1a3541019 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.191368 Sep 01 06:05:02.104566 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3682/7318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:01 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:03.126776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:03.127500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:03.135509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:03.136015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:03.136464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:03.137172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:03.137647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:03.138092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:03.284806 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:03.294081 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65194931-7b93-4f2d-be0b-4ed46f39d855 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.171694 Sep 01 06:05:03.294670 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3637/7319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:03 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:04.321076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:04.322059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:04.333485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:04.333966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:04.334400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:04.335121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:04.335570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:04.335984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:04.486793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:04.495813 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-613d9ca9-8886-437a-a6a7-597ad2455979 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.182153 Sep 01 06:05:04.496393 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3683/7320] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:04 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:05.523019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:05.524123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:05.536361 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:05.536860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:05.537306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:05.538013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:05.538477 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:05.538996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:05.696932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:05.705772 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1e1ae9d-19e1-475c-8fa2-04ce72037b14 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.189830 Sep 01 06:05:05.706351 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3638/7321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:05 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:06.731569 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:06.732489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:06.743980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:06.744795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:06.745557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:06.746683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:06.747473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:06.748172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:06.910637 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:06.920375 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bde58038-ad65-4ba5-8bc4-7efd226b15da tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.195523 Sep 01 06:05:06.920926 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3684/7322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:06 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:07.946369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:07.947572 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:07.959193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:07.959786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:07.960368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:07.961092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:07.961561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:07.961994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:08.107825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:08.118057 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f71933f3-3d4f-42a8-836a-cbf8e37d2155 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.178707 Sep 01 06:05:08.118690 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3639/7323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:07 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:09.148451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:09.149094 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:09.156497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:09.156986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:09.157425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:09.158127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:09.158590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:09.159045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:09.310614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:09.319424 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2503efa2-a424-4073-b4e6-85d3c2c7da6a tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.175461 Sep 01 06:05:09.320007 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3685/7324] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:09 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:10.344369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:10.345066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:10.356987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:10.357727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:10.358438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:10.359567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:10.360285 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:10.360944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:10.509379 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:10.518137 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d37b06b-f266-4030-8402-428dec836a7f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.180264 Sep 01 06:05:10.518724 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3640/7325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:10 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:11.542570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:11.543236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:11.550907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:11.551404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:11.551833 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:11.552525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:11.552976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:11.553392 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:11.711631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:11.720375 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a31d74fa-0df1-443a-a7f7-dd1ee88dd2d9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1757 microversion: 2.1 time: 0.182430 Sep 01 06:05:11.720966 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3686/7326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:11 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:05:12.747814 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:05:12.748933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:05:12.759910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:12.760412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:12.760867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:12.761575 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:05:12.762045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:05:12.762490 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:05:12.928230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:05:12.937706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-594508b4-d743-4068-9409-99eec912af5b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1760 microversion: 2.1 time: 0.197297 Sep 01 06:05:12.938297 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3641/7327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:05:12 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:16.187054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:16.187873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:16.192304 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1395418061"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:16.192844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:16.200668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:16.201139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:16.201568 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:16.202243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:16.202688 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:16.203138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:16.335738 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.network.security_group_api [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Removing security group 490d4313-85ab-4576-b37c-ccd398ac65b9 from port d36dab76-fbf7-4af2-9eda-c4223de816e5 Sep 01 06:06:16.676799 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d37097e9-5ad8-4660-88d2-55649f0744ef tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.491828 Sep 01 06:06:16.680561 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3687/7328] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:06:16 2022] POST /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:06:16.684801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:16.686058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:16.690564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:16.719596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:16.720215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:16.720751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:16.738910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] Creating event network-changed:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:06:16.743244 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] [d81edece-a13c-4f64-ba79-04577897e545] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:06:17.753187 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] [d81edece-a13c-4f64-ba79-04577897e545] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53664. Sep 01 06:06:17.757627 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9fa9de14-fda7-4bf5-b85c-da867be79f00 req-c520cf81-e470-48ed-b6d7-f3123fdf4356 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.075201 Sep 01 06:06:17.758262 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3642/7329] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:18.116076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:18.116707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:18.123578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:18.124033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:18.124657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:18.125622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:18.126114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:18.126628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:18.215545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lazy-loading 'services' on Instance uuid 69b7d258-0036-4155-972b-a0330ac8c1d3 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:06:18.292857 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e15f1508-099f-499e-88cd-38a37b906413 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments/216d901a-fe19-499b-98de-ba41df332676" status: 202 len: 0 microversion: 2.1 time: 0.181752 Sep 01 06:06:18.297137 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3688/7330] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 06:06:18 2022] DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments/216d901a-fe19-499b-98de-ba41df332676 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:06:18.305584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:18.308633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:18.318099 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:18.318733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:18.319301 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:18.320117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:18.320651 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:18.321173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:18.370738 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56ccaf5e-eda8-4d87-ba9b-03806c1399b4 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071290 Sep 01 06:06:18.371405 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3643/7331] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:06:18 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:19.385737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:19.388287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:19.395242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:19.395734 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:19.396170 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:19.397221 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:19.397685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:19.398105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:19.432535 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c0e0e28-bb3f-4f7c-a3f2-4b79fbd0f11e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052233 Sep 01 06:06:19.433111 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3689/7332] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:06:19 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:20.000194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f272c772-d240-4274-9547-75e48d1d35d2 req-6a6356fc-ebbe-49d3-9011-6a1a0d0bd71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:20.006269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f272c772-d240-4274-9547-75e48d1d35d2 req-6a6356fc-ebbe-49d3-9011-6a1a0d0bd71a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:20.006765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f272c772-d240-4274-9547-75e48d1d35d2 req-6a6356fc-ebbe-49d3-9011-6a1a0d0bd71a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:20.007251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f272c772-d240-4274-9547-75e48d1d35d2 req-6a6356fc-ebbe-49d3-9011-6a1a0d0bd71a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:20.019257 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f272c772-d240-4274-9547-75e48d1d35d2 req-6a6356fc-ebbe-49d3-9011-6a1a0d0bd71a service nova] Creating event network-changed:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:06:20.024989 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f272c772-d240-4274-9547-75e48d1d35d2 req-6a6356fc-ebbe-49d3-9011-6a1a0d0bd71a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032922 Sep 01 06:06:20.025719 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3644/7333] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:20.445341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:20.447710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:20.455134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:20.455984 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:20.456631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:20.457360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:20.458051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:20.458480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:20.492117 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef110141-458d-44d1-a54d-528fc462f198 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050835 Sep 01 06:06:20.492954 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3690/7334] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:06:20 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:21.506355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:21.508711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:21.515631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:21.516128 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:21.516571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:21.517276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:21.517740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:21.518171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:21.551384 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bb86602-d1c6-48d4-a7de-8f705492f4bc tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050154 Sep 01 06:06:21.551979 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3645/7335] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:06:21 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:22.564504 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:22.567358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:22.574623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:22.575166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:22.575595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:22.576285 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:22.576725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:22.577144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:22.609194 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bc265b7-2225-4bd5-acdb-00d2ab299dd0 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048829 Sep 01 06:06:22.609781 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3691/7336] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:06:22 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:23.622900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:23.625244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:23.632426 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:23.632930 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:23.633413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:23.634123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:23.634590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:23.635060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:23.667161 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35fcf51a-e47d-4f35-92e5-fd7f405586f8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048517 Sep 01 06:06:23.667748 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3646/7337] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 1 06:06:23 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 06:06:23.678784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:23.679316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:23.686704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:23.687310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:23.687751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:23.688475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:23.688954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:23.689501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:23.768181 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] HTTP exception thrown: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 is not attached to volume 216d901a-fe19-499b-98de-ba41df332676 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Request method failure captured: Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: request: DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments/216d901a-fe19-499b-98de-ba41df332676 HTTP/1.1 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEn4QHDbJ2DNRLEAasI6Zrw-z5JP6_G-MV3nV1E6TpCq-etcyNo0ko7JmkrPCK5WeczotlkxlTY7ep6rEjGwnf3Ndgrvk7PMMnjzYfQHc-q4nJAR5bmSAT3jDqLuGFvsqrku_BXfCt2XYYd8fxXqlCRdDpxF9f4YFoOiLytlICsG7is Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 0a18005274cc44f5a3c390d0f924db56 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 is not attached to volume 216d901a-fe19-499b-98de-ba41df332676 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'server_id': '69b7d258-0036-4155-972b-a0330ac8c1d3', 'id': '216d901a-fe19-499b-98de-ba41df332676'} Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 216d901a-fe19-499b-98de-ba41df332676. Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 is not attached to volume 216d901a-fe19-499b-98de-ba41df332676 Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:06:23.769803 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 is not attached to volume 216d901a-fe19-499b-98de-ba41df332676 Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Returning 404 to user: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 is not attached to volume 216d901a-fe19-499b-98de-ba41df332676 {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3c69a882-4778-41fe-bd33-77c52136182f tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments/216d901a-fe19-499b-98de-ba41df332676" status: 404 len: 154 microversion: 2.1 time: 0.096603 Sep 01 06:06:23.774750 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3692/7338] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 1 06:06:23 2022] DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3/os-volume_attachments/216d901a-fe19-499b-98de-ba41df332676 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:06:27.027487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:27.027987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:27.035217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:27.035715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:27.036159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:27.036866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:27.037330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:27.037770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:27.067142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:06:27.156167 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6787db73-3e28-40fc-b0c6-67f26da477a8 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 204 len: 0 microversion: 2.1 time: 0.132441 Sep 01 06:06:27.157076 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3647/7339] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:06:27 2022] DELETE /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:06:27.165910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:27.166545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:27.174846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:27.175600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:27.176378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:27.177228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:27.177857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:27.178335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:27.393326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:27.402082 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db068e6b-0204-4001-8f0a-695ee3face7e tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1554 microversion: 2.1 time: 0.240396 Sep 01 06:06:27.402659 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3693/7340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:27 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:28.428079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:28.429263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:28.438846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:28.439383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:28.439844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:28.440567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:28.441039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:28.441493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:28.624436 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:28.633009 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74af2009-6cc7-4f3c-92b8-367fb078f63b tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1554 microversion: 2.1 time: 0.212273 Sep 01 06:06:28.633589 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3648/7341] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:28 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:29.658653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:29.659996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:29.670589 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:29.671119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:29.671559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:29.672266 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:29.672721 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:29.673121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:29.888267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a18005274cc44f5a3c390d0f924db56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cee229f11cb4f26a995fd1200fcce82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:29.901120 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7452029b-10f8-4b8e-9723-83e41f15f4c3 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 200 len: 1554 microversion: 2.1 time: 0.249211 Sep 01 06:06:29.901963 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3694/7342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:29 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:29.953262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1b3f4746-5de1-4bad-883a-fa8fc90d1245 req-8293734b-ed4e-4d7c-b7f8-cfd682197511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b7d258-0036-4155-972b-a0330ac8c1d3", "name": "network-vif-deleted", "tag": "d36dab76-fbf7-4af2-9eda-c4223de816e5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:29.963978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1b3f4746-5de1-4bad-883a-fa8fc90d1245 req-8293734b-ed4e-4d7c-b7f8-cfd682197511 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:29.964472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1b3f4746-5de1-4bad-883a-fa8fc90d1245 req-8293734b-ed4e-4d7c-b7f8-cfd682197511 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:29.965031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1b3f4746-5de1-4bad-883a-fa8fc90d1245 req-8293734b-ed4e-4d7c-b7f8-cfd682197511 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:29.977228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1b3f4746-5de1-4bad-883a-fa8fc90d1245 req-8293734b-ed4e-4d7c-b7f8-cfd682197511 service nova] Creating event network-vif-deleted:d36dab76-fbf7-4af2-9eda-c4223de816e5 for instance 69b7d258-0036-4155-972b-a0330ac8c1d3 on n-h2-820368-37 Sep 01 06:06:29.982630 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1b3f4746-5de1-4bad-883a-fa8fc90d1245 req-8293734b-ed4e-4d7c-b7f8-cfd682197511 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Sep 01 06:06:29.983279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3649/7343] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:30.924312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:30.924923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [instance: 69b7d258-0036-4155-972b-a0330ac8c1d3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:30.932313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:30.932810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:30.933247 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:30.934004 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:30.934846 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:30.935333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:30.949486 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] HTTP exception thrown: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 could not be found. Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Request method failure captured: Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 HTTP/1.1 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEn4QHDbJ2DNRLEAasI6Zrw-z5JP6_G-MV3nV1E6TpCq-etcyNo0ko7JmkrPCK5WeczotlkxlTY7ep6rEjGwnf3Ndgrvk7PMMnjzYfQHc-q4nJAR5bmSAT3jDqLuGFvsqrku_BXfCt2XYYd8fxXqlCRdDpxF9f4YFoOiLytlICsG7is Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cee229f11cb4f26a995fd1200fcce82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 9cee229f11cb4f26a995fd1200fcce82 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestMinimumBasicScenario-96506504 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 0a18005274cc44f5a3c390d0f924db56 Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestMinimumBasicScenario-96506504-project Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 could not be found. Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '69b7d258-0036-4155-972b-a0330ac8c1d3'} Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 could not be found. Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 could not be found. Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:06:30.951152 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 could not be found. Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Returning 404 to user: Instance 69b7d258-0036-4155-972b-a0330ac8c1d3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-564f67a8-0305-4d9f-ab8a-c984b26bc60d tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3" status: 404 len: 111 microversion: 2.1 time: 0.032768 Sep 01 06:06:30.955841 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3695/7344] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:30 2022] GET /compute/v2.1/servers/69b7d258-0036-4155-972b-a0330ac8c1d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:06:30.962810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be6b6f88-f7c6-44b2-b030-d52b4a73beb9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] Calling method '.version_select at 0x7fa75be93c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:30.967995 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be6b6f88-f7c6-44b2-b030-d52b4a73beb9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:06:31.980528 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-be6b6f88-f7c6-44b2-b030-d52b4a73beb9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53730. Sep 01 06:06:32.004241 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be6b6f88-f7c6-44b2-b030-d52b4a73beb9 tempest-TestMinimumBasicScenario-96506504 tempest-TestMinimumBasicScenario-96506504-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1723172811" status: 202 len: 0 microversion: 2.1 time: 1.046139 Sep 01 06:06:32.004812 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3650/7345] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 1 06:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1723172811 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:06:41.532846 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:06:41.533315 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Sep 01 06:06:41.533986 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:06:41.534163 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Sep 01 06:06:41.534917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=18 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:41.535634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:41.707744 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1a317bb9-f6ff-416f-9a26-369e5b5305a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: .version_select at 0x7fa76172bd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1926866549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMynGn0qLlOfAiVzctA+QIo8jVijnNVf1Jl2XBDxnb7cxWjkzvGiJ1v3SlaUrCN0b33Y+1RZ5i8vM3ORH9m7456A5Bk6bZGqvQANY5Zul1ilGzT3BYrYYSj0jACNN4BldQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:41.723806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1a317bb9-f6ff-416f-9a26-369e5b5305a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:06:41.729234 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-1a317bb9-f6ff-416f-9a26-369e5b5305a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:06:41.768127 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1a317bb9-f6ff-416f-9a26-369e5b5305a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.241389 Sep 01 06:06:41.768771 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3696/7346] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:06:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:47.998866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1570713877", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "1115c197-25f1-45d3-92fb-ddbc89ad2c90"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1926866549", "security_groups": [{"name": "tempest-secgroup-smoke-1962280495"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:48.016111 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:48.017739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:48.142851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] validate_networks() for [('1115c197-25f1-45d3-92fb-ddbc89ad2c90', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:06:48.647832 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:06:48.648403 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:06:48.648965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:06:48.649496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:06:48.650054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:06:48.659304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:48.659978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:48.660499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:48.661316 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:48.661877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:48.662387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:48.680169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:06:48.687833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:06:48.702160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:06:48.705189 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:06:48.758943 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99915488-8331-40e0-b49a-c31fb42a5285 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766113 Sep 01 06:06:48.759907 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3651/7347] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:06:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 06:06:48.772693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ecced7c1-b3c5-4682-af86-2952a21b2b4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:48.773307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ecced7c1-b3c5-4682-af86-2952a21b2b4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:48.832102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ecced7c1-b3c5-4682-af86-2952a21b2b4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:48.840787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ecced7c1-b3c5-4682-af86-2952a21b2b4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1267 microversion: 2.1 time: 0.073219 Sep 01 06:06:48.841361 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3697/7348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:48 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:49.862074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:49.863638 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:49.870715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:49.871243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:49.871969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:49.873068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:49.873547 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:49.873993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:49.946332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:49.955031 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9cdaeb13-9d4b-4153-ae25-291a8783fed9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1319 microversion: 2.1 time: 0.097765 Sep 01 06:06:49.956488 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3652/7349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:49 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:50.976932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:50.977669 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:50.984753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:50.985236 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:50.985663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:50.986353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:50.986800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:50.987240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:51.215691 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:51.224128 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e33ea627-5f88-49fd-a3d3-d3f8ff86b72c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.251201 Sep 01 06:06:51.224823 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3698/7350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:50 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:51.545582 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-26d72ff7-f423-4225-9176-7d763074caed req-90ee4cf8-535d-4cf7-9cea-61de0d655229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d35a9db-c6e8-4eb7-b33d-6924ece04b7c", "tag": "dba8ccda-9bb6-4c73-a208-b2061fbc31f0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:51.559236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-26d72ff7-f423-4225-9176-7d763074caed req-90ee4cf8-535d-4cf7-9cea-61de0d655229 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:51.560068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-26d72ff7-f423-4225-9176-7d763074caed req-90ee4cf8-535d-4cf7-9cea-61de0d655229 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:51.560672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-26d72ff7-f423-4225-9176-7d763074caed req-90ee4cf8-535d-4cf7-9cea-61de0d655229 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:51.576619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-26d72ff7-f423-4225-9176-7d763074caed req-90ee4cf8-535d-4cf7-9cea-61de0d655229 service nova] Creating event network-changed:dba8ccda-9bb6-4c73-a208-b2061fbc31f0 for instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c on n-h2-820368-37 Sep 01 06:06:51.582835 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-26d72ff7-f423-4225-9176-7d763074caed req-90ee4cf8-535d-4cf7-9cea-61de0d655229 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042684 Sep 01 06:06:51.584080 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3653/7351] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:52.248518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:52.249430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:52.260195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:52.260883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:52.261621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:52.262381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:52.262843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:52.263317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:52.406619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:52.418943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f576478-d4cf-408a-a458-f8e259035f23 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.175419 Sep 01 06:06:52.419984 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3699/7352] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:52 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:53.449164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:53.449889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:53.457511 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:53.458018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:53.458485 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:53.459237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:53.459734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:53.460163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:53.606153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:53.614474 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccae49a3-1d43-486c-9288-7ce4356a3e93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.172104 Sep 01 06:06:53.615074 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3654/7353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:53 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:54.635829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:54.636449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:54.644046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:54.644511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:54.644977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:54.646040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:54.646828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:54.647259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:54.784165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:54.792360 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9165a42d-2a76-4d81-9e20-76c91f903e2e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.160537 Sep 01 06:06:54.792931 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3700/7354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:54 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:55.813518 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:55.814254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:55.821612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:55.822177 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:55.822564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:55.823300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:55.823846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:55.824282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:55.975416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:55.984086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05a462ad-49ac-4938-9abf-a7eda29dfac4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.174567 Sep 01 06:06:55.984699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3655/7355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:55 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:57.006853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:57.007608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:57.015459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:57.016026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:57.016532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:57.017341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:57.017865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:57.018359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:57.175322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:57.184489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-914ff942-3448-487f-b37e-cfc6f6628383 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.182356 Sep 01 06:06:57.185349 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3701/7356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:57 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:57.784551 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9b617af5-a463-40f3-a800-2d43c9cbbbbe req-7d825144-fc4f-4f75-afe0-52a77fd31c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d35a9db-c6e8-4eb7-b33d-6924ece04b7c", "name": "network-vif-plugged", "status": "completed", "tag": "dba8ccda-9bb6-4c73-a208-b2061fbc31f0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:06:57.795827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b617af5-a463-40f3-a800-2d43c9cbbbbe req-7d825144-fc4f-4f75-afe0-52a77fd31c9d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:57.796640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b617af5-a463-40f3-a800-2d43c9cbbbbe req-7d825144-fc4f-4f75-afe0-52a77fd31c9d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:57.796640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9b617af5-a463-40f3-a800-2d43c9cbbbbe req-7d825144-fc4f-4f75-afe0-52a77fd31c9d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:57.808573 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9b617af5-a463-40f3-a800-2d43c9cbbbbe req-7d825144-fc4f-4f75-afe0-52a77fd31c9d service nova] Creating event network-vif-plugged:dba8ccda-9bb6-4c73-a208-b2061fbc31f0 for instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c on n-h2-820368-37 Sep 01 06:06:57.813699 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9b617af5-a463-40f3-a800-2d43c9cbbbbe req-7d825144-fc4f-4f75-afe0-52a77fd31c9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Sep 01 06:06:57.814663 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3656/7357] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:06:58.214908 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:58.216135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:58.227941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:58.228749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:58.229490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:58.230629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:58.231548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:58.232192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:58.376847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:58.385160 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5c5bdd9-235d-4547-adf4-45ae13367358 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1393 microversion: 2.1 time: 0.177052 Sep 01 06:06:58.385745 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3702/7358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:58 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:59.403747 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:59.404699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:59.409715 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:59.410578 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:59.417746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:59.418244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:59.418703 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:59.419430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:59.419936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:59.420442 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:59.574757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:59.583303 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9f37480-aa0f-4bc2-8b01-7723e35afa3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1566 microversion: 2.1 time: 0.180575 Sep 01 06:06:59.583889 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3657/7359] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:59 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:06:59.606156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:06:59.606716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:06:59.609144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:06:59.617495 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:59.618101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:59.618714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:59.619597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:06:59.620239 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:06:59.620760 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:06:59.775251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:06:59.783263 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3d2b4bb-ef12-4dab-99f4-b398b5cc2437 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1566 microversion: 2.1 time: 0.183340 Sep 01 06:06:59.783847 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3703/7360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:06:59 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:07:01.773961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:07:01.775199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:07:01.776163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5a267b82-a365-424c-b626-7db404d4fa80 req-cd958150-fb41-45c3-892a-3a0c45a242b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d35a9db-c6e8-4eb7-b33d-6924ece04b7c", "tag": "dba8ccda-9bb6-4c73-a208-b2061fbc31f0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:07:01.783860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:07:01.784662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:07:01.785341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:07:01.786280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:07:01.786926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a267b82-a365-424c-b626-7db404d4fa80 req-cd958150-fb41-45c3-892a-3a0c45a242b3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:07:01.787235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:07:01.787410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a267b82-a365-424c-b626-7db404d4fa80 req-cd958150-fb41-45c3-892a-3a0c45a242b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:07:01.788014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5a267b82-a365-424c-b626-7db404d4fa80 req-cd958150-fb41-45c3-892a-3a0c45a242b3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:07:01.788156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:07:01.800423 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5a267b82-a365-424c-b626-7db404d4fa80 req-cd958150-fb41-45c3-892a-3a0c45a242b3 service nova] Creating event network-changed:dba8ccda-9bb6-4c73-a208-b2061fbc31f0 for instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c on n-h2-820368-37 Sep 01 06:07:01.805650 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5a267b82-a365-424c-b626-7db404d4fa80 req-cd958150-fb41-45c3-892a-3a0c45a242b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033664 Sep 01 06:07:01.806260 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3704/7361] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:07:02.022028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:07:02.031301 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a3c846f-a3b9-44e9-ab19-230fe8a4f112 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1566 microversion: 2.1 time: 0.261495 Sep 01 06:07:02.032120 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3658/7362] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:07:01 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1566 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:07:35.373745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:07:35.374558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:07:35.379081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:07:35.381337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:07:35.389187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:07:35.389667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:07:35.390096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:07:35.390801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:07:35.391282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:07:35.391706 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:07:35.463130 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2fd25341-e384-403f-b223-7167cb29dd78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action" status: 200 len: 24561 microversion: 2.1 time: 0.091651 Sep 01 06:07:35.463801 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3705/7363] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:07:35 2022] POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action => generated 24561 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:08:14.541567 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:14.542415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:14.546912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:14.547546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:14.555476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:14.556071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:14.556515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:14.557280 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:14.557800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:14.558275 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:14.635206 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4958829-4c2b-4600-9c51-ea952bd6c379 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action" status: 202 len: 0 microversion: 2.1 time: 0.095874 Sep 01 06:08:14.635854 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3659/7364] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:08:14 2022] POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:08:14.647032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:14.647905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:14.650825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:14.651580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:14.658925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:14.659414 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:14.659847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:14.660546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:14.660995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:14.661423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:14.804026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:14.815365 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b8cc760-797b-413e-9354-4f803247b812 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1690 microversion: 2.1 time: 0.173896 Sep 01 06:08:14.816077 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3706/7365] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:14 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:15.842210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:15.843115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:15.850911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:15.851523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:15.852040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:15.852896 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:15.853453 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:15.853976 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:15.995021 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:16.003516 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0fa5d03-04ee-41f4-8cec-225a9555cd2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1670 microversion: 2.1 time: 0.168350 Sep 01 06:08:16.004108 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3660/7366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:15 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:17.113106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:17.116698 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:17.125086 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:17.125581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:17.126026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:17.126739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:17.127223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:17.127679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:17.200955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6da3e53c-5e6c-4849-a3de-580a85c9f3d8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action" status: 200 len: 32638 microversion: 2.1 time: 0.094308 Sep 01 06:08:17.201567 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3707/7367] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:08:17 2022] POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action => generated 32638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:08:17.213761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:17.214318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:17.221885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:17.222835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:17.222835 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:17.223552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:17.224019 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:17.224455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:17.306201 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6aed940a-949a-4fe2-b508-06933bd79d35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action" status: 202 len: 0 microversion: 2.1 time: 0.096378 Sep 01 06:08:17.309249 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3661/7368] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:08:17 2022] POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:08:17.315859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:17.316657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:17.323999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:17.324540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:17.324936 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:17.325628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:17.326076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:17.326490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:17.466770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:17.474752 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-927f3ae1-6a21-4638-a90e-73e462412256 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1677 microversion: 2.1 time: 0.163266 Sep 01 06:08:17.475438 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3708/7369] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:17 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:18.500334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:18.501068 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:18.508825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:18.509317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:18.509763 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:18.510468 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:18.510971 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:18.511402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:18.665371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:18.673661 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2db08998-a74c-4c4e-8728-a8b5f5958d6d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1685 microversion: 2.1 time: 0.179644 Sep 01 06:08:18.674274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3662/7370] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:18 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:18.785956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:18.788205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:18.796265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:18.796749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:18.797180 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:18.797869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:18.798291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:18.798718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:18.864955 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b580b30d-98f7-40ae-a85b-08b6d4b66f27 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action" status: 200 len: 38472 microversion: 2.1 time: 0.082334 Sep 01 06:08:18.865772 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3709/7371] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:08:18 2022] POST /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c/action => generated 38472 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:08:19.878705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:19.880014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:19.887743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:19.888368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:19.888909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:19.889918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:19.890661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:19.891205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:19.920967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:08:19.941411 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c41f6bb6-3abd-4a04-b535-3e58c10ef96e req-dd893bc0-d3d1-4af1-961d-049b02dd52d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d35a9db-c6e8-4eb7-b33d-6924ece04b7c", "tag": "dba8ccda-9bb6-4c73-a208-b2061fbc31f0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:19.953108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c41f6bb6-3abd-4a04-b535-3e58c10ef96e req-dd893bc0-d3d1-4af1-961d-049b02dd52d6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:19.953864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c41f6bb6-3abd-4a04-b535-3e58c10ef96e req-dd893bc0-d3d1-4af1-961d-049b02dd52d6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:19.954301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c41f6bb6-3abd-4a04-b535-3e58c10ef96e req-dd893bc0-d3d1-4af1-961d-049b02dd52d6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:19.967371 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c41f6bb6-3abd-4a04-b535-3e58c10ef96e req-dd893bc0-d3d1-4af1-961d-049b02dd52d6 service nova] Creating event network-changed:dba8ccda-9bb6-4c73-a208-b2061fbc31f0 for instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c on n-h2-820368-37 Sep 01 06:08:19.972611 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c41f6bb6-3abd-4a04-b535-3e58c10ef96e req-dd893bc0-d3d1-4af1-961d-049b02dd52d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095426 Sep 01 06:08:19.973232 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3710/7372] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:08:20.007180 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eaccc14-5c43-4ff0-ad4f-e0717bb2987e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 204 len: 0 microversion: 2.1 time: 0.132250 Sep 01 06:08:20.008279 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3663/7373] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:08:19 2022] DELETE /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:08:20.017081 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:20.018148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:20.026348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:20.027146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:20.027801 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:20.028695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:20.029163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:20.029593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:20.177638 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:20.185890 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-811ff807-a360-4bb0-9820-6fb4cd82db67 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1691 microversion: 2.1 time: 0.173084 Sep 01 06:08:20.186467 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3711/7374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:20 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:08:21.214693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:21.215844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:21.227573 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:21.227916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:21.228437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:21.229066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:21.229529 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:21.229958 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:21.420602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:21.428973 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0745669a-c6f1-499e-a72f-b32fd071c254 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1691 microversion: 2.1 time: 0.222085 Sep 01 06:08:21.429563 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3664/7375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:21 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:22.394288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-62b4e15b-ef2f-465b-ae58-aee511238181 req-0de6dc7c-be07-4dd3-8fd5-7333beb2e334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d35a9db-c6e8-4eb7-b33d-6924ece04b7c", "name": "network-vif-deleted", "tag": "dba8ccda-9bb6-4c73-a208-b2061fbc31f0"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:22.407454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62b4e15b-ef2f-465b-ae58-aee511238181 req-0de6dc7c-be07-4dd3-8fd5-7333beb2e334 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:22.407924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62b4e15b-ef2f-465b-ae58-aee511238181 req-0de6dc7c-be07-4dd3-8fd5-7333beb2e334 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:22.408345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-62b4e15b-ef2f-465b-ae58-aee511238181 req-0de6dc7c-be07-4dd3-8fd5-7333beb2e334 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:22.419782 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-62b4e15b-ef2f-465b-ae58-aee511238181 req-0de6dc7c-be07-4dd3-8fd5-7333beb2e334 service nova] Creating event network-vif-deleted:dba8ccda-9bb6-4c73-a208-b2061fbc31f0 for instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c on n-h2-820368-37 Sep 01 06:08:22.425231 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-62b4e15b-ef2f-465b-ae58-aee511238181 req-0de6dc7c-be07-4dd3-8fd5-7333beb2e334 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091661 Sep 01 06:08:22.425840 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3712/7376] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:08:22.450297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:22.450913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:22.458955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:22.459466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:22.460050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:22.460859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:22.461339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:22.461781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:22.495590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:22.496017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:22.496471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:22.496936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lazy-loading 'fault' on Instance uuid 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:08:22.540708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:22.548839 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d23eb48b-ec62-4c62-804a-e24cf978f48f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 200 len: 1357 microversion: 2.1 time: 0.103094 Sep 01 06:08:22.549416 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3665/7377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:22 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:23.574878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:23.575718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:23.583539 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:23.584106 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:23.584615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:23.585434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:23.585973 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:23.586476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:23.602662 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] HTTP exception thrown: Instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c could not be found. Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Request method failure captured: Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c HTTP/1.1 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEvwKdBLekTITp38N-TxpKn0g1lbbGMEOb4ZGUE7LiYeQkScBj0HER_UlfzG-3NLK5wlBxW1acJmduCmZYB_otSMxcs1zxoO9kyYw85onadCQ-jWCyXRjouiRr5ie8nGsgKHvZxGQLPBrKy8LWX8RmvcAlYfs9nVbK84zl9SZECdLFk Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cf9b0807c3f34fa5ba38cc160d73e829 Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c could not be found. Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': '9d35a9db-c6e8-4eb7-b33d-6924ece04b7c'} Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c could not be found. Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c could not be found. Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:08:23.604327 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c could not be found. Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Returning 404 to user: Instance 9d35a9db-c6e8-4eb7-b33d-6924ece04b7c could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11439145-f323-47b2-b96f-e000289306ad tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c" status: 404 len: 111 microversion: 2.1 time: 0.037758 Sep 01 06:08:23.608939 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3713/7378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:23 2022] GET /compute/v2.1/servers/9d35a9db-c6e8-4eb7-b33d-6924ece04b7c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:08:27.290394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90b95fe1-07b1-42e1-9dcd-b1bc4d472b63 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '.version_select at 0x7fa75ace33a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:27.311327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90b95fe1-07b1-42e1-9dcd-b1bc4d472b63 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1926866549" status: 202 len: 0 microversion: 2.1 time: 0.027122 Sep 01 06:08:27.311934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3666/7379] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 06:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1926866549 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:08:27.342340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-71d499f2-a6aa-459c-93ec-de8048f1baed tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: .version_select at 0x7fa75a606820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2030895832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsR/HWrHthqexx9zqxRlrlMtAFoeDnAw4yI4zXXQsgchTLIBb4mJNoN8MrBA9YKhSFlcrhLtLzQQggphAc2fQdl4Q0nNiFircBrSZdIQR6TNrpXK32ukaJKzkzrr/CiOQ=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:27.360149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-71d499f2-a6aa-459c-93ec-de8048f1baed tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:08:27.365415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-71d499f2-a6aa-459c-93ec-de8048f1baed tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:08:27.392473 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-71d499f2-a6aa-459c-93ec-de8048f1baed tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054761 Sep 01 06:08:27.393081 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3714/7380] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:08:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:08:32.788024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:32.793192 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-404977206", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "19f2494e-05f3-4e13-aa83-b1785c4102f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2030895832", "security_groups": [{"name": "tempest-secgroup-smoke-2095032220"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:32.938243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] validate_networks() for [('19f2494e-05f3-4e13-aa83-b1785c4102f8', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:08:33.374711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:08:33.375165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:08:33.375681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:08:33.376357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:08:33.376647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:08:33.386121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:33.386769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:33.387290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:33.388024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:33.388486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:33.388967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:33.410720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:08:33.415984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:08:33.428889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:08:33.431290 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:08:33.482561 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d1a3081-3de5-4bbc-9260-e5b3dbc0a9ce tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.697061 Sep 01 06:08:33.483434 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3667/7381] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:08:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 06:08:33.495273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-43d9cf78-5148-4441-b6c5-4f9ae414c60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:33.495882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-43d9cf78-5148-4441-b6c5-4f9ae414c60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:33.569228 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-43d9cf78-5148-4441-b6c5-4f9ae414c60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:33.577584 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-43d9cf78-5148-4441-b6c5-4f9ae414c60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1266 microversion: 2.1 time: 0.087164 Sep 01 06:08:33.578286 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3715/7382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:33 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:34.602396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:34.604326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:34.614132 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:34.615005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:34.615709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:34.617455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:34.618137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:34.619107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:34.712766 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:34.723363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-287a0e1d-6f76-4964-89ad-e221aaeacb6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1326 microversion: 2.1 time: 0.128134 Sep 01 06:08:34.724203 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3668/7383] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:34 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:35.746134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:35.746763 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:35.749547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=32 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:35.760230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:35.773141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:35.773598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:35.774359 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:35.777396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:35.777844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:35.967292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:35.981399 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-793161ba-498f-4a95-a73b-b495049c9396 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.240065 Sep 01 06:08:35.986195 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3716/7384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:35 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:36.576619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-64f03100-e79d-43a1-b384-152a38008b9f req-4110091e-3461-4120-aeaf-f81d804c49ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cdee1e4-36d3-4f00-a599-70d3820c3621", "tag": "d72ca4ef-3dc5-4ba2-990a-5539a4531d18"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:36.588248 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-64f03100-e79d-43a1-b384-152a38008b9f req-4110091e-3461-4120-aeaf-f81d804c49ad service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:36.588752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-64f03100-e79d-43a1-b384-152a38008b9f req-4110091e-3461-4120-aeaf-f81d804c49ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:36.589332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-64f03100-e79d-43a1-b384-152a38008b9f req-4110091e-3461-4120-aeaf-f81d804c49ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:36.601394 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-64f03100-e79d-43a1-b384-152a38008b9f req-4110091e-3461-4120-aeaf-f81d804c49ad service nova] Creating event network-changed:d72ca4ef-3dc5-4ba2-990a-5539a4531d18 for instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 on n-h2-820368-37 Sep 01 06:08:36.607200 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-64f03100-e79d-43a1-b384-152a38008b9f req-4110091e-3461-4120-aeaf-f81d804c49ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035320 Sep 01 06:08:36.607850 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3669/7385] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:08:37.009389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:37.010401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:37.018461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:37.019013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:37.019454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:37.020368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:37.020826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:37.021602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:37.170481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:37.180914 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ca4ad519-504e-4c55-a454-d9dcdf8a9406 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.176413 Sep 01 06:08:37.181479 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3717/7386] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:37 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:38.216125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:38.216836 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:38.223329 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:38.223833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:38.224288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:38.224988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:38.225458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:38.225899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:38.382772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:38.391177 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3699674f-14f8-4093-baca-be5690a57931 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.182191 Sep 01 06:08:38.391734 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3670/7387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:38 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:39.412215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:39.412957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:39.420233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:39.420722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:39.421152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:39.421844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:39.422292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:39.422716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:39.558032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:39.566269 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9a114ee5-8137-4f3f-bcd2-914830082636 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.158095 Sep 01 06:08:39.566906 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3718/7388] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:39 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:40.590548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:40.591144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:40.597639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:40.598143 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:40.598594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:40.599347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:40.599805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:40.600249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:40.738981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:40.747244 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8dd8206c-fedf-4223-94ed-6b2b6181f167 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.162550 Sep 01 06:08:40.748106 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3671/7389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:40 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:41.776934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:41.777512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:41.784903 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:41.785386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:41.785817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:41.786503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:41.786980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:41.787402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:41.931516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:41.940242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-02fbd643-a74b-46d1-a646-d0d162351e24 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.169934 Sep 01 06:08:41.940798 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3719/7390] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:41 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:42.279156 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-de1c8a3a-9bb1-4772-943a-732e4c38bae0 req-ec9dfc1f-eef6-4901-8995-df485ef5284c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cdee1e4-36d3-4f00-a599-70d3820c3621", "name": "network-vif-plugged", "status": "completed", "tag": "d72ca4ef-3dc5-4ba2-990a-5539a4531d18"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:42.289862 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-de1c8a3a-9bb1-4772-943a-732e4c38bae0 req-ec9dfc1f-eef6-4901-8995-df485ef5284c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:42.290314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-de1c8a3a-9bb1-4772-943a-732e4c38bae0 req-ec9dfc1f-eef6-4901-8995-df485ef5284c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:42.290794 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-de1c8a3a-9bb1-4772-943a-732e4c38bae0 req-ec9dfc1f-eef6-4901-8995-df485ef5284c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:42.303210 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-de1c8a3a-9bb1-4772-943a-732e4c38bae0 req-ec9dfc1f-eef6-4901-8995-df485ef5284c service nova] Creating event network-vif-plugged:d72ca4ef-3dc5-4ba2-990a-5539a4531d18 for instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 on n-h2-820368-37 Sep 01 06:08:42.308691 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-de1c8a3a-9bb1-4772-943a-732e4c38bae0 req-ec9dfc1f-eef6-4901-8995-df485ef5284c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033213 Sep 01 06:08:42.309302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3672/7391] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:08:42.966361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:42.967296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:42.979341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:42.979867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:42.980312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:42.981003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:42.981448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:42.981863 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:43.128716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:43.139143 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7b6a5bd3-b62a-448b-87b7-a715bb30974b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1392 microversion: 2.1 time: 0.179532 Sep 01 06:08:43.139734 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3720/7392] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:42 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:44.159705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:44.160398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:44.164653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:44.165458 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:44.172749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:44.173249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:44.173697 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:44.174420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:44.174876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:44.175342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:44.319515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:44.328290 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5aba94cd-645f-4aac-aebb-01d0b671973f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1564 microversion: 2.1 time: 0.170636 Sep 01 06:08:44.328882 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3673/7393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:44 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:44.350022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:44.350705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:44.352667 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:44.359053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:44.359541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:44.359979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:44.360672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:44.361131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:44.361556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:44.509859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:44.518450 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6e9d9df2-aaa0-471c-a091-89742efc67b9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1564 microversion: 2.1 time: 0.173168 Sep 01 06:08:44.519053 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3721/7394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:44 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:08:46.161133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:08:46.161724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:08:46.163709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-2030b6d1-2e55-4756-bf25-f35e1d891f08 req-2af29888-ec4b-4b25-9aa8-47f2967601a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cdee1e4-36d3-4f00-a599-70d3820c3621", "tag": "d72ca4ef-3dc5-4ba2-990a-5539a4531d18"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:08:46.166053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:46.171509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:46.172310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:46.173070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:46.173779 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:46.174462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:46.174925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:46.175395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:08:46.178142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2030b6d1-2e55-4756-bf25-f35e1d891f08 req-2af29888-ec4b-4b25-9aa8-47f2967601a8 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:08:46.178857 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2030b6d1-2e55-4756-bf25-f35e1d891f08 req-2af29888-ec4b-4b25-9aa8-47f2967601a8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:08:46.179797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-2030b6d1-2e55-4756-bf25-f35e1d891f08 req-2af29888-ec4b-4b25-9aa8-47f2967601a8 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:08:46.195020 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-2030b6d1-2e55-4756-bf25-f35e1d891f08 req-2af29888-ec4b-4b25-9aa8-47f2967601a8 service nova] Creating event network-changed:d72ca4ef-3dc5-4ba2-990a-5539a4531d18 for instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 on n-h2-820368-37 Sep 01 06:08:46.200980 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-2030b6d1-2e55-4756-bf25-f35e1d891f08 req-2af29888-ec4b-4b25-9aa8-47f2967601a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042041 Sep 01 06:08:46.202288 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3722/7395] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:08:46.321553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:08:46.330132 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d579179c-0092-4002-9247-aa856904948c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1564 microversion: 2.1 time: 0.173525 Sep 01 06:08:46.330951 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3674/7396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:08:46 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:18.730558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:09:18.731907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:09:18.736450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:09:18.738750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:18.746001 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:18.746480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:18.746912 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:18.747603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:18.748049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:18.748463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:18.815742 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-368ad596-bdc0-4102-a75d-c5fdb3a1df2a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action" status: 200 len: 24568 microversion: 2.1 time: 0.087371 Sep 01 06:09:18.816412 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3723/7397] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:09:18 2022] POST /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action => generated 24568 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:09:49.248889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:09:49.250130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:09:49.256915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:09:49.260649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:49.269030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:49.269526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:49.269979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:49.271072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:49.271526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:49.271981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:49.363461 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03df3cef-1a10-4c53-bc5e-7997a8d2385f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action" status: 202 len: 0 microversion: 2.1 time: 0.117947 Sep 01 06:09:49.364122 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3675/7398] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:09:49 2022] POST /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:09:49.373044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:49.373739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:49.376485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:09:49.377121 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:09:49.382318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:49.382803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:49.383286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:49.383978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:49.384415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:49.384832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:49.531828 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:49.540026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5288fe3a-5f84-489f-9025-63f69da8d3a7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1675 microversion: 2.1 time: 0.171169 Sep 01 06:09:49.540622 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3724/7399] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:49 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:50.562685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:50.563391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:50.571032 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:50.571535 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:50.571980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:50.572689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:50.573152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:50.573588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:50.719367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:50.727636 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f25c3797-55bf-48b3-8542-d352af91451b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.169436 Sep 01 06:09:50.728211 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3676/7400] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:50 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:51.753526 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:51.754454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:51.766003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:51.766493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:51.766932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:51.767661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:51.768114 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:51.768542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:51.911888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:51.924102 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80ecc0d1-2b3d-441c-a136-70c96a7c550a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.177239 Sep 01 06:09:51.924864 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3725/7401] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:51 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:52.952822 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:52.953560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:52.962600 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:52.963404 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:52.963964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:52.964857 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:52.965439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:52.965987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:53.104780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:53.113264 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f6c4971-1f05-43fa-a192-772ac025834d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.166582 Sep 01 06:09:53.113880 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3677/7402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:52 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:54.144325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:54.144998 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:54.153697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:54.154235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:54.154749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:54.155478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:54.155922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:54.156350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:54.298596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:54.306652 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-33fa2b95-f491-475a-9f9a-156a5cefc28a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.166808 Sep 01 06:09:54.307287 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3726/7403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:54 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:55.329989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:55.330616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:55.338445 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:55.339004 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:55.339474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:55.340217 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:55.340709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:55.341171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:55.481042 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:55.489910 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bcf1280-5be8-4fa4-a849-3c685557d85d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.164227 Sep 01 06:09:55.490490 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3678/7404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:55 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:56.511188 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:56.511793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:56.518513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:56.519046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:56.519483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:56.520175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:56.520981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:56.521407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:56.663467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:56.673851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-29ecfe4d-ac76-41b9-b997-c4182948bccc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.166660 Sep 01 06:09:56.674469 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3727/7405] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:56 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:57.695702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:57.696342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:57.703981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:57.704483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:57.704933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:57.705640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:57.706116 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:57.706560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:57.843969 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:57.852284 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-469e1aa0-699c-40fb-a11b-3c9c58cd56ee tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.160587 Sep 01 06:09:57.852873 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3679/7406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:57 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:09:58.876783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:09:58.877541 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:09:58.886478 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:58.887136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:58.887685 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:58.888694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:09:58.889179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:09:58.889609 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:09:59.027960 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:09:59.036230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4421c538-c1da-473a-88ea-8e59a28730b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.165049 Sep 01 06:09:59.036806 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3728/7407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:09:58 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:10:00.062011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:00.063147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:00.075196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:00.076053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:00.076820 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:00.078006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:00.078818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:00.079617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:00.226688 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:10:00.238369 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9ceb8cb-83ce-44d6-b61e-80f1bdeed0c9 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1680 microversion: 2.1 time: 0.183216 Sep 01 06:10:00.238918 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3680/7408] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:10:00 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:10:01.260119 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:01.260753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:01.270131 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:01.271066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:01.271542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:01.272305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:01.272754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:01.273173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:01.419795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:10:01.431817 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a2eef226-c34c-45ff-a231-71057fea5ff8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1683 microversion: 2.1 time: 0.175669 Sep 01 06:10:01.432630 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3729/7409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:10:01 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:10:33.727149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:10:33.729441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:33.732000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:10:33.732666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:10:33.733464 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:10:33.733614 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action (ip 10.222.0.26) !!! Sep 01 06:10:33.741431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:33.741954 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:33.742409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:33.743164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:33.743614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:33.744045 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:33.821862 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb6ea74f-cab6-4e8a-b152-dbcddfa6fdca tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action" status: 200 len: 69183 microversion: 2.1 time: 0.100450 Sep 01 06:10:33.822535 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3681/7410] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:10:33 2022] POST /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621/action => generated 69183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:10:51.219152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:51.220328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:51.222929 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:10:51.223089 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 (ip 10.222.0.26) !!! Sep 01 06:10:51.224575 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:10:51.224575 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 (ip 10.222.0.26) !!! Sep 01 06:10:51.225215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0a398467-1a1e-4e86-86e5-c4e680bb6f21 req-370c7a72-194f-47dd-8895-fbf946774a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cdee1e4-36d3-4f00-a599-70d3820c3621", "tag": "d72ca4ef-3dc5-4ba2-990a-5539a4531d18"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:10:51.225672 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:10:51.225979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:10:51.232368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:10:51.234390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:51.234975 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:51.235342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:51.236052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:51.236505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:51.236927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:51.239087 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:10:51.251989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0a398467-1a1e-4e86-86e5-c4e680bb6f21 req-370c7a72-194f-47dd-8895-fbf946774a34 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:51.252523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0a398467-1a1e-4e86-86e5-c4e680bb6f21 req-370c7a72-194f-47dd-8895-fbf946774a34 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:51.252972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0a398467-1a1e-4e86-86e5-c4e680bb6f21 req-370c7a72-194f-47dd-8895-fbf946774a34 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:51.265932 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0a398467-1a1e-4e86-86e5-c4e680bb6f21 req-370c7a72-194f-47dd-8895-fbf946774a34 service nova] Creating event network-changed:d72ca4ef-3dc5-4ba2-990a-5539a4531d18 for instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 on n-h2-820368-37 Sep 01 06:10:51.268024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:10:51.271827 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0a398467-1a1e-4e86-86e5-c4e680bb6f21 req-370c7a72-194f-47dd-8895-fbf946774a34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050828 Sep 01 06:10:51.272404 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3682/7411] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:10:51.355288 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-938d105d-6bc3-4af4-8d20-6d89f8547890 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 204 len: 0 microversion: 2.1 time: 0.140799 Sep 01 06:10:51.356021 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3730/7412] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:10:51 2022] DELETE /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:10:51.365344 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:51.366063 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:51.373102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:51.373608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:51.374055 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:51.374769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:51.375452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:51.375891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:51.509759 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:10:51.518211 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b0bb65a-295c-440c-b8ee-63fdfc79acfc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1689 microversion: 2.1 time: 0.157656 Sep 01 06:10:51.518797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3683/7413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:10:51 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:10:52.545835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:52.546542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:52.555850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:52.556452 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:52.557050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:52.557911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:52.558477 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:52.559035 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:52.702932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:10:52.712009 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-89c595f3-0cdf-4a64-9987-f6e3e76cc793 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1689 microversion: 2.1 time: 0.172425 Sep 01 06:10:52.713265 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3731/7414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:10:52 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:10:53.666216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-abdfe8e4-58f4-47f8-9e70-1fff7fe68f5d req-be195717-f52e-494a-bd6e-56cac7ee68e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cdee1e4-36d3-4f00-a599-70d3820c3621", "name": "network-vif-deleted", "tag": "d72ca4ef-3dc5-4ba2-990a-5539a4531d18"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:10:53.680460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-abdfe8e4-58f4-47f8-9e70-1fff7fe68f5d req-be195717-f52e-494a-bd6e-56cac7ee68e1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:53.681122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-abdfe8e4-58f4-47f8-9e70-1fff7fe68f5d req-be195717-f52e-494a-bd6e-56cac7ee68e1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:53.682233 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-abdfe8e4-58f4-47f8-9e70-1fff7fe68f5d req-be195717-f52e-494a-bd6e-56cac7ee68e1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:53.693959 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-abdfe8e4-58f4-47f8-9e70-1fff7fe68f5d req-be195717-f52e-494a-bd6e-56cac7ee68e1 service nova] Creating event network-vif-deleted:d72ca4ef-3dc5-4ba2-990a-5539a4531d18 for instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 on n-h2-820368-37 Sep 01 06:10:53.699852 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-abdfe8e4-58f4-47f8-9e70-1fff7fe68f5d req-be195717-f52e-494a-bd6e-56cac7ee68e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037615 Sep 01 06:10:53.700440 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3684/7415] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:10:53.734028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:53.734624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:53.742151 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:53.742716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:53.743262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:53.744031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:53.744646 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:53.745083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:53.816181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:10:53.824518 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-615599e6-3f96-4da9-9331-b3787304f5a0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 200 len: 1351 microversion: 2.1 time: 0.094432 Sep 01 06:10:53.825303 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3732/7416] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:10:53 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:10:54.852314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:54.853473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 8cdee1e4-36d3-4f00-a599-70d3820c3621] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:10:54.860564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:54.861069 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:54.861522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:54.862230 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:10:54.862706 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:10:54.863175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:10:54.877142 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] HTTP exception thrown: Instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 could not be found. Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Request method failure captured: Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 HTTP/1.1 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEvwKdBLekTITp38N-TxpKn0g1lbbGMEOb4ZGUE7LiYeQkScBj0HER_UlfzG-3NLK5wlBxW1acJmduCmZYB_otSMxcs1zxoO9kyYw85onadCQ-jWCyXRjouiRr5ie8nGsgKHvZxGQLPBrKy8LWX8RmvcAlYfs9nVbK84zl9SZECdLFk Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: cf9b0807c3f34fa5ba38cc160d73e829 Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 could not be found. Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '8cdee1e4-36d3-4f00-a599-70d3820c3621'} Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 could not be found. Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 could not be found. Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:10:54.878831 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 could not be found. Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Returning 404 to user: Instance 8cdee1e4-36d3-4f00-a599-70d3820c3621 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2bb8a85-7180-4989-8a02-68d7cb217aa0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621" status: 404 len: 111 microversion: 2.1 time: 0.037150 Sep 01 06:10:54.883624 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3685/7417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:10:54 2022] GET /compute/v2.1/servers/8cdee1e4-36d3-4f00-a599-70d3820c3621 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:10:58.535979 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bf293041-8bc3-42d6-9770-af38d7126892 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '.version_select at 0x7fa75a6b0040>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:10:58.566796 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bf293041-8bc3-42d6-9770-af38d7126892 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2030895832" status: 202 len: 0 microversion: 2.1 time: 0.034973 Sep 01 06:10:58.570779 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3733/7418] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 06:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2030895832 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:10:58.596079 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee8e53c5-9856-4a41-aa5d-1a62c28845db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: .version_select at 0x7fa75bdd7dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1975712869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuP82SQnoM+11URhxomSnDmfdj2nqDVJAwPTGZ/GSP+jv4cWuQaAGRuqWLh83Py4IgoJ1gM5ej7U5P8hs7oF12KF5D2aP1i508D3aaws1wp8i2/V/WV/xjTOOk4y45wlw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:10:58.613866 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ee8e53c5-9856-4a41-aa5d-1a62c28845db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:10:58.619402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ee8e53c5-9856-4a41-aa5d-1a62c28845db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:10:58.648252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee8e53c5-9856-4a41-aa5d-1a62c28845db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056294 Sep 01 06:10:58.648861 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3686/7419] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:10:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:11:04.583279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:04.588153 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-864620317", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "55e7f2b5-2de1-473e-8167-f7aeb9277857"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1975712869", "security_groups": [{"name": "tempest-secgroup-smoke-1093996982"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:11:04.708927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] validate_networks() for [('55e7f2b5-2de1-473e-8167-f7aeb9277857', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:11:05.193554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:11:05.193999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:11:05.194463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:11:05.194861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:11:05.195286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:11:05.204649 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:05.205127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:05.205621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:05.206268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:05.206719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:05.207160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:05.224628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:11:05.230331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:11:05.243028 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:11:05.245555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:11:05.295053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a05f9d73-a227-4ed7-a4a0-98551599c4fc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713438 Sep 01 06:11:05.299031 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3734/7420] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:11:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 06:11:05.306712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a2a6697-e25c-46ab-8a37-2f54fc8a015a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:05.307951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a2a6697-e25c-46ab-8a37-2f54fc8a015a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:05.312037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:05.379962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a2a6697-e25c-46ab-8a37-2f54fc8a015a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:05.389948 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a2a6697-e25c-46ab-8a37-2f54fc8a015a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1266 microversion: 2.1 time: 0.086658 Sep 01 06:11:05.402929 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3687/7421] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:05 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:06.412842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:06.413461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:06.421385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:06.422210 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:06.422723 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:06.423994 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:06.424486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:06.425368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:06.514904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:06.523951 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1c0c76a4-86dc-4ba7-b4d5-68e44e9f264d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1326 microversion: 2.1 time: 0.115856 Sep 01 06:11:06.525061 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3735/7422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:06 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:07.546012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:07.547499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:07.558090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:07.558601 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:07.559117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:07.559827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:07.560501 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:07.560964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:07.781254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:07.789535 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9777a8ed-8ab1-4695-8c56-93ab5cad44e2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1392 microversion: 2.1 time: 0.248062 Sep 01 06:11:07.790121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3688/7423] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:07 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:08.059681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3138c9c4-8f08-451a-bb86-69aa3156b170 req-a1d92799-94b6-4e02-95f0-85b0336aa0ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:11:08.071689 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3138c9c4-8f08-451a-bb86-69aa3156b170 req-a1d92799-94b6-4e02-95f0-85b0336aa0ce service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:08.072118 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3138c9c4-8f08-451a-bb86-69aa3156b170 req-a1d92799-94b6-4e02-95f0-85b0336aa0ce service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:08.072552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3138c9c4-8f08-451a-bb86-69aa3156b170 req-a1d92799-94b6-4e02-95f0-85b0336aa0ce service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:08.084200 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-3138c9c4-8f08-451a-bb86-69aa3156b170 req-a1d92799-94b6-4e02-95f0-85b0336aa0ce service nova] Creating event network-changed:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h2-820368-37 Sep 01 06:11:08.089260 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3138c9c4-8f08-451a-bb86-69aa3156b170 req-a1d92799-94b6-4e02-95f0-85b0336aa0ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033825 Sep 01 06:11:08.089829 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3736/7424] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:11:08.815474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:08.816526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:08.826264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:08.826772 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:08.827263 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:08.827988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:08.828469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:08.828916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:08.979235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:08.987405 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cdb8418-aed1-46e6-95c6-d706edb2ac5e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1392 microversion: 2.1 time: 0.178490 Sep 01 06:11:08.987990 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3689/7425] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:08 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:10.014970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:10.016155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:10.026852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:10.027370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:10.027806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:10.028511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:10.028970 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:10.029393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:10.166606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:10.178925 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49c11db3-cb3c-4479-b840-49f52ed8e719 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1392 microversion: 2.1 time: 0.172422 Sep 01 06:11:10.179757 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3737/7426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:10 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:11.210139 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:11.210670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:11.218936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:11.219469 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:11.219926 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:11.220670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:11.221144 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:11.221580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:11.366104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:11.374513 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce459b16-8f45-4eaa-bb33-9e76562122b7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1392 microversion: 2.1 time: 0.171282 Sep 01 06:11:11.375156 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3690/7427] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:11 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:12.400422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:12.401192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:12.408726 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:12.409208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:12.409636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:12.410360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:12.410805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:12.411256 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:12.556659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:12.565024 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a10b91c2-2065-4b7f-a230-689f6a2fd2ff tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1392 microversion: 2.1 time: 0.171629 Sep 01 06:11:12.565606 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3738/7428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:12 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:12.956752 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5695a373-f9a3-4fe7-bbe0-3910991e5794 req-6a3ec5e0-6ee9-4def-8d70-5b1cc9351760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "name": "network-vif-plugged", "status": "completed", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:11:12.967604 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5695a373-f9a3-4fe7-bbe0-3910991e5794 req-6a3ec5e0-6ee9-4def-8d70-5b1cc9351760 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:12.968170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5695a373-f9a3-4fe7-bbe0-3910991e5794 req-6a3ec5e0-6ee9-4def-8d70-5b1cc9351760 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:12.968626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5695a373-f9a3-4fe7-bbe0-3910991e5794 req-6a3ec5e0-6ee9-4def-8d70-5b1cc9351760 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:12.980706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5695a373-f9a3-4fe7-bbe0-3910991e5794 req-6a3ec5e0-6ee9-4def-8d70-5b1cc9351760 service nova] Creating event network-vif-plugged:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h2-820368-37 Sep 01 06:11:12.986066 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5695a373-f9a3-4fe7-bbe0-3910991e5794 req-6a3ec5e0-6ee9-4def-8d70-5b1cc9351760 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096379 Sep 01 06:11:12.986662 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3691/7429] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:11:13.592888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:13.593727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:13.605168 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:13.605648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:13.606090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:13.606780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:13.607264 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:13.607687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:13.748668 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:13.756600 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ef789f0c-697c-4c8b-870f-9ba2b238f505 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1392 microversion: 2.1 time: 0.170424 Sep 01 06:11:13.757185 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3739/7430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:13 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:14.780626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:14.781213 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:14.788614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:14.789121 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:14.789580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:14.790309 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:14.790785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:14.791388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:14.931057 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:14.940391 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-351e4050-c7a8-451e-9d02-aa5b2fc29f35 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1564 microversion: 2.1 time: 0.165197 Sep 01 06:11:14.940972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3692/7431] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:14 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:14.960892 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:14.961535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:14.968838 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:14.969323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:14.969782 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:14.970474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:14.970918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:14.971369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:15.111783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:15.122680 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-333a1f0b-bfaf-49df-9336-a486b0a9de93 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1564 microversion: 2.1 time: 0.165688 Sep 01 06:11:15.123316 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3740/7432] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:14 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:17.103593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:11:17.109018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5149612f-b759-486f-938b-002863fef55e req-84905e2e-a772-4286-9f6c-e50e0b252181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:11:17.111788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:17.113986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:17.121262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:17.123130 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:17.127126 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:17.127821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:17.128347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:17.129339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:17.129818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:17.130457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:17.131045 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5149612f-b759-486f-938b-002863fef55e req-84905e2e-a772-4286-9f6c-e50e0b252181 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:17.131527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5149612f-b759-486f-938b-002863fef55e req-84905e2e-a772-4286-9f6c-e50e0b252181 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:17.131950 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5149612f-b759-486f-938b-002863fef55e req-84905e2e-a772-4286-9f6c-e50e0b252181 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:17.148744 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5149612f-b759-486f-938b-002863fef55e req-84905e2e-a772-4286-9f6c-e50e0b252181 service nova] Creating event network-changed:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h2-820368-37 Sep 01 06:11:17.154626 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5149612f-b759-486f-938b-002863fef55e req-84905e2e-a772-4286-9f6c-e50e0b252181 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049373 Sep 01 06:11:17.155796 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3741/7433] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:11:17.359366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:11:17.368706 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38e087a8-5ef3-4731-9713-e6399be24976 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1564 microversion: 2.1 time: 0.269220 Sep 01 06:11:17.369881 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3693/7434] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:11:17 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:11:48.723574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:48.724497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:11:48.793268 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:11:48.795648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:11:48.802102 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:48.802579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:48.803033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:48.803711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:11:48.804246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:11:48.804662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:11:48.873467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-95b4b670-427a-491b-8e57-3e6bd0b01769 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action" status: 200 len: 24537 microversion: 2.1 time: 0.155005 Sep 01 06:11:48.874098 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3742/7435] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:11:48 2022] POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action => generated 24537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:12:19.308633 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:12:19.309574 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=32 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:12:19.310513 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:12:19.310669 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action (ip 10.222.0.26) !!! Sep 01 06:12:19.316037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:12:19.318412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:19.327818 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:19.328323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:19.328777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:19.329493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:19.329967 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:19.330413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:19.434190 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:19.441588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Sep 01 06:12:19.448704 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:12:19.449137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:12:19.449713 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:12:19.450129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:12:19.450562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:12:19.520865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fef5df4f-6a2c-4fba-a149-65b9340ebe1b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action" status: 202 len: 0 microversion: 2.1 time: 0.214312 Sep 01 06:12:19.521494 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3694/7436] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:12:19 2022] POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:12:19.530510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:19.531410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:19.533982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:12:19.534627 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:12:19.540323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:19.540806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:19.541229 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:19.541922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:19.542370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:19.542788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:19.753997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:19.762678 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76557673-32e5-413b-94aa-5a7d45169225 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1692 microversion: 2.1 time: 0.236588 Sep 01 06:12:19.763304 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3743/7437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:19 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:20.784807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:20.785410 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:20.793093 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:20.793614 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:20.794059 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:20.794774 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:20.795278 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:20.796094 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:20.985867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:20.993933 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d556572-6a99-40f1-97ed-3fe753ed2b75 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1692 microversion: 2.1 time: 0.213539 Sep 01 06:12:20.994695 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3695/7438] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:20 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:22.016938 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:22.017579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:22.025435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:22.025925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:22.026336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:22.027096 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:22.027547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:22.027967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:22.165137 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:22.175884 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8060568a-fa97-4d23-bbc8-3b3271d72f6e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.163106 Sep 01 06:12:22.176465 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3744/7439] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:22 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:12:23.201993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:23.203047 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:23.210872 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:23.211402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:23.211847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:23.212549 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:23.213016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:23.213461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:23.364543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:23.375513 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-374a2f62-e65b-451c-ab48-a69b74394e37 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.179805 Sep 01 06:12:23.376722 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3696/7440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:23 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:24.401555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:24.402162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:24.412607 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:24.413200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:24.413724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:24.414716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:24.415395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:24.415972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:24.548183 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:24.556702 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70fd7bfc-21be-4abf-9ff4-5a7992a00c5d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.161879 Sep 01 06:12:24.557318 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3745/7441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:24 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:25.582755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:25.583892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:25.595413 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:25.595914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:25.596360 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:25.597065 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:25.597538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:25.597977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:25.752720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:25.760981 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9612024e-6caf-4103-ae35-690206176216 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.184880 Sep 01 06:12:25.761566 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3697/7442] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:25 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:26.786501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:26.787485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:26.795932 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:26.796606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:26.797162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:26.798085 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:26.798696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:26.799296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:26.940710 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:26.949032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ce53828d-9c4a-4bea-a279-1b68ece5bfdf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.168350 Sep 01 06:12:26.949659 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3746/7443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:26 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:27.974331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:27.974999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:27.982335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:27.982844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:27.983321 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:27.984034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:27.984506 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:27.984948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:28.142141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:28.151956 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb717b49-94c3-45fc-9590-711671e6bf16 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.183277 Sep 01 06:12:28.152570 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3698/7444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:27 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:29.177508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:29.178661 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:29.189418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:29.190144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:29.190800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:29.191882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:29.192567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:29.193316 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:29.328957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:29.337053 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d02a977-7f55-47f2-9cc9-fd9fd50d0589 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.165623 Sep 01 06:12:29.337629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3747/7445] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:29 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:30.362330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:30.363102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:30.372241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:30.372757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:30.373205 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:30.373908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:30.374499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:30.374833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:30.508717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:30.517237 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a90adf0f-8ff1-4009-9981-719cca8c8a4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.161446 Sep 01 06:12:30.517910 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3699/7446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:30 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:31.545242 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:31.546179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:31.558677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:31.559363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:31.559956 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:31.561003 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:31.561655 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:31.562272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:31.707600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:31.716099 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9bbdd4df-ff35-4c3e-ba9d-e3e33dd60626 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.177292 Sep 01 06:12:31.716690 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3748/7447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:31 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:32.740336 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:32.741220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:32.748848 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:32.749350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:32.749798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:32.750508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:32.751015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:32.751457 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:32.894841 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:32.907781 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1105b0fa-1446-4814-8621-36a6d7ba703e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1697 microversion: 2.1 time: 0.172518 Sep 01 06:12:32.908627 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3700/7448] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:32 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:33.932338 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:33.932952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:33.940211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:33.940861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:33.941296 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:33.941986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:33.942433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:33.942850 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:34.141363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:34.150045 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e96edd0b-6efc-42ea-bb54-04c2b8a5eb26 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1696 microversion: 2.1 time: 0.222091 Sep 01 06:12:34.150592 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3749/7449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:33 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:34.378807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "name": "network-vif-unplugged", "status": "completed", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:12:34.390461 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:34.390979 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:34.391470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:34.404504 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] Creating event network-vif-unplugged:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h1-820368-37 Sep 01 06:12:34.410147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 06:12:34.421281 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-11fbd733-5c59-44f1-9101-c108813b8c5f req-6a6c323b-9063-4684-a6e5-cc59c1d7c2ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046483 Sep 01 06:12:34.421925 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3701/7450] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:12:35.172860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:35.173506 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:35.181520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:35.182026 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:35.182612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:35.183382 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:35.183834 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:35.184443 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:35.422516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:35.431759 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-04ac89c3-4650-4d14-bbcf-8b5c879f14f2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1696 microversion: 2.1 time: 0.263126 Sep 01 06:12:35.432499 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3750/7451] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:35 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1696 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:36.446538 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:12:36.456797 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:36.457829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:36.461899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:36.462399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:36.462840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:36.466365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:36.466859 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:36.467331 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:36.468037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:36.468524 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:36.468952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:36.475170 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] Creating event network-changed:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h1-820368-37 Sep 01 06:12:36.482014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-820368-37', 'n-h2-820368-37'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Sep 01 06:12:36.493308 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-91f18e2c-d286-465f-aa7b-dbeac7ebb14a req-85a835a5-3bc9-47b7-8ee2-0affa2f0bd01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055046 Sep 01 06:12:36.493927 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3702/7452] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:12:36.688350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:36.696851 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e32e2807-44c8-4d37-b77c-bfc743cea60e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1694 microversion: 2.1 time: 0.246764 Sep 01 06:12:36.697466 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3751/7453] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:36 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1694 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:37.720247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:37.720959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:37.727936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:37.728440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:37.728894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:37.729612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:37.730090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:37.730532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:37.873816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:37.882148 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-873127bc-0956-4119-bb09-880fa61f92e4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1691 microversion: 2.1 time: 0.167195 Sep 01 06:12:37.883144 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3703/7454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:37 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:37.903172 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:12:37.903761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:37.910511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:37.911055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:37.911453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:37.912169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:37.912613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:37.913024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:37.975926 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-70bac7c1-4eae-4464-8dc5-97844c442f78 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action" status: 204 len: 0 microversion: 2.1 time: 0.076448 Sep 01 06:12:37.976767 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3752/7455] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:12:37 2022] POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:12:37.985486 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:37.986003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:37.992653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:37.993188 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:37.993617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:37.994649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:37.995297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:37.995913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:38.220548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:38.230089 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9bb1578e-8ab5-4bc6-96e0-5b0dcaea31ba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1691 microversion: 2.1 time: 0.248765 Sep 01 06:12:38.230847 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3704/7456] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:37 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:38.251080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:38.251776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:38.258464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:38.258982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:38.259430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:38.260113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:38.260610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:38.261043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:38.489040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:38.502931 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e7f68ed9-201c-4ad3-9853-bb99ba9d85cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1691 microversion: 2.1 time: 0.253831 Sep 01 06:12:38.503546 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3753/7457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:38 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1691 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:12:39.527138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:12:39.528588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:12:39.535623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:39.536267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:39.536921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:39.537776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:39.538281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:39.538764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:39.604779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-002b09d7-81f1-4222-9b93-b53987b73376 req-c762ea67-f340-4514-b075-7030f34d8483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "name": "network-vif-plugged", "status": "completed", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:12:39.616778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-002b09d7-81f1-4222-9b93-b53987b73376 req-c762ea67-f340-4514-b075-7030f34d8483 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:12:39.617306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-002b09d7-81f1-4222-9b93-b53987b73376 req-c762ea67-f340-4514-b075-7030f34d8483 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:12:39.617767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-002b09d7-81f1-4222-9b93-b53987b73376 req-c762ea67-f340-4514-b075-7030f34d8483 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:12:39.631656 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-002b09d7-81f1-4222-9b93-b53987b73376 req-c762ea67-f340-4514-b075-7030f34d8483 service nova] Creating event network-vif-plugged:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h1-820368-37 Sep 01 06:12:39.637891 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-002b09d7-81f1-4222-9b93-b53987b73376 req-c762ea67-f340-4514-b075-7030f34d8483 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036661 Sep 01 06:12:39.640555 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3754/7458] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:12:39.690202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:12:39.698851 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbaaedcc-e02d-4757-b93d-a5a18f92695c tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1683 microversion: 2.1 time: 0.176635 Sep 01 06:12:39.699797 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3705/7459] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:12:39 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:01.905590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=24 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:01.906460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:01.910707 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:01.913014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:01.920313 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:01.920911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:01.921342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:01.922037 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:01.922490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:01.922918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:01.978208 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4010f5f6-f211-4e6c-ad04-51537a8cb134 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action" status: 200 len: 24575 microversion: 2.1 time: 0.074715 Sep 01 06:13:01.978850 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3755/7460] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:13:01 2022] POST /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372/action => generated 24575 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:13:09.037887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:09.038421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:09.040494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-98c42753-4ef4-4f2c-b26d-1b5512307c2b req-5f334e9f-3809-4e84-893d-41a43da14cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:09.042113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:09.043164 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:09.047475 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:09.047980 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:09.048430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:09.049142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:09.049608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:09.050044 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:09.052897 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98c42753-4ef4-4f2c-b26d-1b5512307c2b req-5f334e9f-3809-4e84-893d-41a43da14cd1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:09.053902 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98c42753-4ef4-4f2c-b26d-1b5512307c2b req-5f334e9f-3809-4e84-893d-41a43da14cd1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:09.054432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-98c42753-4ef4-4f2c-b26d-1b5512307c2b req-5f334e9f-3809-4e84-893d-41a43da14cd1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:09.069101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-98c42753-4ef4-4f2c-b26d-1b5512307c2b req-5f334e9f-3809-4e84-893d-41a43da14cd1 service nova] Creating event network-changed:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h1-820368-37 Sep 01 06:13:09.074700 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-98c42753-4ef4-4f2c-b26d-1b5512307c2b req-5f334e9f-3809-4e84-893d-41a43da14cd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037919 Sep 01 06:13:09.076339 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3756/7461] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:13:09.081222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:13:09.179450 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2242abdb-1bfd-4d70-8262-bd99da8adf50 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 204 len: 0 microversion: 2.1 time: 0.145543 Sep 01 06:13:09.184383 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3706/7462] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:13:09 2022] DELETE /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:13:09.191816 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:09.192553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:09.199009 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:09.199493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:09.200078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:09.200788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:09.201237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:09.201832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:09.357740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:09.366132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-15ce7166-53b3-44a5-add8-ff5799a63e84 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1689 microversion: 2.1 time: 0.180757 Sep 01 06:13:09.371537 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3757/7463] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:09 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:10.389584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:10.390347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:10.397672 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:10.398199 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:10.398648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:10.399411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:10.399901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:10.400357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:10.636939 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:10.646086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7c8fc02-009a-4c6b-a2d8-d1da6cbc182a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 200 len: 1689 microversion: 2.1 time: 0.260575 Sep 01 06:13:10.656578 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3707/7464] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:10 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:11.090600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-01c8cb4c-4f4f-46a7-aedf-65c279f3682d req-098f6803-754b-4a0d-a77e-ea0813e81bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c0b97d-7253-4640-9b9d-8ae38cf5f372", "name": "network-vif-deleted", "tag": "7eef0018-efda-4b74-bf3b-8215ab98a002"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:11.101687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01c8cb4c-4f4f-46a7-aedf-65c279f3682d req-098f6803-754b-4a0d-a77e-ea0813e81bd1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:11.102199 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01c8cb4c-4f4f-46a7-aedf-65c279f3682d req-098f6803-754b-4a0d-a77e-ea0813e81bd1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:11.102620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-01c8cb4c-4f4f-46a7-aedf-65c279f3682d req-098f6803-754b-4a0d-a77e-ea0813e81bd1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:11.114771 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-01c8cb4c-4f4f-46a7-aedf-65c279f3682d req-098f6803-754b-4a0d-a77e-ea0813e81bd1 service nova] Creating event network-vif-deleted:7eef0018-efda-4b74-bf3b-8215ab98a002 for instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 on n-h1-820368-37 Sep 01 06:13:11.119858 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-01c8cb4c-4f4f-46a7-aedf-65c279f3682d req-098f6803-754b-4a0d-a77e-ea0813e81bd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Sep 01 06:13:11.120747 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3758/7465] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:13:11.671853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:11.672496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: 48c0b97d-7253-4640-9b9d-8ae38cf5f372] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:11.680941 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:11.681541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:11.682077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:11.682977 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:11.683659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:11.684194 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:11.701234 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] HTTP exception thrown: Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 could not be found. Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Request method failure captured: Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 HTTP/1.1 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEEvwKdBLekTITp38N-TxpKn0g1lbbGMEOb4ZGUE7LiYeQkScBj0HER_UlfzG-3NLK5wlBxW1acJmduCmZYB_otSMxcs1zxoO9kyYw85onadCQ-jWCyXRjouiRr5ie8nGsgKHvZxGQLPBrKy8LWX8RmvcAlYfs9nVbK84zl9SZECdLFk Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: cf9b0807c3f34fa5ba38cc160d73e829 Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 could not be found. Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': '48c0b97d-7253-4640-9b9d-8ae38cf5f372'} Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 could not be found. Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 could not be found. Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:13:11.703154 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 could not be found. Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Returning 404 to user: Instance 48c0b97d-7253-4640-9b9d-8ae38cf5f372 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bd5eb99-210e-493c-a3ee-beb99b27f40a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372" status: 404 len: 111 microversion: 2.1 time: 0.039976 Sep 01 06:13:11.708168 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3708/7466] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:11 2022] GET /compute/v2.1/servers/48c0b97d-7253-4640-9b9d-8ae38cf5f372 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:13:15.040445 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-84b6d9ab-e2d2-4b48-be64-8d8b96d1a2e8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '.version_select at 0x7fa75a78b310>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:15.066026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-84b6d9ab-e2d2-4b48-be64-8d8b96d1a2e8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1975712869" status: 202 len: 0 microversion: 2.1 time: 0.030790 Sep 01 06:13:15.066632 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3759/7467] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 06:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1975712869 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:13:15.088171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-459ba75d-2f52-41d0-8d8f-6e7c67eeaad0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: .version_select at 0x7fa75b230040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-121341336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxwzJHBA/YlLFcJgtjKy8P/zC1j8tdME19YG3TFzj1TCizjPT1GkIqUeLCpw/2Az+KpJCuxdyRVGGGoBoAkch/hGhZ8JfWFeycpmNg/yp6ouf+mTnMITb8M6yoynKervg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:15.104918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-459ba75d-2f52-41d0-8d8f-6e7c67eeaad0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:13:15.111041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-459ba75d-2f52-41d0-8d8f-6e7c67eeaad0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:13:15.136836 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-459ba75d-2f52-41d0-8d8f-6e7c67eeaad0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052736 Sep 01 06:13:15.142129 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3709/7468] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:13:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:13:20.768915 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-406428720", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "ce146170-a1cd-43e2-ab42-15accb797d23"}], "key_name": "tempest-TestNetworkAdvancedServerOps-121341336", "security_groups": [{"name": "tempest-secgroup-smoke-723111755"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:20.894267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] validate_networks() for [('ce146170-a1cd-43e2-ab42-15accb797d23', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:13:21.107496 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:21.302996 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:13:21.303470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:13:21.304046 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:13:21.304460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:13:21.304905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:13:21.315099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:21.315588 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:21.316024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:21.316750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:21.317205 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:21.317631 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:21.336258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:13:21.341599 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:13:21.355219 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:13:21.357940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:13:21.410058 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4643070c-49d6-4da5-a389-957f8cff6c81 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.645264 Sep 01 06:13:21.417675 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3760/7469] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:13:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 06:13:21.425755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6151881-cc39-4c83-a918-471e66b75e1a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:21.428492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6151881-cc39-4c83-a918-471e66b75e1a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:21.502268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6151881-cc39-4c83-a918-471e66b75e1a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:21.515363 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6151881-cc39-4c83-a918-471e66b75e1a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1265 microversion: 2.1 time: 0.095993 Sep 01 06:13:21.516274 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3710/7470] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:21 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:22.538129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:22.538911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:22.547197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:22.547775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:22.548399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:22.549500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:22.550111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:22.550693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:22.625220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:22.636838 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49dfb301-8308-4117-80ef-b09e157ba8cf tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1317 microversion: 2.1 time: 0.103515 Sep 01 06:13:22.646084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3761/7471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:22 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1317 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:23.661649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:23.662559 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:23.671590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:23.674576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:23.675431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:23.676168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:23.677127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:23.677761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:23.678358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:23.935678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:23.944697 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c577d1e-31f1-4908-8840-5b6b2d21162f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.288876 Sep 01 06:13:23.946493 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3711/7472] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:23 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:24.280043 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1252a086-b3cb-4e08-8490-57f7a2b1c196 req-bf89e4f3-2d3c-44b3-b32a-08dfab049e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709a941-b846-48a5-a7e9-7d99e2896577", "tag": "235ebb8f-5cfc-4bee-8f42-f5316821424f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:24.290212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1252a086-b3cb-4e08-8490-57f7a2b1c196 req-bf89e4f3-2d3c-44b3-b32a-08dfab049e83 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:24.290684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1252a086-b3cb-4e08-8490-57f7a2b1c196 req-bf89e4f3-2d3c-44b3-b32a-08dfab049e83 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:24.291144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1252a086-b3cb-4e08-8490-57f7a2b1c196 req-bf89e4f3-2d3c-44b3-b32a-08dfab049e83 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:24.303213 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1252a086-b3cb-4e08-8490-57f7a2b1c196 req-bf89e4f3-2d3c-44b3-b32a-08dfab049e83 service nova] Creating event network-changed:235ebb8f-5cfc-4bee-8f42-f5316821424f for instance d709a941-b846-48a5-a7e9-7d99e2896577 on n-h2-820368-37 Sep 01 06:13:24.308915 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1252a086-b3cb-4e08-8490-57f7a2b1c196 req-bf89e4f3-2d3c-44b3-b32a-08dfab049e83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092798 Sep 01 06:13:24.309842 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3762/7473] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:13:24.970616 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:24.971288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:24.978758 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:24.979449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:24.979911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:24.980626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:24.981114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:24.981555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:25.120209 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:25.128316 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e36f2616-407f-4d1b-8f9f-3faac0559ee4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.163255 Sep 01 06:13:25.128922 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3712/7474] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:24 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:26.151356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:26.152029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:26.160076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:26.160553 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:26.160981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:26.161662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:26.162109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:26.162521 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:26.310282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:26.319135 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b539d8f7-277f-4c50-a04b-82fb85a2ce4d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.172198 Sep 01 06:13:26.319721 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3763/7475] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:26 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:27.348347 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:27.349048 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:27.357441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:27.357964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:27.358663 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:27.359451 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:27.359934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:27.360376 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:27.498277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:27.506993 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9ff4996-d1a0-4489-bac0-b563f4e3fd4f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.163730 Sep 01 06:13:27.507555 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3713/7476] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:27 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:28.532528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:28.533156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:28.540690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:28.541192 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:28.541643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:28.542330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:28.542830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:28.543312 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:28.681018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:28.689121 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-326135a3-10b3-44ab-877e-85d3acb436b1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.163107 Sep 01 06:13:28.689710 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3764/7477] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:28 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:29.718800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:29.719707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:29.727204 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:29.727712 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:29.728167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:29.728888 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:29.729365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:29.729812 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:29.872853 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:29.884850 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6933153e-291b-4b83-a7dd-f76c6239d3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.169813 Sep 01 06:13:29.885609 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3714/7478] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:29 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:30.907424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:30.908385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:30.915344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:30.915824 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:30.916235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:30.916917 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:30.917367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:30.917785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:31.054485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:31.062632 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b9a80129-9aeb-4340-9cc9-10d03bd3cba6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.159202 Sep 01 06:13:31.063403 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3765/7479] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:30 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:31.511022 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1df0f709-ebca-4257-8e45-f3f14ebfdabe req-908bf9ae-b7f9-44f6-a520-db6a3efc1287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d709a941-b846-48a5-a7e9-7d99e2896577", "name": "network-vif-plugged", "status": "completed", "tag": "235ebb8f-5cfc-4bee-8f42-f5316821424f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:31.517000 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:31.524141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1df0f709-ebca-4257-8e45-f3f14ebfdabe req-908bf9ae-b7f9-44f6-a520-db6a3efc1287 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:31.524643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1df0f709-ebca-4257-8e45-f3f14ebfdabe req-908bf9ae-b7f9-44f6-a520-db6a3efc1287 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:31.525088 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1df0f709-ebca-4257-8e45-f3f14ebfdabe req-908bf9ae-b7f9-44f6-a520-db6a3efc1287 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:31.538054 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1df0f709-ebca-4257-8e45-f3f14ebfdabe req-908bf9ae-b7f9-44f6-a520-db6a3efc1287 service nova] Creating event network-vif-plugged:235ebb8f-5cfc-4bee-8f42-f5316821424f for instance d709a941-b846-48a5-a7e9-7d99e2896577 on n-h2-820368-37 Sep 01 06:13:31.543236 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1df0f709-ebca-4257-8e45-f3f14ebfdabe req-908bf9ae-b7f9-44f6-a520-db6a3efc1287 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035949 Sep 01 06:13:31.544049 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3715/7480] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:13:32.087920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:32.089002 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:32.092525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:32.093620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:32.096446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:13:32.103612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:32.104127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:32.104852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:32.105555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:32.106011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:32.106436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:32.239849 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:32.249423 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-25725aeb-7c52-48a4-a26b-d5e8e86fd028 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1390 microversion: 2.1 time: 0.168186 Sep 01 06:13:32.250101 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3766/7481] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:32 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:33.274151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:33.274921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:33.281371 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:33.281876 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:33.282331 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:33.283142 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:33.283617 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:33.284058 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:33.426484 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:33.434798 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63fa2eeb-bde3-4aee-8737-e969603fa3c0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1562 microversion: 2.1 time: 0.167354 Sep 01 06:13:33.435434 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3716/7482] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:33 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:33.455965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:33.456694 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:33.464058 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:33.464557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:33.464992 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:33.465708 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:33.466370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:33.467000 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:33.604007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:33.611980 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eb188636-59f5-4129-afcb-0257ab1a0f2b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1562 microversion: 2.1 time: 0.159889 Sep 01 06:13:33.612621 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3767/7483] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:33 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:13:35.561286 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:13:35.561853 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-5ad166f7-b8f9-4616-b193-76d3337a6953 req-fdc34f11-a4fc-4665-89b8-767f293deafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709a941-b846-48a5-a7e9-7d99e2896577", "tag": "235ebb8f-5cfc-4bee-8f42-f5316821424f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:13:35.562220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:13:35.569122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:35.569632 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:35.570056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:35.571186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:35.571883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:35.572315 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:35.572957 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5ad166f7-b8f9-4616-b193-76d3337a6953 req-fdc34f11-a4fc-4665-89b8-767f293deafc service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:13:35.573438 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5ad166f7-b8f9-4616-b193-76d3337a6953 req-fdc34f11-a4fc-4665-89b8-767f293deafc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:13:35.574007 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-5ad166f7-b8f9-4616-b193-76d3337a6953 req-fdc34f11-a4fc-4665-89b8-767f293deafc service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:13:35.591510 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-5ad166f7-b8f9-4616-b193-76d3337a6953 req-fdc34f11-a4fc-4665-89b8-767f293deafc service nova] Creating event network-changed:235ebb8f-5cfc-4bee-8f42-f5316821424f for instance d709a941-b846-48a5-a7e9-7d99e2896577 on n-h2-820368-37 Sep 01 06:13:35.598446 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-5ad166f7-b8f9-4616-b193-76d3337a6953 req-fdc34f11-a4fc-4665-89b8-767f293deafc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040599 Sep 01 06:13:35.599640 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3768/7484] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 06:13:35.801012 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:13:35.809198 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e01d7ada-9f0e-4567-b039-6aaea6381c1d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1562 microversion: 2.1 time: 0.253596 Sep 01 06:13:35.823088 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3717/7485] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:13:35 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1562 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:09.446580 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=5 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:14:09.447532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=42 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:14:09.453193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:14:09.456418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:09.466658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:09.467380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:09.467835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:09.468510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:09.468962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:09.469374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:09.539434 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f04442d-380f-4e99-a0f0-ae920c20d9b5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action" status: 200 len: 24573 microversion: 2.1 time: 0.095795 Sep 01 06:14:09.540084 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3769/7486] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:14:09 2022] POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action => generated 24573 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:14:39.946665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:14:39.947642 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:14:39.952536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c635e527-afec-4105-838a-dd788a93796a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:14:39.960193 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c635e527-afec-4105-838a-dd788a93796a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:39.960690 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c635e527-afec-4105-838a-dd788a93796a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:39.961140 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c635e527-afec-4105-838a-dd788a93796a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:39.984819 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c635e527-afec-4105-838a-dd788a93796a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 06:14:40.039112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c635e527-afec-4105-838a-dd788a93796a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action" status: 202 len: 0 microversion: 2.1 time: 0.093896 Sep 01 06:14:40.039793 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3718/7487] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:14:39 2022] POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:14:40.049133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:40.050583 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:40.054921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:14:40.055463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:14:40.061890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:40.062789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:40.063348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:40.064244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:40.064865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:40.065306 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:40.268303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:40.277380 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4c2a90c2-55ad-48e1-b7c3-acd41d43571a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.232679 Sep 01 06:14:40.278001 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3770/7488] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:40 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:14:41.306927 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:41.307686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:41.316231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:41.316975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:41.318462 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:41.319053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:41.320326 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:41.321514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:41.497554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:41.505957 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b87ba35-f43b-466f-965f-653665cf2c3e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.207337 Sep 01 06:14:41.506530 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3719/7489] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:41 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:42.532182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:42.533163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:42.544243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:42.544966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:42.545616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:42.546702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:42.547464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:42.548061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:42.976547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:42.985080 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3a504767-9c46-4d94-9851-0b6dd3d52130 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.459499 Sep 01 06:14:42.985689 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3771/7490] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:42 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:44.008878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:44.009516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:44.017409 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:44.017922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:44.018385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:44.019180 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:44.020009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:44.020441 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:44.168322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:44.176693 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55b18120-284e-4024-88e8-6f5562554d1f tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.172763 Sep 01 06:14:44.177278 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3720/7491] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:44 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:45.201986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:45.202841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:45.212459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:45.212946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:45.213381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:45.214078 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:45.214532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:45.214989 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:45.349293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:45.357659 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8fc5e5fe-d54f-4ad1-8049-d7d7f303fe46 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.162462 Sep 01 06:14:45.358234 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3772/7492] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:45 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:46.392560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:46.393599 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:46.403399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:46.403947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:46.404406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:46.405131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:46.405609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:46.406056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:46.548720 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:46.559218 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2b1cf28-7535-4a7d-86d1-7016da6e22a1 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.174479 Sep 01 06:14:46.559811 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3721/7493] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:46 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:47.581747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:47.582344 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:47.589841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:47.590329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:47.590768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:47.591493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:47.591952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:47.592376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:47.733978 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:47.746132 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-657a6963-cbdb-441e-897e-7707b9668483 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.168096 Sep 01 06:14:47.746820 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3773/7494] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:47 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:48.774607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:48.775365 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:48.783381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:48.783936 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:48.784433 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:48.785219 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:48.785736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:48.786220 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:48.929487 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:48.938117 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec038ed9-4124-43e1-870f-b3c0219d3cb8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.169511 Sep 01 06:14:48.938673 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3722/7495] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:48 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:49.971823 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:49.972907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:49.981075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:49.981574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:49.982016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:49.982719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:49.983211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:49.983647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:50.122352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:50.130624 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7732f3d1-2538-4aa4-8079-1b358b46d6a5 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1690 microversion: 2.1 time: 0.165543 Sep 01 06:14:50.131206 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3774/7496] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:49 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:51.157281 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:51.158384 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:51.170527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:51.171389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:51.172149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:51.173325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:51.174183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:51.174964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:51.315016 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:51.323492 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3928010-e873-456d-b9d1-0a8095dcc8b6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1667 microversion: 2.1 time: 0.172913 Sep 01 06:14:51.324102 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3723/7497] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:51 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:52.424552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:14:52.426745 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:52.434634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:52.435175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:52.435617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:52.436325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:52.436786 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:52.437213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:52.499108 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2494bb9b-92c1-4696-b434-94225386d04e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action" status: 200 len: 38162 microversion: 2.1 time: 0.078492 Sep 01 06:14:52.499748 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3775/7498] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:14:52 2022] POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action => generated 38162 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:14:52.512355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d44a6784-a962-48aa-993f-947bf902e0bc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:14:52.519996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d44a6784-a962-48aa-993f-947bf902e0bc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:52.520498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d44a6784-a962-48aa-993f-947bf902e0bc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:52.520957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d44a6784-a962-48aa-993f-947bf902e0bc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:52.543921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d44a6784-a962-48aa-993f-947bf902e0bc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 06:14:52.591475 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d44a6784-a962-48aa-993f-947bf902e0bc tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action" status: 202 len: 0 microversion: 2.1 time: 0.082910 Sep 01 06:14:52.592115 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3724/7499] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:14:52 2022] POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:14:52.601260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:52.601967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:52.609550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:52.610283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:52.610729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:52.611470 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:52.611930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:52.612367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:52.806122 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:52.814594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ae95b0e6-c841-41e2-b4d0-3cc0ea457862 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1676 microversion: 2.1 time: 0.217635 Sep 01 06:14:52.815201 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3776/7500] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:52 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:14:53.840684 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:14:53.841611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:14:53.850235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:53.850855 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:53.851318 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:53.852173 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:14:53.852838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:14:53.853289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:14:53.993481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:14:54.002203 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee3960cf-136d-46e4-b91d-5abd70918d80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1680 microversion: 2.1 time: 0.167543 Sep 01 06:14:54.002793 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3725/7501] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:14:53 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:15:28.286419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:15:28.289866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:15:28.292077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=14 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:15:28.292720 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=40 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:15:28.298246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:28.298730 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:28.299190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:28.299882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:28.300328 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:28.300758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:28.373964 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-48d97e46-2a7c-496a-aac1-890a9ac3f384 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action" status: 200 len: 62718 microversion: 2.1 time: 0.094347 Sep 01 06:15:28.374876 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3777/7502] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:15:28 2022] POST /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577/action => generated 62718 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:15:45.782415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:15:45.782983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:15:45.784356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-1bee1c8f-353d-4b08-8bbd-f4334ee54de9 req-cdbfe390-518b-48c4-b27a-14fe1f757f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d709a941-b846-48a5-a7e9-7d99e2896577", "tag": "235ebb8f-5cfc-4bee-8f42-f5316821424f"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:15:45.787311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:15:45.788894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:15:45.792425 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:15:45.793461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:15:45.794178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:45.794675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:45.795183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:45.796003 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:45.796631 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:45.797391 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:45.798481 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1bee1c8f-353d-4b08-8bbd-f4334ee54de9 req-cdbfe390-518b-48c4-b27a-14fe1f757f2c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:45.799014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1bee1c8f-353d-4b08-8bbd-f4334ee54de9 req-cdbfe390-518b-48c4-b27a-14fe1f757f2c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:45.799466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-1bee1c8f-353d-4b08-8bbd-f4334ee54de9 req-cdbfe390-518b-48c4-b27a-14fe1f757f2c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:45.812532 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-1bee1c8f-353d-4b08-8bbd-f4334ee54de9 req-cdbfe390-518b-48c4-b27a-14fe1f757f2c service nova] Creating event network-changed:235ebb8f-5cfc-4bee-8f42-f5316821424f for instance d709a941-b846-48a5-a7e9-7d99e2896577 on n-h2-820368-37 Sep 01 06:15:45.818236 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-1bee1c8f-353d-4b08-8bbd-f4334ee54de9 req-cdbfe390-518b-48c4-b27a-14fe1f757f2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037881 Sep 01 06:15:45.819629 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3778/7503] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:15:45.829430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:15:45.936304 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da43060a-b454-43da-8fe6-4c34c07f8107 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 204 len: 0 microversion: 2.1 time: 0.156909 Sep 01 06:15:45.937809 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3726/7504] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:15:45 2022] DELETE /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:15:45.947512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:15:45.948674 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:15:45.955370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:45.956545 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:45.957271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:45.958095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:45.958611 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:45.959340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:46.124295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:15:46.132463 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a5991434-b6ae-4242-aeaa-4ba863f06eac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1686 microversion: 2.1 time: 0.190197 Sep 01 06:15:46.133043 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3779/7505] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:15:45 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:15:47.161320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:15:47.162499 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:15:47.172483 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:47.172983 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:47.173430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:47.174171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:47.174635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:47.175107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:47.410200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:15:47.419017 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e545339d-890f-448c-ad3b-ae77b6b2ee97 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1686 microversion: 2.1 time: 0.264959 Sep 01 06:15:47.419972 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3727/7506] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:15:47 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1686 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:15:48.440486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:15:48.441910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:15:48.448817 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:48.449310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:48.449747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:48.450450 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:48.450918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:48.451363 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:48.526493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:15:48.537235 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6917eb47-8622-4130-bf7c-24aeeb3d3144 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 200 len: 1501 microversion: 2.1 time: 0.100037 Sep 01 06:15:48.537797 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3780/7507] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:15:48 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 1501 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:15:48.581991 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8b3688c9-1227-4499-988b-99fba0f2e5e8 req-9e3fa6b9-b35a-4bc7-a44f-9bc4277c889f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d709a941-b846-48a5-a7e9-7d99e2896577", "name": "network-vif-deleted", "tag": "235ebb8f-5cfc-4bee-8f42-f5316821424f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:15:48.592625 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b3688c9-1227-4499-988b-99fba0f2e5e8 req-9e3fa6b9-b35a-4bc7-a44f-9bc4277c889f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:48.593235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b3688c9-1227-4499-988b-99fba0f2e5e8 req-9e3fa6b9-b35a-4bc7-a44f-9bc4277c889f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:48.593686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b3688c9-1227-4499-988b-99fba0f2e5e8 req-9e3fa6b9-b35a-4bc7-a44f-9bc4277c889f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:48.604935 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8b3688c9-1227-4499-988b-99fba0f2e5e8 req-9e3fa6b9-b35a-4bc7-a44f-9bc4277c889f service nova] Creating event network-vif-deleted:235ebb8f-5cfc-4bee-8f42-f5316821424f for instance d709a941-b846-48a5-a7e9-7d99e2896577 on n-h2-820368-37 Sep 01 06:15:48.611329 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8b3688c9-1227-4499-988b-99fba0f2e5e8 req-9e3fa6b9-b35a-4bc7-a44f-9bc4277c889f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085503 Sep 01 06:15:48.611948 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3728/7508] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:15:49.560968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:15:49.562132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: d709a941-b846-48a5-a7e9-7d99e2896577] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:15:49.573334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:49.574095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:49.574532 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:49.575275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:15:49.575829 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:15:49.576265 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:15:49.589832 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] HTTP exception thrown: Instance d709a941-b846-48a5-a7e9-7d99e2896577 could not be found. Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Request method failure captured: Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 HTTP/1.1 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEvwKdBLekTITp38N-TxpKn0g1lbbGMEOb4ZGUE7LiYeQkScBj0HER_UlfzG-3NLK5wlBxW1acJmduCmZYB_otSMxcs1zxoO9kyYw85onadCQ-jWCyXRjouiRr5ie8nGsgKHvZxGQLPBrKy8LWX8RmvcAlYfs9nVbK84zl9SZECdLFk Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cf9b0807c3f34fa5ba38cc160d73e829 Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance d709a941-b846-48a5-a7e9-7d99e2896577 could not be found. Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'd709a941-b846-48a5-a7e9-7d99e2896577'} Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d709a941-b846-48a5-a7e9-7d99e2896577 could not be found. Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d709a941-b846-48a5-a7e9-7d99e2896577 could not be found. Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:15:49.591518 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d709a941-b846-48a5-a7e9-7d99e2896577 could not be found. Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Returning 404 to user: Instance d709a941-b846-48a5-a7e9-7d99e2896577 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8a45f677-2f9d-45ee-84d7-1357e3e2f0a4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577" status: 404 len: 111 microversion: 2.1 time: 0.038596 Sep 01 06:15:49.596391 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3781/7509] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:15:49 2022] GET /compute/v2.1/servers/d709a941-b846-48a5-a7e9-7d99e2896577 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:15:52.728369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5188665-1c49-4994-8369-42e14a6d9aac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '.version_select at 0x7fa75b153700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:15:52.733109 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b5188665-1c49-4994-8369-42e14a6d9aac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:15:53.745185 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-b5188665-1c49-4994-8369-42e14a6d9aac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [9014b4b1-9785-4553-972f-9d37e24e6ee0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 54728. Sep 01 06:15:53.767776 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5188665-1c49-4994-8369-42e14a6d9aac tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-121341336" status: 202 len: 0 microversion: 2.1 time: 1.044504 Sep 01 06:15:53.768265 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3729/7510] 10.222.0.26 () {58 vars in 1281 bytes} [Thu Sep 1 06:15:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-121341336 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:15:53.801812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42653c28-ee8c-4c61-a4ef-3cdaa8ea95f4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: .version_select at 0x7fa760253280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1989258249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM0spQc+Up//IhBCuovBGtR6cjcAu/q16HMMGnV6OnIaaoDtpeKqYmoq/9b54XeuS1bN3lSd2iXsBtTmJibvgVP98MRFMg0e9SSARbY15jIELkx8Xc+wCTACRAZmBi71g=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:15:53.819464 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-42653c28-ee8c-4c61-a4ef-3cdaa8ea95f4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:15:53.825098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-42653c28-ee8c-4c61-a4ef-3cdaa8ea95f4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:15:53.838760 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-42653c28-ee8c-4c61-a4ef-3cdaa8ea95f4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [71619eec-194b-4380-8e03-02d6f96a168e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:15:54.848156 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [None req-42653c28-ee8c-4c61-a4ef-3cdaa8ea95f4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [71619eec-194b-4380-8e03-02d6f96a168e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 54732. Sep 01 06:15:54.868694 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42653c28-ee8c-4c61-a4ef-3cdaa8ea95f4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.070868 Sep 01 06:15:54.869328 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3782/7511] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:15:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:16:00.699186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1517058025", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "networks": [{"uuid": "cc2c84de-2147-4637-8902-93a7c990e244"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1989258249", "security_groups": [{"name": "tempest-secgroup-smoke-920608747"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:16:00.711243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:00.828928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] validate_networks() for [('cc2c84de-2147-4637-8902-93a7c990e244', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:16:01.308693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:16:01.309831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:16:01.310565 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:16:01.311240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:16:01.312167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:16:01.326938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:01.330463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:01.331643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:01.332722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:01.333447 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:01.334105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:01.356536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:16:01.362681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Getting quotas for user cf9b0807c3f34fa5ba38cc160d73e829 and project 907eb43a17854f539790c4b36d3c00d2. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:16:01.377714 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:16:01.380833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:16:01.439254 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [edb01bb9-7204-4869-9801-90d8ef798828] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:16:02.450832 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [edb01bb9-7204-4869-9801-90d8ef798828] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 54778. Sep 01 06:16:02.455546 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3934102-a768-4f18-8973-4a9a3d74f2f8 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.760736 Sep 01 06:16:02.462720 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3730/7512] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:16:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 06:16:02.466139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:02.470981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ee99652-10aa-481c-9af2-0242a150629b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:02.472135 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ee99652-10aa-481c-9af2-0242a150629b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:02.864628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ee99652-10aa-481c-9af2-0242a150629b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:02.872497 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ee99652-10aa-481c-9af2-0242a150629b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1267 microversion: 2.1 time: 0.408343 Sep 01 06:16:02.873078 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3783/7513] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:02 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:03.895664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:03.896306 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:03.909092 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:03.913345 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:03.913767 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:03.914558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:03.915150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:03.918395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:04.002502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:04.014283 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a16d9ec2-5a56-4945-a0c4-d43ac4be828e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1325 microversion: 2.1 time: 0.123742 Sep 01 06:16:04.018617 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3731/7514] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:03 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1325 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:05.040584 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:05.041283 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:05.048788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:05.049379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:05.049881 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:05.050692 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:05.051257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:05.051755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:05.098789 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-41043924-70d9-43e9-ad19-ea49cc3fe439 req-f9fd5831-64bb-48ff-8687-5bf1f26e890d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56f76c5-fd03-446d-8731-56edab454fc3", "tag": "b8f2dba7-3d29-439b-a78c-89db08ffffc8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:16:05.109644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41043924-70d9-43e9-ad19-ea49cc3fe439 req-f9fd5831-64bb-48ff-8687-5bf1f26e890d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:05.110510 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41043924-70d9-43e9-ad19-ea49cc3fe439 req-f9fd5831-64bb-48ff-8687-5bf1f26e890d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:05.111174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-41043924-70d9-43e9-ad19-ea49cc3fe439 req-f9fd5831-64bb-48ff-8687-5bf1f26e890d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:05.124037 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-41043924-70d9-43e9-ad19-ea49cc3fe439 req-f9fd5831-64bb-48ff-8687-5bf1f26e890d service nova] Creating event network-changed:b8f2dba7-3d29-439b-a78c-89db08ffffc8 for instance a56f76c5-fd03-446d-8731-56edab454fc3 on n-h2-820368-37 Sep 01 06:16:05.129500 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-41043924-70d9-43e9-ad19-ea49cc3fe439 req-f9fd5831-64bb-48ff-8687-5bf1f26e890d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034857 Sep 01 06:16:05.130648 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3732/7515] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:16:05.193207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:05.201080 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1fadb64b-f06d-49f6-af8e-67b84e78e3ae tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.164790 Sep 01 06:16:05.201666 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3784/7516] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:05 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:06.230115 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:06.231295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:06.241938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:06.242773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:06.243568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:06.244742 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:06.245536 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:06.246271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:06.398398 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:06.406621 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce206a8d-1242-4cd8-819f-f9c862e36776 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.186397 Sep 01 06:16:06.407248 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3733/7517] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:06 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:07.428179 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:07.428794 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:07.436503 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:07.437084 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:07.437572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:07.438287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:07.438733 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:07.439182 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:07.587134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:07.595609 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1e1c6cae-bfc4-4077-a0a2-28938b892b9a tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.171536 Sep 01 06:16:07.596227 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3785/7518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:07 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:08.621056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:08.622076 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:08.630108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:08.630592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:08.631080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:08.631787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:08.632252 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:08.632693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:08.781422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:08.792607 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4aa65d08-a363-4202-8cac-ddd67ec4db80 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.178225 Sep 01 06:16:08.793360 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3734/7519] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:08 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:09.814329 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:09.814969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:09.822066 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:09.822554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:09.823044 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:09.823736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:09.824173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:09.824595 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:09.956874 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:09.965535 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a3969a84-9832-4235-a12d-5fb8bfe03eeb tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.155281 Sep 01 06:16:09.966120 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3786/7520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:09 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:10.988771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:10.989407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:10.995970 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:10.996395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:10.996837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:10.997798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:10.998260 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:10.998749 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:11.153595 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:11.166045 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-901f79f6-b2fd-4730-aa2f-ce3c08ea2a68 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.181147 Sep 01 06:16:11.166756 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3735/7521] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:10 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:12.191585 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:12.192602 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:12.204807 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:12.205613 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:12.206336 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:12.207540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:12.208302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:12.208974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:12.346402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:12.354737 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7f0a3c9b-356f-461c-beb4-0b4928b6c1b4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.169813 Sep 01 06:16:12.355565 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3787/7522] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:12 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:12.386104 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9aa87d63-bfc2-4b04-ae87-3236a5636264 req-8965724e-b3d1-45df-87ce-46a5293766e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56f76c5-fd03-446d-8731-56edab454fc3", "name": "network-vif-plugged", "status": "completed", "tag": "b8f2dba7-3d29-439b-a78c-89db08ffffc8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:16:12.391988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:12.392734 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:12.401564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9aa87d63-bfc2-4b04-ae87-3236a5636264 req-8965724e-b3d1-45df-87ce-46a5293766e6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:12.402125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9aa87d63-bfc2-4b04-ae87-3236a5636264 req-8965724e-b3d1-45df-87ce-46a5293766e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:12.402803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9aa87d63-bfc2-4b04-ae87-3236a5636264 req-8965724e-b3d1-45df-87ce-46a5293766e6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:12.415665 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9aa87d63-bfc2-4b04-ae87-3236a5636264 req-8965724e-b3d1-45df-87ce-46a5293766e6 service nova] Creating event network-vif-plugged:b8f2dba7-3d29-439b-a78c-89db08ffffc8 for instance a56f76c5-fd03-446d-8731-56edab454fc3 on n-h2-820368-37 Sep 01 06:16:12.421247 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9aa87d63-bfc2-4b04-ae87-3236a5636264 req-8965724e-b3d1-45df-87ce-46a5293766e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Sep 01 06:16:12.422091 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3736/7523] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:16:13.377342 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:13.377885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:13.379921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:13.386415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:13.386907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:13.387346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:13.388038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:13.388489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:13.388884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:13.528653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:13.537227 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fb3f1d48-8c0a-4d56-9507-32e1fcc3f842 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1392 microversion: 2.1 time: 0.164136 Sep 01 06:16:13.537805 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3788/7524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:13 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:14.563932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:14.565227 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:14.572182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:14.572680 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:14.573131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:14.573831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:14.574303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:14.574740 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:14.718831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:14.731063 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a187157c-cf56-4c63-b11b-ec3cf70d5c58 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1565 microversion: 2.1 time: 0.175090 Sep 01 06:16:14.731790 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3737/7525] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:14 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:14.753323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:14.753948 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:14.761031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:14.761522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:14.761955 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:14.762656 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:14.763146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:14.763577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:14.904197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:14.917540 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5a380b3e-095f-463a-823f-e36dab8e3733 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1565 microversion: 2.1 time: 0.167820 Sep 01 06:16:14.918345 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3789/7526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:14 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:16.587908 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:16:16.588571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:16.591166 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6f98ba0f-ebfc-4a34-a5cf-20a47c54eaa0 req-43dcc81a-b305-465d-ad1c-92549dea32bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56f76c5-fd03-446d-8731-56edab454fc3", "tag": "b8f2dba7-3d29-439b-a78c-89db08ffffc8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:16:16.591699 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:16.597714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:16.597959 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:16.598503 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:16.599780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:16.600771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:16.601339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:16.601768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:16.604025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6f98ba0f-ebfc-4a34-a5cf-20a47c54eaa0 req-43dcc81a-b305-465d-ad1c-92549dea32bb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:16.604570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6f98ba0f-ebfc-4a34-a5cf-20a47c54eaa0 req-43dcc81a-b305-465d-ad1c-92549dea32bb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:16.605069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6f98ba0f-ebfc-4a34-a5cf-20a47c54eaa0 req-43dcc81a-b305-465d-ad1c-92549dea32bb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:16.617926 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6f98ba0f-ebfc-4a34-a5cf-20a47c54eaa0 req-43dcc81a-b305-465d-ad1c-92549dea32bb service nova] Creating event network-changed:b8f2dba7-3d29-439b-a78c-89db08ffffc8 for instance a56f76c5-fd03-446d-8731-56edab454fc3 on n-h2-820368-37 Sep 01 06:16:16.623403 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6f98ba0f-ebfc-4a34-a5cf-20a47c54eaa0 req-43dcc81a-b305-465d-ad1c-92549dea32bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036091 Sep 01 06:16:16.624467 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3790/7527] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:16:16.747472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:16:16.756772 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9145399-8cf2-4b49-b5b1-9f9fa316cf69 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1565 microversion: 2.1 time: 0.172800 Sep 01 06:16:16.758267 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3738/7528] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:16:16 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:16:48.086545 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:16:48.087172 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action (ip 10.222.0.26) !!! Sep 01 06:16:48.088136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:48.088864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:16:48.093365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:16:48.095643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:16:48.104768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:48.105248 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:48.105676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:48.106362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:16:48.106812 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:16:48.107262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:16:48.182878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2f77a5de-c2c6-40ac-978f-18dbe6a8eeba tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action" status: 200 len: 24566 microversion: 2.1 time: 0.098383 Sep 01 06:16:48.183945 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3791/7529] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:16:48 2022] POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action => generated 24566 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:17:18.651524 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:18.652702 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=42 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:18.906388 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:18.906915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:18.913292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:18.913795 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:18.914247 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:18.919660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:18.920141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:18.920589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:18.948543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lazy-loading 'flavor' on Instance uuid a56f76c5-fd03-446d-8731-56edab454fc3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:17:19.024719 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5153fe0-fd87-4f11-a9fd-c38cebaa69b0 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.377440 Sep 01 06:17:19.025396 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3739/7530] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:17:18 2022] POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:17:19.035324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:19.036054 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:19.038591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:19.039522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=4 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:19.045696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:19.046187 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:19.046684 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:19.047505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:19.047981 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:19.048463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:19.314778 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:19.325398 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0483b948-05c2-4115-b3e1-432d97db064e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1691 microversion: 2.1 time: 0.294788 Sep 01 06:17:19.325970 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3792/7531] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:19 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:20.355666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:20.356623 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:20.366683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:20.367512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:20.368203 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:20.369284 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:20.370009 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:20.370700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:20.564694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:20.572942 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4d0e3f2-5bb6-4b93-8b87-4fab3add4f48 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1691 microversion: 2.1 time: 0.225833 Sep 01 06:17:20.573686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3740/7532] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:20 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:21.596326 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:21.596935 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:21.605134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:21.605620 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:21.606050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:21.606741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:21.607238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:21.607659 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:21.753735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:21.765818 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0463e27e-409b-415f-a7d2-2384de5bd530 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1674 microversion: 2.1 time: 0.173897 Sep 01 06:17:21.766611 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3793/7533] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:21 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:22.881103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:22.884957 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:22.895375 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:22.895870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:22.896314 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:22.897015 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:22.897481 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:22.897914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:22.960531 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06ae9b2b-816e-4d9d-89df-6d9faec271c7 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action" status: 200 len: 36133 microversion: 2.1 time: 0.086074 Sep 01 06:17:22.961370 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3741/7534] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:17:22 2022] POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action => generated 36133 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:17:22.975498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:22.976033 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:22.983432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:22.983922 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:22.984353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:22.985041 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:22.985591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:22.985991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:23.060314 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c21740a9-2db9-4f9b-8a52-9917c1fcd8f6 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.088847 Sep 01 06:17:23.061282 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3794/7535] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:17:22 2022] POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:17:23.071339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:23.072080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:23.079671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:23.080228 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:23.080711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:23.081407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:23.081911 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:23.083182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:23.228870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:23.237849 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77601c32-8c63-4414-be28-4346cb3808db tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1680 microversion: 2.1 time: 0.170785 Sep 01 06:17:23.238473 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3742/7536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:23 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:24.265718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:24.266836 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:24.274644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:24.275156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:24.275587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:24.276303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:24.276735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:24.277160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:24.428577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:24.440756 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-890d0755-b606-4c50-830a-47826ccbd324 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1680 microversion: 2.1 time: 0.182285 Sep 01 06:17:24.441577 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3795/7537] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:24 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:25.467864 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:25.468434 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:25.476183 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:25.476685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:25.477129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:25.477827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:25.478293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:25.478728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:25.622701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:25.635118 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b979b80b-4480-4240-b4d1-df134b67a57e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1683 microversion: 2.1 time: 0.171547 Sep 01 06:17:25.635961 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3743/7538] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:25 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:25.740643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:25.742839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:25.750082 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:25.750560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:25.751230 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:25.751785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:25.752233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:25.752653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:25.815467 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bb97f23b-8271-4d52-9416-795f2f2b4c73 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action" status: 200 len: 36133 microversion: 2.1 time: 0.078607 Sep 01 06:17:25.816105 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3796/7539] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:17:25 2022] POST /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3/action => generated 36133 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 06:17:26.937295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:26.937827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:26.940479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-4c1ed1f9-2405-464c-9e86-cc217ca463e4 req-130603b5-a825-4018-b6dc-2da93f5d2c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56f76c5-fd03-446d-8731-56edab454fc3", "tag": "b8f2dba7-3d29-439b-a78c-89db08ffffc8"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:26.945770 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:26.946355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:26.946878 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:26.947780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:26.948525 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:26.949046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:26.951790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4c1ed1f9-2405-464c-9e86-cc217ca463e4 req-130603b5-a825-4018-b6dc-2da93f5d2c93 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:26.952417 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4c1ed1f9-2405-464c-9e86-cc217ca463e4 req-130603b5-a825-4018-b6dc-2da93f5d2c93 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:26.952873 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-4c1ed1f9-2405-464c-9e86-cc217ca463e4 req-130603b5-a825-4018-b6dc-2da93f5d2c93 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:26.965447 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-4c1ed1f9-2405-464c-9e86-cc217ca463e4 req-130603b5-a825-4018-b6dc-2da93f5d2c93 service nova] Creating event network-changed:b8f2dba7-3d29-439b-a78c-89db08ffffc8 for instance a56f76c5-fd03-446d-8731-56edab454fc3 on n-h2-820368-37 Sep 01 06:17:26.971466 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-4c1ed1f9-2405-464c-9e86-cc217ca463e4 req-130603b5-a825-4018-b6dc-2da93f5d2c93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035346 Sep 01 06:17:26.972370 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3797/7540] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:17:26.980264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:17:27.076065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb37dee8-eb25-4ebd-a1f8-add65d4a7d4b tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 204 len: 0 microversion: 2.1 time: 0.142510 Sep 01 06:17:27.076882 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3744/7541] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:17:26 2022] DELETE /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:17:27.088059 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:27.089008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:27.095986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:27.096634 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:27.097643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:27.098018 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:27.098571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:27.099136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:27.240550 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:27.248971 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9af311f2-5f84-498f-8a42-036807eb1c47 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1689 microversion: 2.1 time: 0.167057 Sep 01 06:17:27.249557 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3798/7542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:27 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:17:28.273833 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:28.274584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:28.282998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:28.283498 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:28.283944 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:28.284653 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:28.285123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:28.285553 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:28.428081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:28.436840 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-776e3c8c-9504-45c3-a15f-673ebbfdceb4 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1689 microversion: 2.1 time: 0.168283 Sep 01 06:17:28.437699 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3745/7543] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:28 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:29.459146 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:29.459749 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:29.467261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:29.467891 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:29.468333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:29.469047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:29.469510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:29.469972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:29.610222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9b0807c3f34fa5ba38cc160d73e829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907eb43a17854f539790c4b36d3c00d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:29.618383 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc09cfdb-d800-4c81-a100-36765a348ef2 tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 200 len: 1571 microversion: 2.1 time: 0.163433 Sep 01 06:17:29.619220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3799/7544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:29 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:29.647743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1ca0f522-3bc1-4a71-9451-13e956212b1d req-a6248223-e5bf-4650-aaf4-451c19e3ba2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56f76c5-fd03-446d-8731-56edab454fc3", "name": "network-vif-deleted", "tag": "b8f2dba7-3d29-439b-a78c-89db08ffffc8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:29.659673 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ca0f522-3bc1-4a71-9451-13e956212b1d req-a6248223-e5bf-4650-aaf4-451c19e3ba2f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:29.660171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ca0f522-3bc1-4a71-9451-13e956212b1d req-a6248223-e5bf-4650-aaf4-451c19e3ba2f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:29.660618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ca0f522-3bc1-4a71-9451-13e956212b1d req-a6248223-e5bf-4650-aaf4-451c19e3ba2f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:29.672106 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1ca0f522-3bc1-4a71-9451-13e956212b1d req-a6248223-e5bf-4650-aaf4-451c19e3ba2f service nova] Creating event network-vif-deleted:b8f2dba7-3d29-439b-a78c-89db08ffffc8 for instance a56f76c5-fd03-446d-8731-56edab454fc3 on n-h2-820368-37 Sep 01 06:17:29.678108 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1ca0f522-3bc1-4a71-9451-13e956212b1d req-a6248223-e5bf-4650-aaf4-451c19e3ba2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034593 Sep 01 06:17:29.678785 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3746/7545] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:17:30.643034 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:30.644387 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] [instance: a56f76c5-fd03-446d-8731-56edab454fc3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:30.656053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:30.656865 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:30.657616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:30.658508 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:30.659013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:30.659436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:30.673054 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] HTTP exception thrown: Instance a56f76c5-fd03-446d-8731-56edab454fc3 could not be found. Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Request method failure captured: Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 HTTP/1.1 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEEvwKdBLekTITp38N-TxpKn0g1lbbGMEOb4ZGUE7LiYeQkScBj0HER_UlfzG-3NLK5wlBxW1acJmduCmZYB_otSMxcs1zxoO9kyYw85onadCQ-jWCyXRjouiRr5ie8nGsgKHvZxGQLPBrKy8LWX8RmvcAlYfs9nVbK84zl9SZECdLFk Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/907eb43a17854f539790c4b36d3c00d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 907eb43a17854f539790c4b36d3c00d2 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1872116275 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: cf9b0807c3f34fa5ba38cc160d73e829 Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1872116275-project Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance a56f76c5-fd03-446d-8731-56edab454fc3 could not be found. Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'a56f76c5-fd03-446d-8731-56edab454fc3'} Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56f76c5-fd03-446d-8731-56edab454fc3 could not be found. Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56f76c5-fd03-446d-8731-56edab454fc3 could not be found. Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:17:30.674866 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56f76c5-fd03-446d-8731-56edab454fc3 could not be found. Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Returning 404 to user: Instance a56f76c5-fd03-446d-8731-56edab454fc3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-99921f2d-f57c-42fa-b2d3-254cd7bee84e tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3" status: 404 len: 111 microversion: 2.1 time: 0.039839 Sep 01 06:17:30.679513 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3800/7546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:30 2022] GET /compute/v2.1/servers/a56f76c5-fd03-446d-8731-56edab454fc3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:17:34.010325 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15407e62-85e8-4839-94b9-ac2ebd32d46d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] Calling method '.version_select at 0x7fa75b092d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:34.036727 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15407e62-85e8-4839-94b9-ac2ebd32d46d tempest-TestNetworkAdvancedServerOps-1872116275 tempest-TestNetworkAdvancedServerOps-1872116275-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1989258249" status: 202 len: 0 microversion: 2.1 time: 0.031829 Sep 01 06:17:34.037918 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3747/7547] 10.222.0.26 () {58 vars in 1284 bytes} [Thu Sep 1 06:17:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1989258249 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:17:45.627610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=18 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:45.628373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:45.841839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2c323c4-4d28-416f-8bc2-9af9ee676db1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'create', calling method: .version_select at 0x7fa75a645a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1529025797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6kaVgEASqSfZlIP6DtmQAlAMxgpDRTMx2XoCCUlibLkWemvG/2QPVmajGDgYpWs6KT+J6Zmh8KjMXNnPtrzYZazWoGaLOvYMPqaPOC7fuWBl+R2Pb9GG5KY8YljplPlw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:45.860292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f2c323c4-4d28-416f-8bc2-9af9ee676db1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:17:45.866705 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f2c323c4-4d28-416f-8bc2-9af9ee676db1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for user 2f00165a0e4847a79882af6fb9fd3e8d and project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:17:45.901193 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2c323c4-4d28-416f-8bc2-9af9ee676db1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.284112 Sep 01 06:17:45.903802 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3801/7548] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:17:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:17:46.973289 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:46.974064 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:46.978291 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2043749624", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1529025797", "security_groups": [{"name": "tempest-secgroup-smoke-2106026053"}], "networks": [{"uuid": "6d1a90de-e1da-464a-b815-e7ac6bfed0e0"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:47.092062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] validate_networks() for [('6d1a90de-e1da-464a-b815-e7ac6bfed0e0', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:17:47.576777 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:17:47.577218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:17:47.577883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:17:47.578327 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:17:47.578803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:17:47.588422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:47.588922 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:47.589370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:47.590300 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:47.590951 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:47.591544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:47.611568 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:17:47.617558 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for user 2f00165a0e4847a79882af6fb9fd3e8d and project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:17:47.633943 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:17:47.639212 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:17:47.692719 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bba7ab1a-3155-4c8d-a9ac-52ec19cce6fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721271 Sep 01 06:17:47.693572 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3748/7549] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:17:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 06:17:47.706393 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c3ceb5a2-19db-4c03-a79a-d7f95b38af56 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:47.708074 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c3ceb5a2-19db-4c03-a79a-d7f95b38af56 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:47.776243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c3ceb5a2-19db-4c03-a79a-d7f95b38af56 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:47.784239 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c3ceb5a2-19db-4c03-a79a-d7f95b38af56 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1247 microversion: 2.1 time: 0.083634 Sep 01 06:17:47.784799 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3802/7550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:47 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:48.806293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:48.807733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:48.815210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:48.820224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:48.820893 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:48.821928 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:48.822507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:48.822973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:48.891489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:48.900255 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58f395f3-0bb6-4492-be40-7a3df4347c5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1307 microversion: 2.1 time: 0.099458 Sep 01 06:17:48.901098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3749/7551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:48 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:49.921818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:49.923587 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:49.935696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:49.936529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:49.941446 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:49.942227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:49.943448 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:49.943927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:50.085946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:50.093761 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42f09b98-cca6-495d-ac62-4c938efd8448 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.176067 Sep 01 06:17:50.094336 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3803/7552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:49 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:17:50.309415 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8bebf5e1-0f50-49bb-a60a-6c6ed19feb22 req-f6f45ec3-44b7-4fdc-9c53-87a34a2c11a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:50.323694 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8bebf5e1-0f50-49bb-a60a-6c6ed19feb22 req-f6f45ec3-44b7-4fdc-9c53-87a34a2c11a9 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:50.324769 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8bebf5e1-0f50-49bb-a60a-6c6ed19feb22 req-f6f45ec3-44b7-4fdc-9c53-87a34a2c11a9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:50.325277 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8bebf5e1-0f50-49bb-a60a-6c6ed19feb22 req-f6f45ec3-44b7-4fdc-9c53-87a34a2c11a9 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:50.338651 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8bebf5e1-0f50-49bb-a60a-6c6ed19feb22 req-f6f45ec3-44b7-4fdc-9c53-87a34a2c11a9 service nova] Creating event network-changed:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:17:50.344686 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8bebf5e1-0f50-49bb-a60a-6c6ed19feb22 req-f6f45ec3-44b7-4fdc-9c53-87a34a2c11a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041852 Sep 01 06:17:50.345783 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3750/7553] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:17:51.119571 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:51.120419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:51.132373 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:51.133171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:51.133886 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:51.135070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:51.135822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:51.136512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:51.278011 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:51.286647 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-1ac2dcd1-7d5b-439d-b126-6cbee24bbc28 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.174008 Sep 01 06:17:51.287235 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3804/7554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:51 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:52.312949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:52.313827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:52.321570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:52.322056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:52.322512 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:52.323322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:52.323791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:52.324224 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:52.471264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:52.479365 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ab84bf1-031f-4e7f-b6dd-f45b72e9869b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.173573 Sep 01 06:17:52.479948 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3751/7555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:52 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:53.505067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:53.506123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:53.517444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:53.517928 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:53.518361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:53.519436 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:53.519890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:53.520310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:53.666702 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:53.675988 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b15994ae-9d43-44fd-b8c2-6b0e787fbabd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.177797 Sep 01 06:17:53.676599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3805/7556] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:53 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:54.698879 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:54.699947 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:54.707739 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:54.708237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:54.708676 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:54.709395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:54.709856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:54.710294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:54.850728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:54.859223 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b94fad5-a39a-4f9e-8fbd-74c6ca075df7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.164100 Sep 01 06:17:54.859822 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3752/7557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:54 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:55.885141 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:55.886108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:55.896462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:55.896952 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:55.897421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:55.898142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:55.898597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:55.899061 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:56.039558 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:56.047619 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3b170999-d192-46bc-a82e-f28a66daaa90 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.169104 Sep 01 06:17:56.048209 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3806/7558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:55 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:56.965956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-27ebd652-9abe-44ef-a912-bd87906e220c req-05d2f1a6-e3f8-4fa7-aab7-2bbd7f0bdc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "name": "network-vif-plugged", "status": "completed", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:17:56.975736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-27ebd652-9abe-44ef-a912-bd87906e220c req-05d2f1a6-e3f8-4fa7-aab7-2bbd7f0bdc2f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:56.976225 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-27ebd652-9abe-44ef-a912-bd87906e220c req-05d2f1a6-e3f8-4fa7-aab7-2bbd7f0bdc2f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:56.976661 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-27ebd652-9abe-44ef-a912-bd87906e220c req-05d2f1a6-e3f8-4fa7-aab7-2bbd7f0bdc2f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:56.987842 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-27ebd652-9abe-44ef-a912-bd87906e220c req-05d2f1a6-e3f8-4fa7-aab7-2bbd7f0bdc2f service nova] Creating event network-vif-plugged:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:17:56.993086 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-27ebd652-9abe-44ef-a912-bd87906e220c req-05d2f1a6-e3f8-4fa7-aab7-2bbd7f0bdc2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099244 Sep 01 06:17:56.993780 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3753/7559] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:17:57.070138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:57.070841 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:57.078398 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:57.078980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:57.079657 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:57.080695 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:57.081142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:57.081564 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:57.217977 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:57.226198 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-40b4ff79-5045-439e-8092-e48336cbf317 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.160582 Sep 01 06:17:57.226773 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3807/7560] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:57 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:58.247787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:58.249043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:58.255995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:58.256717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:58.263990 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:58.264488 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:58.264933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:58.265643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:58.266103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:58.266542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:58.405635 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:58.414747 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e042146-1915-45ca-a6fb-ee73793dcc03 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1373 microversion: 2.1 time: 0.168688 Sep 01 06:17:58.415500 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3754/7561] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:58 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:59.446633 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:59.447233 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:59.449747 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:17:59.462810 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:59.463309 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:59.463767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:59.464468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:59.464919 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:59.465341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:59.605345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:59.614034 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d14ee50f-b5f4-4334-951d-f94343f65621 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1557 microversion: 2.1 time: 0.174243 Sep 01 06:17:59.614581 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3808/7562] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:59 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:17:59.634660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:17:59.635312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:17:59.642552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:59.643084 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:59.643542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:59.644792 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:17:59.645276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:17:59.645710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:17:59.783780 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:17:59.792204 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26732746-513a-4963-ab37-646bcc78b29d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1557 microversion: 2.1 time: 0.161453 Sep 01 06:17:59.792820 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3755/7563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:17:59 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:18:01.786777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-590ef676-041a-4d93-ba49-83978b5d9201 req-737c5679-0c04-499e-9402-05191aad2dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:18:01.797752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-590ef676-041a-4d93-ba49-83978b5d9201 req-737c5679-0c04-499e-9402-05191aad2dea service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:18:01.798220 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-590ef676-041a-4d93-ba49-83978b5d9201 req-737c5679-0c04-499e-9402-05191aad2dea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:18:01.798719 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-590ef676-041a-4d93-ba49-83978b5d9201 req-737c5679-0c04-499e-9402-05191aad2dea service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:18:01.818920 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-590ef676-041a-4d93-ba49-83978b5d9201 req-737c5679-0c04-499e-9402-05191aad2dea service nova] Creating event network-changed:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:18:01.824446 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-590ef676-041a-4d93-ba49-83978b5d9201 req-737c5679-0c04-499e-9402-05191aad2dea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041604 Sep 01 06:18:01.825050 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3809/7564] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:20:27.906527 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:20:27.907531 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:20:27.908351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:20:27.909102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:20:27.910039 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:20:27.910166 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action (ip 10.222.0.26) !!! Sep 01 06:20:27.911364 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:20:27.911533 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action (ip 10.222.0.26) !!! Sep 01 06:20:27.912523 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:20:27.912635 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action (ip 10.222.0.26) !!! Sep 01 06:20:27.918222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:20:27.918773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:27.929847 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:27.930351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:27.930803 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:27.931731 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:27.932519 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:27.932963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:27.958723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lazy-loading 'flavor' on Instance uuid d349e6eb-ea9d-4168-9e8c-4292095c2d6b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:20:28.168972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c01b2d1-9d46-41d2-8fcd-36d0dd6d9fc2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.264232 Sep 01 06:20:28.169611 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3756/7565] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:20:27 2022] POST /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:20:28.176609 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:20:28.177486 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:20:28.178362 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:20:28.179276 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=38 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:20:28.180308 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:20:28.180456 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b (ip 10.222.0.26) !!! Sep 01 06:20:28.181624 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:20:28.181783 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b (ip 10.222.0.26) !!! Sep 01 06:20:28.186767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:28.187510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:28.197301 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:28.197783 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:28.198215 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:28.198926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:28.199375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:28.199795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:28.336964 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:28.345806 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ba1b0e06-60d0-476b-a2a8-6a51856a3a25 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.171289 Sep 01 06:20:28.346410 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3810/7566] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:28 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:29.375310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:29.375948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:29.387699 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55146. Sep 01 06:20:29.391644 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:29.392216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:29.392649 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:29.393352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:29.394165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:29.394602 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:29.395241 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55144. Sep 01 06:20:29.532662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:29.540753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5639a8d-c913-4326-9ff0-8f0202aa71a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.175695 Sep 01 06:20:29.541333 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3757/7567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:29 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:30.570498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:30.572098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:30.585861 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:30.586581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:30.587286 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:30.588356 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:30.589378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:30.589617 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:30.594911 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55150. Sep 01 06:20:30.600287 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55152. Sep 01 06:20:30.740563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:30.750693 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cdf136bb-0498-4ff1-ae1a-7490ebe95127 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.190969 Sep 01 06:20:30.751301 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3811/7568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:30 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:31.772648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:31.773276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:31.780914 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:31.781412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:31.781889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:31.782593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:31.783097 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:31.783534 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:31.924783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:31.936045 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25a27d99-026c-4ca9-ad7d-c50a0d76daa8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.167912 Sep 01 06:20:31.936954 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3758/7569] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:31 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:32.961614 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:32.962224 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:32.969709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:32.970193 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:32.970628 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:32.971355 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:32.971805 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:32.972223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:33.116108 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:33.124517 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5ac311c3-3ea5-4773-b143-5c38d5d84b1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.166909 Sep 01 06:20:33.125097 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3812/7570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:32 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:34.151592 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:34.152619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:34.164313 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:34.165174 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:34.165921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:34.167159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:34.167964 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:34.168722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:34.318840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:34.331093 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b30b6300-6799-40f5-8772-0a90c64f0d4d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.186765 Sep 01 06:20:34.331950 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3759/7571] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:34 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:35.356717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:35.357394 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:35.364843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:35.365330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:35.365736 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:35.366461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:35.366930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:35.367395 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:35.509990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:35.518572 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-aeb33a43-fd23-493f-bdd5-1e7712929f31 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.166002 Sep 01 06:20:35.519539 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3813/7572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:35 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:36.544894 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:36.545966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:36.557639 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:36.558476 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:36.559420 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:36.560160 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:36.560671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:36.561152 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:36.704039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:36.716594 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-409ac2f2-f6b9-42d5-a4ae-53ab6f8e6781 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.178865 Sep 01 06:20:36.717185 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3760/7573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:36 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:37.738251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:37.738871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:37.746354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:37.746845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:37.747315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:37.748083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:37.748557 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:37.748980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:37.893428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:37.907489 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e14a5acf-48ce-4025-a6c8-ba5a575c1481 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.173126 Sep 01 06:20:37.908384 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3814/7574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:37 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:38.937311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:38.937986 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:38.946197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:38.946736 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:38.947265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:38.948041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:38.948560 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:38.949040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:39.084526 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:39.092808 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09f07c5d-8ea6-488c-9edf-96637b547192 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.161582 Sep 01 06:20:39.093400 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3761/7575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:38 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:40.115158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:40.115785 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:40.123590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:40.124318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:40.124777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:40.125489 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:40.125944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:40.126368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:40.268235 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:40.276657 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cc56cdc0-e005-440f-ab4c-d06179abb32d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1703 microversion: 2.1 time: 0.165709 Sep 01 06:20:40.277236 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3815/7576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:40 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1703 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:41.298107 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:41.298775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:41.306169 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:41.306707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:41.307200 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:41.307913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:41.308416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:41.308831 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:41.452438 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:41.457341 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0fd9eca-ccfe-4d9e-b03c-132e9dc10b1d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1703 microversion: 2.1 time: 0.163272 Sep 01 06:20:41.457934 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3762/7577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:41 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1703 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:42.479124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:42.479800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:42.486831 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:42.487353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:42.487789 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:42.488482 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:42.488934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:42.489361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:42.633675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:42.646960 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0f7b314c-9096-4067-bb1c-d561908cacd7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1703 microversion: 2.1 time: 0.171619 Sep 01 06:20:42.647906 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3816/7578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:42 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1703 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:43.673975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:43.674613 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:43.682355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:43.683075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:43.683322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:43.684078 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:43.684597 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:43.685184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:43.818249 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "name": "network-vif-plugged", "status": "completed", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:20:43.823005 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:43.829728 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:43.830162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:43.830598 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:43.832402 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d0227b3-fd04-4030-b2b5-049592a86181 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1703 microversion: 2.1 time: 0.163413 Sep 01 06:20:43.834765 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3763/7579] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:43 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1703 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:43.844481 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] Creating event network-vif-plugged:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:20:43.848174 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] [cc1aa239-8f00-48e9-a2f1-bf9998b45054] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:20:44.860080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:44.862216 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:44.862787 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] [cc1aa239-8f00-48e9-a2f1-bf9998b45054] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55210. Sep 01 06:20:44.867672 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-eaabd758-ab38-4df1-b6e1-ec8e9a61abf9 req-77dff722-e46e-482b-b279-b833857395e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.053970 Sep 01 06:20:44.873117 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:44.873781 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3817/7580] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:20:44.874191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:44.874952 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:44.875693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:44.876154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:44.876791 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:45.039430 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:45.048742 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0af2055a-8fb1-49cf-b18b-e2d96c1026bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.198697 Sep 01 06:20:45.049596 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3764/7581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:44 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:20:46.074291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:46.075412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:46.083604 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:46.084099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:46.084818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:46.085641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:46.086380 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:46.086555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:46.253428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:46.262360 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f2dbfa8a-a6d0-4b73-a4b4-912f565d1c24 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.193765 Sep 01 06:20:46.263650 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3818/7582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:46 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:47.289303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:47.290608 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:47.297683 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:47.298463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:47.299129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:47.300074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:47.300748 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:47.301516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:47.452358 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:47.463936 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9ba80c7-2143-403a-922f-e0df8a2c1d5a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.179272 Sep 01 06:20:47.478031 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3765/7583] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:47 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:20:48.487862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:48.488811 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:48.497218 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:48.498227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:48.499072 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:48.500294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:48.501405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:48.502366 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:48.657739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:48.666026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8b52a8fc-5c44-4500-b416-63e6150a71b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.183529 Sep 01 06:20:48.666624 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3819/7584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:48 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:20:49.691159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:49.692827 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:49.700918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:49.701431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:49.701881 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:49.702798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:49.703387 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:49.703732 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:49.889091 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:49.899112 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a31db957-734e-4e38-a566-4bd8a17603dd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.214018 Sep 01 06:20:49.900156 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3766/7585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:49 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:50.922715 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:50.923367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:50.932512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:50.933305 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:50.933751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:50.934650 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:50.935315 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:50.935904 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:51.114854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:51.123331 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cd43ede0-914d-447e-972a-b1822d917166 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.205345 Sep 01 06:20:51.124199 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3820/7586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:50 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:52.146080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:52.146696 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:52.157825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:52.158647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:52.159137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:52.159867 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:52.160351 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:52.160785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:52.306299 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:52.315657 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c74fbc55-5f57-448f-9c82-3495a40db46d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.173822 Sep 01 06:20:52.316285 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3767/7587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:52 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:53.339660 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:53.340643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:53.349999 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:53.350818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:53.351608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:53.352533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:53.352988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:53.353412 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:53.501493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:53.509730 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2875454-c272-4165-986e-6d751067c037 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1698 microversion: 2.1 time: 0.176206 Sep 01 06:20:53.510272 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3821/7588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:53 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:54.532046 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:54.532724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:54.540293 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:54.540802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:54.541264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:54.541987 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:54.542455 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:54.542918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:54.679624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:54.687688 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc3aedf1-78f1-4b13-9634-0b275b05fb2b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1680 microversion: 2.1 time: 0.159914 Sep 01 06:20:54.688270 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3768/7589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:54 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:55.713658 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:55.717905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:55.726535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:55.727389 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:55.728109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:55.729260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:55.730013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:55.730713 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:56.193241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:56.201633 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-76462dff-2ff4-4126-9f5e-c99b44711183 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1680 microversion: 2.1 time: 0.494740 Sep 01 06:20:56.202200 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3822/7590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:55 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1680 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:57.228256 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:57.229272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:57.238543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.239086 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.239570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.240282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.240757 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.241197 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.379762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:57.388257 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8f8e410-5dbe-478d-b56d-78c12657449d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1623 microversion: 2.1 time: 0.166641 Sep 01 06:20:57.388843 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3769/7591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:57 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1623 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:57.409527 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:20:57.410079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:57.420291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.420291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.420291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.420291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.420291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.420291 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.519367 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 06:20:57.599442 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-55b952c6-51a8-4835-b40c-4864a8b4bfd0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.194088 Sep 01 06:20:57.600048 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3823/7592] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:20:57 2022] POST /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:20:57.608369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:57.608998 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:57.615175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.615679 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.616129 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.616838 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.617308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.617750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.636537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:20:57.784399 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:57.794293 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6539eca-4a57-4d84-a2d4-0d3258d58cbc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1631 microversion: 2.1 time: 0.189836 Sep 01 06:20:57.795275 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3770/7593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:57 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1631 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:20:57.933158 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-3b708b07-e3d1-4f00-9103-63a9a4d76704 req-eab15404-641d-4fd0-b757-f275b6917b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "name": "network-vif-unplugged", "status": "completed", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:20:57.944360 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b708b07-e3d1-4f00-9103-63a9a4d76704 req-eab15404-641d-4fd0-b757-f275b6917b6f service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:57.945052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b708b07-e3d1-4f00-9103-63a9a4d76704 req-eab15404-641d-4fd0-b757-f275b6917b6f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:57.945662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-3b708b07-e3d1-4f00-9103-63a9a4d76704 req-eab15404-641d-4fd0-b757-f275b6917b6f service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:57.958931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-3b708b07-e3d1-4f00-9103-63a9a4d76704 req-eab15404-641d-4fd0-b757-f275b6917b6f service nova] Unable to find a host for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b. Dropping event network-vif-unplugged {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 06:20:57.959877 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-3b708b07-e3d1-4f00-9103-63a9a4d76704 req-eab15404-641d-4fd0-b757-f275b6917b6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031842 Sep 01 06:20:57.960481 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3824/7594] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 06:20:58.817843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:20:58.818781 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:20:58.822520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=31 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:20:58.829580 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:58.830074 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:58.830516 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:58.831243 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:20:58.831693 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:20:58.832102 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:20:58.965474 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:20:58.974038 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ca2aa6e-e433-44e9-bc3a-aef624877ef8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1631 microversion: 2.1 time: 0.162149 Sep 01 06:20:58.974630 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3771/7595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:58 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1631 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:20:59.999330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:00.000176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:00.003663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:21:00.009751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:00.010241 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:00.010681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:00.011416 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:00.011888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:00.012335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:00.016354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:21:00.171297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:00.179906 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-2420d265-809f-4ac4-8245-dd9d92e33362 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1631 microversion: 2.1 time: 0.187376 Sep 01 06:21:00.180483 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3825/7596] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:20:59 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1631 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:01.213834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:01.214609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:01.224066 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:01.224566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:01.225011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:01.225711 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:01.226179 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:01.226821 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:01.367654 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:01.379209 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-276f66da-c109-4b17-8013-f4db4d372323 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1631 microversion: 2.1 time: 0.172306 Sep 01 06:21:01.379788 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3772/7597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:01 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1631 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:02.405578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:02.406486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:02.417370 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:02.418176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:02.418931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:02.420157 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:02.420920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:02.421677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:02.586079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:02.594090 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-141745d5-bdbc-4ba6-b1ed-9098ea0a3b53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1631 microversion: 2.1 time: 0.195693 Sep 01 06:21:02.594636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3826/7598] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:02 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1631 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:03.618956 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:03.619751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:03.629837 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:03.630335 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:03.630783 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:03.631528 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:03.631993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:03.632429 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:03.771424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:03.779417 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e390642-702f-4302-a6ab-ea789b8b582c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.166210 Sep 01 06:21:03.779973 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3773/7599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:03 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:04.802434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:04.803444 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:04.812152 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:04.813349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:04.814190 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:04.815737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:04.816270 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:04.816725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:04.960147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:04.969035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c2e9b3f2-5e71-48e3-b0ca-632064ec05c4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.171587 Sep 01 06:21:04.970433 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3827/7600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:04 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:05.992422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:05.992972 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:06.003949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:06.004470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:06.004923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:06.007407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:06.007889 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:06.008334 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:06.158340 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:06.167189 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4488d5a-6786-4a94-b0aa-032ea2d8f8de tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.179157 Sep 01 06:21:06.180640 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3774/7601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:05 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:07.196926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:07.198725 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:07.210095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:07.211024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:07.211683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:07.212616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:07.213273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:07.213947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:07.364345 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:07.372594 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-574da40b-7070-44e6-9d6e-9c57c914ed15 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.182568 Sep 01 06:21:07.373390 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3828/7602] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:07 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:08.394383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:08.394978 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:08.402935 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:08.403424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:08.403852 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:08.404605 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:08.405080 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:08.405520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:08.549053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:08.558007 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3e988e8-839d-4090-99d3-3717b901eff6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.167990 Sep 01 06:21:08.558864 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3775/7603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:08 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:09.584790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:09.585645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:09.595629 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:09.596297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:09.596884 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:09.597837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:09.598619 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:09.599303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:09.746578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:09.757114 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-08ae02a3-50f8-4618-99bf-99ddc88e8230 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.180107 Sep 01 06:21:09.757908 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3829/7604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:09 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:10.780165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:10.780918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:10.788765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:10.789444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:10.790161 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:10.791383 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:10.792153 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:10.792828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:10.949612 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:10.958860 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-162f2572-03ca-4ceb-b550-2da02c2cb66b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.181967 Sep 01 06:21:10.970686 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3776/7605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:10 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:11.982777 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:11.983542 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:11.992632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:11.993259 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:11.993761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:11.994457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:11.999711 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:12.000173 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:12.150552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:12.158623 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f226cca3-a4ba-4506-8b91-317500254dc4 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.180093 Sep 01 06:21:12.159234 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3830/7606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:11 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:13.184695 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:13.185689 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:13.196508 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:13.197013 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:13.197466 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:13.198178 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:13.198646 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:13.199123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:13.351138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:13.362149 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33cd7ea2-3ffe-4123-a62d-2c2ae17af20c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.184218 Sep 01 06:21:13.362745 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3777/7607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:13 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:14.388289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:14.389287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:14.401176 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:14.401654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:14.402335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:14.402813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:14.403321 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:14.403751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:14.559519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:14.568089 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3bc978ca-7d29-4a4c-8f88-bd27366764f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.186731 Sep 01 06:21:14.568673 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3831/7608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:14 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:15.594367 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:15.595489 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:15.612726 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:15.613675 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:15.614542 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:15.615805 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:15.616640 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:15.617368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:15.769176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:15.777517 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-634d8ab3-afc3-4115-9c4b-711158fa47bd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.189680 Sep 01 06:21:15.778098 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3778/7609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:15 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:16.802980 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:16.804053 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:16.816113 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:16.816930 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:16.817704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:16.818862 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:16.819718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:16.820439 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:16.968428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:16.976409 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-87479230-62a9-448e-948f-c93a8eabffaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.179996 Sep 01 06:21:16.976997 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3832/7610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:16 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:17.998755 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:17.999396 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:18.008308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:18.009576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:18.010237 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:18.011182 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:18.011662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:18.012105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:18.150721 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:18.159138 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6ebca8b-a8b2-4c9f-9aa1-91cdf772c59d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.164326 Sep 01 06:21:18.159735 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3779/7611] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:17 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:19.184490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:19.185499 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:19.197148 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:19.197643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:19.198071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:19.198767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:19.199251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:19.199671 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:19.345223 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:19.353692 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0a47a49a-c43d-4348-aafe-b6ee2f9399b1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.175971 Sep 01 06:21:19.354244 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3833/7612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:19 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:20.385075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:20.385999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:20.398439 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:20.399394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:20.400150 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:20.401342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:20.401816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:20.402261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:20.545955 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:20.554055 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01935a00-be94-4a5a-96ca-b3df82e542a7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.175715 Sep 01 06:21:20.554645 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3780/7613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:20 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:21.579451 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:21.580202 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:21.590091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:21.590573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:21.591042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:21.591780 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:21.592217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:21.592662 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:21.737951 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:21.746458 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5b98a924-cb3e-462f-ab68-78d7289d297e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.173536 Sep 01 06:21:21.747067 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3834/7614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:21 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:22.047784 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6f1a4479-9c89-4329-b5dd-fc22cf8453e5 req-048844f3-79ed-410e-bab9-3e5d1d2c2a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "name": "network-vif-plugged", "status": "completed", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:21:22.058660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6f1a4479-9c89-4329-b5dd-fc22cf8453e5 req-048844f3-79ed-410e-bab9-3e5d1d2c2a83 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:22.059186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6f1a4479-9c89-4329-b5dd-fc22cf8453e5 req-048844f3-79ed-410e-bab9-3e5d1d2c2a83 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:22.059647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6f1a4479-9c89-4329-b5dd-fc22cf8453e5 req-048844f3-79ed-410e-bab9-3e5d1d2c2a83 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:22.072020 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6f1a4479-9c89-4329-b5dd-fc22cf8453e5 req-048844f3-79ed-410e-bab9-3e5d1d2c2a83 service nova] Creating event network-vif-plugged:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:21:22.077268 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6f1a4479-9c89-4329-b5dd-fc22cf8453e5 req-048844f3-79ed-410e-bab9-3e5d1d2c2a83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 Sep 01 06:21:22.077868 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3781/7615] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:21:22.774642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:22.776047 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:22.787476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:22.788279 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:22.788995 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:22.790123 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:22.790867 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:22.791693 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:22.926605 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:22.934936 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-267be2af-be42-4dab-902f-40985966f8e8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.167189 Sep 01 06:21:22.935555 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3835/7616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:22 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:23.958389 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:23.959297 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:23.966170 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:23.966764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:23.967322 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:23.968184 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:23.968750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:23.969244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:24.111607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:24.120299 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9cc4a17-e27a-4c9e-88cb-a868d4a447be tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1689 microversion: 2.1 time: 0.167137 Sep 01 06:21:24.120921 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3782/7617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:23 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:21:25.146675 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:21:25.147742 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:21:25.159701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:25.160516 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:25.161250 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:25.162405 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:21:25.163243 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:21:25.163963 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:21:25.297826 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:21:25.309550 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c26d506b-17de-4ca3-a2ec-d29d9582a97e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1676 microversion: 2.1 time: 0.169990 Sep 01 06:21:25.310214 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3836/7618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:21:25 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:02.592965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=23 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:02.594356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=70 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:02.598435 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=23 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:02.600075 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=71 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:02.600607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:02.600849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:02.617790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:02.618292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:02.618743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:02.619686 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:02.620272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:02.621154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:02.656807 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:23:02.717087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-0a71557d-eee4-4c2c-b74f-a568bb03cb7b req-4b526d4b-64ec-42a3-af64-6438a6ac333d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:02.730967 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a71557d-eee4-4c2c-b74f-a568bb03cb7b req-4b526d4b-64ec-42a3-af64-6438a6ac333d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:02.731434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a71557d-eee4-4c2c-b74f-a568bb03cb7b req-4b526d4b-64ec-42a3-af64-6438a6ac333d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:02.733200 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-0a71557d-eee4-4c2c-b74f-a568bb03cb7b req-4b526d4b-64ec-42a3-af64-6438a6ac333d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:02.748282 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5438c96c-5293-407d-aeaf-2b6a8a868775 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 204 len: 0 microversion: 2.1 time: 0.157749 Sep 01 06:23:02.749092 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3783/7619] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:23:02 2022] DELETE /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:23:02.749829 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-0a71557d-eee4-4c2c-b74f-a568bb03cb7b req-4b526d4b-64ec-42a3-af64-6438a6ac333d service nova] Creating event network-changed:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:23:02.757814 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-0a71557d-eee4-4c2c-b74f-a568bb03cb7b req-4b526d4b-64ec-42a3-af64-6438a6ac333d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164062 Sep 01 06:23:02.759127 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:02.759753 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3837/7620] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:23:02.759921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:02.767236 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:02.767678 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:02.768171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:02.769223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:02.769900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:02.770368 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:02.964961 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:02.973096 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51943bb9-77d7-4a16-8364-813d89a4b88c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.218991 Sep 01 06:23:02.973698 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3784/7621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:02 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:23:03.996512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:03.997222 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:04.005352 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:04.005847 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:04.006257 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:04.007024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:04.007462 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:04.007888 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:04.200397 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:04.209484 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-298489ba-f786-42c5-8f27-cf81e0c8f0a5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1682 microversion: 2.1 time: 0.218325 Sep 01 06:23:04.210056 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3838/7622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:03 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:05.073036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c9fd020f-4b81-4cfb-a835-86360d5d522c req-fad9aa85-e932-40ef-aaf1-7599541421e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d349e6eb-ea9d-4168-9e8c-4292095c2d6b", "name": "network-vif-deleted", "tag": "1884176d-4731-4769-a8db-d2de6de9307b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:05.085354 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c9fd020f-4b81-4cfb-a835-86360d5d522c req-fad9aa85-e932-40ef-aaf1-7599541421e2 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:05.085843 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c9fd020f-4b81-4cfb-a835-86360d5d522c req-fad9aa85-e932-40ef-aaf1-7599541421e2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:05.086292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c9fd020f-4b81-4cfb-a835-86360d5d522c req-fad9aa85-e932-40ef-aaf1-7599541421e2 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:05.098610 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c9fd020f-4b81-4cfb-a835-86360d5d522c req-fad9aa85-e932-40ef-aaf1-7599541421e2 service nova] Creating event network-vif-deleted:1884176d-4731-4769-a8db-d2de6de9307b for instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b on n-h2-820368-37 Sep 01 06:23:05.103959 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c9fd020f-4b81-4cfb-a835-86360d5d522c req-fad9aa85-e932-40ef-aaf1-7599541421e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034666 Sep 01 06:23:05.104733 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3785/7623] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:23:05.232340 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:05.233073 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:05.240375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:05.241147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:05.241590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:05.242303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:05.242767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:05.243251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:05.281900 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:05.282302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:05.282735 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:05.283322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lazy-loading 'fault' on Instance uuid d349e6eb-ea9d-4168-9e8c-4292095c2d6b {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:23:05.327307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:05.335456 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4a883ffc-0eea-4e8b-937f-9832d855a22f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 200 len: 1337 microversion: 2.1 time: 0.107315 Sep 01 06:23:05.336066 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3839/7624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:05 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 1337 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:06.363412 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:06.364583 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: d349e6eb-ea9d-4168-9e8c-4292095c2d6b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:06.373851 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:06.374370 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:06.374975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:06.375753 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:06.376229 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:06.376662 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:06.390632 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] HTTP exception thrown: Instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b could not be found. Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Request method failure captured: Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b HTTP/1.1 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEE6E2_gKh76OZd4Qr3WkFaZIysKsq94hd-8th785OYVnyzY1HRSAHuU2WId87nKeLpMTxijqef6ukj3f1N30mQf1JNFXBl53BRX1GLPsTE9eGndx04BykQ6pApwoOy0aPZjK0Ndish84kf__GBe4XbtZihqA7MnhqX0KZAsWlK_g9Ho Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: cfbb8f6aa94947ee8c04672e5f2631c8 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestShelveInstance-1221688530 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestShelveInstance-1221688530 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: cfbb8f6aa94947ee8c04672e5f2631c8 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestShelveInstance-1221688530 Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestShelveInstance-1221688530-project Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 2f00165a0e4847a79882af6fb9fd3e8d Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestShelveInstance-1221688530-project Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b could not be found. Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'd349e6eb-ea9d-4168-9e8c-4292095c2d6b'} Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b could not be found. Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b could not be found. Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:23:06.392364 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b could not be found. Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Returning 404 to user: Instance d349e6eb-ea9d-4168-9e8c-4292095c2d6b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02310aeb-7ed1-4844-b4da-6b7eeb9a686f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b" status: 404 len: 111 microversion: 2.1 time: 0.039178 Sep 01 06:23:06.397787 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3786/7625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:06 2022] GET /compute/v2.1/servers/d349e6eb-ea9d-4168-9e8c-4292095c2d6b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:23:06.570875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-58944954-3769-4950-91a4-b25b6ab76e1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '.version_select at 0x7fa75afeb790>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:06.602125 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-58944954-3769-4950-91a4-b25b6ab76e1a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1529025797" status: 202 len: 0 microversion: 2.1 time: 0.035168 Sep 01 06:23:06.605908 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3840/7626] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Sep 1 06:23:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1529025797 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 06:23:06.639576 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-419f3cc2-331f-4c80-8c76-d245f930c363 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'create', calling method: .version_select at 0x7fa75ad3faf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-455506652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwsl3g3TMNdVLETjtyILM70173RZuZTa7UmKhtmDTRvkLDd8CkklbKi6OSuYPX/mMwS1N0wc72q1kVqRtaMvKBHZKHlH0ARjv0oCK8o3h6DRNgEHbCfzEuT4vjm9M2oOA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:06.657089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-419f3cc2-331f-4c80-8c76-d245f930c363 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:23:06.662521 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-419f3cc2-331f-4c80-8c76-d245f930c363 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for user 2f00165a0e4847a79882af6fb9fd3e8d and project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:23:06.698593 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-419f3cc2-331f-4c80-8c76-d245f930c363 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.064714 Sep 01 06:23:06.699551 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3787/7627] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:23:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:23:24.093577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=16 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:24.094696 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:24.099946 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1106488905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-455506652", "security_groups": [{"name": "tempest-secgroup-smoke-446999249"}], "networks": [{"uuid": "6d1a90de-e1da-464a-b815-e7ac6bfed0e0"}], "block_device_mapping_v2": [{"uuid": "edbe7cbb-64c0-498b-98a4-5219ce0ec764", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:24.224546 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] validate_networks() for [('6d1a90de-e1da-464a-b815-e7ac6bfed0e0', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:23:24.632486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:23:24.633067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:23:24.633724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:23:24.634252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:23:24.634825 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:23:24.649461 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:24.650150 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:24.650750 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:24.651909 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:24.652536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:24.653057 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:24.673346 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:23:24.682303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Getting quotas for user 2f00165a0e4847a79882af6fb9fd3e8d and project cfbb8f6aa94947ee8c04672e5f2631c8. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:23:24.744875 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:23:24.748882 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edbe7cbb-64c0-498b-98a4-5219ce0ec764',volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:23:24.901642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b8e61e35-f621-4661-9335-f4f2e8b3cbc8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.810828 Sep 01 06:23:24.902202 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3841/7628] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:23:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 06:23:24.911452 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:24.912240 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:24.913030 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:24.917105 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f62ae1c2-d1b3-4acf-851f-ab8e506f7c55 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:24.917949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f62ae1c2-d1b3-4acf-851f-ab8e506f7c55 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:24.978722 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f62ae1c2-d1b3-4acf-851f-ab8e506f7c55 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:24.986370 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f62ae1c2-d1b3-4acf-851f-ab8e506f7c55 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1088 microversion: 2.1 time: 0.076799 Sep 01 06:23:24.986977 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3788/7629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:24 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:26.008029 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:26.008758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:26.017910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:26.019317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:26.019830 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:26.020784 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:26.021311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:26.021799 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:26.094302 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:26.103714 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-42a7e768-da20-487f-b194-452db6d65eaa tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1204 microversion: 2.1 time: 0.100009 Sep 01 06:23:26.104253 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3842/7630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:26 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:27.125502 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:27.126332 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:27.134110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:27.134899 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:27.135394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:27.136125 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:27.136620 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:27.137424 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:27.286100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:27.295888 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45d40be7-35b8-4caf-afa4-a550fc4c9b20 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1271 microversion: 2.1 time: 0.174565 Sep 01 06:23:27.296639 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3789/7631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:27 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:27.378460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6a908d16-c8e4-4afe-ad23-90b8040a1cd6 req-8443bac5-9ad1-4dc0-973e-684e4a5f0044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:27.396642 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a908d16-c8e4-4afe-ad23-90b8040a1cd6 req-8443bac5-9ad1-4dc0-973e-684e4a5f0044 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:27.397282 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a908d16-c8e4-4afe-ad23-90b8040a1cd6 req-8443bac5-9ad1-4dc0-973e-684e4a5f0044 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:27.397806 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6a908d16-c8e4-4afe-ad23-90b8040a1cd6 req-8443bac5-9ad1-4dc0-973e-684e4a5f0044 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:27.413152 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6a908d16-c8e4-4afe-ad23-90b8040a1cd6 req-8443bac5-9ad1-4dc0-973e-684e4a5f0044 service nova] Creating event network-changed:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h1-820368-37 Sep 01 06:23:27.418743 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6a908d16-c8e4-4afe-ad23-90b8040a1cd6 req-8443bac5-9ad1-4dc0-973e-684e4a5f0044 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044610 Sep 01 06:23:27.419655 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3843/7632] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:23:28.317995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:28.319432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:28.329382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:28.329910 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:28.330619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:28.331875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:28.332544 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:28.332994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:28.472932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:28.480870 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63a19dd0-f1f8-4e07-8ec4-0c787aa5540e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1271 microversion: 2.1 time: 0.167774 Sep 01 06:23:28.481484 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3790/7633] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:28 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:29.502476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:29.503348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:29.510918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:29.511500 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:29.511931 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:29.512622 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:29.513079 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:29.513497 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:29.654813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:29.664769 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9f181bee-a5ce-4cc0-94b0-6794d914a436 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1271 microversion: 2.1 time: 0.166671 Sep 01 06:23:29.665767 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3844/7634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:29 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:30.685594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:30.686210 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:30.693330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:30.693849 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:30.694304 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:30.695072 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:30.695555 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:30.695999 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:30.848437 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:30.856496 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-075632a2-774f-4669-8b44-6cac70ec5be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1271 microversion: 2.1 time: 0.175195 Sep 01 06:23:30.857205 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3791/7635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:30 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:31.878307 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:31.878921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:31.885640 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:31.886133 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:31.886572 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:31.887318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:31.887774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:31.888275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:32.027404 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:32.035935 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7c21c60a-1601-4ff5-9271-7a63cbf6ff5b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.161986 Sep 01 06:23:32.036527 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3845/7636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:31 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:33.058317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:33.058925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:33.066288 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:33.066786 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:33.067261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:33.067962 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:33.068427 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:33.068856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:33.217918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:33.230378 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cfdf8bd-ae86-4e38-acd7-78e65dc54c51 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.175763 Sep 01 06:23:33.231213 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3792/7637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:33 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:34.254848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:34.255538 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:34.263965 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:34.264512 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:34.264997 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:34.265776 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:34.266288 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:34.266765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:34.406354 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:34.414774 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-68d6d75a-99ca-44d7-abdc-28c2abca9be2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.165425 Sep 01 06:23:34.415360 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3846/7638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:34 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:35.443328 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:35.443907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:35.446756 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:35.452710 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:35.453191 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:35.453627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:35.454339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:35.454800 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:35.455258 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:35.607603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:35.615612 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d5b8c42-30ef-40f2-9339-205da10356a0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.176386 Sep 01 06:23:35.616197 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3793/7639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:35 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:36.639410 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:36.640024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:36.642722 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:36.643871 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:23:36.653217 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:36.653851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:36.654422 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:36.655471 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:36.656040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:36.656632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:36.801385 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:36.809943 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6d0590a0-b4ee-4709-8db3-928e8d67f057 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.176798 Sep 01 06:23:36.810541 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3847/7640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:36 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:37.835362 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:37.836421 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:37.847870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:37.848352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:37.848801 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:37.849507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:37.849973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:37.850406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:37.982053 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:37.990102 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28f9329b-2559-4cad-a5f2-a93460ee283a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.162090 Sep 01 06:23:37.990683 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3794/7641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:37 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:39.015083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:39.016109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:39.025136 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:39.025624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:39.026056 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:39.026754 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:39.027251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:39.027700 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:39.167648 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:39.176122 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-eaf05d95-38ef-42b5-8b79-e92f4384466b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.167715 Sep 01 06:23:39.176707 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3848/7642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:39 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:40.200682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:40.201750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:40.213670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:40.214514 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:40.215302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:40.216460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:40.217249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:40.217989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:40.358282 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:40.369625 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2030ca76-dac2-4edb-afc7-64a7d5a9cb53 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.175813 Sep 01 06:23:40.370302 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3795/7643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:40 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:41.396428 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:41.397092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:41.404540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:41.405025 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:41.405456 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:41.406147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:41.406593 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:41.407070 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:41.543982 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:41.552597 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-7a28eb41-1b3c-4f7b-8ee4-975bea516156 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.161834 Sep 01 06:23:41.553186 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3849/7644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:41 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:42.574369 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:42.575118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:42.582341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:42.582844 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:42.583320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:42.584002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:42.584478 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:42.584909 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:42.664743 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-6bba4c48-cda5-4a2a-aa8a-48ef5d80b553 req-7015524a-9245-4319-b539-a93cfded2bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "name": "network-vif-plugged", "status": "completed", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:42.677143 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6bba4c48-cda5-4a2a-aa8a-48ef5d80b553 req-7015524a-9245-4319-b539-a93cfded2bd3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:42.677531 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6bba4c48-cda5-4a2a-aa8a-48ef5d80b553 req-7015524a-9245-4319-b539-a93cfded2bd3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:42.677962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-6bba4c48-cda5-4a2a-aa8a-48ef5d80b553 req-7015524a-9245-4319-b539-a93cfded2bd3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:42.691363 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-6bba4c48-cda5-4a2a-aa8a-48ef5d80b553 req-7015524a-9245-4319-b539-a93cfded2bd3 service nova] Creating event network-vif-plugged:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h1-820368-37 Sep 01 06:23:42.697581 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-6bba4c48-cda5-4a2a-aa8a-48ef5d80b553 req-7015524a-9245-4319-b539-a93cfded2bd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091536 Sep 01 06:23:42.698207 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3850/7645] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:23:42.747643 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:42.758263 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08172a8e-9ff4-411c-889c-ae352b46d1af tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.188500 Sep 01 06:23:42.758866 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3796/7646] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:42 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:43.780494 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:43.784578 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:43.792415 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:43.792913 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:43.793372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:43.794080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:43.794536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:43.794986 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:43.939623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:43.948032 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e71531fc-98e4-44c8-9239-9061a742fb5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1259 microversion: 2.1 time: 0.171840 Sep 01 06:23:43.948620 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3851/7647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:43 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:44.973082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:44.973989 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:44.984323 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:44.985098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:44.985728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:44.986931 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:44.987664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:44.988373 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:45.137137 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:45.145775 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-be706f2a-725c-4001-a8b7-2f536cb32a61 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1444 microversion: 2.1 time: 0.179110 Sep 01 06:23:45.146372 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3797/7648] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:44 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1444 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:45.166165 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:23:45.166756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:23:45.173852 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:45.174334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:45.174804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:45.175520 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:45.175972 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:45.176400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:45.314255 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:23:45.324878 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-bcfbf7b4-2324-42cf-be32-30ba3f5e892a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1444 microversion: 2.1 time: 0.162646 Sep 01 06:23:45.325472 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3852/7649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:23:45 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:23:47.073356 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bda7617f-7df5-4666-aa5d-a9d997759765 req-60319c91-b7aa-4972-a3ec-58e1cfcff2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:23:47.082996 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bda7617f-7df5-4666-aa5d-a9d997759765 req-60319c91-b7aa-4972-a3ec-58e1cfcff2f6 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:23:47.083571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bda7617f-7df5-4666-aa5d-a9d997759765 req-60319c91-b7aa-4972-a3ec-58e1cfcff2f6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:23:47.084296 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bda7617f-7df5-4666-aa5d-a9d997759765 req-60319c91-b7aa-4972-a3ec-58e1cfcff2f6 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:23:47.098986 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bda7617f-7df5-4666-aa5d-a9d997759765 req-60319c91-b7aa-4972-a3ec-58e1cfcff2f6 service nova] Creating event network-changed:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h1-820368-37 Sep 01 06:23:47.104146 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bda7617f-7df5-4666-aa5d-a9d997759765 req-60319c91-b7aa-4972-a3ec-58e1cfcff2f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090059 Sep 01 06:23:47.104761 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3798/7650] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:25:44.432643 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:25:44.434426 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:25:44.435396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:25:44.436554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=60 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:25:44.438476 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:25:44.438736 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:25:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3/action (ip 10.222.0.26) !!! Sep 01 06:25:44.440577 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:25:44.440839 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:25:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3/action (ip 10.222.0.26) !!! Sep 01 06:25:44.447679 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:25:44.448556 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:44.460005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:44.460483 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:44.460923 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:44.461615 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:44.462062 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:44.462486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:44.491232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.objects.instance [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lazy-loading 'flavor' on Instance uuid b0aef54b-457a-462b-a6ab-a093dfaf9df3 {{(pid=128862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:25:44.570898 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-021d3fad-6140-4ab6-bb64-bd8304285946 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3/action" status: 202 len: 0 microversion: 2.1 time: 0.142090 Sep 01 06:25:44.571528 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3853/7651] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:25:44 2022] POST /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:25:44.578500 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:25:44.579444 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:25:44.580041 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:25:44.580823 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=56 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:25:44.581732 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:25:44.581876 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:25:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 (ip 10.222.0.26) !!! Sep 01 06:25:44.583164 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:25:44.583304 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:25:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 (ip 10.222.0.26) !!! Sep 01 06:25:44.589454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:44.590267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:44.601311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:44.601811 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:44.602259 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:44.603002 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:44.603527 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:44.603966 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:44.754158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:44.762479 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7a1b847-1e27-4e47-9a77-a2ec73c9c7a2 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.185940 Sep 01 06:25:44.763099 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3799/7652] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:44 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:45.791752 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:45.792770 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:45.802077 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:45.802563 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:45.803031 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:45.803762 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:45.804216 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:45.804641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:45.810311 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55734. Sep 01 06:25:45.811030 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55732. Sep 01 06:25:45.951555 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:45.959642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-b829fdfa-0032-44dd-861e-9c4d9304c001 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.177677 Sep 01 06:25:45.960200 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3854/7653] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:45 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:46.983100 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:46.983860 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:46.996223 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:46.997196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:46.997718 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:46.998440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:46.998916 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:46.999355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:47.007841 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55738. Sep 01 06:25:47.019800 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55740. Sep 01 06:25:47.135776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:47.145122 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d55ba243-559f-48a6-8c74-251f7eb13870 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.167137 Sep 01 06:25:47.145712 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3800/7654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:46 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:48.168953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:48.169570 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:48.177174 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:48.177653 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:48.178087 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:48.178775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:48.179260 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:48.179683 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:48.323341 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:48.331795 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fc4c1ae3-dc19-4b60-bd83-65b37934b3c6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.167711 Sep 01 06:25:48.332379 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3855/7655] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:48 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:49.357023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:49.357566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:49.364938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:49.365440 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:49.365892 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:49.366570 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:49.367101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:49.367539 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:49.516366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:49.525296 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-888bfdbd-98cf-489a-8c1b-601cc72e489e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.174990 Sep 01 06:25:49.525890 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3801/7656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:49 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:50.554024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:50.554687 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:50.562334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:50.562818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:50.563361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:50.564049 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:50.564501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:50.564926 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:50.706333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:50.714794 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-49529cba-1cec-410e-b7f2-7bfa5989a4b8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.165046 Sep 01 06:25:50.715423 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3856/7657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:50 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:51.738700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:51.739464 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:51.748176 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:51.748765 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:51.749949 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:51.750785 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:51.751378 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:51.751898 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:51.904353 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:51.913039 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49f07389-e1d8-40c9-8199-f9f7bbe8abcc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.179579 Sep 01 06:25:51.913630 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3802/7658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:51 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:52.937885 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:52.938540 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:52.946055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:52.946554 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:52.947024 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:52.947746 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:52.948207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:52.948632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:53.106361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:53.117230 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8e011173-f15a-46f2-9609-06b4424fdffd tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.185176 Sep 01 06:25:53.117814 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3857/7659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:52 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:54.144692 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:54.145298 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:54.152790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:54.153295 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:54.153751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:54.154467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:54.154940 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:54.155610 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:54.309685 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:54.318288 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-541e9283-34ed-4b88-8299-8b2f0a73e2c3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.178119 Sep 01 06:25:54.318874 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3803/7660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:54 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:55.344529 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:55.345374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:55.357318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:55.358127 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:55.358990 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:55.359878 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:55.360337 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:55.360767 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:55.506927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:55.518112 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-85c88a5b-f140-43cf-8a3c-fc0cbf2cd67b tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.180482 Sep 01 06:25:55.519093 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3858/7661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:55 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:56.544569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:56.545664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:56.557975 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:56.558809 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:56.559609 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:56.560788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:56.561557 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:56.562393 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:56.718798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:56.726763 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c337b996-a228-41d6-8a4b-71e69a980537 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.188900 Sep 01 06:25:56.727379 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3804/7662] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:56 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:57.748458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:57.749111 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:57.756421 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:57.756918 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:57.757357 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:57.758064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:57.758523 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:57.758976 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:57.909793 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:57.918245 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-07420f87-0440-401b-811b-3fd6051e64e0 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.173802 Sep 01 06:25:57.918920 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3859/7663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:57 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:58.939887 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:58.940523 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:58.947548 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:58.948043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:58.948492 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:58.949195 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:58.949724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:58.950082 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:59.094023 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:59.106355 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6084bd10-dfa5-48de-9a93-8389e740cc89 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1569 microversion: 2.1 time: 0.170446 Sep 01 06:25:59.107347 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3805/7664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:58 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:25:59.127775 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:25:59.128375 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:59.135869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:59.136361 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:59.136804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:59.137479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:59.137941 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:59.138400 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:59.168424 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128862) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 06:25:59.244426 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-91e6e4be-f444-43af-867d-6072ef2397f5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "POST /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3/action" status: 202 len: 0 microversion: 2.1 time: 0.120561 Sep 01 06:25:59.248123 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3860/7665] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:25:59 2022] POST /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:25:59.253630 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:25:59.254265 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:25:59.261988 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:59.262562 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:59.263130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:59.263913 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:59.264594 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:59.265305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:59.320237 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c96a1812-d5e0-49ae-b30a-0cfdc25cce54 req-bff1d30a-5b7d-43c2-811d-7e3f874c041d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "name": "network-vif-unplugged", "status": "completed", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:25:59.331954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c96a1812-d5e0-49ae-b30a-0cfdc25cce54 req-bff1d30a-5b7d-43c2-811d-7e3f874c041d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:25:59.332525 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c96a1812-d5e0-49ae-b30a-0cfdc25cce54 req-bff1d30a-5b7d-43c2-811d-7e3f874c041d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:25:59.333211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c96a1812-d5e0-49ae-b30a-0cfdc25cce54 req-bff1d30a-5b7d-43c2-811d-7e3f874c041d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:25:59.349430 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.compute.server_external_events [req-c96a1812-d5e0-49ae-b30a-0cfdc25cce54 req-bff1d30a-5b7d-43c2-811d-7e3f874c041d service nova] Unable to find a host for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3. Dropping event network-vif-unplugged {{(pid=128862) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 06:25:59.350914 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c96a1812-d5e0-49ae-b30a-0cfdc25cce54 req-bff1d30a-5b7d-43c2-811d-7e3f874c041d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034913 Sep 01 06:25:59.351927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3861/7666] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 06:25:59.420666 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:25:59.428753 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66757f37-a0b7-417f-b0f4-05dc078e3f10 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1517 microversion: 2.1 time: 0.179327 Sep 01 06:25:59.429326 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3806/7667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:25:59 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:26:00.449697 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:00.450303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:00.457612 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:00.458100 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:00.458536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:00.459267 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:00.459717 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:00.460171 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:00.599476 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:00.607730 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-53b16fb9-7d2f-4907-9724-a5afb0248e46 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1517 microversion: 2.1 time: 0.161993 Sep 01 06:26:00.608327 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3862/7668] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:00 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:01.633591 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:01.634590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:01.644834 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:01.645330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:01.645773 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:01.646505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:01.647024 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:01.647459 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:01.797172 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:01.805716 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b7caf5f-9c23-4258-b54b-6e1c082c4a5f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1517 microversion: 2.1 time: 0.178783 Sep 01 06:26:01.806439 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3807/7669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:01 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:02.830552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:02.831213 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:02.838254 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:02.838741 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:02.839211 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:02.839920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:02.840376 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:02.840844 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:02.979040 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:02.989642 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4299e99d-c8a4-4c93-a2f5-48f9d7b4533f tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1517 microversion: 2.1 time: 0.165260 Sep 01 06:26:02.990189 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3863/7670] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:02 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:04.010839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:04.011561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:04.020495 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:04.020995 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:04.021428 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:04.022157 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:04.022621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:04.023090 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:04.158145 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:04.167165 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9efda2f3-a325-415f-a48c-b7b8bfcea3ba tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1519 microversion: 2.1 time: 0.160524 Sep 01 06:26:04.167821 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3808/7671] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:04 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:05.188943 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:05.189505 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:05.197535 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:05.198022 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:05.198458 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:05.199195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:05.199652 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:05.200076 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:05.653724 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:05.662026 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-0e106d03-ee8d-42c2-9c6d-d89bef978462 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1519 microversion: 2.1 time: 0.477117 Sep 01 06:26:05.662599 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3864/7672] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:05 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1519 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:06.683948 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:06.684515 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:06.692119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:06.692619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:06.693089 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:06.693788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:06.694255 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:06.694707 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:06.825900 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:06.834718 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-102f1ed5-cc69-4246-aa10-3d5b12cf3b75 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1519 microversion: 2.1 time: 0.154887 Sep 01 06:26:06.835337 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3809/7673] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:06 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:07.855536 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:07.856134 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:07.863740 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:07.864238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:07.864676 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:07.865390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:07.865819 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:07.866454 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:08.011699 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:08.020660 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3dd83b01-3247-47cc-86ed-c9f26cfc37da tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1519 microversion: 2.1 time: 0.169265 Sep 01 06:26:08.021258 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3865/7674] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:07 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:09.042067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:09.042723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:09.050118 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:09.050648 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:09.051130 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:09.052214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:09.052727 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:09.053175 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:09.194056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:09.202219 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d13aff5-e426-4e63-b346-637a247bc5bc tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1519 microversion: 2.1 time: 0.164244 Sep 01 06:26:09.202810 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3810/7675] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:09 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:10.223934 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:10.224610 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:10.232156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:10.232644 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:10.233080 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:10.233774 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:10.234225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:10.234645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:10.378636 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:10.387446 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-364acfbd-9f80-4c60-adc7-a24ee1fcf53a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.167375 Sep 01 06:26:10.388039 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3866/7676] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:10 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:10.429588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-972897df-2994-4510-a2ea-935d091c7559 req-38609961-cf0c-44eb-84f9-66641a68ab55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:26:10.440251 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-972897df-2994-4510-a2ea-935d091c7559 req-38609961-cf0c-44eb-84f9-66641a68ab55 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:10.440750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-972897df-2994-4510-a2ea-935d091c7559 req-38609961-cf0c-44eb-84f9-66641a68ab55 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:10.441196 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-972897df-2994-4510-a2ea-935d091c7559 req-38609961-cf0c-44eb-84f9-66641a68ab55 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:10.455754 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-972897df-2994-4510-a2ea-935d091c7559 req-38609961-cf0c-44eb-84f9-66641a68ab55 service nova] Creating event network-changed:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h2-820368-37 Sep 01 06:26:10.460881 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-972897df-2994-4510-a2ea-935d091c7559 req-38609961-cf0c-44eb-84f9-66641a68ab55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035252 Sep 01 06:26:10.461496 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3811/7677] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:26:11.411258 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:11.411864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:11.421927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:11.422418 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:11.422854 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:11.423581 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:11.424032 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:11.424459 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:11.429905 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:26:11.571962 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:11.580480 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fce86b0e-0215-4922-9e60-738a891a9709 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.175586 Sep 01 06:26:11.581069 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3867/7678] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:11 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:12.603561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:12.604303 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:12.610973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:12.611472 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:12.611921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:12.612626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:12.613095 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:12.613540 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:12.759381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:12.767938 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7196b23-6e65-44b6-86ca-f1f13bbdb497 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.169765 Sep 01 06:26:12.768885 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3812/7679] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:12 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:13.794384 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:13.795423 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:13.805606 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:13.806090 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:13.806519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:13.807274 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:13.807727 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:13.808147 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:13.946681 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:13.955863 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-21c461bc-0268-4e21-baf3-1f548ae589a8 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.168478 Sep 01 06:26:13.956471 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3868/7680] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:13 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:14.979231 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:14.980028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:14.983709 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=31 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:26:14.991075 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:14.991735 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:14.992330 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:14.993264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:14.993925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:14.994505 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:14.998302 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=81 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:26:15.136938 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:15.145421 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95248114-5ce2-4a2b-8e98-0c41c64fcf21 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.171420 Sep 01 06:26:15.146002 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3813/7681] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:14 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:16.168729 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:16.169379 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:16.171537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:26:16.177802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:16.178368 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:16.178856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:16.179645 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:16.180101 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:16.180567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:16.327911 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:16.336560 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-74ab930f-15e2-426b-aa26-585f328096b7 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.172806 Sep 01 06:26:16.337140 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3869/7682] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:16 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:17.361621 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:17.362615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:17.371670 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:17.372166 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:17.372611 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:17.373311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:17.373776 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:17.374221 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:17.517802 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:17.526608 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea15d71c-0a83-44c9-ad40-9467eb3263d5 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.171841 Sep 01 06:26:17.527198 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3814/7683] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:17 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:18.548921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:18.549543 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:18.557092 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:18.557573 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:18.558008 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:18.558704 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:18.559189 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:18.559616 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:18.700227 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:18.708308 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-195e77f4-3a3c-4d7f-b39b-f02e0c7f1406 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.163511 Sep 01 06:26:18.709073 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3870/7684] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:18 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:19.730305 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:19.731163 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:19.738449 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:19.739050 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:19.739500 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:19.740202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:19.740668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:19.741103 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:19.877895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:19.886459 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff0d85fa-7d7f-43a9-80f4-c5e6e9b985fb tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.160287 Sep 01 06:26:19.887007 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3815/7685] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:19 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:20.912567 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:20.913621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:20.923207 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:20.924014 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:20.924641 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:20.925803 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:20.926432 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:20.927208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:21.073050 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:21.085554 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-306ef28b-9bba-4a0d-a1cb-d90a199f98b3 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.179746 Sep 01 06:26:21.086377 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3871/7686] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:20 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:21.732915 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c5e1f793-3690-4744-94e8-530a61239c02 req-53a13261-6a45-4681-a8ae-9d1cd0f36f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "name": "network-vif-plugged", "status": "completed", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:26:21.744241 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c5e1f793-3690-4744-94e8-530a61239c02 req-53a13261-6a45-4681-a8ae-9d1cd0f36f95 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:21.744728 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c5e1f793-3690-4744-94e8-530a61239c02 req-53a13261-6a45-4681-a8ae-9d1cd0f36f95 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:21.745171 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c5e1f793-3690-4744-94e8-530a61239c02 req-53a13261-6a45-4681-a8ae-9d1cd0f36f95 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:21.756760 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c5e1f793-3690-4744-94e8-530a61239c02 req-53a13261-6a45-4681-a8ae-9d1cd0f36f95 service nova] Creating event network-vif-plugged:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h2-820368-37 Sep 01 06:26:21.761845 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c5e1f793-3690-4744-94e8-530a61239c02 req-53a13261-6a45-4681-a8ae-9d1cd0f36f95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Sep 01 06:26:21.762448 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3816/7687] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:26:22.107800 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:22.108399 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:22.117013 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:22.117594 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:22.118107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:22.118959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:22.119457 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:22.119890 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:22.274519 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:22.282913 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-e2e7f6c1-7808-49b5-925b-6590495a2c01 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.180040 Sep 01 06:26:22.283528 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3872/7688] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:22 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:23.311081 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:23.311815 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:23.318587 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:23.319123 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:23.319563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:23.320262 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:23.320723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:23.321151 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:23.466628 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:23.475676 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d610830-65b3-4a5d-b099-5879967b55e6 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1575 microversion: 2.1 time: 0.173584 Sep 01 06:26:23.476583 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3817/7689] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:23 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:26:24.500737 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:26:24.501502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:26:24.516907 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:24.517386 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:24.517818 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:24.518856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:26:24.519339 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:26:24.519761 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:26:24.660271 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:26:24.670350 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-ad1813ab-8d0e-46f5-99db-509e683ff26a tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1562 microversion: 2.1 time: 0.176235 Sep 01 06:26:24.670927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3873/7690] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:26:24 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:41.105372 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=9 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:27:41.106308 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=25 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:27:41.108240 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=9 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:27:41.109552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=40 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:27:41.111923 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:41.112482 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:41.114498 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-c1289b32-b9fb-4e2a-873f-b8bdf0bfacf8 req-ee5b4250-14f3-441b-9ef0-6df3bc26ea11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:27:41.120101 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:41.120603 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:41.121049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:41.121751 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:41.122214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:41.122701 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:41.137600 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1289b32-b9fb-4e2a-873f-b8bdf0bfacf8 req-ee5b4250-14f3-441b-9ef0-6df3bc26ea11 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:41.138703 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1289b32-b9fb-4e2a-873f-b8bdf0bfacf8 req-ee5b4250-14f3-441b-9ef0-6df3bc26ea11 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:41.139175 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-c1289b32-b9fb-4e2a-873f-b8bdf0bfacf8 req-ee5b4250-14f3-441b-9ef0-6df3bc26ea11 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:41.151935 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-c1289b32-b9fb-4e2a-873f-b8bdf0bfacf8 req-ee5b4250-14f3-441b-9ef0-6df3bc26ea11 service nova] Creating event network-changed:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h2-820368-37 Sep 01 06:27:41.152619 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:27:41.158528 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-c1289b32-b9fb-4e2a-873f-b8bdf0bfacf8 req-ee5b4250-14f3-441b-9ef0-6df3bc26ea11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051960 Sep 01 06:27:41.159498 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3874/7691] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:27:41.242708 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdf3fd80-3331-4773-a559-aba3421ffb17 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 204 len: 0 microversion: 2.1 time: 0.139228 Sep 01 06:27:41.243672 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3818/7692] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:27:41 2022] DELETE /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:27:41.252840 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:41.253552 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:41.261225 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:41.261716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:41.262548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:41.262848 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:41.263325 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:41.263753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:41.409690 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:41.417961 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-80474527-a057-423c-9538-09d364ed754e tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.169719 Sep 01 06:27:41.418542 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3875/7693] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:41 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:42.441098 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:42.441891 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:42.449593 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:42.450114 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:42.450546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:42.451268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:42.451723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:42.452159 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:42.590141 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:42.598295 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-554ab2ec-3a3b-4ec1-8223-1c7349e191f1 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1568 microversion: 2.1 time: 0.161554 Sep 01 06:27:42.598901 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3819/7694] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:42 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:43.620300 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:43.620877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:43.628677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:43.629181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:43.629618 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:43.630333 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:43.630795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:43.631261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:43.769105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:43.778349 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6c65b9c5-d34b-46f9-924e-568d42306acf tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1450 microversion: 2.1 time: 0.162119 Sep 01 06:27:43.779188 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3876/7695] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:43 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:43.940011 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fcaaf6ed-a487-4fe8-bab3-2b048bdb3fd9 req-c8dd077f-b11d-48c9-845f-3f75633df0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0aef54b-457a-462b-a6ab-a093dfaf9df3", "name": "network-vif-deleted", "tag": "4c0e16a2-30f1-494b-90bc-cd84462ec261"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:27:43.950743 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fcaaf6ed-a487-4fe8-bab3-2b048bdb3fd9 req-c8dd077f-b11d-48c9-845f-3f75633df0fb service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:43.951267 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fcaaf6ed-a487-4fe8-bab3-2b048bdb3fd9 req-c8dd077f-b11d-48c9-845f-3f75633df0fb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:43.951705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fcaaf6ed-a487-4fe8-bab3-2b048bdb3fd9 req-c8dd077f-b11d-48c9-845f-3f75633df0fb service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:43.963951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fcaaf6ed-a487-4fe8-bab3-2b048bdb3fd9 req-c8dd077f-b11d-48c9-845f-3f75633df0fb service nova] Creating event network-vif-deleted:4c0e16a2-30f1-494b-90bc-cd84462ec261 for instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 on n-h2-820368-37 Sep 01 06:27:43.969015 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fcaaf6ed-a487-4fe8-bab3-2b048bdb3fd9 req-c8dd077f-b11d-48c9-845f-3f75633df0fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032755 Sep 01 06:27:43.969615 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3820/7696] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:27:44.800042 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:44.800678 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:44.808795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:44.809295 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:44.809731 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:44.810449 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:44.810924 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:44.811358 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:44.885251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:44.894242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-44ef3bc3-7192-4355-9fb6-d9d04702d33d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1219 microversion: 2.1 time: 0.098186 Sep 01 06:27:44.894846 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3877/7697] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:44 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:45.917636 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:45.918269 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:45.925324 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:45.925762 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:45.926202 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:45.927056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:45.927456 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:45.927921 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:46.006342 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:46.015265 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e3f6cc5-2010-4c38-b27e-5d962d16c47d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1219 microversion: 2.1 time: 0.102983 Sep 01 06:27:46.016080 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3821/7698] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:45 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:47.037350 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:47.038055 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:47.045162 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:47.045651 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:47.046098 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:47.047112 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:47.047560 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:47.047983 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:47.116095 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:47.124540 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-cdd1cc92-15f1-45f5-9dfc-044508772d16 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1219 microversion: 2.1 time: 0.091237 Sep 01 06:27:47.125125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3878/7699] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:47 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:48.145394 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:48.146119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:48.152761 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:48.153311 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:48.153810 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:48.154584 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:48.155096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:48.155533 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:48.225096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f00165a0e4847a79882af6fb9fd3e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbb8f6aa94947ee8c04672e5f2631c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:27:48.234132 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a3f506d-8da4-49ad-8603-f8d5efe4e333 tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 200 len: 1219 microversion: 2.1 time: 0.093222 Sep 01 06:27:48.244015 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3822/7700] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:48 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:27:49.255314 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:49.255940 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] [instance: b0aef54b-457a-462b-a6ab-a093dfaf9df3] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:27:49.263323 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:49.263832 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:49.264251 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:49.264944 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:27:49.265396 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:27:49.265883 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:27:49.281111 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] HTTP exception thrown: Instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 could not be found. Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Request method failure captured: Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 HTTP/1.1 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEE6E2_gKh76OZd4Qr3WkFaZIysKsq94hd-8th785OYVnyzY1HRSAHuU2WId87nKeLpMTxijqef6ukj3f1N30mQf1JNFXBl53BRX1GLPsTE9eGndx04BykQ6pApwoOy0aPZjK0Ndish84kf__GBe4XbtZihqA7MnhqX0KZAsWlK_g9Ho Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: cfbb8f6aa94947ee8c04672e5f2631c8 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestShelveInstance-1221688530 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfbb8f6aa94947ee8c04672e5f2631c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestShelveInstance-1221688530 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: cfbb8f6aa94947ee8c04672e5f2631c8 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestShelveInstance-1221688530 Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestShelveInstance-1221688530-project Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 2f00165a0e4847a79882af6fb9fd3e8d Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestShelveInstance-1221688530-project Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 could not be found. Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'b0aef54b-457a-462b-a6ab-a093dfaf9df3'} Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 could not be found. Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 could not be found. Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:27:49.282732 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 could not be found. Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Returning 404 to user: Instance b0aef54b-457a-462b-a6ab-a093dfaf9df3 could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-5f5e213b-62e7-4140-a7ac-52bfde00069c tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3" status: 404 len: 111 microversion: 2.1 time: 0.033017 Sep 01 06:27:49.290677 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3879/7701] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:27:49 2022] GET /compute/v2.1/servers/b0aef54b-457a-462b-a6ab-a093dfaf9df3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:27:49.448883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17953e38-c11e-4626-ba6f-e959472f7f7d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] Calling method '.version_select at 0x7fa75b0f7e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:27:49.476619 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17953e38-c11e-4626-ba6f-e959472f7f7d tempest-TestShelveInstance-1221688530 tempest-TestShelveInstance-1221688530-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-455506652" status: 202 len: 0 microversion: 2.1 time: 0.031705 Sep 01 06:27:49.477605 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3823/7702] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 1 06:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-455506652 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 06:28:07.302365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=12 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:07.303860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=28 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:07.481864 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f59d6fe0-9c33-4d2c-8615-578178c5f8fc tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Action: 'create', calling method: .version_select at 0x7fa75a7a2e50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1783654297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHnQpxpIjaokEKK321RPGop4RkkkYlf26zJF89dIhkxi6zVkcGHwTipFxryJ7GUOMdVB4i9CdZC1XwuWpk38L9guNJblz7RvKyIbouN7BmKsXVPG6vvpbeMDkjLdff4cw=="}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:28:07.499303 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f59d6fe0-9c33-4d2c-8615-578178c5f8fc tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Getting quotas for project 313266c9b46d4faa940bced757ba37ec. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:28:07.505842 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-f59d6fe0-9c33-4d2c-8615-578178c5f8fc tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Getting quotas for user 75626514bf2c42979b512c79da920226 and project 313266c9b46d4faa940bced757ba37ec. Resources: {'key_pairs'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:28:07.538100 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f59d6fe0-9c33-4d2c-8615-578178c5f8fc tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.241442 Sep 01 06:28:07.538791 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3880/7703] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 1 06:28:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:28:08.576039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:08.577235 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:08.582054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-786378826", "imageRef": "a6ef865c-7f44-4aad-804f-11f5772882db", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1783654297", "security_groups": [{"name": "tempest-secgroup-smoke-2040671383"}], "networks": [{"uuid": "5c854146-ab53-4efd-a2c1-c9b6edc61070"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:28:08.800244 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] validate_networks() for [('5c854146-ab53-4efd-a2c1-c9b6edc61070', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:28:09.290158 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:28:09.290571 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:28:09.291168 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:28:09.291566 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:28:09.292018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:28:09.302507 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:09.303039 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:09.303471 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:09.304443 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:09.304924 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:09.305366 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:09.323133 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Getting quotas for project 313266c9b46d4faa940bced757ba37ec. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:28:09.328569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.quota [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Getting quotas for user 75626514bf2c42979b512c79da920226 and project 313266c9b46d4faa940bced757ba37ec. Resources: {'ram', 'cores', 'instances'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:28:09.343382 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:28:09.345771 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a6ef865c-7f44-4aad-804f-11f5772882db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:28:09.395765 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16d24907-1874-4f93-9536-07f65a696fd5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.821711 Sep 01 06:28:09.396429 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3824/7704] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:28:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 06:28:09.408574 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-11c8a564-834e-49af-ae56-2d62749f4e66 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:09.409181 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-11c8a564-834e-49af-ae56-2d62749f4e66 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:09.536012 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-11c8a564-834e-49af-ae56-2d62749f4e66 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:09.544166 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-11c8a564-834e-49af-ae56-2d62749f4e66 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1248 microversion: 2.1 time: 0.140392 Sep 01 06:28:09.544836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3881/7705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:09 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1248 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:28:10.566768 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:10.567569 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:10.575665 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:10.576470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:10.577162 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:10.577965 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:10.578716 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:10.579411 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:10.661615 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:10.677012 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47a25907-0964-430f-978c-b817da11ea2b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1308 microversion: 2.1 time: 0.115018 Sep 01 06:28:10.678903 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3825/7706] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:10 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:11.699839 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:11.700463 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:11.707910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:11.708390 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:11.708815 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:11.709517 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:11.709968 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:11.710511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:11.846522 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:11.855133 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28f3d3d5-7caa-4d7c-b4f7-83ac4efe42ed tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.159324 Sep 01 06:28:11.855719 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3882/7707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:11 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:28:12.091350 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-28876cb7-a884-49ac-ab30-32037c794cfc req-6d035959-4c45-4ce2-a0bd-dc0a30db8200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:28:12.107272 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-28876cb7-a884-49ac-ab30-32037c794cfc req-6d035959-4c45-4ce2-a0bd-dc0a30db8200 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:12.108028 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-28876cb7-a884-49ac-ab30-32037c794cfc req-6d035959-4c45-4ce2-a0bd-dc0a30db8200 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:12.108677 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-28876cb7-a884-49ac-ab30-32037c794cfc req-6d035959-4c45-4ce2-a0bd-dc0a30db8200 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:12.124419 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-28876cb7-a884-49ac-ab30-32037c794cfc req-6d035959-4c45-4ce2-a0bd-dc0a30db8200 service nova] Creating event network-changed:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:28:12.130056 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-28876cb7-a884-49ac-ab30-32037c794cfc req-6d035959-4c45-4ce2-a0bd-dc0a30db8200 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120913 Sep 01 06:28:12.130682 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3826/7708] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:28:12.878177 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:12.879010 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:12.887365 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:12.887879 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:12.888318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:12.889016 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:12.889473 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:12.889898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:13.023178 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:13.031419 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-596a4a1d-c063-4c49-bc22-ac7e2a8b7062 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.158241 Sep 01 06:28:13.031969 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3883/7709] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:12 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:14.054355 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:14.055096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:14.061925 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:14.062422 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:14.062870 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:14.063607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:14.064071 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:14.064509 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:14.205435 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:14.214251 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76e94c84-ef82-4de6-a72f-9c40e19c7a23 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.165267 Sep 01 06:28:14.214844 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3827/7710] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:14 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:15.239409 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:15.240419 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:15.252755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:15.253577 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:15.254287 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:15.255511 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:15.256269 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:15.257261 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:15.400468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:15.413076 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9b519598-5fba-41d3-b4a5-d1df37f590ad tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.180008 Sep 01 06:28:15.414220 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3884/7711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:15 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:16.441723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:16.442357 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:16.449798 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:16.450292 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:16.450700 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:16.451444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:16.451907 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:16.452385 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:16.600025 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:16.608972 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f2627f4-2f3e-4906-bca5-5ba6e30870a7 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.171293 Sep 01 06:28:16.609529 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3828/7712] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:16 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:17.636311 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:17.636953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:17.644453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:17.644954 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:17.645407 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:17.646128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:17.646597 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:17.647071 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:17.784378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:17.792849 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9fbeb0ea-6790-46f7-91dd-5d5581467bd3 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.161497 Sep 01 06:28:17.793439 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3885/7713] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:17 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:18.462618 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2ac06987-b374-4507-a4c4-571605b36b9c req-8eea0584-0d24-40c4-992e-41559d2e3ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "name": "network-vif-plugged", "status": "completed", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:28:18.472402 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ac06987-b374-4507-a4c4-571605b36b9c req-8eea0584-0d24-40c4-992e-41559d2e3ae0 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:18.472895 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ac06987-b374-4507-a4c4-571605b36b9c req-8eea0584-0d24-40c4-992e-41559d2e3ae0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:18.473341 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2ac06987-b374-4507-a4c4-571605b36b9c req-8eea0584-0d24-40c4-992e-41559d2e3ae0 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:18.485711 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2ac06987-b374-4507-a4c4-571605b36b9c req-8eea0584-0d24-40c4-992e-41559d2e3ae0 service nova] Creating event network-vif-plugged:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:28:18.491327 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2ac06987-b374-4507-a4c4-571605b36b9c req-8eea0584-0d24-40c4-992e-41559d2e3ae0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Sep 01 06:28:18.491945 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3829/7714] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:28:18.817124 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:18.817969 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:18.826332 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:18.826813 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:18.827277 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:18.827971 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:18.828434 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:18.828851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:18.970548 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:18.979085 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fe87c9b2-3aed-440e-bf31-d82a9be2b8e9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1374 microversion: 2.1 time: 0.168800 Sep 01 06:28:18.979636 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3886/7715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:18 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:20.001040 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:20.001839 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:20.004537 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:20.005222 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:20.012934 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:20.013431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:20.013877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:20.014589 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:20.015096 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:20.015563 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:20.155942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:20.163935 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28834f20-f065-46c0-895e-a9f1c5c9092d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1560 microversion: 2.1 time: 0.167500 Sep 01 06:28:20.164498 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3830/7716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:19 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:28:20.189877 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:28:20.190518 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:28:20.192474 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=6 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:28:20.199226 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:20.199712 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:20.200149 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:20.200843 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:20.201294 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:20.201716 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:20.338795 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:28:20.347249 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-9d1bf2d1-85a6-4fb1-ae8f-609ff1aa11a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1560 microversion: 2.1 time: 0.161251 Sep 01 06:28:20.347836 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3887/7717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:28:20 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:28:22.393564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5e4e7aa4-1116-4b8f-ad27-c3aabf366afb req-1a857b65-64aa-4f24-97b5-aa515cb2b2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:28:22.404932 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5e4e7aa4-1116-4b8f-ad27-c3aabf366afb req-1a857b65-64aa-4f24-97b5-aa515cb2b2d3 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:28:22.405395 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5e4e7aa4-1116-4b8f-ad27-c3aabf366afb req-1a857b65-64aa-4f24-97b5-aa515cb2b2d3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:28:22.405816 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5e4e7aa4-1116-4b8f-ad27-c3aabf366afb req-1a857b65-64aa-4f24-97b5-aa515cb2b2d3 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:28:22.417193 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5e4e7aa4-1116-4b8f-ad27-c3aabf366afb req-1a857b65-64aa-4f24-97b5-aa515cb2b2d3 service nova] Creating event network-changed:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:28:22.422252 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5e4e7aa4-1116-4b8f-ad27-c3aabf366afb req-1a857b65-64aa-4f24-97b5-aa515cb2b2d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 Sep 01 06:28:22.422857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3831/7718] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:30:48.683190 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:30:48.684641 n-d-820368-37 devstack@n-api.service[128862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 06:30:48.685502 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:30:48.686768 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=36 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:30:48.688275 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:30:48.688535 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:30:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6/action (ip 10.222.0.26) !!! Sep 01 06:30:48.690966 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 06:30:48.691211 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:30:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6/action (ip 10.222.0.26) !!! Sep 01 06:30:48.693366 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:30:48.693601 n-d-820368-37 devstack@n-api.service[128862]: Thu Sep 1 06:30:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6/action (ip 10.222.0.26) !!! Sep 01 06:30:48.699643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1233124548"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:30:48.702132 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:30:48.714208 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:30:48.714701 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:30:48.715163 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:30:48.715869 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:30:48.716324 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:30:48.716751 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:30:48.928125 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-297ecf48-6b9f-468e-9b66-0d997d2545ee tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "POST /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6/action" status: 202 len: 0 microversion: 2.1 time: 0.244437 Sep 01 06:30:48.928125 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3888/7719] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:30:48 2022] POST /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 06:30:55.050468 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:30:55.051348 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 06:30:55.051994 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:30:55.052746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=32 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:30:55.053706 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:30:55.053820 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:30:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 01 06:30:55.055349 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:30:55.055636 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:30:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 01 06:30:55.056828 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 06:30:55.057148 n-d-820368-37 devstack@n-api.service[128863]: Thu Sep 1 06:30:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 01 06:30:55.130830 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9a671ab3-b0ee-48d2-af7e-d0ddaa4408f4 req-9191ef11-6d5d-402f-8e37-64ec0dac7a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "name": "network-vif-plugged", "status": "completed", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:30:55.141624 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a671ab3-b0ee-48d2-af7e-d0ddaa4408f4 req-9191ef11-6d5d-402f-8e37-64ec0dac7a33 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:30:55.142054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a671ab3-b0ee-48d2-af7e-d0ddaa4408f4 req-9191ef11-6d5d-402f-8e37-64ec0dac7a33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:30:55.142497 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a671ab3-b0ee-48d2-af7e-d0ddaa4408f4 req-9191ef11-6d5d-402f-8e37-64ec0dac7a33 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:30:55.153403 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9a671ab3-b0ee-48d2-af7e-d0ddaa4408f4 req-9191ef11-6d5d-402f-8e37-64ec0dac7a33 service nova] Creating event network-vif-plugged:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:30:55.159293 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9a671ab3-b0ee-48d2-af7e-d0ddaa4408f4 req-9191ef11-6d5d-402f-8e37-64ec0dac7a33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110773 Sep 01 06:30:55.159869 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3832/7720] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:31:07.691493 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:07.692273 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:07.696608 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1881892838", "imageRef": "69a1ca50-23b0-455d-8339-16e4500e0891", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1783654297", "security_groups": [{"name": "tempest-secgroup-smoke-2040671383"}], "networks": [{"uuid": "5c854146-ab53-4efd-a2c1-c9b6edc61070"}]}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:31:07.722651 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6a51260-1155-4173-9cd4-bdc4cb07dcb5] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56302. Sep 01 06:31:07.725472 n-d-820368-37 devstack@n-api.service[128862]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e81dc61-d5c9-4785-bda0-b497eb24df7a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56300. Sep 01 06:31:07.820083 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.network.neutron [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] validate_networks() for [('5c854146-ab53-4efd-a2c1-c9b6edc61070', None, None, None, None, None)] {{(pid=128862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 06:31:08.258167 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Flavor limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 06:31:08.258748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Image limits 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 06:31:08.259293 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Flavor pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 06:31:08.259709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Image pref 0:0:0 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 06:31:08.260139 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.virt.hardware [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 06:31:08.270142 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:08.270632 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:08.271115 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:08.271851 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:08.272310 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:08.272739 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:08.290453 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Getting quotas for project 313266c9b46d4faa940bced757ba37ec. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 06:31:08.296244 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.quota [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Getting quotas for user 75626514bf2c42979b512c79da920226 and project 313266c9b46d4faa940bced757ba37ec. Resources: {'ram', 'cores', 'instances'} {{(pid=128862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 06:31:08.309988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Going to run 1 instances... {{(pid=128862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 06:31:08.312586 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69a1ca50-23b0-455d-8339-16e4500e0891',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 06:31:08.372866 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-3f3554c2-52cf-4dc7-9480-eef75e6a9d69 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.684538 Sep 01 06:31:08.373577 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3889/7721] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 1 06:31:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 06:31:08.383607 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:08.384377 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:08.388793 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da07bc48-a364-4db9-bb1d-5be49a6e425f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:08.389541 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da07bc48-a364-4db9-bb1d-5be49a6e425f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:08.403516 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56318. Sep 01 06:31:08.405285 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56320. Sep 01 06:31:08.452946 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da07bc48-a364-4db9-bb1d-5be49a6e425f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:08.459895 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da07bc48-a364-4db9-bb1d-5be49a6e425f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1249 microversion: 2.1 time: 0.078828 Sep 01 06:31:08.460447 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3833/7722] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:08 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:09.481590 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-d7e576f5-c536-46d1-9413-668d7c7108a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:09.482195 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-d7e576f5-c536-46d1-9413-668d7c7108a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:09.537238 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-d7e576f5-c536-46d1-9413-668d7c7108a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:09.544485 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-d7e576f5-c536-46d1-9413-668d7c7108a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1249 microversion: 2.1 time: 0.067998 Sep 01 06:31:09.545018 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3890/7723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:09 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1249 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:10.569588 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1373c347-498e-44c6-9adb-3980ff2e0e53 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:10.570877 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1373c347-498e-44c6-9adb-3980ff2e0e53 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:10.630997 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1373c347-498e-44c6-9adb-3980ff2e0e53 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:10.638230 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1373c347-498e-44c6-9adb-3980ff2e0e53 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1249 microversion: 2.1 time: 0.075252 Sep 01 06:31:10.639007 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3834/7724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:10 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:11.097297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-b5f03412-6f3c-49e3-94ae-8df38e2be6ff req-6d63379d-9535-41b2-8744-f6d3d66033ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "name": "network-vif-unplugged", "status": "completed", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:31:11.109959 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b5f03412-6f3c-49e3-94ae-8df38e2be6ff req-6d63379d-9535-41b2-8744-f6d3d66033ad service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:11.110547 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b5f03412-6f3c-49e3-94ae-8df38e2be6ff req-6d63379d-9535-41b2-8744-f6d3d66033ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:11.111015 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-b5f03412-6f3c-49e3-94ae-8df38e2be6ff req-6d63379d-9535-41b2-8744-f6d3d66033ad service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:11.121967 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-b5f03412-6f3c-49e3-94ae-8df38e2be6ff req-6d63379d-9535-41b2-8744-f6d3d66033ad service nova] Creating event network-vif-unplugged:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:31:11.127108 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-b5f03412-6f3c-49e3-94ae-8df38e2be6ff req-6d63379d-9535-41b2-8744-f6d3d66033ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033618 Sep 01 06:31:11.127855 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3891/7725] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:31:11.664036 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9cf4b0b-ef3e-4b2f-9ae8-95bd05b6db41 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:11.665067 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9cf4b0b-ef3e-4b2f-9ae8-95bd05b6db41 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:11.722274 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9cf4b0b-ef3e-4b2f-9ae8-95bd05b6db41 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:11.729951 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9cf4b0b-ef3e-4b2f-9ae8-95bd05b6db41 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1249 microversion: 2.1 time: 0.072645 Sep 01 06:31:11.730531 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3835/7726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:11 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:12.757232 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:12.758374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:12.765630 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:12.766105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:12.766537 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:12.767262 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:12.767709 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:12.768480 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:12.831974 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:12.840787 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-64627683-d98e-4272-8c90-7b9adec8553d tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1253 microversion: 2.1 time: 0.092113 Sep 01 06:31:12.841387 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3892/7727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:12 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:13.862660 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:13.863338 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:13.871775 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:13.872276 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:13.872840 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:13.873532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:13.874034 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:13.874470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:13.964108 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:13.973166 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f259f327-6952-4e99-b925-3d521913e7d9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1307 microversion: 2.1 time: 0.114987 Sep 01 06:31:13.973891 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3836/7728] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:13 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 06:31:14.996947 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:14.998372 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:15.006781 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:15.007335 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:15.007779 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:15.008501 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:15.009099 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:15.009528 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:15.168272 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:15.177712 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-6ae43612-d101-41fd-97e4-cda3857bf98b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.185277 Sep 01 06:31:15.187445 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3893/7729] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:14 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:16.199448 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:16.200062 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:16.207444 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:16.208211 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:16.208846 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:16.209750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:16.210380 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:16.211006 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:16.363037 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:16.371496 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-737c199a-51d6-4fe2-88ff-149d0466e13b tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.176268 Sep 01 06:31:16.372095 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3837/7730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:16 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:17.395467 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:17.396038 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:17.403753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:17.404317 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:17.404758 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:17.405468 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:17.405927 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:17.406353 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:17.549880 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:17.558557 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-c289e0fb-d096-44a8-81fd-d218fab41772 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.169061 Sep 01 06:31:17.559176 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3894/7731] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:17 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:18.579667 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:18.580310 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:18.587750 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:18.588261 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:18.588705 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:18.589416 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:18.589880 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:18.590312 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:18.741339 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:18.750642 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1574a1d1-feb8-4ec6-aba5-e751d8ab173f tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.174824 Sep 01 06:31:18.751255 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3838/7732] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:18 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:19.773466 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:19.774091 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:19.776440 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:19.777920 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell0:SELECT=8 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:19.784275 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:19.784804 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:19.785197 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:19.785925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:19.786371 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:19.786858 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:19.933664 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:19.943159 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-28c5620f-0f26-4db8-b0fd-07d55cd547b9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.173545 Sep 01 06:31:19.944420 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3895/7733] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:19 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:20.965871 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:20.966520 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:20.973897 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:20.974417 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:20.974875 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:20.975664 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:20.976138 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:20.976577 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:21.121561 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:21.129628 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d13d4bb0-00d4-4bd1-b8ad-c711dd2ed1de tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.167884 Sep 01 06:31:21.130210 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3839/7734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:20 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:21.888991 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-15643528-4324-4b18-8ac8-d774a88a107f req-e1d36a9a-dff0-46ab-ac16-2232003ce528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:31:21.901582 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15643528-4324-4b18-8ac8-d774a88a107f req-e1d36a9a-dff0-46ab-ac16-2232003ce528 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:21.902051 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15643528-4324-4b18-8ac8-d774a88a107f req-e1d36a9a-dff0-46ab-ac16-2232003ce528 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:21.902654 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-15643528-4324-4b18-8ac8-d774a88a107f req-e1d36a9a-dff0-46ab-ac16-2232003ce528 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:21.915398 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-15643528-4324-4b18-8ac8-d774a88a107f req-e1d36a9a-dff0-46ab-ac16-2232003ce528 service nova] Creating event network-changed:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:31:21.920893 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-15643528-4324-4b18-8ac8-d774a88a107f req-e1d36a9a-dff0-46ab-ac16-2232003ce528 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 Sep 01 06:31:21.921657 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3896/7735] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:31:22.150828 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:22.151552 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:22.153467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:31:22.160405 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:22.160901 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:22.161352 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:22.162060 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:22.162532 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:22.162984 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:22.299764 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:22.308415 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3bc8b08-c8fc-4f3f-b1a2-503958ad28b8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.161621 Sep 01 06:31:22.309086 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3840/7736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:22 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:23.330624 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:23.331348 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:23.338105 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:23.338579 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:23.339064 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:23.339753 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:23.340203 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:23.340623 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:23.486322 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:23.495242 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-98464b49-c385-4cd7-b936-5d4e6ee5f455 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.169608 Sep 01 06:31:23.495723 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3897/7737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:23 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:24.516993 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:24.517671 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:24.526167 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:24.526724 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:24.527257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:24.528043 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:24.528564 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:24.529049 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:24.678264 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:24.690445 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f50e8f4b-c3f9-4f0e-9037-b6bb987cbe0c tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.177582 Sep 01 06:31:24.691399 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3841/7738] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:24 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:25.717925 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:25.718802 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:25.731068 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:25.731738 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:25.732485 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:25.733621 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:25.734381 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:25.735129 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:25.874460 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:25.882340 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-fd1825ef-138b-46ea-8d4d-a3deee812491 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.171648 Sep 01 06:31:25.882927 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3898/7739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:25 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:26.904131 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:26.904733 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:26.912470 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:26.913017 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:26.913473 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:26.914268 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:26.914723 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:26.915381 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:27.036145 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-29a6c767-58eb-4c31-b623-6b267b31ac23 req-feb3b422-919c-415a-bfa1-fe3e8799317b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "name": "network-vif-plugged", "status": "completed", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:31:27.047138 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-29a6c767-58eb-4c31-b623-6b267b31ac23 req-feb3b422-919c-415a-bfa1-fe3e8799317b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:27.047790 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-29a6c767-58eb-4c31-b623-6b267b31ac23 req-feb3b422-919c-415a-bfa1-fe3e8799317b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:27.048318 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-29a6c767-58eb-4c31-b623-6b267b31ac23 req-feb3b422-919c-415a-bfa1-fe3e8799317b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:27.060001 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-29a6c767-58eb-4c31-b623-6b267b31ac23 req-feb3b422-919c-415a-bfa1-fe3e8799317b service nova] Creating event network-vif-plugged:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:31:27.065483 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-29a6c767-58eb-4c31-b623-6b267b31ac23 req-feb3b422-919c-415a-bfa1-fe3e8799317b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033488 Sep 01 06:31:27.066271 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3899/7740] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:31:27.070119 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:27.078337 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ea460ef-7574-4c34-a109-f0689c63f428 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.178270 Sep 01 06:31:27.078951 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3842/7741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:26 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:28.101364 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:28.101966 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:28.108755 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:28.109246 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:28.109682 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:28.110378 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:28.110835 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:28.111289 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:28.258993 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:28.268126 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-8c0a5385-4d74-4743-bc34-43913d0978a4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1375 microversion: 2.1 time: 0.171711 Sep 01 06:31:28.269081 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3900/7742] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:28 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:29.291668 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:29.292463 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:29.301963 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:29.302626 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:29.303271 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:29.304254 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:29.304883 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:29.305467 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:29.469432 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:29.478034 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc38a28f-0986-49aa-b546-9eacd36559d8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1560 microversion: 2.1 time: 0.191828 Sep 01 06:31:29.478651 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3843/7743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:29 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:29.499160 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:31:29.499756 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:31:29.506856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:29.507447 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:29.507910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:29.508603 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:29.509052 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:29.509479 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:29.648433 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:31:29.659491 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-329d763f-aeb0-4a11-9a91-73398f7e6d96 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1560 microversion: 2.1 time: 0.164645 Sep 01 06:31:29.660285 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3901/7744] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:31:29 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:31:31.363407 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-61956507-1c4d-4861-adae-27a62fbcc665 req-a134a988-3d17-430c-83fc-b3f77140586b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:31:31.374056 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-61956507-1c4d-4861-adae-27a62fbcc665 req-a134a988-3d17-430c-83fc-b3f77140586b service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:31:31.374546 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-61956507-1c4d-4861-adae-27a62fbcc665 req-a134a988-3d17-430c-83fc-b3f77140586b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:31:31.375014 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-61956507-1c4d-4861-adae-27a62fbcc665 req-a134a988-3d17-430c-83fc-b3f77140586b service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:31:31.386581 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-61956507-1c4d-4861-adae-27a62fbcc665 req-a134a988-3d17-430c-83fc-b3f77140586b service nova] Creating event network-changed:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:31:31.392157 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-61956507-1c4d-4861-adae-27a62fbcc665 req-a134a988-3d17-430c-83fc-b3f77140586b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 Sep 01 06:31:31.393553 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3844/7745] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:10.184402 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:33:10.185765 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=56 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:33:10.264297 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1271819324"}} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:10.266748 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:10.273666 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:10.274154 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:10.274596 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:10.275330 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:10.275788 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:10.276212 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:10.622511 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-de03edff-a309-49ab-885f-e39735d58c94 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "POST /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b/action" status: 202 len: 0 microversion: 2.1 time: 0.441792 Sep 01 06:33:10.623191 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3902/7746] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 1 06:33:10 2022] POST /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 01 06:33:15.610784 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 06:33:15.614866 n-d-820368-37 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 06:33:15.615460 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=30 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:33:15.616717 n-d-820368-37 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=50 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:33:15.624031 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-57bff4af-0c55-4ae9-aff4-0307df3f109e req-8102a305-e85e-4c10-aa94-65e27cdfd426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "name": "network-vif-plugged", "status": "completed", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:15.639454 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57bff4af-0c55-4ae9-aff4-0307df3f109e req-8102a305-e85e-4c10-aa94-65e27cdfd426 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:15.640418 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57bff4af-0c55-4ae9-aff4-0307df3f109e req-8102a305-e85e-4c10-aa94-65e27cdfd426 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:15.641249 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57bff4af-0c55-4ae9-aff4-0307df3f109e req-8102a305-e85e-4c10-aa94-65e27cdfd426 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:15.654622 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-57bff4af-0c55-4ae9-aff4-0307df3f109e req-8102a305-e85e-4c10-aa94-65e27cdfd426 service nova] Creating event network-vif-plugged:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:33:15.660735 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-57bff4af-0c55-4ae9-aff4-0307df3f109e req-8102a305-e85e-4c10-aa94-65e27cdfd426 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057233 Sep 01 06:33:15.661993 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3845/7747] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:24.646510 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_api:SELECT=2 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:33:24.647391 n-d-820368-37 devstack@n-api.service[128862]: DEBUG dbcounter [-] [128862] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 06:33:24.660988 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:24.662349 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:24.663106 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [d55c0654-32e7-409a-baff-562176b5cd7c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56632. Sep 01 06:33:24.663991 n-d-820368-37 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [994a23dd-3697-4100-b8b0-56f24bb4f62a] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56630. Sep 01 06:33:24.672663 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:24.673156 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:24.673591 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:24.674292 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:24.674718 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:24.675401 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:24.704665 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Going to try to terminate instance {{(pid=128862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:33:24.724918 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-86f20c90-bbcf-4d6b-934d-a935c0abe374 req-05441c5a-b93f-4450-8dee-166caf70767d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:24.737165 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86f20c90-bbcf-4d6b-934d-a935c0abe374 req-05441c5a-b93f-4450-8dee-166caf70767d service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:24.737788 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86f20c90-bbcf-4d6b-934d-a935c0abe374 req-05441c5a-b93f-4450-8dee-166caf70767d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:24.738232 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-86f20c90-bbcf-4d6b-934d-a935c0abe374 req-05441c5a-b93f-4450-8dee-166caf70767d service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:24.749865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-86f20c90-bbcf-4d6b-934d-a935c0abe374 req-05441c5a-b93f-4450-8dee-166caf70767d service nova] Creating event network-changed:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:33:24.755365 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-86f20c90-bbcf-4d6b-934d-a935c0abe374 req-05441c5a-b93f-4450-8dee-166caf70767d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108574 Sep 01 06:33:24.756121 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3846/7748] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:24.798287 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-f4e55e93-fa92-4f40-9724-8fa8ab31dcb6 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 204 len: 0 microversion: 2.1 time: 0.153633 Sep 01 06:33:24.801938 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3903/7749] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:33:24 2022] DELETE /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:33:24.808234 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:24.808942 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:24.815981 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:24.816708 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:24.817149 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:24.817856 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:24.818317 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:24.818746 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:25.016033 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:33:25.024865 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c019157a-1030-4417-8c5e-c232a87f4178 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1685 microversion: 2.1 time: 0.220773 Sep 01 06:33:25.025445 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3847/7750] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:24 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1685 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:33:25.546107 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-a67ee4b0-fbb7-4d5d-bc60-563e76ffaf78 req-cc30c397-0da2-4f9d-ac91-bbbb1a5e274a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "name": "network-vif-unplugged", "status": "completed", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:25.556910 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a67ee4b0-fbb7-4d5d-bc60-563e76ffaf78 req-cc30c397-0da2-4f9d-ac91-bbbb1a5e274a service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:25.557490 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a67ee4b0-fbb7-4d5d-bc60-563e76ffaf78 req-cc30c397-0da2-4f9d-ac91-bbbb1a5e274a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:25.557937 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-a67ee4b0-fbb7-4d5d-bc60-563e76ffaf78 req-cc30c397-0da2-4f9d-ac91-bbbb1a5e274a service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:25.570930 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-a67ee4b0-fbb7-4d5d-bc60-563e76ffaf78 req-cc30c397-0da2-4f9d-ac91-bbbb1a5e274a service nova] Creating event network-vif-unplugged:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:33:25.576016 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-a67ee4b0-fbb7-4d5d-bc60-563e76ffaf78 req-cc30c397-0da2-4f9d-ac91-bbbb1a5e274a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034255 Sep 01 06:33:25.577038 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3904/7751] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:26.047218 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:26.047842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:26.055554 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:26.056052 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:26.056496 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:26.057214 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:26.057681 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:26.058113 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:26.205590 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:33:26.214228 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdb4300b-c473-4f80-8170-11b74bf833a9 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1685 microversion: 2.1 time: 0.171461 Sep 01 06:33:26.214857 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3848/7752] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:26 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:33:26.771856 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-8b5410b6-5b4b-45ea-9d6c-dbe79355242a req-8a4df3af-1c89-4d66-8970-047c40df327c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb92446-a943-413d-afd3-ff808fe4fe3b", "name": "network-vif-deleted", "tag": "60126f9c-e8c6-4a42-ad13-bac26da14a71"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:26.781647 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8b5410b6-5b4b-45ea-9d6c-dbe79355242a req-8a4df3af-1c89-4d66-8970-047c40df327c service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:26.782128 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8b5410b6-5b4b-45ea-9d6c-dbe79355242a req-8a4df3af-1c89-4d66-8970-047c40df327c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:26.782559 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-8b5410b6-5b4b-45ea-9d6c-dbe79355242a req-8a4df3af-1c89-4d66-8970-047c40df327c service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:26.795251 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-8b5410b6-5b4b-45ea-9d6c-dbe79355242a req-8a4df3af-1c89-4d66-8970-047c40df327c service nova] Creating event network-vif-deleted:60126f9c-e8c6-4a42-ad13-bac26da14a71 for instance ceb92446-a943-413d-afd3-ff808fe4fe3b on n-h1-820368-37 Sep 01 06:33:26.800544 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-8b5410b6-5b4b-45ea-9d6c-dbe79355242a req-8a4df3af-1c89-4d66-8970-047c40df327c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Sep 01 06:33:26.801728 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3905/7753] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:27.236885 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:27.237543 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:27.245186 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:27.245912 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:27.246556 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:27.247320 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:27.247790 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:27.248294 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:27.285257 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:27.285659 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:27.286110 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:27.286581 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lazy-loading 'fault' on Instance uuid ceb92446-a943-413d-afd3-ff808fe4fe3b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 06:33:27.328215 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:33:27.335624 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37c63015-1897-447c-a209-ac47aa978090 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 200 len: 1339 microversion: 2.1 time: 0.103215 Sep 01 06:33:27.336179 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3849/7754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:27 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:33:28.362252 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:28.363144 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ceb92446-a943-413d-afd3-ff808fe4fe3b] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:28.371898 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:28.372465 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:28.372953 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:28.373798 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:28.374334 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:28.374845 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:28.391143 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.wsgi [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] HTTP exception thrown: Instance ceb92446-a943-413d-afd3-ff808fe4fe3b could not be found. Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Request method failure captured: Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: request: GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b HTTP/1.1 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Accept: application/json Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Accept-Encoding: identity Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Connection: close Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Content-Length: 0 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Content-Type: application/json Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Host: 10.222.0.26 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: Openstack-System-Scope: None Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: User-Agent: python-urllib3/1.26.12 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Auth-Token: gAAAAABjEFDy42wAKbT5zoKIj_8mhLMkHjt9ky75XryA2-f_3CnfbiOipXQsFJONaaBfs3_YwEBT4xWn3Kw7Z_BOsWwQ6zWc5lsQ4VIkHKcBFvCVB85MU71nSO_WI6lWa-IOCb9XX6TYFVIth8kFsht0cP4_phcwTH5Cn-PJTywzHKyRJrPuHCU Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Id: None Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Domain-Name: None Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Identity-Status: Confirmed Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Is-Admin-Project: True Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Id: default Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Domain-Name: Default Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Id: 313266c9b46d4faa940bced757ba37ec Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Project-Name: tempest-TestSnapshotPattern-573125076 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Role: reader,member Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Roles: reader,member Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/313266c9b46d4faa940bced757ba37ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/313266c9b46d4faa940bced757ba37ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_313266c9b46d4faa940bced757ba37ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/313266c9b46d4faa940bced757ba37ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant: tempest-TestSnapshotPattern-573125076 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Id: 313266c9b46d4faa940bced757ba37ec Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-Tenant-Name: tempest-TestSnapshotPattern-573125076 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-User: tempest-TestSnapshotPattern-573125076-project Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Id: default Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-User-Domain-Name: Default Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-User-Id: 75626514bf2c42979b512c79da920226 Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: X-User-Name: tempest-TestSnapshotPattern-573125076-project Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: method: > Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: exception: Instance ceb92446-a943-413d-afd3-ff808fe4fe3b could not be found. Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: action_args: {'id': 'ceb92446-a943-413d-afd3-ff808fe4fe3b'} Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceb92446-a943-413d-afd3-ff808fe4fe3b could not be found. Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceb92446-a943-413d-afd3-ff808fe4fe3b could not be found. Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:33:28.393155 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceb92446-a943-413d-afd3-ff808fe4fe3b could not be found. Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: ERROR nova.api.openstack.wsgi Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Returning 404 to user: Instance ceb92446-a943-413d-afd3-ff808fe4fe3b could not be found. {{(pid=128862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-a001be93-a3af-4a2d-b39a-fc1144eb55e8 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b" status: 404 len: 111 microversion: 2.1 time: 0.039737 Sep 01 06:33:28.398169 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3906/7755] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:28 2022] GET /compute/v2.1/servers/ceb92446-a943-413d-afd3-ff808fe4fe3b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:33:29.813865 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:29.814627 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:29.815714 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-ad24bc50-1c8f-459c-b16c-fdb16adce7d9 req-d86c4a0b-7420-4a47-b9be-5dee53713a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:29.822054 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:29.822917 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:29.823606 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:29.824431 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:29.825122 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:29.825813 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:29.827067 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad24bc50-1c8f-459c-b16c-fdb16adce7d9 req-d86c4a0b-7420-4a47-b9be-5dee53713a77 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:29.827643 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad24bc50-1c8f-459c-b16c-fdb16adce7d9 req-d86c4a0b-7420-4a47-b9be-5dee53713a77 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:29.828069 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-ad24bc50-1c8f-459c-b16c-fdb16adce7d9 req-d86c4a0b-7420-4a47-b9be-5dee53713a77 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:29.839035 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-ad24bc50-1c8f-459c-b16c-fdb16adce7d9 req-d86c4a0b-7420-4a47-b9be-5dee53713a77 service nova] Creating event network-changed:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:33:29.844758 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-ad24bc50-1c8f-459c-b16c-fdb16adce7d9 req-d86c4a0b-7420-4a47-b9be-5dee53713a77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032755 Sep 01 06:33:29.845632 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3907/7756] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:29.853859 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 06:33:29.943604 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cceee7d6-7ee7-47c9-be57-f2871a1e4eb4 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 204 len: 0 microversion: 2.1 time: 0.133623 Sep 01 06:33:29.944437 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3850/7757] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 1 06:33:29 2022] DELETE /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 06:33:29.953475 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:29.954369 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.compute.api [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:29.972109 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:29.972592 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:29.973280 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:29.974005 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:29.974486 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:29.974929 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:30.112837 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.policy [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:33:30.120808 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-4bcd0189-fbc5-4b7d-91f3-aca1b6bd2f06 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1685 microversion: 2.1 time: 0.171817 Sep 01 06:33:30.121422 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3908/7758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:29 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:33:31.145077 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:31.145902 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:31.152992 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:31.153493 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:31.153933 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:31.154647 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:31.155147 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:31.155698 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:31.300825 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75626514bf2c42979b512c79da920226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313266c9b46d4faa940bced757ba37ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 06:33:31.309065 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78cf0b6f-bece-4fda-a534-f013e6df6bbe tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 200 len: 1566 microversion: 2.1 time: 0.169396 Sep 01 06:33:31.309726 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3851/7759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:31 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 06:33:31.667860 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [req-9f76152b-d8a3-4761-8909-39d639f2c653 req-b982a1f7-9b4a-4f6a-8d42-de3f03f1fac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdb700b-7a0a-47a9-a558-a9b212de52b6", "name": "network-vif-deleted", "tag": "93e1be6d-6e7a-495a-83ca-621f7e4e131a"}]} {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 06:33:31.677921 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f76152b-d8a3-4761-8909-39d639f2c653 req-b982a1f7-9b4a-4f6a-8d42-de3f03f1fac5 service nova] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:31.678374 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f76152b-d8a3-4761-8909-39d639f2c653 req-b982a1f7-9b4a-4f6a-8d42-de3f03f1fac5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:31.678822 n-d-820368-37 devstack@n-api.service[128862]: DEBUG oslo_concurrency.lockutils [req-9f76152b-d8a3-4761-8909-39d639f2c653 req-b982a1f7-9b4a-4f6a-8d42-de3f03f1fac5 service nova] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:31.690285 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.compute.server_external_events [req-9f76152b-d8a3-4761-8909-39d639f2c653 req-b982a1f7-9b4a-4f6a-8d42-de3f03f1fac5 service nova] Creating event network-vif-deleted:93e1be6d-6e7a-495a-83ca-621f7e4e131a for instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 on n-h2-820368-37 Sep 01 06:33:31.695298 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [req-9f76152b-d8a3-4761-8909-39d639f2c653 req-b982a1f7-9b4a-4f6a-8d42-de3f03f1fac5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089500 Sep 01 06:33:31.696068 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3909/7760] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 1 06:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 06:33:32.331070 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:32.331842 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] [instance: ecdb700b-7a0a-47a9-a558-a9b212de52b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 06:33:32.339018 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:32.339522 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:32.339973 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:32.340682 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Acquiring lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 06:33:32.341154 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 06:33:32.341596 n-d-820368-37 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Lock "d0d5f4e8-de5e-4681-b062-ea6b446cdfe7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 06:33:32.355717 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] HTTP exception thrown: Instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 could not be found. Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Request method failure captured: Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 HTTP/1.1 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Accept: application/json Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Accept-Encoding: identity Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Connection: close Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Content-Length: 0 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Content-Type: application/json Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Host: 10.222.0.26 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: Openstack-System-Scope: None Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjEFDy42wAKbT5zoKIj_8mhLMkHjt9ky75XryA2-f_3CnfbiOipXQsFJONaaBfs3_YwEBT4xWn3Kw7Z_BOsWwQ6zWc5lsQ4VIkHKcBFvCVB85MU71nSO_WI6lWa-IOCb9XX6TYFVIth8kFsht0cP4_phcwTH5Cn-PJTywzHKyRJrPuHCU Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Id: None Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Domain-Name: None Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Is-Admin-Project: True Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Id: default Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Id: 313266c9b46d4faa940bced757ba37ec Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Project-Name: tempest-TestSnapshotPattern-573125076 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Role: reader,member Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Roles: reader,member Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/313266c9b46d4faa940bced757ba37ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/313266c9b46d4faa940bced757ba37ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_313266c9b46d4faa940bced757ba37ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/313266c9b46d4faa940bced757ba37ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant: tempest-TestSnapshotPattern-573125076 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Id: 313266c9b46d4faa940bced757ba37ec Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestSnapshotPattern-573125076 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-User: tempest-TestSnapshotPattern-573125076-project Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Id: default Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-User-Domain-Name: Default Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-User-Id: 75626514bf2c42979b512c79da920226 Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: X-User-Name: tempest-TestSnapshotPattern-573125076-project Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: method: > Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: exception: Instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 could not be found. Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: action_args: {'id': 'ecdb700b-7a0a-47a9-a558-a9b212de52b6'} Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 could not be found. Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 could not be found. Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 06:33:32.357397 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 could not be found. Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Returning 404 to user: Instance ecdb700b-7a0a-47a9-a558-a9b212de52b6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e88f2ecf-7caa-4910-a9a1-6113913f965a tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6" status: 404 len: 111 microversion: 2.1 time: 0.031844 Sep 01 06:33:32.362406 n-d-820368-37 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3852/7761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 1 06:33:32 2022] GET /compute/v2.1/servers/ecdb700b-7a0a-47a9-a558-a9b212de52b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 06:33:32.537533 n-d-820368-37 devstack@n-api.service[128862]: DEBUG nova.api.openstack.wsgi [None req-db01b4c9-7818-4717-8201-3cec0a4cf7a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] Calling method '.version_select at 0x7fa75ae5e1f0>' {{(pid=128862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 06:33:32.571101 n-d-820368-37 devstack@n-api.service[128862]: INFO nova.api.openstack.requestlog [None req-db01b4c9-7818-4717-8201-3cec0a4cf7a5 tempest-TestSnapshotPattern-573125076 tempest-TestSnapshotPattern-573125076-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1783654297" status: 202 len: 0 microversion: 2.1 time: 0.038286 Sep 01 06:33:32.571861 n-d-820368-37 devstack@n-api.service[128862]: [pid: 128862|app: 0|req: 3910/7762] 10.222.0.26 () {58 vars in 1257 bytes} [Thu Sep 1 06:33:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1783654297 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)